2024-09-10T23:03:17.976 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:03:18.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:03:18.120 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899778' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOEraCrlkHNXPeIpD8QE3uA9Dsc1EG9w2hyPjNN8HSjrjKN3LLFGJhubVbPFFpe156AxokTmStZY/DxsLAeC48Q= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgafDbNNAcjMljrnlVJos94psJypaLI9aEL43oWLGRRUGNXUHNECMiy1lwdf08g6z+5tSgqkA2WOeP5egDR5GM= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6/C83nL44o/dEodwcZMvtWG0owWncJrD6wwy3rxCrwdbtMyBPSQa2vlP3rXnMlhCuUIu5MlnklAiYQ5GpEYgg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:03:18.120 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:03:18.121 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:03:18.121 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:03:18.123 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:03:18.146 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:03:18.146 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:03:18.146 INFO:teuthology.packaging:ref: None 2024-09-10T23:03:18.146 INFO:teuthology.packaging:tag: None 2024-09-10T23:03:18.146 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:03:18.146 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:03:18.146 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:03:18.298 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:03:18.299 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:03:18.306 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:03:18.306 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:03:18.326 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:03:18.346 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:03:18.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:03:18.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:58:07.966089', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOEraCrlkHNXPeIpD8QE3uA9Dsc1EG9w2hyPjNN8HSjrjKN3LLFGJhubVbPFFpe156AxokTmStZY/DxsLAeC48Q='} 2024-09-10T23:03:18.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:58:07.967314', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgafDbNNAcjMljrnlVJos94psJypaLI9aEL43oWLGRRUGNXUHNECMiy1lwdf08g6z+5tSgqkA2WOeP5egDR5GM='} 2024-09-10T23:03:18.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:58:07.964350', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6/C83nL44o/dEodwcZMvtWG0owWncJrD6wwy3rxCrwdbtMyBPSQa2vlP3rXnMlhCuUIu5MlnklAiYQ5GpEYgg='} 2024-09-10T23:03:18.451 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:03:18.458 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T23:03:18.458 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T23:03:18.458 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T23:03:18.458 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:03:18.562 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6118e8bbe0>, signals=[15]) 2024-09-10T23:03:18.563 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:03:18.568 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:03:18.569 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:03:18.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:03:18.655 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T23:03:18.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:03:18.740 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-09-10T23:03:18.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:03:18.822 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:03:18.829 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-10T23:03:18.847 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-10T23:03:18.848 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-10T23:03:18.905 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-10T23:03:18.905 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:03:18.906 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:03:18.907 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:03:18.907 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:03:18.907 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:03:18.907 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:03:18.907 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-10T23:03:18.938 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-10T23:03:18.956 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-10T23:03:18.956 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-10T23:03:19.014 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:03:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:03:19.016 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:03:19.016 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-10T23:03:19.046 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-09-10T23:03:19.065 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-09-10T23:03:19.065 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-09-10T23:03:19.123 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:03:19.124 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:03:19.125 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:03:19.125 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:03:19.125 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-09-10T23:03:19.154 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:03:19.164 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:03:19.171 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:03:19.171 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:03:19.174 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:03:19.176 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:03:19.193 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:03:19.199 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:03:19.199 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:03:19.231 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:03:19.233 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:03:19.337 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:03:19.436 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:03:19.451 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:03:19.452 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T23:03:19.452 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T23:03:19.452 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:03:19.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:03:19.469 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-10T23:03:19.527 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:03:19.527 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-10T23:03:19.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-10T23:03:22.159 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.2 MB 00:00 2024-09-10T23:03:24.127 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-10T23:03:29.694 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-10T23:03:31.369 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-10T23:03:32.373 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-10T23:03:37.979 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-10T23:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T23:03:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T23:03:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-10T23:03:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-10T23:03:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-10T23:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-10T23:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-10T23:03:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-10T23:03:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 280 kB/s | 23 kB 00:00 2024-09-10T23:03:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-10T23:03:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 42 MB/s | 35 MB 00:00 2024-09-10T23:03:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-10T23:03:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:03:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-10T23:03:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-10T23:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-10T23:03:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-10T23:03:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-10T23:03:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-10T23:03:46.130 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-10T23:03:46.792 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:03:46.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:03:49.696 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:03:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:03:54.953 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:03:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:00.133 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:38.923 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:38.964 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:04:39.313 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:04:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T23:04:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T23:04:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:04:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-10T23:04:40.502 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:04:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:04:40.638 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:04:40.638 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T23:04:40.638 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T23:04:40.638 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T23:04:40.638 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T23:04:40.638 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T23:04:40.638 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:04:40.697 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:04:40.697 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:04:40.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-10T23:04:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-10T23:04:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-10T23:04:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-10T23:04:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:04:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:04:40.732 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:04:40.732 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-505.el9.x86_64 2024-09-10T23:04:40.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:04:41.376 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-10T23:04:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:04:42.734 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-10T23:04:42.741 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-10T23:04:42.756 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.bToLgLGXWZ 2024-09-10T23:04:42.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bToLgLGXWZ 2024-09-10T23:04:42.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.bToLgLGXWZ 2024-09-10T23:04:42.972 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.bToLgLGXWZ is 6KB 2024-09-10T23:04:43.020 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.bToLgLGXWZ 2024-09-10T23:04:43.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:04:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:04:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:04:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:04:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T23:04:43.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T23:04:43.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-10T23:05:13.254 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T23:05:13.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T23:05:13.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:05:31.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-10T23:05:40.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T23:05:40.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:40.722 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:06:52.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T23:06:52.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:53.115 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-10T23:06:53.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T23:06:53.478 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T23:06:53.479 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-10T23:06:53.496 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-505.el9.x86_64 2024-09-10T23:06:53.497 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T23:06:53.497 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:06:53.497 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:06:54.498 DEBUG:teuthology.parallel:result is None 2024-09-10T23:06:54.498 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:06:54.505 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:06:54.506 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:06:54.508 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:06:54.511 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:06:54.530 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:06:54.539 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:06:54.547 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:06:54.547 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:06:54.568 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:06:54.571 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:06:54.703 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:06:54.710 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:06:54.710 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:06:54.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:54.727 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:06:54.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:54.744 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:06:54.747 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:06:54.771 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:06:54.822 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:54.827 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:54.843 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:54.843 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:54.846 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:54.864 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:54.866 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:06:54.873 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:06:54.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:06:54.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:06:54.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:06:54.913 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:06:54.922 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:06:54.922 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:06:54.946 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:06:54.949 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:06:54.969 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:55.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:55.098 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:55.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:55.225 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:06:55.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:06:55.291 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:55.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:55.393 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:55.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:55.521 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:06:55.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:06:55.588 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:55.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:55.686 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:55.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:55.814 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:06:55.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:06:55.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-10T23:06:55.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-10T23:06:55.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-09-10T23:06:55.920 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:06:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:06:55.961 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:06:56.319 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:06:56.326 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:06:56.326 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:06:56.336 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:06:56.344 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:06:56.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-10T23:06:56.415 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-10T23:06:56.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-10T23:06:56.479 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-10T23:06:56.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-09-10T23:06:56.521 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-09-10T23:06:56.523 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:06:56.523 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-10T23:06:56.547 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-10T23:06:56.548 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-10T23:06:56.570 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-10T23:06:56.571 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-09-10T23:06:56.597 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-09-10T23:06:56.597 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:06:56.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:06:56.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:56.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:06:56.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:56.656 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:06:56.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:56.683 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:06:56.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:06:56.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:06:56.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:06:56.786 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:06:56.795 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T23:06:56.798 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T23:06:56.918 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:06:56.928 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:06:56.929 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:10:57.729 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-09-10T23:10:57.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T23:10:57.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:10:57.833 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-10T23:10:57.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T23:10:57.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T23:10:57.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:10:58.019 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-10T23:10:58.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T23:10:58.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-10T23:10:58.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:10:58.198 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-10T23:10:58.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-10T23:10:58.287 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:10:58.298 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:10:58.298 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:10:58.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:10:58.301 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:10:58.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:10:58.303 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:10:58.303 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:10:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:10:58.331 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:10:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:10:58.346 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:10:58.354 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:10:58.368 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:10:58.370 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-10T23:10:58.371 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-10T23:10:58.381 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-10T23:10:58.382 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-10T23:10:58.392 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-09-10T23:10:58.396 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:10:58.397 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:10:58.403 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-09-10T23:10:58.410 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:10:58.411 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:10:58.417 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:10:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:10:58.464 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:10:58.468 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:10:58.469 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T23:10:58.469 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.469 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.469 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.469 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.469 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:10:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:10:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-10T23:10:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.474 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.486 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:10:58.489 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:10:58.489 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-10T23:10:58.489 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.489 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.490 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.490 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:10:58.491 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:10:58.500 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:10:58.500 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:10:58.500 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:10:58.500 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:10:58.505 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:10:58.505 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:10:58.506 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:10:58.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:10:58.508 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:10:58.508 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:10:58.509 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:10:58.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:10:58.674 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:10:58.675 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:10:58.687 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:10:58.687 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:10:58.702 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:10:58.702 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:10:58.812 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:10:58.812 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:10:58.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:10:58.817 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:10:58.817 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:10:58.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:10:58.825 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:10:58.825 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:10:58.825 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:10:58.838 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:10:58.838 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:10:58.845 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:10:58.846 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:10:58.851 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:10:58.852 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:10:58.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:10:58.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:10:58.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:10:58.980 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:10:58.991 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:10:58.992 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:10:59.045 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-10T23:10:59.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-10T23:10:59.056 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-09-10T23:10:59.057 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-10T23:10:59.058 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-09-10T23:10:59.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-10T23:10:59.272 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-10T23:10:59.282 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-09-10T23:10:59.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:10:59.301 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-10T23:10:59.312 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:10:59.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:10:59.832 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 337 kB/s | 84 kB 00:00 2024-09-10T23:10:59.873 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-10T23:10:59.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-10T23:11:00.125 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-10T23:11:00.190 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 88 kB/s | 24 kB 00:00 2024-09-10T23:11:00.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-10T23:11:00.392 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-10T23:11:00.465 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:11:00.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T23:11:01.375 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.2 MB 00:00 2024-09-10T23:11:02.292 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-10T23:11:02.490 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:01 2024-09-10T23:11:04.350 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-10T23:11:04.868 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-09-10T23:11:08.826 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-10T23:11:10.227 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-10T23:11:10.369 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 19 kB 00:00 2024-09-10T23:11:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T23:11:11.909 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-09-10T23:11:12.228 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 19 kB 00:00 2024-09-10T23:11:13.332 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T23:11:17.020 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-10T23:11:17.134 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-10T23:11:18.810 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-10T23:11:18.988 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T23:11:19.288 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:19.289 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:19.300 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:19.301 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:19.302 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:19.303 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:19.304 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:19.306 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:19.307 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:19.370 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-10T23:11:19.387 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-09-10T23:11:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-10T23:11:19.387 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-09-10T23:11:19.387 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-10T23:11:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout:Install 149 Packages 2024-09-10T23:11:19.401 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 8 Packages 2024-09-10T23:11:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:11:19.402 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 240 M 2024-09-10T23:11:19.402 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-10T23:11:19.906 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T23:11:20.212 INFO:teuthology.orchestra.run.smithi177.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 56 kB/s | 6.6 kB 00:00 2024-09-10T23:11:20.438 INFO:teuthology.orchestra.run.smithi177.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.9 MB/s | 900 kB 00:00 2024-09-10T23:11:20.521 INFO:teuthology.orchestra.run.smithi177.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 5.5 MB 00:00 2024-09-10T23:11:20.546 INFO:teuthology.orchestra.run.smithi177.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.3 MB/s | 145 kB 00:00 2024-09-10T23:11:20.663 INFO:teuthology.orchestra.run.smithi177.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 2.4 MB 00:00 2024-09-10T23:11:20.789 INFO:teuthology.orchestra.run.smithi177.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-10T23:11:20.864 INFO:teuthology.orchestra.run.smithi177.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 24 MB/s | 4.8 MB 00:00 2024-09-10T23:11:21.373 INFO:teuthology.orchestra.run.smithi177.stdout:(8/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 22 MB/s | 11 MB 00:00 2024-09-10T23:11:21.423 INFO:teuthology.orchestra.run.smithi177.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 505 kB/s | 25 kB 00:00 2024-09-10T23:11:21.451 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:21.452 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:21.466 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:21.467 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:21.468 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:21.473 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:21.474 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:21.542 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-10T23:11:21.567 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-10T23:11:21.567 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-10T23:11:21.567 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-10T23:11:21.567 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-10T23:11:21.567 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:21.567 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:21.568 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:21.569 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:21.570 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:21.571 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:21.572 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:21.573 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:21.574 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:21.575 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:21.576 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:21.577 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:21.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-10T23:11:21.579 INFO:teuthology.orchestra.run.smithi002.stdout:Install 149 Packages 2024-09-10T23:11:21.580 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-09-10T23:11:21.580 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:11:21.580 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 240 M 2024-09-10T23:11:21.580 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-10T23:11:21.623 INFO:teuthology.orchestra.run.smithi177.stdout:(10/157): ceph-common-19.3.0-4854.g8f219c47.el9 14 MB/s | 22 MB 00:01 2024-09-10T23:11:21.673 INFO:teuthology.orchestra.run.smithi177.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T23:11:21.740 INFO:teuthology.orchestra.run.smithi177.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 406 kB/s | 27 kB 00:00 2024-09-10T23:11:21.807 INFO:teuthology.orchestra.run.smithi177.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 477 kB/s | 32 kB 00:00 2024-09-10T23:11:21.933 INFO:teuthology.orchestra.run.smithi177.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 755 kB 00:00 2024-09-10T23:11:22.016 INFO:teuthology.orchestra.run.smithi177.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.9 MB/s | 162 kB 00:00 2024-09-10T23:11:22.092 INFO:teuthology.orchestra.run.smithi177.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.6 MB/s | 127 kB 00:00 2024-09-10T23:11:22.175 INFO:teuthology.orchestra.run.smithi177.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 5.9 MB/s | 507 kB 00:00 2024-09-10T23:11:22.289 INFO:teuthology.orchestra.run.smithi002.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-09-10T23:11:22.634 INFO:teuthology.orchestra.run.smithi177.stdout:(18/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-10T23:11:22.684 INFO:teuthology.orchestra.run.smithi177.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 907 kB/s | 45 kB 00:00 2024-09-10T23:11:22.784 INFO:teuthology.orchestra.run.smithi177.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.4 MB/s | 143 kB 00:00 2024-09-10T23:11:22.955 INFO:teuthology.orchestra.run.smithi002.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.3 MB/s | 900 kB 00:00 2024-09-10T23:11:22.985 INFO:teuthology.orchestra.run.smithi177.stdout:(21/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 7.8 MB/s | 17 MB 00:02 2024-09-10T23:11:23.010 INFO:teuthology.orchestra.run.smithi177.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 716 kB/s | 161 kB 00:00 2024-09-10T23:11:23.022 INFO:teuthology.orchestra.run.smithi002.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T23:11:23.043 INFO:teuthology.orchestra.run.smithi177.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 5.4 MB/s | 321 kB 00:00 2024-09-10T23:11:23.069 INFO:teuthology.orchestra.run.smithi177.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-10T23:11:23.094 INFO:teuthology.orchestra.run.smithi177.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T23:11:23.119 INFO:teuthology.orchestra.run.smithi177.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T23:11:23.406 INFO:teuthology.orchestra.run.smithi002.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 6.2 MB/s | 2.4 MB 00:00 2024-09-10T23:11:23.539 INFO:teuthology.orchestra.run.smithi002.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 3.7 MB/s | 5.5 MB 00:01 2024-09-10T23:11:23.570 INFO:teuthology.orchestra.run.smithi177.stdout:(27/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 23 MB/s | 50 MB 00:02 2024-09-10T23:11:23.595 INFO:teuthology.orchestra.run.smithi177.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 359 kB/s | 171 kB 00:00 2024-09-10T23:11:23.620 INFO:teuthology.orchestra.run.smithi177.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 686 kB/s | 34 kB 00:00 2024-09-10T23:11:23.623 INFO:teuthology.orchestra.run.smithi002.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-10T23:11:23.654 INFO:teuthology.orchestra.run.smithi177.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T23:11:23.713 INFO:teuthology.orchestra.run.smithi177.stdout:(31/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 5.1 MB/s | 3.2 MB 00:00 2024-09-10T23:11:23.963 INFO:teuthology.orchestra.run.smithi177.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.1 MB/s | 291 kB 00:00 2024-09-10T23:11:24.038 INFO:teuthology.orchestra.run.smithi177.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 660 kB/s | 49 kB 00:00 2024-09-10T23:11:24.113 INFO:teuthology.orchestra.run.smithi177.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 220 kB/s | 16 kB 00:00 2024-09-10T23:11:24.197 INFO:teuthology.orchestra.run.smithi177.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.4 MB/s | 285 kB 00:00 2024-09-10T23:11:24.290 INFO:teuthology.orchestra.run.smithi002.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 6.4 MB/s | 4.8 MB 00:00 2024-09-10T23:11:24.322 INFO:teuthology.orchestra.run.smithi177.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-10T23:11:24.473 INFO:teuthology.orchestra.run.smithi177.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 17 MB/s | 14 MB 00:00 2024-09-10T23:11:24.498 INFO:teuthology.orchestra.run.smithi177.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 104 kB/s | 18 kB 00:00 2024-09-10T23:11:24.523 INFO:teuthology.orchestra.run.smithi177.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 2.3 MB/s | 783 kB 00:00 2024-09-10T23:11:24.606 INFO:teuthology.orchestra.run.smithi177.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-10T23:11:24.640 INFO:teuthology.orchestra.run.smithi177.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-10T23:11:24.682 INFO:teuthology.orchestra.run.smithi177.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T23:11:24.716 INFO:teuthology.orchestra.run.smithi177.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-10T23:11:24.741 INFO:teuthology.orchestra.run.smithi177.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T23:11:24.775 INFO:teuthology.orchestra.run.smithi177.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T23:11:24.800 INFO:teuthology.orchestra.run.smithi177.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T23:11:24.825 INFO:teuthology.orchestra.run.smithi177.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T23:11:24.868 INFO:teuthology.orchestra.run.smithi177.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-10T23:11:24.966 INFO:teuthology.orchestra.run.smithi002.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 22 MB 00:02 2024-09-10T23:11:25.001 INFO:teuthology.orchestra.run.smithi177.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-10T23:11:25.007 INFO:teuthology.orchestra.run.smithi002.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 609 kB/s | 25 kB 00:00 2024-09-10T23:11:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-10T23:11:25.077 INFO:teuthology.orchestra.run.smithi177.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-10T23:11:25.110 INFO:teuthology.orchestra.run.smithi177.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-10T23:11:25.135 INFO:teuthology.orchestra.run.smithi177.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-10T23:11:25.161 INFO:teuthology.orchestra.run.smithi177.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-10T23:11:25.186 INFO:teuthology.orchestra.run.smithi177.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T23:11:25.211 INFO:teuthology.orchestra.run.smithi177.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T23:11:25.236 INFO:teuthology.orchestra.run.smithi177.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-10T23:11:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 12 MB/s | 11 MB 00:00 2024-09-10T23:11:25.278 INFO:teuthology.orchestra.run.smithi177.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-10T23:11:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T23:11:25.303 INFO:teuthology.orchestra.run.smithi177.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-10T23:11:25.336 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-10T23:11:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 543 kB/s | 27 kB 00:00 2024-09-10T23:11:25.379 INFO:teuthology.orchestra.run.smithi177.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-10T23:11:25.391 INFO:teuthology.orchestra.run.smithi002.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 637 kB/s | 32 kB 00:00 2024-09-10T23:11:25.404 INFO:teuthology.orchestra.run.smithi177.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-10T23:11:25.429 INFO:teuthology.orchestra.run.smithi177.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-09-10T23:11:25.455 INFO:teuthology.orchestra.run.smithi177.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T23:11:25.480 INFO:teuthology.orchestra.run.smithi177.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-10T23:11:25.505 INFO:teuthology.orchestra.run.smithi177.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-10T23:11:25.517 INFO:teuthology.orchestra.run.smithi002.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 755 kB 00:00 2024-09-10T23:11:25.531 INFO:teuthology.orchestra.run.smithi177.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-10T23:11:25.556 INFO:teuthology.orchestra.run.smithi177.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T23:11:25.648 INFO:teuthology.orchestra.run.smithi177.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-10T23:11:25.692 INFO:teuthology.orchestra.run.smithi002.stdout:(15/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 8.3 MB/s | 17 MB 00:02 2024-09-10T23:11:25.717 INFO:teuthology.orchestra.run.smithi002.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 808 kB/s | 162 kB 00:00 2024-09-10T23:11:25.723 INFO:teuthology.orchestra.run.smithi177.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-10T23:11:25.750 INFO:teuthology.orchestra.run.smithi002.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.1 MB/s | 127 kB 00:00 2024-09-10T23:11:25.790 INFO:teuthology.orchestra.run.smithi177.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-10T23:11:25.809 INFO:teuthology.orchestra.run.smithi002.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 5.4 MB/s | 507 kB 00:00 2024-09-10T23:11:25.815 INFO:teuthology.orchestra.run.smithi177.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-10T23:11:25.857 INFO:teuthology.orchestra.run.smithi177.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.2 MB/s | 910 kB 00:00 2024-09-10T23:11:25.860 INFO:teuthology.orchestra.run.smithi002.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 901 kB/s | 45 kB 00:00 2024-09-10T23:11:25.899 INFO:teuthology.orchestra.run.smithi177.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-10T23:11:25.910 INFO:teuthology.orchestra.run.smithi002.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-10T23:11:25.925 INFO:teuthology.orchestra.run.smithi177.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T23:11:25.960 INFO:teuthology.orchestra.run.smithi002.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.2 MB/s | 161 kB 00:00 2024-09-10T23:11:25.966 INFO:teuthology.orchestra.run.smithi177.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T23:11:26.019 INFO:teuthology.orchestra.run.smithi002.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 5.4 MB/s | 321 kB 00:00 2024-09-10T23:11:26.073 INFO:teuthology.orchestra.run.smithi177.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-10T23:11:26.077 INFO:teuthology.orchestra.run.smithi002.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-10T23:11:26.129 INFO:teuthology.orchestra.run.smithi002.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T23:11:26.178 INFO:teuthology.orchestra.run.smithi002.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T23:11:26.217 INFO:teuthology.orchestra.run.smithi177.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 977 kB/s | 245 kB 00:00 2024-09-10T23:11:26.251 INFO:teuthology.orchestra.run.smithi177.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-09-10T23:11:26.276 INFO:teuthology.orchestra.run.smithi177.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-09-10T23:11:26.293 INFO:teuthology.orchestra.run.smithi177.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 455 kB/s | 19 kB 00:00 2024-09-10T23:11:26.320 INFO:teuthology.orchestra.run.smithi002.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 9.7 MB/s | 5.5 MB 00:00 2024-09-10T23:11:26.371 INFO:teuthology.orchestra.run.smithi002.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.4 MB/s | 171 kB 00:00 2024-09-10T23:11:26.377 INFO:teuthology.orchestra.run.smithi177.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-10T23:11:26.394 INFO:teuthology.orchestra.run.smithi177.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-10T23:11:26.419 INFO:teuthology.orchestra.run.smithi177.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-10T23:11:26.420 INFO:teuthology.orchestra.run.smithi002.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 689 kB/s | 34 kB 00:00 2024-09-10T23:11:26.444 INFO:teuthology.orchestra.run.smithi177.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-10T23:11:26.469 INFO:teuthology.orchestra.run.smithi177.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T23:11:26.495 INFO:teuthology.orchestra.run.smithi177.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T23:11:26.496 INFO:teuthology.orchestra.run.smithi002.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 10 MB/s | 3.2 MB 00:00 2024-09-10T23:11:26.520 INFO:teuthology.orchestra.run.smithi177.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-10T23:11:26.521 INFO:teuthology.orchestra.run.smithi002.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.5 MB/s | 154 kB 00:00 2024-09-10T23:11:26.546 INFO:teuthology.orchestra.run.smithi177.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-10T23:11:26.571 INFO:teuthology.orchestra.run.smithi177.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T23:11:26.596 INFO:teuthology.orchestra.run.smithi177.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T23:11:26.621 INFO:teuthology.orchestra.run.smithi177.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T23:11:26.647 INFO:teuthology.orchestra.run.smithi177.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T23:11:26.730 INFO:teuthology.orchestra.run.smithi177.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-10T23:11:26.755 INFO:teuthology.orchestra.run.smithi177.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-10T23:11:26.781 INFO:teuthology.orchestra.run.smithi177.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-10T23:11:26.823 INFO:teuthology.orchestra.run.smithi177.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-10T23:11:26.848 INFO:teuthology.orchestra.run.smithi177.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-10T23:11:26.873 INFO:teuthology.orchestra.run.smithi177.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T23:11:26.908 INFO:teuthology.orchestra.run.smithi177.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T23:11:26.932 INFO:teuthology.orchestra.run.smithi177.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-10T23:11:26.958 INFO:teuthology.orchestra.run.smithi177.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T23:11:26.983 INFO:teuthology.orchestra.run.smithi177.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T23:11:27.008 INFO:teuthology.orchestra.run.smithi177.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-10T23:11:27.089 INFO:teuthology.orchestra.run.smithi002.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-10T23:11:27.149 INFO:teuthology.orchestra.run.smithi002.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.9 MB/s | 291 kB 00:00 2024-09-10T23:11:27.197 INFO:teuthology.orchestra.run.smithi002.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 990 kB/s | 49 kB 00:00 2024-09-10T23:11:27.247 INFO:teuthology.orchestra.run.smithi002.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 329 kB/s | 16 kB 00:00 2024-09-10T23:11:27.250 INFO:teuthology.orchestra.run.smithi177.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-10T23:11:27.275 INFO:teuthology.orchestra.run.smithi177.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-10T23:11:27.306 INFO:teuthology.orchestra.run.smithi002.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T23:11:27.342 INFO:teuthology.orchestra.run.smithi177.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-10T23:11:27.367 INFO:teuthology.orchestra.run.smithi177.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 791 kB/s | 19 kB 00:00 2024-09-10T23:11:27.392 INFO:teuthology.orchestra.run.smithi177.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-10T23:11:27.406 INFO:teuthology.orchestra.run.smithi002.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 7.7 MB/s | 783 kB 00:00 2024-09-10T23:11:27.426 INFO:teuthology.orchestra.run.smithi177.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 772 kB/s | 26 kB 00:00 2024-09-10T23:11:27.452 INFO:teuthology.orchestra.run.smithi177.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T23:11:27.485 INFO:teuthology.orchestra.run.smithi177.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-10T23:11:27.511 INFO:teuthology.orchestra.run.smithi177.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-10T23:11:27.544 INFO:teuthology.orchestra.run.smithi177.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T23:11:27.548 INFO:teuthology.orchestra.run.smithi002.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 13 MB/s | 14 MB 00:01 2024-09-10T23:11:27.573 INFO:teuthology.orchestra.run.smithi002.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 109 kB/s | 18 kB 00:00 2024-09-10T23:11:27.603 INFO:teuthology.orchestra.run.smithi177.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.5 MB/s | 548 kB 00:00 2024-09-10T23:11:27.625 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:27.625 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:27.628 INFO:teuthology.orchestra.run.smithi177.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:11:27.639 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:27.640 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:27.641 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:27.642 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:27.644 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:27.646 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:27.647 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:27.653 INFO:teuthology.orchestra.run.smithi177.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T23:11:27.678 INFO:teuthology.orchestra.run.smithi177.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-10T23:11:27.704 INFO:teuthology.orchestra.run.smithi177.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-10T23:11:27.710 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:27.729 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:27.730 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:27.732 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:27.733 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:27.734 INFO:teuthology.orchestra.run.smithi154.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:27.735 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:27.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:27.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:27.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:27.742 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:11:27.743 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-10T23:11:27.743 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T23:11:27.743 INFO:teuthology.orchestra.run.smithi154.stdout:Install 149 Packages 2024-09-10T23:11:27.743 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-10T23:11:27.743 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:11:27.743 INFO:teuthology.orchestra.run.smithi177.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T23:11:27.744 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 240 M 2024-09-10T23:11:27.744 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-10T23:11:27.763 INFO:teuthology.orchestra.run.smithi177.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T23:11:27.821 INFO:teuthology.orchestra.run.smithi177.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.7 MB/s | 4.4 MB 00:00 2024-09-10T23:11:27.855 INFO:teuthology.orchestra.run.smithi177.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-10T23:11:27.880 INFO:teuthology.orchestra.run.smithi177.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-10T23:11:27.905 INFO:teuthology.orchestra.run.smithi177.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T23:11:27.931 INFO:teuthology.orchestra.run.smithi177.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-10T23:11:27.949 INFO:teuthology.orchestra.run.smithi002.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 199 kB/s | 80 kB 00:00 2024-09-10T23:11:27.956 INFO:teuthology.orchestra.run.smithi177.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-10T23:11:27.981 INFO:teuthology.orchestra.run.smithi177.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T23:11:28.006 INFO:teuthology.orchestra.run.smithi177.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T23:11:28.032 INFO:teuthology.orchestra.run.smithi177.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T23:11:28.057 INFO:teuthology.orchestra.run.smithi177.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:11:28.091 INFO:teuthology.orchestra.run.smithi177.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T23:11:28.116 INFO:teuthology.orchestra.run.smithi177.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T23:11:28.150 INFO:teuthology.orchestra.run.smithi177.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-10T23:11:28.200 INFO:teuthology.orchestra.run.smithi177.stdout:(134/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-10T23:11:28.217 INFO:teuthology.orchestra.run.smithi177.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-09-10T23:11:28.242 INFO:teuthology.orchestra.run.smithi177.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-10T23:11:28.259 INFO:teuthology.orchestra.run.smithi177.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 679 kB/s | 28 kB 00:00 2024-09-10T23:11:28.276 INFO:teuthology.orchestra.run.smithi177.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 923 kB/s | 31 kB 00:00 2024-09-10T23:11:28.301 INFO:teuthology.orchestra.run.smithi177.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-10T23:11:28.327 INFO:teuthology.orchestra.run.smithi177.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T23:11:28.352 INFO:teuthology.orchestra.run.smithi177.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T23:11:28.377 INFO:teuthology.orchestra.run.smithi177.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-10T23:11:28.402 INFO:teuthology.orchestra.run.smithi177.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-10T23:11:28.428 INFO:teuthology.orchestra.run.smithi177.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T23:11:28.432 INFO:teuthology.orchestra.run.smithi002.stdout:(40/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 15 MB/s | 50 MB 00:03 2024-09-10T23:11:28.453 INFO:teuthology.orchestra.run.smithi177.stdout:(145/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T23:11:28.454 INFO:teuthology.orchestra.run.smithi154.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-10T23:11:28.457 INFO:teuthology.orchestra.run.smithi002.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 376 kB/s | 191 kB 00:00 2024-09-10T23:11:28.478 INFO:teuthology.orchestra.run.smithi177.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T23:11:28.503 INFO:teuthology.orchestra.run.smithi177.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:11:28.529 INFO:teuthology.orchestra.run.smithi177.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:11:28.596 INFO:teuthology.orchestra.run.smithi177.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T23:11:28.649 INFO:teuthology.orchestra.run.smithi002.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 745 kB/s | 801 kB 00:01 2024-09-10T23:11:28.713 INFO:teuthology.orchestra.run.smithi154.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.4 MB/s | 900 kB 00:00 2024-09-10T23:11:28.766 INFO:teuthology.orchestra.run.smithi002.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 913 kB/s | 106 kB 00:00 2024-09-10T23:11:28.787 INFO:teuthology.orchestra.run.smithi177.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-10T23:11:28.830 INFO:teuthology.orchestra.run.smithi154.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T23:11:28.855 INFO:teuthology.orchestra.run.smithi154.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.0 MB/s | 145 kB 00:00 2024-09-10T23:11:28.871 INFO:teuthology.orchestra.run.smithi177.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-09-10T23:11:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-10T23:11:28.913 INFO:teuthology.orchestra.run.smithi177.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 981 kB/s | 41 kB 00:00 2024-09-10T23:11:28.955 INFO:teuthology.orchestra.run.smithi177.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-10T23:11:28.956 INFO:teuthology.orchestra.run.smithi154.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 2.4 MB 00:00 2024-09-10T23:11:29.001 INFO:teuthology.orchestra.run.smithi002.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-10T23:11:29.025 INFO:teuthology.orchestra.run.smithi002.stdout:(46/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 427 kB/s | 253 kB 00:00 2024-09-10T23:11:29.030 INFO:teuthology.orchestra.run.smithi177.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-10T23:11:29.067 INFO:teuthology.orchestra.run.smithi002.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 2.0 MB/s | 1.2 MB 00:00 2024-09-10T23:11:29.114 INFO:teuthology.orchestra.run.smithi154.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-09-10T23:11:29.117 INFO:teuthology.orchestra.run.smithi002.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-10T23:11:29.131 INFO:teuthology.orchestra.run.smithi177.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-10T23:11:29.256 INFO:teuthology.orchestra.run.smithi154.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-10T23:11:29.289 INFO:teuthology.orchestra.run.smithi177.stdout:(156/157): librados2-19.3.0-4854.g8f219c47.el9. 4.4 MB/s | 3.5 MB 00:00 2024-09-10T23:11:29.295 INFO:teuthology.orchestra.run.smithi002.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 604 kB/s | 107 kB 00:00 2024-09-10T23:11:29.320 INFO:teuthology.orchestra.run.smithi002.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-10T23:11:29.354 INFO:teuthology.orchestra.run.smithi002.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-10T23:11:29.373 INFO:teuthology.orchestra.run.smithi177.stdout:(157/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 3.2 MB 00:00 2024-09-10T23:11:29.378 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:29.379 INFO:teuthology.orchestra.run.smithi177.stdout:Total 24 MB/s | 240 MB 00:09 2024-09-10T23:11:29.412 INFO:teuthology.orchestra.run.smithi002.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-10T23:11:29.437 INFO:teuthology.orchestra.run.smithi002.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-10T23:11:29.471 INFO:teuthology.orchestra.run.smithi002.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-10T23:11:29.496 INFO:teuthology.orchestra.run.smithi002.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-10T23:11:29.522 INFO:teuthology.orchestra.run.smithi002.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-10T23:11:29.555 INFO:teuthology.orchestra.run.smithi002.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-10T23:11:29.573 INFO:teuthology.orchestra.run.smithi154.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-10T23:11:29.605 INFO:teuthology.orchestra.run.smithi002.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-10T23:11:29.631 INFO:teuthology.orchestra.run.smithi002.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-10T23:11:29.632 INFO:teuthology.orchestra.run.smithi154.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 433 kB/s | 25 kB 00:00 2024-09-10T23:11:29.748 INFO:teuthology.orchestra.run.smithi002.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-10T23:11:29.773 INFO:teuthology.orchestra.run.smithi002.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-10T23:11:29.798 INFO:teuthology.orchestra.run.smithi002.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-10T23:11:29.832 INFO:teuthology.orchestra.run.smithi002.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-10T23:11:29.874 INFO:teuthology.orchestra.run.smithi002.stdout:(64/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-09-10T23:11:29.899 INFO:teuthology.orchestra.run.smithi002.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-10T23:11:29.924 INFO:teuthology.orchestra.run.smithi002.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-10T23:11:29.950 INFO:teuthology.orchestra.run.smithi002.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-10T23:11:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 15 MB/s | 11 MB 00:00 2024-09-10T23:11:30.074 INFO:teuthology.orchestra.run.smithi154.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.3 MB/s | 225 kB 00:00 2024-09-10T23:11:30.116 INFO:teuthology.orchestra.run.smithi002.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-10T23:11:30.157 INFO:teuthology.orchestra.run.smithi154.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 325 kB/s | 27 kB 00:00 2024-09-10T23:11:30.217 INFO:teuthology.orchestra.run.smithi002.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-10T23:11:30.275 INFO:teuthology.orchestra.run.smithi002.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T23:11:30.333 INFO:teuthology.orchestra.run.smithi154.stdout:(13/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 14 MB/s | 17 MB 00:01 2024-09-10T23:11:30.366 INFO:teuthology.orchestra.run.smithi154.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 152 kB/s | 32 kB 00:00 2024-09-10T23:11:30.400 INFO:teuthology.orchestra.run.smithi154.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 755 kB 00:00 2024-09-10T23:11:30.425 INFO:teuthology.orchestra.run.smithi154.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T23:11:30.451 INFO:teuthology.orchestra.run.smithi154.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:11:30.467 INFO:teuthology.orchestra.run.smithi002.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 8.7 MB/s | 4.9 MB 00:00 2024-09-10T23:11:30.476 INFO:teuthology.orchestra.run.smithi154.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 9.9 MB/s | 507 kB 00:00 2024-09-10T23:11:30.534 INFO:teuthology.orchestra.run.smithi002.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-10T23:11:30.535 INFO:teuthology.orchestra.run.smithi154.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 772 kB/s | 45 kB 00:00 2024-09-10T23:11:30.591 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-10T23:11:30.593 INFO:teuthology.orchestra.run.smithi002.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T23:11:30.618 INFO:teuthology.orchestra.run.smithi154.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T23:11:30.626 INFO:teuthology.orchestra.run.smithi002.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-10T23:11:30.677 INFO:teuthology.orchestra.run.smithi002.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T23:11:30.718 INFO:teuthology.orchestra.run.smithi154.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-10T23:11:30.743 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-10T23:11:30.743 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-10T23:11:30.744 INFO:teuthology.orchestra.run.smithi154.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.3 MB/s | 161 kB 00:00 2024-09-10T23:11:30.752 INFO:teuthology.orchestra.run.smithi002.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-10T23:11:30.769 INFO:teuthology.orchestra.run.smithi154.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-10T23:11:30.777 INFO:teuthology.orchestra.run.smithi002.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T23:11:30.794 INFO:teuthology.orchestra.run.smithi154.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 6.0 MB/s | 306 kB 00:00 2024-09-10T23:11:30.810 INFO:teuthology.orchestra.run.smithi002.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-10T23:11:30.820 INFO:teuthology.orchestra.run.smithi154.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T23:11:30.827 INFO:teuthology.orchestra.run.smithi002.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-10T23:11:30.853 INFO:teuthology.orchestra.run.smithi154.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-10T23:11:30.861 INFO:teuthology.orchestra.run.smithi002.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-10T23:11:30.886 INFO:teuthology.orchestra.run.smithi002.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T23:11:30.912 INFO:teuthology.orchestra.run.smithi002.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-09-10T23:11:30.920 INFO:teuthology.orchestra.run.smithi154.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-10T23:11:30.971 INFO:teuthology.orchestra.run.smithi154.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 21 MB/s | 3.2 MB 00:00 2024-09-10T23:11:30.971 INFO:teuthology.orchestra.run.smithi002.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T23:11:30.996 INFO:teuthology.orchestra.run.smithi154.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 455 kB/s | 34 kB 00:00 2024-09-10T23:11:31.029 INFO:teuthology.orchestra.run.smithi154.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T23:11:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-10T23:11:31.113 INFO:teuthology.orchestra.run.smithi002.stdout:(85/157): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-10T23:11:31.138 INFO:teuthology.orchestra.run.smithi002.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-09-10T23:11:31.163 INFO:teuthology.orchestra.run.smithi002.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-10T23:11:31.197 INFO:teuthology.orchestra.run.smithi002.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T23:11:31.222 INFO:teuthology.orchestra.run.smithi002.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T23:11:31.256 INFO:teuthology.orchestra.run.smithi002.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-10T23:11:31.281 INFO:teuthology.orchestra.run.smithi002.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-10T23:11:31.348 INFO:teuthology.orchestra.run.smithi002.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-10T23:11:31.398 INFO:teuthology.orchestra.run.smithi002.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 377 kB/s | 54 kB 00:00 2024-09-10T23:11:31.423 INFO:teuthology.orchestra.run.smithi002.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-10T23:11:31.457 INFO:teuthology.orchestra.run.smithi002.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-09-10T23:11:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-10T23:11:31.482 INFO:teuthology.orchestra.run.smithi002.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T23:11:31.516 INFO:teuthology.orchestra.run.smithi002.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-10T23:11:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.9 MB/s | 291 kB 00:00 2024-09-10T23:11:31.541 INFO:teuthology.orchestra.run.smithi002.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-10T23:11:31.575 INFO:teuthology.orchestra.run.smithi002.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T23:11:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 738 kB/s | 49 kB 00:00 2024-09-10T23:11:31.600 INFO:teuthology.orchestra.run.smithi002.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-10T23:11:31.633 INFO:teuthology.orchestra.run.smithi002.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T23:11:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 247 kB/s | 16 kB 00:00 2024-09-10T23:11:31.659 INFO:teuthology.orchestra.run.smithi002.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T23:11:31.684 INFO:teuthology.orchestra.run.smithi002.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-10T23:11:31.776 INFO:teuthology.orchestra.run.smithi002.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-10T23:11:31.826 INFO:teuthology.orchestra.run.smithi002.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T23:11:31.861 INFO:teuthology.orchestra.run.smithi002.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T23:11:31.877 INFO:teuthology.orchestra.run.smithi002.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-10T23:11:31.985 INFO:teuthology.orchestra.run.smithi002.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-10T23:11:32.123 INFO:teuthology.orchestra.run.smithi154.stdout:(35/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 20 MB/s | 50 MB 00:02 2024-09-10T23:11:32.156 INFO:teuthology.orchestra.run.smithi154.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 570 kB/s | 285 kB 00:00 2024-09-10T23:11:32.160 INFO:teuthology.orchestra.run.smithi002.stdout:(109/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-10T23:11:32.186 INFO:teuthology.orchestra.run.smithi002.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 130 kB/s | 26 kB 00:00 2024-09-10T23:11:32.207 INFO:teuthology.orchestra.run.smithi154.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 9.2 MB/s | 783 kB 00:00 2024-09-10T23:11:32.219 INFO:teuthology.orchestra.run.smithi002.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-10T23:11:32.232 INFO:teuthology.orchestra.run.smithi154.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 243 kB/s | 18 kB 00:00 2024-09-10T23:11:32.245 INFO:teuthology.orchestra.run.smithi002.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 594 kB/s | 49 kB 00:00 2024-09-10T23:11:32.270 INFO:teuthology.orchestra.run.smithi002.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-10T23:11:32.329 INFO:teuthology.orchestra.run.smithi002.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-10T23:11:32.354 INFO:teuthology.orchestra.run.smithi002.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:11:32.379 INFO:teuthology.orchestra.run.smithi002.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T23:11:32.382 INFO:teuthology.orchestra.run.smithi154.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 10 MB/s | 14 MB 00:01 2024-09-10T23:11:32.405 INFO:teuthology.orchestra.run.smithi002.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-10T23:11:32.430 INFO:teuthology.orchestra.run.smithi002.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T23:11:32.497 INFO:teuthology.orchestra.run.smithi002.stdout:(119/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-10T23:11:32.507 INFO:teuthology.orchestra.run.smithi154.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 266 kB/s | 80 kB 00:00 2024-09-10T23:11:32.522 INFO:teuthology.orchestra.run.smithi002.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-10T23:11:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-10T23:11:32.581 INFO:teuthology.orchestra.run.smithi002.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-10T23:11:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-10T23:11:32.631 INFO:teuthology.orchestra.run.smithi002.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T23:11:32.641 INFO:teuthology.orchestra.run.smithi154.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 740 kB/s | 191 kB 00:00 2024-09-10T23:11:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-10T23:11:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-10T23:11:32.656 INFO:teuthology.orchestra.run.smithi002.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-10T23:11:32.666 INFO:teuthology.orchestra.run.smithi154.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-10T23:11:32.682 INFO:teuthology.orchestra.run.smithi002.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-10T23:11:32.707 INFO:teuthology.orchestra.run.smithi002.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-10T23:11:32.732 INFO:teuthology.orchestra.run.smithi002.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-10T23:11:32.750 INFO:teuthology.orchestra.run.smithi154.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-10T23:11:32.758 INFO:teuthology.orchestra.run.smithi002.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T23:11:32.783 INFO:teuthology.orchestra.run.smithi002.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:11:32.816 INFO:teuthology.orchestra.run.smithi002.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T23:11:32.833 INFO:teuthology.orchestra.run.smithi154.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-10T23:11:32.842 INFO:teuthology.orchestra.run.smithi002.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T23:11:32.859 INFO:teuthology.orchestra.run.smithi154.stdout:(45/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-10T23:11:32.885 INFO:teuthology.orchestra.run.smithi002.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T23:11:32.909 INFO:teuthology.orchestra.run.smithi002.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-10T23:11:32.917 INFO:teuthology.orchestra.run.smithi154.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T23:11:32.934 INFO:teuthology.orchestra.run.smithi002.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T23:11:32.959 INFO:teuthology.orchestra.run.smithi002.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T23:11:32.976 INFO:teuthology.orchestra.run.smithi154.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-10T23:11:32.985 INFO:teuthology.orchestra.run.smithi002.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T23:11:33.010 INFO:teuthology.orchestra.run.smithi002.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-10T23:11:33.060 INFO:teuthology.orchestra.run.smithi002.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-10T23:11:33.085 INFO:teuthology.orchestra.run.smithi002.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2024-09-10T23:11:33.111 INFO:teuthology.orchestra.run.smithi002.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-10T23:11:33.126 INFO:teuthology.orchestra.run.smithi154.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-10T23:11:33.136 INFO:teuthology.orchestra.run.smithi002.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T23:11:33.161 INFO:teuthology.orchestra.run.smithi002.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-10T23:11:33.195 INFO:teuthology.orchestra.run.smithi002.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-10T23:11:33.210 INFO:teuthology.orchestra.run.smithi154.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-10T23:11:33.220 INFO:teuthology.orchestra.run.smithi002.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T23:11:33.246 INFO:teuthology.orchestra.run.smithi002.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T23:11:33.252 INFO:teuthology.orchestra.run.smithi154.stdout:(50/157): python3-cryptography-36.0.1-4.el9.x86 2.0 MB/s | 1.2 MB 00:00 2024-09-10T23:11:33.269 INFO:teuthology.orchestra.run.smithi154.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-10T23:11:33.271 INFO:teuthology.orchestra.run.smithi002.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:11:33.297 INFO:teuthology.orchestra.run.smithi154.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-10T23:11:33.297 INFO:teuthology.orchestra.run.smithi002.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T23:11:33.311 INFO:teuthology.orchestra.run.smithi154.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 782 kB/s | 33 kB 00:00 2024-09-10T23:11:33.353 INFO:teuthology.orchestra.run.smithi154.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-10T23:11:33.355 INFO:teuthology.orchestra.run.smithi002.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T23:11:33.387 INFO:teuthology.orchestra.run.smithi154.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 337 kB/s | 11 kB 00:00 2024-09-10T23:11:33.420 INFO:teuthology.orchestra.run.smithi154.stdout:(56/157): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-10T23:11:33.454 INFO:teuthology.orchestra.run.smithi154.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-10T23:11:33.479 INFO:teuthology.orchestra.run.smithi154.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T23:11:33.505 INFO:teuthology.orchestra.run.smithi154.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-10T23:11:33.588 INFO:teuthology.orchestra.run.smithi154.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-10T23:11:33.622 INFO:teuthology.orchestra.run.smithi154.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-10T23:11:33.647 INFO:teuthology.orchestra.run.smithi154.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-10T23:11:33.672 INFO:teuthology.orchestra.run.smithi154.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-10T23:11:33.748 INFO:teuthology.orchestra.run.smithi154.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-10T23:11:33.773 INFO:teuthology.orchestra.run.smithi154.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-10T23:11:33.799 INFO:teuthology.orchestra.run.smithi154.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 761 kB/s | 38 kB 00:00 2024-09-10T23:11:33.847 INFO:teuthology.orchestra.run.smithi002.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 6.0 MB/s | 3.5 MB 00:00 2024-09-10T23:11:34.105 INFO:teuthology.orchestra.run.smithi002.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 3.1 MB/s | 2.3 MB 00:00 2024-09-10T23:11:34.132 INFO:teuthology.orchestra.run.smithi154.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-09-10T23:11:34.214 INFO:teuthology.orchestra.run.smithi002.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 377 kB/s | 41 kB 00:00 2024-09-10T23:11:34.331 INFO:teuthology.orchestra.run.smithi002.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-10T23:11:34.448 INFO:teuthology.orchestra.run.smithi002.stdout:(154/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 2.8 MB/s | 3.2 MB 00:01 2024-09-10T23:11:34.490 INFO:teuthology.orchestra.run.smithi002.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-10T23:11:34.581 INFO:teuthology.orchestra.run.smithi002.stdout:(156/157): NetworkManager-libnm-1.49.90-1.el9.x 2.5 MB/s | 1.8 MB 00:00 2024-09-10T23:11:34.582 INFO:teuthology.orchestra.run.smithi154.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-09-10T23:11:34.858 INFO:teuthology.orchestra.run.smithi154.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.2 MB/s | 910 kB 00:00 2024-09-10T23:11:34.933 INFO:teuthology.orchestra.run.smithi154.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-10T23:11:35.000 INFO:teuthology.orchestra.run.smithi154.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-10T23:11:35.142 INFO:teuthology.orchestra.run.smithi154.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-10T23:11:35.184 INFO:teuthology.orchestra.run.smithi154.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-10T23:11:35.284 INFO:teuthology.orchestra.run.smithi154.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-10T23:11:35.318 INFO:teuthology.orchestra.run.smithi154.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-10T23:11:35.393 INFO:teuthology.orchestra.run.smithi154.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-09-10T23:11:35.443 INFO:teuthology.orchestra.run.smithi154.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-10T23:11:35.535 INFO:teuthology.orchestra.run.smithi154.stdout:(78/157): postgresql-server-13.16-1.el9.x86_64. 9.6 MB/s | 5.8 MB 00:00 2024-09-10T23:11:35.552 INFO:teuthology.orchestra.run.smithi154.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-10T23:11:35.565 INFO:teuthology.orchestra.run.smithi002.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-10T23:11:35.572 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:35.572 INFO:teuthology.orchestra.run.smithi002.stdout:Total 17 MB/s | 240 MB 00:13 2024-09-10T23:11:35.577 INFO:teuthology.orchestra.run.smithi154.stdout:(80/157): python3-devel-3.9.19-8.el9.x86_64.rpm 944 kB/s | 245 kB 00:00 2024-09-10T23:11:35.594 INFO:teuthology.orchestra.run.smithi154.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-10T23:11:35.620 INFO:teuthology.orchestra.run.smithi154.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-10T23:11:35.636 INFO:teuthology.orchestra.run.smithi154.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-09-10T23:11:35.662 INFO:teuthology.orchestra.run.smithi154.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-10T23:11:35.712 INFO:teuthology.orchestra.run.smithi154.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-10T23:11:35.737 INFO:teuthology.orchestra.run.smithi154.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-10T23:11:35.754 INFO:teuthology.orchestra.run.smithi154.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi154.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-10T23:11:35.880 INFO:teuthology.orchestra.run.smithi154.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-10T23:11:35.905 INFO:teuthology.orchestra.run.smithi154.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T23:11:35.930 INFO:teuthology.orchestra.run.smithi154.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T23:11:35.955 INFO:teuthology.orchestra.run.smithi154.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T23:11:36.031 INFO:teuthology.orchestra.run.smithi154.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-10T23:11:36.056 INFO:teuthology.orchestra.run.smithi154.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-10T23:11:36.081 INFO:teuthology.orchestra.run.smithi154.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-10T23:11:36.107 INFO:teuthology.orchestra.run.smithi154.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T23:11:36.132 INFO:teuthology.orchestra.run.smithi154.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-10T23:11:36.157 INFO:teuthology.orchestra.run.smithi154.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-10T23:11:36.183 INFO:teuthology.orchestra.run.smithi154.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T23:11:36.208 INFO:teuthology.orchestra.run.smithi154.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T23:11:36.233 INFO:teuthology.orchestra.run.smithi154.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T23:11:36.258 INFO:teuthology.orchestra.run.smithi154.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T23:11:36.284 INFO:teuthology.orchestra.run.smithi154.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-10T23:11:36.551 INFO:teuthology.orchestra.run.smithi154.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-10T23:11:36.576 INFO:teuthology.orchestra.run.smithi154.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 70 kB/s | 22 kB 00:00 2024-09-10T23:11:36.643 INFO:teuthology.orchestra.run.smithi154.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-10T23:11:36.660 INFO:teuthology.orchestra.run.smithi154.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-10T23:11:36.693 INFO:teuthology.orchestra.run.smithi154.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-10T23:11:36.710 INFO:teuthology.orchestra.run.smithi154.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-10T23:11:36.727 INFO:teuthology.orchestra.run.smithi154.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-10T23:11:36.761 INFO:teuthology.orchestra.run.smithi154.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T23:11:36.795 INFO:teuthology.orchestra.run.smithi154.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T23:11:36.855 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-10T23:11:36.878 INFO:teuthology.orchestra.run.smithi154.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-10T23:11:36.928 INFO:teuthology.orchestra.run.smithi154.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T23:11:36.954 INFO:teuthology.orchestra.run.smithi154.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:11:36.979 INFO:teuthology.orchestra.run.smithi154.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T23:11:37.027 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-10T23:11:37.027 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-10T23:11:37.046 INFO:teuthology.orchestra.run.smithi154.stdout:(117/157): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T23:11:37.071 INFO:teuthology.orchestra.run.smithi154.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 153 kB/s | 14 kB 00:00 2024-09-10T23:11:37.113 INFO:teuthology.orchestra.run.smithi154.stdout:(119/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-10T23:11:37.138 INFO:teuthology.orchestra.run.smithi154.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-10T23:11:37.189 INFO:teuthology.orchestra.run.smithi154.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-10T23:11:37.222 INFO:teuthology.orchestra.run.smithi154.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-10T23:11:37.256 INFO:teuthology.orchestra.run.smithi154.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:11:37.281 INFO:teuthology.orchestra.run.smithi154.stdout:(124/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-09-10T23:11:37.307 INFO:teuthology.orchestra.run.smithi154.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 211 kB/s | 11 kB 00:00 2024-09-10T23:11:37.332 INFO:teuthology.orchestra.run.smithi154.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-10T23:11:37.357 INFO:teuthology.orchestra.run.smithi154.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T23:11:37.383 INFO:teuthology.orchestra.run.smithi154.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T23:11:37.408 INFO:teuthology.orchestra.run.smithi154.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T23:11:37.433 INFO:teuthology.orchestra.run.smithi154.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:11:37.459 INFO:teuthology.orchestra.run.smithi154.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:11:37.492 INFO:teuthology.orchestra.run.smithi154.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T23:11:37.525 INFO:teuthology.orchestra.run.smithi154.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T23:11:37.551 INFO:teuthology.orchestra.run.smithi154.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-10T23:11:37.593 INFO:teuthology.orchestra.run.smithi154.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-10T23:11:37.618 INFO:teuthology.orchestra.run.smithi154.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-10T23:11:37.643 INFO:teuthology.orchestra.run.smithi154.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-10T23:11:37.669 INFO:teuthology.orchestra.run.smithi154.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T23:11:37.694 INFO:teuthology.orchestra.run.smithi154.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T23:11:37.736 INFO:teuthology.orchestra.run.smithi154.stdout:(140/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-10T23:11:37.761 INFO:teuthology.orchestra.run.smithi154.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-10T23:11:37.786 INFO:teuthology.orchestra.run.smithi154.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-09-10T23:11:37.812 INFO:teuthology.orchestra.run.smithi154.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T23:11:37.837 INFO:teuthology.orchestra.run.smithi154.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:11:37.871 INFO:teuthology.orchestra.run.smithi154.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T23:11:37.887 INFO:teuthology.orchestra.run.smithi154.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T23:11:37.921 INFO:teuthology.orchestra.run.smithi154.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-10T23:11:37.955 INFO:teuthology.orchestra.run.smithi154.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T23:11:38.013 INFO:teuthology.orchestra.run.smithi154.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-10T23:11:38.439 INFO:teuthology.orchestra.run.smithi154.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 6.7 MB/s | 3.5 MB 00:00 2024-09-10T23:11:38.497 INFO:teuthology.orchestra.run.smithi154.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.0 MB/s | 3.2 MB 00:00 2024-09-10T23:11:38.606 INFO:teuthology.orchestra.run.smithi154.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 377 kB/s | 41 kB 00:00 2024-09-10T23:11:38.756 INFO:teuthology.orchestra.run.smithi154.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-10T23:11:38.832 INFO:teuthology.orchestra.run.smithi154.stdout:(154/157): NetworkManager-1.49.90-1.el9.x86_64. 2.8 MB/s | 2.3 MB 00:00 2024-09-10T23:11:39.099 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-10T23:11:39.140 INFO:teuthology.orchestra.run.smithi154.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 2.6 MB/s | 1.8 MB 00:00 2024-09-10T23:11:39.174 INFO:teuthology.orchestra.run.smithi154.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-10T23:11:39.234 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:11:39.249 INFO:teuthology.orchestra.run.smithi154.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.7 MB/s | 2.4 MB 00:00 2024-09-10T23:11:39.255 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:39.256 INFO:teuthology.orchestra.run.smithi154.stdout:Total 21 MB/s | 240 MB 00:11 2024-09-10T23:11:39.273 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:11:39.326 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:11:39.360 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:11:39.394 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:11:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-10T23:11:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-10T23:11:39.437 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:11:39.774 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:11:39.887 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:11:40.008 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:11:40.038 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:11:40.129 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:11:40.167 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:11:40.196 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:11:40.350 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:11:40.423 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:11:40.451 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:11:40.505 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-10T23:11:40.556 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:11:40.585 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:11:40.648 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:11:40.658 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-10T23:11:40.658 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-10T23:11:40.669 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:11:40.691 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:11:40.888 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:11:41.028 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:11:41.159 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:11:41.273 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:41.658 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:11:41.690 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:11:41.724 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:11:41.797 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:11:41.842 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:11:41.882 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:11:41.934 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:11:41.967 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:11:41.994 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:11:42.071 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:11:42.124 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:11:42.156 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:11:42.191 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:11:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:11:42.311 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:11:42.354 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:11:42.391 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:11:42.462 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:11:42.507 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:11:42.533 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-10T23:11:42.533 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-10T23:11:42.580 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:11:42.717 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:11:42.767 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:11:43.309 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:11:43.390 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:11:43.419 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:11:43.462 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:11:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:11:43.550 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:11:43.753 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:11:43.844 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:11:43.917 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:11:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:11:44.021 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:11:44.057 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:11:44.104 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:11:44.140 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:11:44.182 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:11:44.225 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:11:44.367 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:11:44.410 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:11:44.451 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:11:44.764 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:11:44.802 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:11:44.842 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:11:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:11:44.901 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:11:44.978 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:11:45.110 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:11:45.152 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:11:45.187 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:11:45.229 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:11:45.268 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:11:45.299 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:11:45.329 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:11:45.364 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:11:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:11:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:11:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:11:45.576 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:11:45.628 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:11:45.668 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:11:45.769 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:11:45.819 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:11:46.307 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-10T23:11:46.411 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:11:46.463 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:11:46.520 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:11:46.532 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:11:46.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:11:46.583 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:11:46.586 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:11:46.633 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:11:46.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:11:46.740 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:11:46.805 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:11:46.849 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:11:46.928 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:11:46.961 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:11:46.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:11:47.096 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:11:47.145 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:11:47.175 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:11:47.229 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:11:47.252 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:11:47.263 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:11:47.363 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:11:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:11:47.423 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:11:47.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:11:47.658 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:11:47.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:11:47.792 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:11:47.819 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:11:47.882 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:11:47.892 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:11:47.904 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:11:47.929 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:11:48.007 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:11:48.116 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:11:48.314 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:11:48.428 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:11:48.541 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:48.620 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:48.839 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:48.952 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:11:48.983 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:11:49.018 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:11:49.064 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-10T23:11:49.094 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:11:49.145 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:11:49.169 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:11:49.184 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:11:49.207 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:11:49.222 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:11:49.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:11:49.269 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:11:49.269 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:11:49.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:11:49.302 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:11:49.304 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:11:49.328 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:11:49.331 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:11:49.365 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:11:49.368 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:11:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:11:49.427 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:11:49.457 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:11:49.509 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:11:49.588 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:11:49.628 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:11:49.671 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:11:49.687 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:11:49.700 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:11:49.728 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:11:49.765 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:11:49.773 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:11:49.810 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:11:49.815 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:11:49.841 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:11:49.878 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:11:49.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:11:49.937 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:11:50.037 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:11:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:11:50.093 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:11:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:11:50.189 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:11:50.218 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:11:50.247 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:11:50.371 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:11:50.397 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:11:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:11:50.451 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:11:50.473 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:11:50.474 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:11:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:11:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:11:50.649 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:11:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:11:50.740 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:11:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:11:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:11:50.774 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:11:50.818 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:11:50.856 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:11:50.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:11:50.963 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:11:51.078 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:11:51.114 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:11:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:11:51.229 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:11:51.235 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:11:51.290 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:11:51.343 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:51.364 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:11:51.402 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:11:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:51.438 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:11:51.494 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:11:51.529 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:11:51.573 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:11:51.614 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:11:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:11:51.740 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:11:51.756 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:11:51.773 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:11:51.799 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:11:51.825 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:11:51.841 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:11:51.899 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:11:51.943 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:11:51.946 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:11:51.974 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:11:51.982 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:11:52.023 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:11:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:11:52.056 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:11:52.067 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:11:52.080 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:11:52.104 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:11:52.172 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:11:52.225 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:11:52.265 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:11:52.299 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:11:52.380 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:11:52.414 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:11:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:11:52.472 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:11:52.486 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:11:52.556 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:11:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:11:52.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:11:52.654 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:11:52.682 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:11:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:11:52.724 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:11:52.764 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:11:52.804 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:11:52.817 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:11:52.822 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:11:52.834 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:11:52.869 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:11:52.879 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:11:52.902 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:11:52.944 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:11:52.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:11:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:11:53.076 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:11:53.125 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:11:53.173 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:11:53.279 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:11:53.344 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:11:53.401 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:11:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:11:53.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:11:53.579 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:11:53.597 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:11:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:11:53.632 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:11:53.658 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:11:53.727 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:11:53.727 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:11:53.728 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:11:53.728 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:11:53.758 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:11:53.824 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:11:53.886 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:11:53.978 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:11:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:11:54.105 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:11:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:11:54.157 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:11:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:11:54.191 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:11:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:11:54.301 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:11:54.313 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:11:54.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:11:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:11:54.491 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:11:54.508 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:11:54.527 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:11:54.551 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:11:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:11:54.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:11:54.742 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:11:54.750 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:11:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:11:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:11:54.837 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:11:54.937 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:11:54.978 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:11:55.017 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:11:55.043 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:11:55.068 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:11:55.143 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:11:55.270 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:11:55.524 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:11:55.530 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:11:55.652 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:11:55.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:11:55.687 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:11:55.727 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:11:55.775 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:11:55.805 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:11:55.839 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:11:55.872 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:11:55.914 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:11:55.948 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:11:56.044 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:11:56.095 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:11:56.127 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:11:56.229 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:11:56.277 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:11:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:11:57.051 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:11:57.094 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:11:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:11:57.200 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:11:57.249 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:11:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:11:57.293 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:11:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:11:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:11:57.382 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:11:57.413 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:11:57.605 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:11:57.644 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:11:57.668 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:11:57.710 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:11:57.721 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:11:57.811 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:11:57.840 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:11:57.877 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:11:58.372 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:11:58.397 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:11:58.421 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:11:58.484 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:11:58.492 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:11:58.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:11:59.711 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:11:59.814 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:11:59.842 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:11:59.926 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:12:00.304 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:12:00.347 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:00.437 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:00.468 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:12:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:12:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:00.978 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:00.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:12:01.025 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:01.087 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:01.118 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:12:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:01.622 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:01.714 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:01.714 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:01.714 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:01.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:01.757 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:03.494 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:03.531 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:04.083 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:04.203 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:04.203 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:04.203 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:04.235 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:05.286 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:05.286 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-09-10T23:12:05.286 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-09-10T23:12:05.286 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-09-10T23:12:05.287 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-09-10T23:12:05.287 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-09-10T23:12:05.287 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-09-10T23:12:05.287 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-09-10T23:12:05.287 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:05.462 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:05.478 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:05.478 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:06.973 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:07.000 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:07.000 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:07.000 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:07.000 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:07.000 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:07.000 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:07.224 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:07.247 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:07.248 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:07.248 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:07.248 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:07.248 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:07.248 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:07.692 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:07.715 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:07.715 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:07.715 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:07.715 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:07.715 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:07.715 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:07.813 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:07.878 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:07.942 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:08.127 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:08.167 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:08.343 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:08.489 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:08.526 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:08.558 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:08.585 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:08.973 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:09.001 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:09.033 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:09.098 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:09.124 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:12.309 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:12.363 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:13.321 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:13.347 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:13.625 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:13.665 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:13.689 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:13.690 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:13.741 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:13.752 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-10T23:12:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:13.850 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:13.905 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:14.045 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:14.045 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:14.854 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:14.885 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:14.908 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:14.909 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:14.909 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:14.909 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:14.909 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:14.909 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:14.952 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:14.975 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:14.975 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:14.975 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:14.975 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:15.020 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:15.043 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:15.043 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:15.043 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:15.043 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:15.043 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:15.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:15.354 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:15.377 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:15.377 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:15.377 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:15.377 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:15.377 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:15.377 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:15.615 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:15.643 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:15.643 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:15.643 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:15.643 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:15.643 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:15.643 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:15.874 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:15.876 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-10T23:12:15.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:15.899 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:15.899 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:15.899 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:15.899 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:15.899 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:15.899 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:16.062 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:16.062 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:16.366 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:16.391 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:16.391 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:16.391 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:16.391 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:16.391 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:16.392 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:16.505 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:16.563 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:16.821 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:16.875 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:16.956 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:17.053 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:17.205 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:17.243 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:17.274 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:17.301 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:17.574 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:17.601 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:17.601 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:17.601 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:17.601 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:17.751 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:17.783 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:17.816 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:17.824 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:17.848 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:17.848 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:17.848 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:17.848 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:17.848 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:17.848 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:17.885 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:17.914 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:18.315 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:18.315 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:18.315 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:18.315 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:18.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:18.725 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:18.767 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:19.088 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:19.126 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:19.166 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:19.202 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:19.766 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:19.799 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:20.049 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:20.090 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:20.139 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:20.171 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:20.207 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:20.385 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:20.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:20.459 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:20.489 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:20.535 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:21.141 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:21.161 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:21.282 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:21.354 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:21.984 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:22.087 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:22.128 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:22.208 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:22.241 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:22.265 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:22.300 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:22.300 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:22.375 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:22.392 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:22.392 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:22.404 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:22.476 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:22.501 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:22.506 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:22.506 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:22.525 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:22.686 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:22.686 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:22.699 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:22.740 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:22.764 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:22.765 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:22.765 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:22.765 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:22.765 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:22.765 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:22.771 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:22.815 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:22.827 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:22.834 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:22.980 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:23.000 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:23.046 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:24.005 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:24.012 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:24.034 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:24.038 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:24.059 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:24.059 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:24.059 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:24.059 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:24.060 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:24.060 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:24.102 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:24.126 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:24.126 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:24.126 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:24.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:24.177 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:24.202 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:24.202 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:24.202 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:24.202 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:24.202 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:24.203 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:24.317 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:24.373 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:24.373 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:24.373 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:24.373 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:24.424 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:24.436 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:24.534 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:24.545 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:24.570 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:24.588 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:25.585 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:25.610 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:25.610 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:25.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:25.676 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:25.676 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:25.743 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:25.744 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:25.744 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:25.744 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:26.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:26.077 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:26.077 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:26.077 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:26.077 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:26.077 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:26.077 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:12:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:12:29.094 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:12:29.095 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:12:29.096 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:12:29.097 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:12:29.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:12:29.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:12:29.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:12:29.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:12:29.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:12:29.103 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:12:29.104 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:12:29.105 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:12:29.106 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:12:29.106 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:12:29.106 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:12:29.106 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:12:29.106 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:12:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:30.687 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:30.732 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:30.753 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:30.766 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:30.815 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:30.856 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:30.888 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:30.915 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:31.098 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:31.252 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:31.427 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:12:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:12:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:12:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:12:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:12:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:12:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:12:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:12:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:12:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:12:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:12:31.440 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-10T23:12:31.654 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:31.745 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:31.795 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:31.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:31.899 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:31.919 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:31.922 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:31.932 DEBUG:teuthology.parallel:result is None 2024-09-10T23:12:31.948 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:31.974 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:31.974 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:32.058 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:32.058 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:32.125 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:32.151 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:32.156 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:32.156 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:32.344 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:32.344 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:32.428 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:32.505 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:32.837 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:32.878 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:33.050 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:33.117 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:33.117 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:33.403 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:33.403 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:33.487 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:38.822 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:38.822 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:12:38.823 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:12:38.824 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:12:38.836 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:12:38.836 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:12:38.836 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:12:38.836 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:12:38.836 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:12:38.836 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:12:38.837 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:12:38.837 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:12:38.837 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:12:38.837 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:12:38.838 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:12:38.839 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:12:38.840 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:12:38.841 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:12:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:12:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:12:38.844 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:12:38.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:12:38.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:12:38.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:12:38.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:12:38.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:12:38.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:12:38.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:12:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:12:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:12:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:12:39.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:12:39.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:12:39.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:12:39.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:12:39.928 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:12:39.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:12:39.930 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:12:39.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:12:39.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:12:39.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:12:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:12:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:12:39.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:12:39.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:12:41.252 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:12:41.253 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.256 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:12:41.257 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:12:41.258 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:12:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:12:41.260 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:12:41.261 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:12:41.262 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:12:41.263 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:12:41.264 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:12:41.265 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:12:41.265 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:12:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-10T23:12:41.659 DEBUG:teuthology.parallel:result is None 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.363 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.365 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:12:42.366 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.367 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.368 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:12:42.369 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.370 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:12:42.371 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:42.372 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:12:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:12:42.374 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:12:42.375 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:12:42.376 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:12:42.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:12:42.376 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-10T23:12:42.803 DEBUG:teuthology.parallel:result is None 2024-09-10T23:12:42.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:12:42.956 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:12:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:12:42.984 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:12:42.984 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:12:42.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:12:43.130 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:12:43.155 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:12:43.156 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:12:43.156 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:12:43.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:12:43.310 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:12:43.337 INFO:teuthology.orchestra.run.smithi177.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:12:43.338 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:12:43.338 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:12:43.340 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:12:43.340 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:12:43.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:12:43.373 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:12:43.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:12:43.406 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:12:43.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:12:43.438 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:12:43.438 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:12:43.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:12:43.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:12:43.535 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:12:43.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:12:43.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:12:43.635 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:12:43.635 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:12:43.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:12:43.737 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:12:43.738 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:12:43.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:12:43.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:12:43.837 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:12:43.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:12:43.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:12:43.936 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:12:43.936 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:12:43.961 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:12:44.026 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:12:44.026 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:12:44.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:12:44.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:12:44.127 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:12:44.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:12:44.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:12:44.226 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:12:44.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:12:44.252 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:12:44.316 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T23:12:44.415 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T23:12:44.415 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:12:44.416 INFO:tasks.cephadm:Cluster fsid is 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:12:44.416 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T23:12:44.416 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.154', 'mon.c': '172.21.15.177'} 2024-09-10T23:12:44.416 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-09-10T23:12:44.416 INFO:tasks.cephadm:First mgr is x 2024-09-10T23:12:44.417 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T23:12:44.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-10T23:12:44.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-09-10T23:12:44.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname $(hostname -s) 2024-09-10T23:12:44.503 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T23:12:44.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:12:44.650 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T23:12:44.796 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:12:44.797 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:12:44.797 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:12:44.798 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:12 /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.187 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.574 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:12 /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.575 DEBUG:teuthology.orchestra.run.smithi177:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.939 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:12 /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.940 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.960 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:45.979 DEBUG:teuthology.orchestra.run.smithi177:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:12:46.016 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T23:12:46.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:12:46.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:12:46.024 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:12:47.537 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:12:47.561 INFO:teuthology.orchestra.run.smithi177.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:12:47.660 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:20.766 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:13:20.766 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:13:20.766 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:13:20.766 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-10T23:13:20.766 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:13:20.767 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:13:20.767 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:13:27.224 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-10T23:13:27.224 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:13:27.224 INFO:teuthology.orchestra.run.smithi177.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:13:27.224 INFO:teuthology.orchestra.run.smithi177.stdout: "repo_digests": [ 2024-09-10T23:13:27.224 INFO:teuthology.orchestra.run.smithi177.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:13:27.224 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-09-10T23:13:27.225 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-10T23:13:44.246 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T23:13:44.247 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:13:44.247 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:13:44.247 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-09-10T23:13:44.247 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:13:44.247 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-10T23:13:44.247 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T23:13:44.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-10T23:13:44.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-09-10T23:13:44.333 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph 2024-09-10T23:13:44.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-10T23:13:44.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-09-10T23:13:44.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /etc/ceph 2024-09-10T23:13:44.451 INFO:tasks.cephadm:Writing seed config... 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T23:13:44.453 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T23:13:44.454 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T23:13:44.455 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:13:44.455 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T23:13:44.474 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2f953db4-6fca-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-10T23:13:44.475 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T23:13:44.517 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T23:13:44.560 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T23:13:44.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:13:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:13:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-10T23:13:44.781 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T23:13:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-10T23:13:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:13:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-10T23:13:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-10T23:13:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:13:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:13:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:13:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-10T23:13:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-10T23:13:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-10T23:13:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:13:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-10T23:13:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:13:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T23:13:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-10T23:13:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-10T23:13:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:13:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:13:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:13:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-10T23:13:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-10T23:13:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-10T23:13:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:13:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-10T23:13:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:13:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 139750357128048 on /run/cephadm/2f953db4-6fca-11ef-bcea-c7b262605968.lock 2024-09-10T23:13:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 139750357128048 acquired on /run/cephadm/2f953db4-6fca-11ef-bcea-c7b262605968.lock 2024-09-10T23:13:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-10T23:13:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-10T23:13:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-10T23:13:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-10T23:13:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-10T23:13:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T23:13:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T23:13:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1779sec hoplimit 64 pref medium 2024-09-10T23:13:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T23:13:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T23:13:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:13:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T23:13:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-10T23:13:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:13:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-10T23:13:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-10T23:13:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T23:13:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T23:13:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:13:48.031 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T23:13:56.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:13:56.806 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:13:56.806 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T23:13:57.786 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-10T23:13:57.786 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-10T23:13:58.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQC20uBmw10lBhAA9ZLdRzzy+lO1ntzKGu4piA== 2024-09-10T23:13:59.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQC20uBmelMdOhAAIBZ8ZTAklD+KdCPqIg40yw== 2024-09-10T23:14:00.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQC30uBmCY+cNBAAWMmEP2nUguWBpYuGacRuUQ== 2024-09-10T23:14:00.487 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-10T23:14:01.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:14:01.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T23:14:01.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:01.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:14:01.436 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:14:01.436 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-10T23:14:01.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:01.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:14:01.436 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:14:01.436 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-10T23:14:02.467 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-09-10T23:14:02.688 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T23:14:02.874 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T23:14:03.060 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2f953db4-6fca-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-2f953db4-6fca-11ef-bcea-c7b262605968.target. 2024-09-10T23:14:03.060 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2f953db4-6fca-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-2f953db4-6fca-11ef-bcea-c7b262605968.target. 2024-09-10T23:14:03.332 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:14:03.332 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T23:14:03.522 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2f953db4-6fca-11ef-bcea-c7b262605968.target.wants/ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-2f953db4-6fca-11ef-bcea-c7b262605968@.service. 2024-09-10T23:14:04.032 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:14:04.032 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-10T23:14:04.039 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:14:04.039 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-10T23:14:04.040 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-10T23:14:04.040 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:14:04.040 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-10T23:14:04.040 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-10T23:14:05.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:04 smithi002 ceph-mon[30783]: from='client.? 172.21.15.2:0/159285359' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T23:14:05.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T23:14:05.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:05.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T23:14:05.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:05.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.539638s) 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-10T23:14:05.070 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T23:14:06.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:06.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:14:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-10T23:14:06.172 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:05 smithi002 ceph-mon[30783]: from='client.? 172.21.15.2:0/698671353' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:14:06.172 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:05 smithi002 ceph-mon[30783]: from='client.? 172.21.15.2:0/698671353' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T23:14:07.022 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-10T23:14:07.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:06 smithi002 ceph-mon[30783]: from='client.? 172.21.15.2:0/1977902325' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:14:07.306 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:07 smithi002 systemd[1]: Stopping Ceph mon.a for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:14:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a[30779]: 2024-09-10T23:14:07.304+0000 7f778f6e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:14:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a[30779]: 2024-09-10T23:14:07.304+0000 7f778f6e0640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T23:14:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:07 smithi002 podman[31025]: 2024-09-10 23:14:07.500266866 +0000 UTC m=+0.309242201 container died ca7d1722a2e16147399d1ca0ea709d50e50be1fcb284dfc8308afcd75d602372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:14:08.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:07 smithi002 podman[31025]: 2024-09-10 23:14:07.854902417 +0000 UTC m=+0.663877751 container cleanup ca7d1722a2e16147399d1ca0ea709d50e50be1fcb284dfc8308afcd75d602372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:14:08.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:07 smithi002 bash[31025]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:14:08.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 podman[31037]: 2024-09-10 23:14:08.122497244 +0000 UTC m=+0.623777643 container remove ca7d1722a2e16147399d1ca0ea709d50e50be1fcb284dfc8308afcd75d602372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:14:08.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T23:14:08.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 systemd[1]: Stopped Ceph mon.a for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:08.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 systemd[1]: Starting Ceph mon.a for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 podman[31130]: 2024-09-10 23:14:08.481563652 +0000 UTC m=+0.097574610 container create 45da16428b40e06b27d2c291add3a9a32a8545fe0bbecae83efd05ae6c599f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 podman[31130]: 2024-09-10 23:14:08.400221252 +0000 UTC m=+0.016232202 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 podman[31130]: 2024-09-10 23:14:08.659092993 +0000 UTC m=+0.275103952 container init 45da16428b40e06b27d2c291add3a9a32a8545fe0bbecae83efd05ae6c599f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 podman[31130]: 2024-09-10 23:14:08.662251896 +0000 UTC m=+0.278262855 container start 45da16428b40e06b27d2c291add3a9a32a8545fe0bbecae83efd05ae6c599f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: pidfile_write: ignore empty --pid-file 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: load: jerasure load: lrc 2024-09-10T23:14:08.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Git sha 0 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: DB SUMMARY 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: DB Session ID: G27BGZW0JLZZ34Z8X6EZ 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95086 ; 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:14:08.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.env: 0x55e45628c180 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.info_log: 0x55e458913700 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.statistics: (nil) 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.use_fsync: 0 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:14:08.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.db_log_dir: 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.wal_dir: 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:14:08.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.write_buffer_manager: 0x55e458917b80 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:14:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.unordered_write: 0 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:14:08.741 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.row_cache: None 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.wal_filter: None 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.wal_compression: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:14:08.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_open_files: -1 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Compression algorithms supported: 2024-09-10T23:14:08.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kZSTD supported: 0 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:14:08.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.merge_operator: 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_filter: None 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e458913320) 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-09-10T23:14:08.746 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x55e458907610 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-09-10T23:14:08.747 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-09-10T23:14:08.748 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression: NoCompression 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.num_levels: 7 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:14:08.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:14:08.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:14:08.751 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:14:08.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:14:08.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:14:08.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.ttl: 2592000 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:14:08.755 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 850fb240-8b01-4312-a24d-ee5085a0379f 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010048689271, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010048690211, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91239, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89287, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11686, "raw_average_key_size": 47, "raw_value_size": 82707, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726010048, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "850fb240-8b01-4312-a24d-ee5085a0379f", "db_session_id": "G27BGZW0JLZZ34Z8X6EZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010048690308, "job": 1, "event": "recovery_finished"} 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e458936e00 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: DB pointer 0x55e458a38000 2024-09-10T23:14:08.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-10T23:14:08.757 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 90.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 90.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:14:08.758 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 27.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 27.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x55e458907610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-10T23:14:08.759 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???) e1 preinit fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).mds e1 new map 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).mds e1 print_map 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-09-10T23:14:03:974933+0000 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:14:08.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:14:08.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:14:08.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:14:08.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T23:14:08.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 bash[31130]: 45da16428b40e06b27d2c291add3a9a32a8545fe0bbecae83efd05ae6c599f7d 2024-09-10T23:14:08.761 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 systemd[1]: Started Ceph mon.a for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: monmap epoch 1 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: last_changed 2024-09-10T23:14:00.802094+0000 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: created 2024-09-10T23:14:00.802094+0000 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: election_strategy: 1 2024-09-10T23:14:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T23:14:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: fsmap 2024-09-10T23:14:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:14:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:08 smithi002 ceph-mon[31150]: mgrmap e1: no daemons active 2024-09-10T23:14:09.852 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T23:14:09.873 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:14:09.874 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-10T23:14:09.874 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T23:14:09.874 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T23:14:10.136 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:14:10.136 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T23:14:10.299 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2f953db4-6fca-11ef-bcea-c7b262605968.target.wants/ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-2f953db4-6fca-11ef-bcea-c7b262605968@.service. 2024-09-10T23:14:10.532 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/435196028' entity='client.admin' 2024-09-10T23:14:10.533 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 systemd[1]: Starting Ceph mgr.x for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:14:10.811 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 podman[31365]: 2024-09-10 23:14:10.434552573 +0000 UTC m=+0.016124218 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:14:10.811 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 podman[31365]: 2024-09-10 23:14:10.533909411 +0000 UTC m=+0.115481046 container create 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T23:14:10.811 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 podman[31365]: 2024-09-10 23:14:10.736243992 +0000 UTC m=+0.317815627 container init 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:14:10.812 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 podman[31365]: 2024-09-10 23:14:10.738915186 +0000 UTC m=+0.320486822 container start 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:14:10.812 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 bash[31365]: 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 2024-09-10T23:14:10.825 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:14:10.825 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-10T23:14:10.834 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:14:10.834 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-10T23:14:10.834 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-10T23:14:10.834 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:14:10.844 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:14:10.844 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-10T23:14:10.852 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:14:10.852 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-10T23:14:10.852 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-10T23:14:10.852 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T23:14:10.852 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-10T23:14:10.852 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-10T23:14:11.101 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:10 smithi002 systemd[1]: Started Ceph mgr.x for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:11.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2005984463' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:14:11.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:14:11.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:14:11.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:11.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:14:11.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:14:11.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:14:11.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:14:11.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:14:11.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:14:11.978 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:14:03:974933+0000", 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:14:11.979 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:14:03.975587+0000", 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:11.980 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-10T23:14:14.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:14 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2091857324' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:14:14.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:14.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:14.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:14:14.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:14:14.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:14:14.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:14:14.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:14:14.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:14.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:14:14.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:14:14.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:14:14.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:14.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:14:14.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:14:14.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:14.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T23:14:15.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:14:15.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:15.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:14:15.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:14:15.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:14:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:14:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:14:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:14:15.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:14:15.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:14:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:14:03:974933+0000", 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:14:15.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:14:03.975587+0000", 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:15.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:14:15.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:15.006 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-10T23:14:16.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: Activating manager daemon x 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: mgrmap e2: x(active, starting, since 0.00305617s) 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: Manager daemon x is now available 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:14:16.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' 2024-09-10T23:14:16.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' 2024-09-10T23:14:16.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:16 smithi002 ceph-mon[31150]: from='mgr.14100 172.21.15.2:0/3470419199' entity='mgr.x' 2024-09-10T23:14:18.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:18 smithi002 ceph-mon[31150]: mgrmap e3: x(active, since 1.00769s) 2024-09-10T23:14:18.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:18 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3023119489' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:14:18.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:18.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:18.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:14:18.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:14:18.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:14:18.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:14:18.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:14:18.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:14:18.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:14:18.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:14:18.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:14:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:14:03:974933+0000", 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:14:18.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:14:03.975587+0000", 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:18.269 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-10T23:14:19.195 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:19 smithi002 ceph-mon[31150]: mgrmap e4: x(active, since 2s) 2024-09-10T23:14:19.195 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:19 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1546384890' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:14:19.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:19.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:14:19.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:19.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:14:19.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-10T23:14:19.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:14:19.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:14:19.477 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-10T23:14:20.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2627163210' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T23:14:20.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:20 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: ignoring --setuser ceph since I am not root 2024-09-10T23:14:20.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:20 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: ignoring --setgroup ceph since I am not root 2024-09-10T23:14:21.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:21 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2627163210' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T23:14:21.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:21 smithi002 ceph-mon[31150]: mgrmap e5: x(active, since 4s) 2024-09-10T23:14:22.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:22.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T23:14:22.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:14:22.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:14:22.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:14:22.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:22.154 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-10T23:14:22.154 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-10T23:14:22.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:22 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/730580467' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:14:25.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: Active manager daemon x restarted 2024-09-10T23:14:25.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: Activating manager daemon x 2024-09-10T23:14:25.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T23:14:25.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: mgrmap e6: x(active, starting, since 0.0032678s) 2024-09-10T23:14:25.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:14:25.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:14:25.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:14:25.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:14:25.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:14:25.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:25 smithi002 ceph-mon[31150]: Manager daemon x is now available 2024-09-10T23:14:27.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:27.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T23:14:27.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:14:27.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:27.000 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-10T23:14:27.000 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: Found migration_current of "None". Setting to last migration. 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:27.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:27.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:14:27.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:14:27.343 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-mon[31150]: mgrmap e7: x(active, since 1.00568s) 2024-09-10T23:14:27.987 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:14:27.812+0000 7fdd60fdf640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:14:27] ENGINE Error in HTTPServer.serve 2024-09-10T23:14:27.987 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: Traceback (most recent call last): 2024-09-10T23:14:27.987 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:14:27.987 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self._connections.run(self.expiration_interval) 2024-09-10T23:14:27.987 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self._run(expiration_interval) 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: s = self.context.wrap_socket( 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: return self.sslsocket_class._create( 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self.do_handshake() 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:14:27.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self._sslobj.do_handshake() 2024-09-10T23:14:27.989 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:14:27.989 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:14:28.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:28 smithi002 ceph-mon[31150]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:14:28.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:28 smithi002 ceph-mon[31150]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:14:28.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:28 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:28.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:28 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:28.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:28 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:27] ENGINE Bus STARTING 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:27] ENGINE Serving on http://172.21.15.2:8765 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:27] ENGINE Serving on https://172.21.15.2:7150 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:27] ENGINE Bus STARTED 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:27] ENGINE Error in HTTPServer.serve 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:14:29.326 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:14:29.327 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-10T23:14:29.328 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:14:29.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:29 smithi002 ceph-mon[31150]: mgrmap e8: x(active, since 2s) 2024-09-10T23:14:29.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T23:14:29.604 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-10T23:14:30.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-mon[31150]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: Generating public/private rsa key pair. 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: Your identification has been saved in /tmp/tmpvqm9lnhb/key 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: Your public key has been saved in /tmp/tmpvqm9lnhb/key.pub 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: The key fingerprint is: 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: SHA256:0XTBhnSCT5XYDGMHz4SU/nC8LU+jIj/uJpOh31+v0gU ceph-2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: The key's randomart image is: 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: +---[RSA 3072]----+ 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | +X%Bo | 2024-09-10T23:14:30.487 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | .+*X* | 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | .+.oo | 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | .+ o E | 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | S + o . | 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | . + + .| 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | . o *.o | 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | . =.+ o.o. | 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: | ..O=+.....| 2024-09-10T23:14:30.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: +----[SHA256]-----+ 2024-09-10T23:14:31.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:31 smithi002 ceph-mon[31150]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:31.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:31 smithi002 ceph-mon[31150]: Generating ssh key... 2024-09-10T23:14:31.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:31 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:31.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:31 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:32.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:32.050 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:14:32.050 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T23:14:32.056 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-10T23:14:32.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:32 smithi002 ceph-mon[31150]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:33.411 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:33 smithi002 ceph-mon[31150]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:34.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:34 smithi002 ceph-mon[31150]: Deploying cephadm binary to smithi002 2024-09-10T23:14:37.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-10T23:14:37.208 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-09-10T23:14:37.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:37 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:37.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:37 smithi002 ceph-mon[31150]: Added host smithi002 2024-09-10T23:14:37.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:37 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:38.626 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T23:14:38.626 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-09-10T23:14:39.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:38 smithi002 ceph-mon[31150]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:39.188 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:38 smithi002 ceph-mon[31150]: Saving service mon spec with placement count:5 2024-09-10T23:14:39.188 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:38 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:40.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:40 smithi002 ceph-mon[31150]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:40.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:40 smithi002 ceph-mon[31150]: Saving service mgr spec with placement count:2 2024-09-10T23:14:40.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:40 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:40.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:40 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T23:14:41.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:41 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:41.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:41 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1190156747' entity='client.admin' 2024-09-10T23:14:42.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:42 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-10T23:14:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:43 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2111320819' entity='client.admin' 2024-09-10T23:14:44.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:43 smithi002 ceph-mon[31150]: from='mgr.14118 172.21.15.2:0/4200837320' entity='mgr.x' 2024-09-10T23:14:45.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:44 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/688713524' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T23:14:45.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: ignoring --setuser ceph since I am not root 2024-09-10T23:14:45.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: ignoring --setgroup ceph since I am not root 2024-09-10T23:14:45.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:45 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/688713524' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T23:14:45.950 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:45 smithi002 ceph-mon[31150]: mgrmap e9: x(active, since 19s) 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-10T23:14:46.883 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-10T23:14:47.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:46 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2464853799' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: Active manager daemon x restarted 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: Activating manager daemon x 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: mgrmap e10: x(active, starting, since 0.00374559s) 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:14:50.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:14:50.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:50 smithi002 ceph-mon[31150]: Manager daemon x is now available 2024-09-10T23:14:51.426 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:51.426 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:14:51.426 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:14:51.426 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:51 smithi002 ceph-mon[31150]: mgrmap e11: x(active, since 1.00653s) 2024-09-10T23:14:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T23:14:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:14:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-10T23:14:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T23:14:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-mon[31150]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:14:52.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-mon[31150]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:14:52.666 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:14:52.377+0000 7fc25a033640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:14:52] ENGINE Error in HTTPServer.serve 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: Traceback (most recent call last): 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self._connections.run(self.expiration_interval) 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self._run(expiration_interval) 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:14:52.667 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: s = self.context.wrap_socket( 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: return self.sslsocket_class._create( 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self.do_handshake() 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: self._sslobj.do_handshake() 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:14:52.668 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:14:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: mgrmap e12: x(active, since 2s) 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:52] ENGINE Bus STARTING 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:52] ENGINE Serving on https://172.21.15.2:7150 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:52] ENGINE Error in HTTPServer.serve 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:14:53.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:52] ENGINE Serving on http://172.21.15.2:8765 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: [10/Sep/2024:23:14:52] ENGINE Bus STARTED 2024-09-10T23:14:53.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:14:54.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:54 smithi002 ceph-mon[31150]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:54.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:54 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:14:55.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUXvD64K9/dvIODFfzkkFVFviE4M0wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIzMTQ1NFoXDTM0\nMDkxMTIzMTQ1NFowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjIwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCmOL0z1Pjc/O5MCFYUFrj821Nr+M7g9ekMMVG5\n6jHZRSClcF0Jl/1+8Rp24u39sAmS4mnl1mG1MGqlLwNfGuwHKHvxTraNIsWA9adI\nrZSabZLsYHzupGhf+BhSiG7dddKB+5ESV6WXXuRjtmwH0lnMfpvs1Fy3ftbOrmLf\npOhLxxwbwU0uB8XFCObOipduPC+65gEWi5fm6H9EziFQ6/VRXRo4oHETWblci1al\nyoVyyvlA3YsXP+O1rvXZgOQwf2nl6LmXdhzLPXfVIGFdjHJ/SMy5B6kibnuOMrQB\ny/En0xewhWKFb7Fp9ooMyqzWDhsCr6BEn+2+WCECXjTIGQ93QrYJM7xfTgaShvl3\nJB58i3WDwrxj79yZfBlIlwlrufddV50fX6BBIKE21NYyhl1OjzgEcxWaD8xH/BkH\n+RPciToaFm6G9PDmXCzfvmttN3T7qQwVgRLDSdTlnhet+FVBua4vAhveUKLTM6Ay\nMu6eiR8Xsdya15ZvLXw3rVjOaY+SFYY8RNiqV0S6uXpw583kL+549TY9YBmyDY1w\nJxvtVfAZJNuSTsn+r3zpSrVUiAmKonpNRTkFou28O3QJ4chqv/HK0ATPe36/8mYO\nXrm+7pZ6i3gqde0uFx05NyZnmt+nf/VaExO8eWlg6AnBEO8M1k0aMQu5okpqQr5s\n1OoeNwIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDKCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8CMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBADoo\n2gHBs72oPBr0xjtbu9ECLyXXvEJyHLE3lFhqS1hY8zH5s8Nw+zk8m74568Ibir0k\n/F2v19wSc1G5V7FkR7RFhY92YAlZVZ2W0QfrWM+W13zXS2aKW1ZeUNBYBhTxxqog\nXnFrme7o/3Rx/WWuEoNH8sLx/xD2LCRGyTXR6j4XnT09GzjJbv/ShzL+sSgTVHhP\n+LKgZHGrG4XTFhCm9b5DJadWWnbd/Pc8/0gH8yzNvm/10AULapJmOtREuy2ysYek\novEj4NwNeztymIh+7b/icextyDIfPAKD/8EkRFgmTGWUj7oOpcOMagjG7600UN9f\n7iC2SH4VPdMZ5UC/rIZ5CnKzBdL7opYlp6yCeCezZhDnPFiXC4Cz0TyWdxzYfwrL\nwHbyJuebEgTJ3AZXvDiNHTE0mY8pC+ZfySZUHFSFokp9dqOnhuLLIMT1YhQ9dS9t\nnGao+4ia/uwHiBLNa+OXUiuce0OEYBAW7dsztnxtcNyIcw9IpYgmEWv3jJJcrpN/\nnuFazm14zRkiHHKgTQ05ZxAQ0FvvtQkJN0eiG8dc0tdWZGKNZIGVidwpgb/Yi7cu\nawEkKs+o5URDDvvxvGGRZ604gsMLB6LmyXZCP8O/VUtNE/ayJ8F0fBdqm1czsjoG\nVlcwn4XNa3NbX8N5zoAxBCWiEZFEG7+oBXKJiztU\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKgIBAAKCAgEApji9M9T43PzuTAhWFBa4/NtTa/jO4PXpDDFRueox2UUgpXBd\nCZf9fvEaduLt/bAJkuJp5dZhtTBqpS8DXxrsByh78U62jSLFgPWnSK2Umm2S7GB8\n7qRoX/gYUohu3XXSgfuRElell17kY7ZsB9JZzH6b7NRct37Wzq5i36ToS8ccG8FN\nLgfFxQjmzoqXbjwvuuYBFouX5uh/RM4hUOv1UV0aOKBxE1m5XItWpcqFcsr5QN2L\nFz/jta712YDkMH9p5ei5l3Ycyz131SBhXYxyf0jMuQepIm57jjK0AcvxJ9MXsIVi\nhW+xafaKDMqs1g4bAq+gRJ/tvlghAl40yBkPd0K2CTO8X04Gkob5dyQefIt1g8K8\nY+/cmXwZSJcJa7n3XVedH1+gQSChNtTWMoZdTo84BHMVmg/MR/wZB/kT3Ik6GhZu\nhvTw5lws375rbTd0+6kMFYESw0nU5Z4XrfhVQbmuLwIb3lCi0zOgMjLunokfF7Hc\nmteWby18N61YzmmPkhWGPETYqldEurl6cOfN5C/uePU2PWAZsg2NcCcb7VXwGSTb\nkk7J/q986Uq1VIgJiqJ6TUU5BaLtvDt0CeHIar/xytAEz3t+v/JmDl65vu6Weot4\nKnXtLhcdOTcmZ5rfp3/1WhMTvHlpYOgJwRDvDNZNGjELuaJKakK+bNTqHjcCAwEA\nAQKCAgAK3gFwrBHWe4AmNGf8SZKv5V7024AbBmNwH/ap4v0oqUj9x/TX4GSlsfml\noCcobiPnbdS36WYwmbO/N5hO1XcXmLanC3Bf6yVieFexfA0PyO4myhV2PLAeO3LL\noo6CUruqh9nviw9mcBZvy8i6/Nj7ck5GE4mO7Zn5n+kS72Md4Syd8UCsgRGVqi6n\nfjlxmY8SobWcgGUz/CtQl5wSAFCPkI4FpGeqzjOSMKyU4O1h7ec8gxTJi6xwKmTP\nDYrdqNbcPco0dCJkdJEAZsI22Cx8Kd7zPI766KI8pQ/5C25UHjbu8X7Zc83zkYzA\n/VcuFMoAnkl/cxKbXoOkoKgZakSvz4aI9baQti82+62LfjCuoP+8J6fT025go+6b\nlCgWHWyTkSSrjQ3Xvol1zzc0oeSrQ3w6iwqhKKbTD6kCpIWH/gbRWFrqo3XE1UR2\nlU11pVqEcxX2TgHMhwylWlqBbJWDnMEaUxkgER6woiQmRKov7iQrJgQkkUOqAGI/\nZ1AW3Db4C2AA/fZ2Ltix7M1BY3rxMk20I4SbOUsGPied0MHVbL/b/JUZlZxfyRfl\nvHTB9Jhrg9C8a4qv1aIUh32JJpwaYBB3+S4S4y+iMvoa+R7ZRkOFufNjfb9gSbgH\n4BdAMk+WNtFOcRx28j4KYdihQZiKqPKOz3iv1vNp7WosG/Nk0QKCAQEA6a1b/qf/\nvt6WmSE+IpW+t6/iI3jUGZxsH1qy+bSlENcCfi7PdWptCYRg2TQMqM+dUOpTQXpT\nYaVAry55IrJQhnBkJVVqJECrxtB2OgqCnda2CS5ljLJUcx81l32eTikDJyPMmIKW\n6u+nT4E2yYFVMs727h5wkL+ucpGdl2977njKlb6cjSTLwoRO+tK/BErYgsr0Hlcw\nhqELBd4bOs910rGO1PNurHEyG/95FHi7qvSeDvE+Ly50OG2cR60iO9F48JY0Oelk\nMDPcV5xN9tT5M4MQW9cYyOD6Vxw28WfcoWQW8zrOfw2GHbjHmrNlajiA4xZwqQNd\nF/SQ80RYC11NiwKCAQEAthm8SfCokPP5NP4nBI0IxSv4aZx/bjy/U/Ja+eF8cXCY\nzgZZXx0LjbM4fKDXsHcype/OeVp/Uw7Juyq1is82ozj1he86yUFb5pSfvg19z2vl\ndDmyG3xIjKG/YYvvIveI9mV5s8JGqmeVy2DhJ1u5kGHQ4/gqWhqNBoCpXhPQA1MR\nw+O5LBWbvpo3PIh+vYhDU6mG6tKJ2SNHzQ+HFsfQx/UWBClBJaKvA0cEpPrZjK2s\nUDRSgUhOFLUhpp5bgsIHWV1rEi5LodD12d0c5u2r0DgFXO5gWxnxKkvgm29rX8i6\nRPrrB80rZudANGv18l20xLyNSezCX1yHKtNVTscfhQKCAQEA0CTjNMpgO5v5eRzr\nQ9Mutl+shvwxsT5r8OHRWitWfNGIHu2DTYsm5LtNqSt7u0JzVofi8QgNDYUtQN2c\neRNsNtQV4Etc6D3SxJ0bMkf6YK3IKBVzzwdpwcGi8vWp9OUDMfHpZE+uLkaaOW9X\nZdYWFdPUj/X9PnH+6X5baXCca6acjRXkTLTh6rn/v9vI2gHxKU+ucvgm+USplOhq\nSNBSmwIdwAG2K1QI1neRWnLQd069G4I3ab9vNnQsKIxHWhEUMPkaPBtwap9HPaK0\nr5C1CPVNtQC7yvLbCozPQ+jH1dpZtv5CwVlChWb6JQp2407BP4XVhDbCzXvDQW03\nH6hUUQKCAQEAhiI60XQVloA/pss2zmFcfnA/EPwX2YmhnSI95SY01hKMW+XNWwQ4\nCG5lQ1fuyKtkgVo9CqKgevu/mMCC7PZpVp2ULM3kzW35VcVQTVv+uhTN9WiySxCn\nF//kyuOaiHUxS92/YavPBaI7co2wC5/C9hk3F1UrTSeVjZ6kIwoRBQHhahuJwHFC\nQYmy+kHIqa9/eFa9bKccpvcX4nJ3nU4d+cwMJZCFzkUhCRb80tF8AeXDsWh5BYXP\nDe3GFcc7vPtTEn5/aer0BwO2tH3s1iVnk35QZP2puDFJtVAi6BuQSgO/QSRaj2qP\nd8MLRhHoHljr2KbSpAtjuX6cie0VP2vpSQKCAQEAid60BSHEZYLxU9fNLxz4LEgz\n/ucWHlR2/aBZnHlQ1eS0Htm7i0x3UZ3czYqPdat0ggFxYqgN73sl5IR3oJsf6ajd\nPzlR16fFMQ1kVnJ68tngjM91bcdHqrSjfhn9vWjcgcR9JxUcSdCyZtbxSYJwFUrH\n1CUNBj42PYsRL0zDA9gGF5tbqlLaBLL+qkca9uLiBsrgtzYT3Ng5vB5+Ia57zcPD\nEjWw5C2D2k09a1erfkPDjOgv20eB9KRNgg8LPThglwkIR4t/0csIH5EC5IOEfSVZ\nZkEnz6Qd9YQSzIAHyoSiHBzPNgG4tKm/aAmM0mdmBKEkMax5ybPiC/weLCdjXg==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T23:14:56.384 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T23:14:56.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:56 smithi002 ceph-mon[31150]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:56.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:14:57.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T23:14:57.708 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-10T23:14:58.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:58 smithi002 ceph-mon[31150]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:58.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:14:59.105 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0H.4bq0JBNXi6rBJysObA.Ti8I9u1tcBe1XhVP3bwnLBzr46DiNS6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726010098, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T23:14:59.105 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-10T23:14:59.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:59 smithi002 ceph-mon[31150]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:14:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:00.228 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T23:15:00.238 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:15:00.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-10T23:15:00.246 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:15:00.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-10T23:15:00.246 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-10T23:15:00.246 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout: Password: diu37wg3du 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:00.248 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config directory 2024-09-10T23:15:00.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:00 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2414397213' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.577 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-10T23:15:01.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.578 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-10T23:15:01.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.578 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T23:15:01.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:01.578 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-10T23:15:01.622 INFO:tasks.cephadm:Fetching config... 2024-09-10T23:15:01.623 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:15:01.623 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T23:15:01.640 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T23:15:01.640 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:15:01.640 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T23:15:01.697 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T23:15:01.697 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:15:01.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T23:15:01.762 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T23:15:01.762 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:15:01.762 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T23:15:01.818 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T23:15:01.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:15:01.897 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:01.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:15:01.950 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:01.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:15:02.004 INFO:teuthology.orchestra.run.smithi177.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfpxBi3CrGPIglnpoQyEDKXKxCqJaUlvEj8xu5xZWXnW9GmP4qZrZk1oUDNxME6uJC/gea1cD8osQmrrFPuRs4iDekQQU8yI+hki+KxDvYm4/XJHeRPMVj4plNWYms8kvPFDpRi+LCuPW6RaUEqS7C+Djonw/XtRq9A0irqXvdKMzaUuW8J9qUiZ9QXF4aR3mUGIfLFbIxE2Ke0SnvBllDUTfmYZ8IfhoB+5ev0CB0k2TD+T9qXfv5hKqRqffT8N0FJMaqlgnWRvAKfzXyGRiRpBdUCJUwopvAqfGH3+4KSZ5MqULcBr2jAw2/QWmzD61bEj8WGNwKkxaLBsvDqRIojm5zr5i80+TzBcCiTZhVmovCbxwmC8+LnfKc1uvlJMCwWsSOFtF5TBlAwFu1gs6GXIJJWaMaAli7hy1aCiFiNr3Frexg05VE5voTGEseJkbAvrS+xo9yqwNLYQ3O/e4ji2uFPFivLHslA8+lGBxRgBAKhQ6CuU9RSIkfwmmtry0= ceph-2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:02.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T23:15:02.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:02 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3023415226' entity='client.admin' 2024-09-10T23:15:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:03.565 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T23:15:03.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T23:15:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:03 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/586311651' entity='client.admin' 2024-09-10T23:15:04.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:03 smithi002 ceph-mon[31150]: mgrmap e13: x(active, since 12s) 2024-09-10T23:15:04.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:04.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:04.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:04.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:05.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:04 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:05.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:04 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-10T23:15:06.430 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: Updating smithi002:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:06.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:06.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: Updating smithi002:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:06.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:06.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:06.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:06.458 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-09-10T23:15:06.458 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:15:06.458 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:06.478 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:15:06.478 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:06.537 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-09-10T23:15:06.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch host add smithi154 2024-09-10T23:15:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:07 smithi002 ceph-mon[31150]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:09.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:08 smithi002 ceph-mon[31150]: Deploying cephadm binary to smithi154 2024-09-10T23:15:11.325 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-09-10T23:15:11.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:11 smithi002 ceph-mon[31150]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:11.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:15:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:12.577 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:12.577 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:12 smithi002 ceph-mon[31150]: Added host smithi154 2024-09-10T23:15:12.577 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:12.577 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:12.577 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:12.857 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-09-10T23:15:13.457 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi177 2024-09-10T23:15:13.457 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:15:13.457 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:13.473 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:15:13.474 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:13.529 INFO:tasks.cephadm:Adding host smithi177 to orchestrator... 2024-09-10T23:15:13.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch host add smithi177 2024-09-10T23:15:13.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:13 smithi002 ceph-mon[31150]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:13.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:13 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:13.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:13 smithi002 ceph-mon[31150]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:13.786 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi177", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:15.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:15.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:15.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:16.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:16 smithi002 ceph-mon[31150]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T23:15:16.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:16 smithi002 ceph-mon[31150]: Deploying cephadm binary to smithi177 2024-09-10T23:15:16.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:16 smithi002 ceph-mon[31150]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:16.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:16.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:16.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:17.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:17 smithi002 ceph-mon[31150]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:17.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:17 smithi002 ceph-mon[31150]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:17.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:17 smithi002 ceph-mon[31150]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:18.374 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi177' with addr '172.21.15.177' 2024-09-10T23:15:18.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:15:19.213 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:19.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:19 smithi002 ceph-mon[31150]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:19.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:19.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:19 smithi002 ceph-mon[31150]: Added host smithi177 2024-09-10T23:15:19.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:19.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:19.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:19.885 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:15:19.886 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}, {"addr": "172.21.15.177", "hostname": "smithi177", "labels": [], "status": ""}] 2024-09-10T23:15:20.486 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T23:15:20.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T23:15:20.740 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:20.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:20 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:20.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:20 smithi002 ceph-mon[31150]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-10T23:15:21.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:21 smithi002 ceph-mon[31150]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:21 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2999446898' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:15:22.347 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-09-10T23:15:22.347 INFO:tasks.cephadm:Adding mon.b on smithi154 2024-09-10T23:15:22.348 INFO:tasks.cephadm:Adding mon.c on smithi177 2024-09-10T23:15:22.348 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi154:172.21.15.154=b;smithi177:172.21.15.177=c' 2024-09-10T23:15:22.588 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:15:22.631 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2999446898' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:23.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:23.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:22 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:23.335 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mon update... 2024-09-10T23:15:23.986 DEBUG:teuthology.orchestra.run.smithi154:mon.b> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T23:15:23.989 DEBUG:teuthology.orchestra.run.smithi177:mon.c> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T23:15:23.991 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:23.991 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:24.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:24.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:24.722 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:24 smithi002 ceph-mon[31150]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:24 smithi002 ceph-mon[31150]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:24 smithi002 ceph-mon[31150]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi154:172.21.15.154=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:24 smithi002 ceph-mon[31150]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi154:172.21.15.154=b;smithi177:172.21.15.177=c;count:3 2024-09-10T23:15:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:24 smithi002 ceph-mon[31150]: Deploying daemon mon.c on smithi177 2024-09-10T23:15:26.067 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:15:26.067 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":1,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:14:00.802094Z","created":"2024-09-10T23:14:00.802094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:15:26.067 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 1 2024-09-10T23:15:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:25 smithi002 ceph-mon[31150]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:27.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:26 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/1846904501' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:27.771 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:27.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:28.176 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:15:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:27 smithi002 ceph-mon[31150]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:28.875 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:15:28.875 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":1,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:14:00.802094Z","created":"2024-09-10T23:14:00.802094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:15:28.876 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 1 2024-09-10T23:15:30.609 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:30.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:30.882 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:15:34.418 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: mon.a calling monitor election 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: mon.c calling monitor election 2024-09-10T23:15:34.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: monmap epoch 2 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: last_changed 2024-09-10T23:15:28.965524+0000 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: created 2024-09-10T23:14:00.802094+0000 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: election_strategy: 1 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T23:15:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: fsmap 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: mgrmap e13: x(active, since 43s) 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: overall HEALTH_OK 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:34.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:34.525 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:15:34.525 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:15:28.965524Z","created":"2024-09-10T23:14:00.802094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:15:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 2 2024-09-10T23:15:35.085 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:35 smithi177 ceph-mon[35760]: Deploying daemon mon.b on smithi154 2024-09-10T23:15:35.085 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:35 smithi177 ceph-mon[35760]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:35.085 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:35 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/3390970211' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:35.085 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:35.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:35 smithi002 ceph-mon[31150]: Deploying daemon mon.b on smithi154 2024-09-10T23:15:35.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:35 smithi002 ceph-mon[31150]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:35.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:35 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/3390970211' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:35.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:36.114 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:36.115 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:36.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:15:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:15:35.964+0000 7fc28da28640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T23:15:36.367 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:15:37.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:15:37.044 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:15:28.965524Z","created":"2024-09-10T23:14:00.802094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:15:37.044 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 2 2024-09-10T23:15:37.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:37 smithi177 ceph-mon[35760]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:37.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:37 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/2769767196' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:37.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:37 smithi002 ceph-mon[31150]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:37.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:37 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/2769767196' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:37.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:15:37.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.wal_compression: 0 2024-09-10T23:15:37.688 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:15:37.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:15:37.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:15:37.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:15:37.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:15:37.689 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:15:37.690 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_open_files: -1 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:15:37.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Compression algorithms supported: 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kZSTD supported: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:15:37.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.merge_operator: 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_filter: None 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:15:37.693 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c446d39320) 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_type: 0 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: data_block_index_type: 0 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_shortening: 1 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: checksum: 4 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: no_block_cache: 0 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache: 0x55c446d2d610 2024-09-10T23:15:37.694 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_options: 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: capacity : 536870912 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: num_shard_bits : 4 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: strict_capacity_limit : 0 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_compressed: (nil) 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: persistent_cache: (nil) 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_size: 4096 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_size_deviation: 10 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_restart_interval: 16 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_block_restart_interval: 1 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: metadata_block_size: 4096 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: partition_filters: 0 2024-09-10T23:15:37.695 INFO:journalctl@ceph.mon.b.smithi154.stdout: use_delta_encoding: 1 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: filter_policy: bloomfilter 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: whole_key_filtering: 1 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: verify_compression: 0 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: format_version: 5 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: enable_index_compression: 1 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_align: 0 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: max_auto_readahead_size: 262144 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: prepopulate_block_cache: 0 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:15:37.696 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression: NoCompression 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.num_levels: 7 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:15:37.698 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:15:37.699 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:15:37.700 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:15:37.701 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:15:37.702 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:15:37.703 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.ttl: 2592000 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:15:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 83c48ed4-1358-4287-94fa-eaabf19d0299 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010137687051, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010137687577, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726010137, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "83c48ed4-1358-4287-94fa-eaabf19d0299", "db_session_id": "1Y76GH2P5EP8HM0NSYSA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010137687705, "job": 1, "event": "recovery_finished"} 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c446d5ce00 2024-09-10T23:15:37.705 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: DB pointer 0x55c446e5e000 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** DB Stats ** 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2024-09-10T23:15:37.706 INFO:journalctl@ceph.mon.b.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-10T23:15:37.707 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: Block cache BinnedLRUCache@0x55c446d2d610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T23:15:37.708 INFO:journalctl@ceph.mon.b.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:15:37.709 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-10T23:15:37.709 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:15:37.709 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T23:15:37.709 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-10T23:15:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: starting mon.b rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(???) e0 preinit fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T23:15:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T23:15:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout: e1 2024-09-10T23:15:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout: btime 2024-09-10T23:14:03:974933+0000 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout: legacy client fscid: -1 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout: No filesystems configured 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:15:38.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi177", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.032 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:38.032 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:38.032 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:38.032 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T23:15:38.032 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Deploying cephadm binary to smithi177 2024-09-10T23:15:38.032 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:38.033 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.033 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.033 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.033 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:38.033 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Added host smithi177 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2999446898' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2999446898' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:38.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi154:172.21.15.154=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi154:172.21.15.154=b;smithi177:172.21.15.177=c;count:3 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Deploying daemon mon.c on smithi177 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/1846904501' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:38.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.a calling monitor election 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.c calling monitor election 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:15:38.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: monmap epoch 2 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: last_changed 2024-09-10T23:15:28.965524+0000 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: created 2024-09-10T23:14:00.802094+0000 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: min_mon_release 19 (squid) 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: election_strategy: 1 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: fsmap 2024-09-10T23:15:38.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:38.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mgrmap e13: x(active, since 43s) 2024-09-10T23:15:38.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: overall HEALTH_OK 2024-09-10T23:15:38.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:38.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:38.040 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:38.040 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: Deploying daemon mon.b on smithi154 2024-09-10T23:15:38.040 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.040 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/3390970211' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:38.040 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:38.041 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.041 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/2769767196' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:38.041 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 ceph-mon[35136]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T23:15:38.041 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 bash[35116]: 00dca4eb2b756df9d5e42006ee7e01b12c8c29feed3a476315a1bdac3618eceb 2024-09-10T23:15:38.041 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:37 smithi154 systemd[1]: Started Ceph mon.b for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:15:38.552 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:38.553 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:38.800 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:15:43.156 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:15:43.156 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:15:37.713059Z","created":"2024-09-10T23:14:00.802094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T23:15:43.157 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 3 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: mon.a calling monitor election 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: mon.c calling monitor election 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.157 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: mon.b calling monitor election 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: monmap epoch 3 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: last_changed 2024-09-10T23:15:37.713059+0000 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: created 2024-09-10T23:14:00.802094+0000 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: min_mon_release 19 (squid) 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: election_strategy: 1 2024-09-10T23:15:43.158 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: fsmap 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: mgrmap e13: x(active, since 52s) 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: overall HEALTH_OK 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.159 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: mon.a calling monitor election 2024-09-10T23:15:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: mon.c calling monitor election 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: mon.b calling monitor election 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: monmap epoch 3 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: last_changed 2024-09-10T23:15:37.713059+0000 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: created 2024-09-10T23:14:00.802094+0000 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: election_strategy: 1 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T23:15:43.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: fsmap 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: mgrmap e13: x(active, since 52s) 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: overall HEALTH_OK 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:43.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: mon.a calling monitor election 2024-09-10T23:15:43.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:43.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: mon.c calling monitor election 2024-09-10T23:15:43.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: mon.b calling monitor election 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: monmap epoch 3 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: last_changed 2024-09-10T23:15:37.713059+0000 2024-09-10T23:15:43.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: created 2024-09-10T23:14:00.802094+0000 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: min_mon_release 19 (squid) 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: election_strategy: 1 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: fsmap 2024-09-10T23:15:43.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:43.284 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: mgrmap e13: x(active, since 52s) 2024-09-10T23:15:43.284 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: overall HEALTH_OK 2024-09-10T23:15:43.284 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.284 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.284 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.284 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:43.745 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T23:15:43.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T23:15:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:43 smithi177 ceph-mon[35760]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:43 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/4178439304' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:44.014 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:44.135 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:43 smithi002 ceph-mon[31150]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:44.135 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:44.135 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:43 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/4178439304' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:44.135 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:44.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:43 smithi154 ceph-mon[35136]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:44.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:44.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:43 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/4178439304' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:44.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:15:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-10T23:15:44.821 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:44.821 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-09-10T23:15:44.986 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:15:44.712+0000 7fc28da28640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1056524518' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:44.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:44.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1056524518' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1056524518' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:45.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:45.396 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T23:15:45.396 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:15:45.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:45.425 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:15:45.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:45.492 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:15:45.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:45.522 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:15:45.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:45.588 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:15:45.588 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:45.616 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:15:45.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:45.681 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-09-10T23:15:45.682 INFO:tasks.cephadm:Adding mgr.y on smithi154 2024-09-10T23:15:45.682 INFO:tasks.cephadm:Adding mgr.z on smithi177 2024-09-10T23:15:45.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi154=y;smithi177=z' 2024-09-10T23:15:45.957 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:15:46.193 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:46.193 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-10T23:15:46.193 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T23:15:46.193 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-10T23:15:46.193 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: Updating smithi002:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:46.194 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:46.195 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-10T23:15:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T23:15:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: Updating smithi002:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:46.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:46.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: Updating smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: Updating smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: Updating smithi002:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:46.583 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mgr update... 2024-09-10T23:15:47.130 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:15:47.130 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: Reconfiguring daemon mon.a on smithi002 2024-09-10T23:15:47.131 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.131 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.131 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:47.131 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:47.131 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:47.131 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.161 DEBUG:teuthology.orchestra.run.smithi154:mgr.y> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T23:15:47.163 DEBUG:teuthology.orchestra.run.smithi177:mgr.z> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T23:15:47.166 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T23:15:47.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T23:15:47.169 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T23:15:47.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T23:15:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: Reconfiguring daemon mon.a on smithi002 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:47.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: Reconfiguring daemon mon.a on smithi002 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:47.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:47.195 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T23:15:47.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T23:15:47.239 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:15:47.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T23:15:47.283 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:15:47.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T23:15:47.326 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T23:15:47.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T23:15:47.370 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:15:47.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T23:15:47.413 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T23:15:47.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T23:15:47.457 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T23:15:47.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T23:15:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:47.507 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T23:15:47.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T23:15:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:47.543 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T23:15:47.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T23:15:47.607 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T23:15:47.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T23:15:47.651 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T23:15:47.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T23:15:47.695 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:15:47.695 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T23:15:47.739 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:15:47.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T23:15:47.783 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T23:15:47.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T23:15:47.840 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:15:47.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T23:15:47.890 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:15:47.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:15:47.935 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:15:47.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:15:47.980 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:15:47.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T23:15:48.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:47 smithi002 ceph-mon[31150]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:48.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:47 smithi002 ceph-mon[31150]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:15:48.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:47 smithi002 ceph-mon[31150]: Reconfiguring daemon mon.b on smithi154 2024-09-10T23:15:48.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:47 smithi002 ceph-mon[31150]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi154=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:48.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:47 smithi002 ceph-mon[31150]: Saving service mgr spec with placement smithi002=x;smithi154=y;smithi177=z;count:3 2024-09-10T23:15:48.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:47 smithi154 ceph-mon[35136]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:48.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:47 smithi154 ceph-mon[35136]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:15:48.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:47 smithi154 ceph-mon[35136]: Reconfiguring daemon mon.b on smithi154 2024-09-10T23:15:48.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:47 smithi154 ceph-mon[35136]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi154=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:48.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:47 smithi154 ceph-mon[35136]: Saving service mgr spec with placement smithi002=x;smithi154=y;smithi177=z;count:3 2024-09-10T23:15:48.044 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:15:48.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:15:48.091 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:15:48.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T23:15:48.149 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T23:15:48.149 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi002') 2024-09-10T23:15:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:47 smithi177 ceph-mon[35760]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:47 smithi177 ceph-mon[35760]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:15:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:47 smithi177 ceph-mon[35760]: Reconfiguring daemon mon.b on smithi154 2024-09-10T23:15:48.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:47 smithi177 ceph-mon[35760]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi154=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:48.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:47 smithi177 ceph-mon[35760]: Saving service mgr spec with placement smithi002=x;smithi154=y;smithi177=z;count:3 2024-09-10T23:15:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: Reconfiguring daemon mon.c on smithi177 2024-09-10T23:15:49.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:49.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:48 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1224859338' entity='client.admin' 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: Reconfiguring daemon mon.c on smithi177 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:49.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:48 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1224859338' entity='client.admin' 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: Reconfiguring daemon mon.c on smithi177 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:48 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1224859338' entity='client.admin' 2024-09-10T23:15:49.657 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi002') 2024-09-10T23:15:49.846 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:49.855 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:49.857 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:49.859 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:50.260 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi002') 2024-09-10T23:15:50.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2816876400' entity='client.admin' 2024-09-10T23:15:50.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:50.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:50.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:50.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:50.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:15:50.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:50.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:50.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:50 smithi002 ceph-mon[31150]: Deploying daemon mgr.z on smithi177 2024-09-10T23:15:50.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2816876400' entity='client.admin' 2024-09-10T23:15:50.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:50.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:50 smithi177 ceph-mon[35760]: Deploying daemon mgr.z on smithi177 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2816876400' entity='client.admin' 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:15:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:50 smithi154 ceph-mon[35136]: Deploying daemon mgr.z on smithi177 2024-09-10T23:15:51.163 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 systemd[1]: Starting Ceph mgr.z for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:15:51.465 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 podman[37328]: 2024-09-10 23:15:51.274769033 +0000 UTC m=+0.015547152 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:15:51.465 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 podman[37328]: 2024-09-10 23:15:51.402281447 +0000 UTC m=+0.143059556 container create a962b256e70aac20eca5411815171fe1b4111d8870f215fdb968aecc3a04fc75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T23:15:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:51 smithi154 ceph-mon[35136]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:51 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1144814790' entity='client.admin' 2024-09-10T23:15:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:51 smithi002 ceph-mon[31150]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:51 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1144814790' entity='client.admin' 2024-09-10T23:15:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:51 smithi177 ceph-mon[35760]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:51 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1144814790' entity='client.admin' 2024-09-10T23:15:51.965 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 podman[37328]: 2024-09-10 23:15:51.612780198 +0000 UTC m=+0.353558317 container init a962b256e70aac20eca5411815171fe1b4111d8870f215fdb968aecc3a04fc75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T23:15:51.965 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 podman[37328]: 2024-09-10 23:15:51.615672647 +0000 UTC m=+0.356450764 container start a962b256e70aac20eca5411815171fe1b4111d8870f215fdb968aecc3a04fc75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T23:15:51.965 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 ceph-mgr[37347]: -- 172.21.15.177:0/2593355382 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565445f090e0 con 0x565445ee6800 2024-09-10T23:15:51.965 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 bash[37328]: a962b256e70aac20eca5411815171fe1b4111d8870f215fdb968aecc3a04fc75 2024-09-10T23:15:51.965 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:15:51 smithi177 systemd[1]: Started Ceph mgr.z for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: Deploying daemon mgr.y on smithi154 2024-09-10T23:15:52.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3196150728' entity='client.admin' 2024-09-10T23:15:52.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:52 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/577386671' entity='client.admin' 2024-09-10T23:15:53.142 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:53.142 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: Deploying daemon mgr.y on smithi154 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3196150728' entity='client.admin' 2024-09-10T23:15:53.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:52 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/577386671' entity='client.admin' 2024-09-10T23:15:53.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:53.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:53.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: Deploying daemon mgr.y on smithi154 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3196150728' entity='client.admin' 2024-09-10T23:15:53.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:52 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/577386671' entity='client.admin' 2024-09-10T23:15:53.771 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:53 smithi154 systemd[1]: Starting Ceph mgr.y for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:15:54.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:53 smithi154 ceph-mon[35136]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:54.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:53 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3807850300' entity='client.admin' 2024-09-10T23:15:54.022 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:53 smithi154 podman[36261]: 2024-09-10 23:15:53.67313301 +0000 UTC m=+0.015652232 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:15:54.022 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:53 smithi154 podman[36261]: 2024-09-10 23:15:53.773995059 +0000 UTC m=+0.116514266 container create 348398aa5980de2ba80121cc6e477c2398a9b5e50f51d011902e76881536f59e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T23:15:54.022 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:53 smithi154 podman[36261]: 2024-09-10 23:15:53.993652044 +0000 UTC m=+0.336171247 container init 348398aa5980de2ba80121cc6e477c2398a9b5e50f51d011902e76881536f59e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T23:15:54.022 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:53 smithi154 podman[36261]: 2024-09-10 23:15:53.996354527 +0000 UTC m=+0.338873744 container start 348398aa5980de2ba80121cc6e477c2398a9b5e50f51d011902e76881536f59e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:15:54.023 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:54 smithi154 ceph-mgr[36279]: -- 172.21.15.154:0/3302245099 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55904e44d0e0 con 0x55904e42b400 2024-09-10T23:15:54.064 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:53 smithi002 ceph-mon[31150]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:54.064 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:53 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3807850300' entity='client.admin' 2024-09-10T23:15:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:53 smithi177 ceph-mon[35760]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:53 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3807850300' entity='client.admin' 2024-09-10T23:15:54.279 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:54 smithi154 bash[36261]: 348398aa5980de2ba80121cc6e477c2398a9b5e50f51d011902e76881536f59e 2024-09-10T23:15:54.279 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:15:54 smithi154 systemd[1]: Started Ceph mgr.y for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:15:54.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 -- 172.21.15.2:0/2064235246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fa403f510 msgr2=0x7f8fa40419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 --2- 172.21.15.2:0/2064235246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fa403f510 0x7f8fa40419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8005fd0 tx=0x7f8fa8009680 comp rx=0 tx=0).stop 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 -- 172.21.15.2:0/2064235246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb8103430 msgr2=0x7f8fb8199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 --2- 172.21.15.2:0/2064235246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb8103430 0x7f8fb8199f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000d750 tx=0x7f8fb000dc10 comp rx=0 tx=0).stop 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 -- 172.21.15.2:0/2064235246 shutdown_connections 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 --2- 172.21.15.2:0/2064235246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fa403f510 0x7f8fa40419d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 --2- 172.21.15.2:0/2064235246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb8103430 0x7f8fb8199f40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 --2- 172.21.15.2:0/2064235246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8102a70 0x7f8fb8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 --2- 172.21.15.2:0/2064235246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb8101910 0x7f8fb8198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 -- 172.21.15.2:0/2064235246 >> 172.21.15.2:0/2064235246 conn(0x7f8fb80fd1e0 msgr2=0x7f8fb80fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 -- 172.21.15.2:0/2064235246 shutdown_connections 2024-09-10T23:15:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.746+0000 7f8fbe0ac640 1 -- 172.21.15.2:0/2064235246 wait complete. 2024-09-10T23:15:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 -- 172.21.15.2:0/3860752619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8101910 msgr2=0x7efec8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 --2- 172.21.15.2:0/3860752619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8101910 0x7efec8101d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009930 tx=0x7efeb802a420 comp rx=0 tx=0).stop 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 -- 172.21.15.2:0/3860752619 shutdown_connections 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 --2- 172.21.15.2:0/3860752619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec8103430 0x7efec8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 --2- 172.21.15.2:0/3860752619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8102a70 0x7efec8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 --2- 172.21.15.2:0/3860752619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8101910 0x7efec8101d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 -- 172.21.15.2:0/3860752619 >> 172.21.15.2:0/3860752619 conn(0x7efec80fd1e0 msgr2=0x7efec80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 -- 172.21.15.2:0/3860752619 shutdown_connections 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.754+0000 7efece175640 1 -- 172.21.15.2:0/3860752619 wait complete. 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 Processor -- start 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 -- start start 2024-09-10T23:15:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8101910 0x7efec8105660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 0x7efec8103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec8103430 0x7efec8104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efec810d430 con 0x7efec8102a70 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efec810d2b0 con 0x7efec8101910 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efece175640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efec810d5b0 con 0x7efec8103430 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efec6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 0x7efec8103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efec6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 0x7efec8103f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37274/0 (socket says 172.21.15.2:37274) 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efec6ffd640 1 -- 172.21.15.2:0/354159868 learned_addr learned my addr 172.21.15.2:0/354159868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efec77fe640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8101910 0x7efec8105660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.755+0000 7efec7fff640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec8103430 0x7efec8104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec6ffd640 1 -- 172.21.15.2:0/354159868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec8103430 msgr2=0x7efec8104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec6ffd640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec8103430 0x7efec8104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec6ffd640 1 -- 172.21.15.2:0/354159868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8101910 msgr2=0x7efec8105660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec6ffd640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8101910 0x7efec8105660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec6ffd640 1 -- 172.21.15.2:0/354159868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec8104c80 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec77fe640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8101910 0x7efec8105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec6ffd640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 0x7efec8103f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efebc00e9f0 tx=0x7efebc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc00cd80 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efece175640 1 -- 172.21.15.2:0/354159868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec81a2e10 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7efebc0108c0 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc0187d0 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.756+0000 7efece175640 1 -- 172.21.15.2:0/354159868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec81a32c0 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.757+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7efebc0189b0 con 0x7efec8102a70 2024-09-10T23:15:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.757+0000 7efece175640 1 -- 172.21.15.2:0/354159868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec81a34f0 con 0x7efec8102a70 2024-09-10T23:15:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.758+0000 7efec4ff9640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efeb003f510 0x7efeb00419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.758+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efebc054230 con 0x7efec8102a70 2024-09-10T23:15:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.758+0000 7efec77fe640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efeb003f510 0x7efeb00419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.758+0000 7efec77fe640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efeb003f510 0x7efeb00419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009900 tx=0x7efeb8005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.763+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efebc016e90 con 0x7efec8102a70 2024-09-10T23:15:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.952+0000 7efece175640 1 -- 172.21.15.2:0/354159868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7efec81a37e0 con 0x7efec8102a70 2024-09-10T23:15:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.955+0000 7efec4ff9640 1 -- 172.21.15.2:0/354159868 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v17)=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7efebc0071c0 con 0x7efec8102a70 2024-09-10T23:15:54.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 -- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efeb003f510 msgr2=0x7efeb00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efeb003f510 0x7efeb00419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009900 tx=0x7efeb8005720 comp rx=0 tx=0).stop 2024-09-10T23:15:54.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 -- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 msgr2=0x7efec8103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:54.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 0x7efec8103f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efebc00e9f0 tx=0x7efebc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 -- 172.21.15.2:0/354159868 shutdown_connections 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efeb003f510 0x7efeb00419d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec8103430 0x7efec8104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efec8102a70 0x7efec8103f40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 --2- 172.21.15.2:0/354159868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec8101910 0x7efec8105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.957+0000 7efece175640 1 -- 172.21.15.2:0/354159868 >> 172.21.15.2:0/354159868 conn(0x7efec80fd1e0 msgr2=0x7efec80fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.958+0000 7efece175640 1 -- 172.21.15.2:0/354159868 shutdown_connections 2024-09-10T23:15:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:54.958+0000 7efece175640 1 -- 172.21.15.2:0/354159868 wait complete. 2024-09-10T23:15:55.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:55.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:55.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2064235246' entity='client.admin' 2024-09-10T23:15:55.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:55 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/354159868' entity='client.admin' 2024-09-10T23:15:55.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2064235246' entity='client.admin' 2024-09-10T23:15:55.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:55 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/354159868' entity='client.admin' 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2064235246' entity='client.admin' 2024-09-10T23:15:55.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:55 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/354159868' entity='client.admin' 2024-09-10T23:15:56.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: Reconfiguring daemon mgr.x on smithi002 2024-09-10T23:15:56.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:56.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:15:56.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:56.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:56.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:56.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: Reconfiguring daemon mgr.x on smithi002 2024-09-10T23:15:56.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.642 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:56.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: Reconfiguring daemon mgr.x on smithi002 2024-09-10T23:15:56.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 -- 172.21.15.2:0/98302281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc10b300 msgr2=0x7f27cc10b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 --2- 172.21.15.2:0/98302281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc10b300 0x7f27cc10b780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009900 tx=0x7f27bc02a400 comp rx=0 tx=0).stop 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 -- 172.21.15.2:0/98302281 shutdown_connections 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 --2- 172.21.15.2:0/98302281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 --2- 172.21.15.2:0/98302281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc10b300 0x7f27cc10b780 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 --2- 172.21.15.2:0/98302281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc074380 0x7f27cc074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 -- 172.21.15.2:0/98302281 >> 172.21.15.2:0/98302281 conn(0x7f27cc06fcb0 msgr2=0x7f27cc0720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 -- 172.21.15.2:0/98302281 shutdown_connections 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.838+0000 7f27d152b640 1 -- 172.21.15.2:0/98302281 wait complete. 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 Processor -- start 2024-09-10T23:15:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 -- start start 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 0x7f27cc19f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 0x7f27cc19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc114ba0 con 0x7f27cc10bcc0 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc114a20 con 0x7f27cc10b300 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27d152b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc114d20 con 0x7f27cc074380 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27ca7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 0x7f27cc19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27caffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 0x7f27cc19f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27ca7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 0x7f27cc19f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:53984/0 (socket says 172.21.15.2:53984) 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27caffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 0x7f27cc19f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:34452/0 (socket says 172.21.15.2:34452) 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27ca7fc640 1 -- 172.21.15.2:0/1618581373 learned_addr learned my addr 172.21.15.2:0/1618581373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:15:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.839+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37300/0 (socket says 172.21.15.2:37300) 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27cb7fe640 1 -- 172.21.15.2:0/1618581373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 msgr2=0x7f27cc19f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27cb7fe640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 0x7f27cc19f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27cb7fe640 1 -- 172.21.15.2:0/1618581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 msgr2=0x7f27cc19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27cb7fe640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 0x7f27cc19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27cb7fe640 1 -- 172.21.15.2:0/1618581373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc1a0e00 con 0x7f27cc10bcc0 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27caffd640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 0x7f27cc19f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27ca7fc640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 0x7f27cc19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27cb7fe640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1a0560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009fd0 tx=0x7f27c400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c400ce20 con 0x7f27cc10bcc0 2024-09-10T23:15:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f27c4005020 con 0x7f27cc10bcc0 2024-09-10T23:15:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc1a10f0 con 0x7f27cc10bcc0 2024-09-10T23:15:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4010690 con 0x7f27cc10bcc0 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.840+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc1a77d0 con 0x7f27cc10bcc0 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.841+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7f27c4010830 con 0x7f27cc10bcc0 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.841+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc1114c0 con 0x7f27cc10bcc0 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.841+0000 7f27c3fff640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27b8041720 0x7f27b8043be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.842+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f27c4054340 con 0x7f27cc10bcc0 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.842+0000 7f27caffd640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27b8041720 0x7f27b8043be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.842+0000 7f27caffd640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27b8041720 0x7f27b8043be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27b40095f0 tx=0x7f27b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:56.846+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f27c401fe40 con 0x7f27cc10bcc0 2024-09-10T23:15:57.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.036+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f27cc063dc0 con 0x7f27cc10bcc0 2024-09-10T23:15:57.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.039+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f27c4016370 con 0x7f27cc10bcc0 2024-09-10T23:15:57.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.040+0000 7f27c3fff640 1 -- 172.21.15.2:0/1618581373 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27c4014230 con 0x7f27cc10bcc0 2024-09-10T23:15:57.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27b8041720 msgr2=0x7f27b8043be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27b8041720 0x7f27b8043be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27b40095f0 tx=0x7f27b4005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:57.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 msgr2=0x7f27cc1a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1a0560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009fd0 tx=0x7f27c400ef10 comp rx=0 tx=0).stop 2024-09-10T23:15:57.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 shutdown_connections 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27b8041720 0x7f27b8043be0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc10bcc0 0x7f27cc1a0560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27cc10b300 0x7f27cc19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 --2- 172.21.15.2:0/1618581373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27cc074380 0x7f27cc19f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 >> 172.21.15.2:0/1618581373 conn(0x7f27cc06fcb0 msgr2=0x7f27cc10e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 shutdown_connections 2024-09-10T23:15:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:57.043+0000 7f27d152b640 1 -- 172.21.15.2:0/1618581373 wait complete. 2024-09-10T23:15:57.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: Standby manager daemon z started 2024-09-10T23:15:57.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:15:57.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:15:57.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:15:57.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:15:57.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:57 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1618581373' entity='client.admin' 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: Standby manager daemon z started 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:15:57.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:57 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1618581373' entity='client.admin' 2024-09-10T23:15:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: Standby manager daemon z started 2024-09-10T23:15:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:15:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:15:58.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:15:58.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.177:0/4075535464' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:15:58.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:57 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1618581373' entity='client.admin' 2024-09-10T23:15:58.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:58.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 -- 172.21.15.2:0/961514499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0101910 msgr2=0x7f83c0101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 --2- 172.21.15.2:0/961514499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0101910 0x7f83c0101d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009ca0 tx=0x7f83b002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 -- 172.21.15.2:0/961514499 shutdown_connections 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 --2- 172.21.15.2:0/961514499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c0103430 0x7f83c0109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 --2- 172.21.15.2:0/961514499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83c0102a70 0x7f83c0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 --2- 172.21.15.2:0/961514499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0101910 0x7f83c0101d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 -- 172.21.15.2:0/961514499 >> 172.21.15.2:0/961514499 conn(0x7f83c00fd1e0 msgr2=0x7f83c00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 -- 172.21.15.2:0/961514499 shutdown_connections 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 -- 172.21.15.2:0/961514499 wait complete. 2024-09-10T23:15:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.857+0000 7f83c7387640 1 Processor -- start 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 -- start start 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c0101910 0x7f83c019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83c0102a70 0x7f83c019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 0x7f83c019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83c010e660 con 0x7f83c0103430 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83c010e4e0 con 0x7f83c0102a70 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c7387640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83c010e7e0 con 0x7f83c0101910 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 0x7f83c019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c4922640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83c0102a70 0x7f83c019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5123640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c0101910 0x7f83c019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 0x7f83c019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37310/0 (socket says 172.21.15.2:37310) 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 -- 172.21.15.2:0/501687504 learned_addr learned my addr 172.21.15.2:0/501687504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 -- 172.21.15.2:0/501687504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c0101910 msgr2=0x7f83c019af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c0101910 0x7f83c019af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 -- 172.21.15.2:0/501687504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83c0102a70 msgr2=0x7f83c019b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83c0102a70 0x7f83c019b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 -- 172.21.15.2:0/501687504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c019cab0 con 0x7f83c0103430 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83c5924640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 0x7f83c019c210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c970 tx=0x7f83b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.858+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8007bb0 con 0x7f83c0103430 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.859+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83b8007d50 con 0x7f83c0103430 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.859+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c019cda0 con 0x7f83c0103430 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.859+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8018770 con 0x7f83c0103430 2024-09-10T23:15:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.859+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c01a3480 con 0x7f83c0103430 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.860+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c01a3650 con 0x7f83c0103430 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.860+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 102336+0+0 (secure 0 0 0) 0x7f83b800f990 con 0x7f83c0103430 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.861+0000 7f83be7fc640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f83a807a3b0 0x7f83a807c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.861+0000 7f83c5123640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f83a807a3b0 0x7f83a807c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.861+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f83b809bce0 con 0x7f83c0103430 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.861+0000 7f83c5123640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f83a807a3b0 0x7f83a807c870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005e30 tx=0x7f83b0005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:58.865+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f83b8014030 con 0x7f83c0103430 2024-09-10T23:15:58.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-10T23:15:58.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:15:58.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:58.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:58.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:58.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:58.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:58.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:59.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:15:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.053+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f83c01a3940 con 0x7f83c0103430 2024-09-10T23:15:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.056+0000 7f83be7fc640 1 -- 172.21.15.2:0/501687504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f83b80643c0 con 0x7f83c0103430 2024-09-10T23:15:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f83a807a3b0 msgr2=0x7f83a807c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f83a807a3b0 0x7f83a807c870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005e30 tx=0x7f83b0005dc0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 msgr2=0x7f83c019c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 0x7f83c019c210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c970 tx=0x7f83b800ce30 comp rx=0 tx=0).stop 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 shutdown_connections 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f83a807a3b0 0x7f83a807c870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83c0103430 0x7f83c019c210 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83c0102a70 0x7f83c019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 --2- 172.21.15.2:0/501687504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83c0101910 0x7f83c019af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.058+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 >> 172.21.15.2:0/501687504 conn(0x7f83c00fd1e0 msgr2=0x7f83c010a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.059+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 shutdown_connections 2024-09-10T23:15:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.059+0000 7f83c7387640 1 -- 172.21.15.2:0/501687504 wait complete. 2024-09-10T23:15:59.209 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-09-10T23:15:59.209 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-09-10T23:15:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/2797561888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c103470 msgr2=0x7fba9c109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/2797561888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c103470 0x7fba9c109df0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009cd0 tx=0x7fba8c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/2797561888 shutdown_connections 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/2797561888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c103470 0x7fba9c109df0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/2797561888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba9c102ab0 0x7fba9c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/2797561888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba9c101950 0x7fba9c101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/2797561888 >> 172.21.15.2:0/2797561888 conn(0x7fba9c0fd200 msgr2=0x7fba9c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/2797561888 shutdown_connections 2024-09-10T23:15:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.366+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/2797561888 wait complete. 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 Processor -- start 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 -- start start 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba9c101950 0x7fba9c105710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 0x7fba9c103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba9c103470 0x7fba9c1044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c10d620 con 0x7fba9c102ab0 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c10d4a0 con 0x7fba9c103470 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa3cbd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c10d7a0 con 0x7fba9c101950 2024-09-10T23:15:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa1258640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 0x7fba9c103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa1258640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 0x7fba9c103f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37330/0 (socket says 172.21.15.2:37330) 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa1258640 1 -- 172.21.15.2:0/925838002 learned_addr learned my addr 172.21.15.2:0/925838002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa1a59640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba9c101950 0x7fba9c105710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.367+0000 7fbaa225a640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba9c103470 0x7fba9c1044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa1258640 1 -- 172.21.15.2:0/925838002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba9c101950 msgr2=0x7fba9c105710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa1258640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba9c101950 0x7fba9c105710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa1258640 1 -- 172.21.15.2:0/925838002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba9c103470 msgr2=0x7fba9c1044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa1258640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba9c103470 0x7fba9c1044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa1258640 1 -- 172.21.15.2:0/925838002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c104d80 con 0x7fba9c102ab0 2024-09-10T23:15:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa1258640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 0x7fba9c103f80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba9000d770 tx=0x7fba9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90017070 con 0x7fba9c102ab0 2024-09-10T23:15:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba900054d0 con 0x7fba9c102ab0 2024-09-10T23:15:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c1a2ec0 con 0x7fba9c102ab0 2024-09-10T23:15:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90004c30 con 0x7fba9c102ab0 2024-09-10T23:15:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.368+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c1a3370 con 0x7fba9c102ab0 2024-09-10T23:15:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.369+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c1a35a0 con 0x7fba9c102ab0 2024-09-10T23:15:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.370+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 102336+0+0 (secure 0 0 0) 0x7fba90004e10 con 0x7fba9c102ab0 2024-09-10T23:15:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.370+0000 7fba9affd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fba8407a3b0 0x7fba8407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.370+0000 7fbaa1a59640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fba8407a3b0 0x7fba8407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.370+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba9009b7d0 con 0x7fba9c102ab0 2024-09-10T23:15:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.371+0000 7fbaa1a59640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fba8407a3b0 0x7fba8407c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba94009bd0 tx=0x7fba94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.375+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fba90063eb0 con 0x7fba9c102ab0 2024-09-10T23:15:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.560+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fba9c1a3770 con 0x7fba9c102ab0 2024-09-10T23:15:59.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.563+0000 7fba9affd640 1 -- 172.21.15.2:0/925838002 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7fba900688e0 con 0x7fba9c102ab0 2024-09-10T23:15:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fba8407a3b0 msgr2=0x7fba8407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fba8407a3b0 0x7fba8407c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba94009bd0 tx=0x7fba94005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 msgr2=0x7fba9c103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 0x7fba9c103f80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba9000d770 tx=0x7fba9000dc30 comp rx=0 tx=0).stop 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 shutdown_connections 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fba8407a3b0 0x7fba8407c870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba9c103470 0x7fba9c1044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c102ab0 0x7fba9c103f80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 --2- 172.21.15.2:0/925838002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba9c101950 0x7fba9c105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.565+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 >> 172.21.15.2:0/925838002 conn(0x7fba9c0fd200 msgr2=0x7fba9c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.566+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 shutdown_connections 2024-09-10T23:15:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:15:59.566+0000 7fbaa3cbd640 1 -- 172.21.15.2:0/925838002 wait complete. 2024-09-10T23:15:59.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: Standby manager daemon y started 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/501687504' entity='client.admin' 2024-09-10T23:15:59.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:15:59 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/925838002' entity='client.admin' 2024-09-10T23:15:59.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:59.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: Standby manager daemon y started 2024-09-10T23:15:59.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:15:59.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:15:59.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:15:59.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:15:59.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/501687504' entity='client.admin' 2024-09-10T23:15:59.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:15:59 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/925838002' entity='client.admin' 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: Standby manager daemon y started 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: from='mgr.? 172.21.15.154:0/1471468364' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/501687504' entity='client.admin' 2024-09-10T23:16:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:15:59 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/925838002' entity='client.admin' 2024-09-10T23:16:00.667 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:00 smithi002 ceph-mon[31150]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-10T23:16:00.667 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:00 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 -- 172.21.15.2:0/1762646163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500101910 msgr2=0x7f8500101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 --2- 172.21.15.2:0/1762646163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500101910 0x7f8500101d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009930 tx=0x7f84f002a420 comp rx=0 tx=0).stop 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 -- 172.21.15.2:0/1762646163 shutdown_connections 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 --2- 172.21.15.2:0/1762646163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500103430 0x7f8500109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 --2- 172.21.15.2:0/1762646163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500102a70 0x7f8500102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 --2- 172.21.15.2:0/1762646163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500101910 0x7f8500101d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 -- 172.21.15.2:0/1762646163 >> 172.21.15.2:0/1762646163 conn(0x7f85000fd1e0 msgr2=0x7f85000ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 -- 172.21.15.2:0/1762646163 shutdown_connections 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 -- 172.21.15.2:0/1762646163 wait complete. 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.666+0000 7f850746c640 1 Processor -- start 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 -- start start 2024-09-10T23:16:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500101910 0x7f850010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 0x7f850010aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500103430 0x7f850010af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f850010e680 con 0x7f8500102a70 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f850010e500 con 0x7f8500103430 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f850746c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f850010e800 con 0x7f8500101910 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 0x7f850010aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 0x7f850010aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37352/0 (socket says 172.21.15.2:37352) 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 -- 172.21.15.2:0/1235606744 learned_addr learned my addr 172.21.15.2:0/1235606744 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8505208640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500101910 0x7f850010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8505a09640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500103430 0x7f850010af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 -- 172.21.15.2:0/1235606744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500101910 msgr2=0x7f850010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500101910 0x7f850010c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 -- 172.21.15.2:0/1235606744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500103430 msgr2=0x7f850010af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500103430 0x7f850010af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8504a07640 1 -- 172.21.15.2:0/1235606744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850010b800 con 0x7f8500102a70 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8505208640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500101910 0x7f850010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.667+0000 7f8505a09640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500103430 0x7f850010af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.668+0000 7f8504a07640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 0x7f850010aa00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c920 tx=0x7f84f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.668+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4007c70 con 0x7f8500102a70 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.668+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84f4007e10 con 0x7f8500102a70 2024-09-10T23:16:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.668+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85001a2e90 con 0x7f8500102a70 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.668+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4018820 con 0x7f8500102a70 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.668+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85001a3390 con 0x7f8500102a70 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.669+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8500108c30 con 0x7f8500102a70 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.670+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f84f400f450 con 0x7f8500102a70 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.671+0000 7f84fe7fc640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84e80b52d0 0x7f84e80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.671+0000 7f8505208640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84e80b52d0 0x7f84e80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.671+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f84f40e40d0 con 0x7f8500102a70 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.671+0000 7f8505208640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84e80b52d0 0x7f84e80b7790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84f0006010 tx=0x7f84f0031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.675+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f84f4014030 con 0x7f8500102a70 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.864+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8500063d80 con 0x7f8500102a70 2024-09-10T23:16:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.867+0000 7f84fe7fc640 1 -- 172.21.15.2:0/1235606744 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f84f40acbc0 con 0x7f8500102a70 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84e80b52d0 msgr2=0x7f84e80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84e80b52d0 0x7f84e80b7790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84f0006010 tx=0x7f84f0031450 comp rx=0 tx=0).stop 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 msgr2=0x7f850010aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 0x7f850010aa00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c920 tx=0x7f84f400cde0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 shutdown_connections 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84e80b52d0 0x7f84e80b7790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8500103430 0x7f850010af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8500102a70 0x7f850010aa00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 --2- 172.21.15.2:0/1235606744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8500101910 0x7f850010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 >> 172.21.15.2:0/1235606744 conn(0x7f85000fd1e0 msgr2=0x7f8500105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 shutdown_connections 2024-09-10T23:16:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.870+0000 7f850746c640 1 -- 172.21.15.2:0/1235606744 wait complete. 2024-09-10T23:16:00.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.894+0000 7f07d3fff640 1 -- 172.21.15.2:0/1880519599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8031830 con 0x7f07dc102a50 2024-09-10T23:16:00.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 -- 172.21.15.2:0/1880519599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc102a50 msgr2=0x7f07dc102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 --2- 172.21.15.2:0/1880519599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc102a50 0x7f07dc102e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009930 tx=0x7f07d802a420 comp rx=0 tx=0).stop 2024-09-10T23:16:00.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 -- 172.21.15.2:0/1880519599 shutdown_connections 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 --2- 172.21.15.2:0/1880519599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc104570 0x7f07dc10aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 --2- 172.21.15.2:0/1880519599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 --2- 172.21.15.2:0/1880519599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc102a50 0x7f07dc102e50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 -- 172.21.15.2:0/1880519599 >> 172.21.15.2:0/1880519599 conn(0x7f07dc0fe320 msgr2=0x7f07dc100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.895+0000 7f07e370e640 1 -- 172.21.15.2:0/1880519599 shutdown_connections 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.896+0000 7f07e370e640 1 -- 172.21.15.2:0/1880519599 wait complete. 2024-09-10T23:16:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 Processor -- start 2024-09-10T23:16:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 -- start start 2024-09-10T23:16:00.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc102a50 0x7f07dc198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc104570 0x7f07dc19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc10e6d0 con 0x7f07dc104570 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc10e550 con 0x7f07dc102a50 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e370e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc10e850 con 0x7f07dc103bb0 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.897+0000 7f07e0ca9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc1994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:34498/0 (socket says 172.21.15.2:34498) 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 -- 172.21.15.2:0/1494695410 learned_addr learned my addr 172.21.15.2:0/1494695410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e14aa640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc102a50 0x7f07dc198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e1cab640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc104570 0x7f07dc19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 -- 172.21.15.2:0/1494695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc102a50 msgr2=0x7f07dc198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc102a50 0x7f07dc198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 -- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc104570 msgr2=0x7f07dc19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc104570 0x7f07dc19a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 -- 172.21.15.2:0/1494695410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc19a9b0 con 0x7f07dc103bb0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07e0ca9640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc1994d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00d770 tx=0x7f07cc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc017070 con 0x7f07dc103bb0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07cc0054d0 con 0x7f07dc103bb0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.898+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc004c30 con 0x7f07dc103bb0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.899+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc19aca0 con 0x7f07dc103bb0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.899+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc1a1380 con 0x7f07dc103bb0 2024-09-10T23:16:00.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.900+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07dc102e50 con 0x7f07dc103bb0 2024-09-10T23:16:00.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.901+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f07cc004e10 con 0x7f07dc103bb0 2024-09-10T23:16:00.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.902+0000 7f07d27fc640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07c80b52d0 0x7f07c80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.902+0000 7f07e14aa640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07c80b52d0 0x7f07c80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.902+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f07cc0e3930 con 0x7f07dc103bb0 2024-09-10T23:16:00.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.902+0000 7f07e14aa640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07c80b52d0 0x7f07c80b7790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009900 tx=0x7f07d8031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:00.907+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07cc0abdd0 con 0x7f07dc103bb0 2024-09-10T23:16:00.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:00 smithi177 ceph-mon[35760]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-10T23:16:00.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:00 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:16:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:00 smithi154 ceph-mon[35136]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-10T23:16:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:00 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:16:01.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.095+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f07dc063d50 con 0x7f07dc103bb0 2024-09-10T23:16:01.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.100+0000 7f07d27fc640 1 -- 172.21.15.2:0/1494695410 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f07cc0b0800 con 0x7f07dc103bb0 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07c80b52d0 msgr2=0x7f07c80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07c80b52d0 0x7f07c80b7790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009900 tx=0x7f07d8031430 comp rx=0 tx=0).stop 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 msgr2=0x7f07dc1994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc1994d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00d770 tx=0x7f07cc00dc30 comp rx=0 tx=0).stop 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 shutdown_connections 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07c80b52d0 0x7f07c80b7790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07dc104570 0x7f07dc19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc103bb0 0x7f07dc1994d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 --2- 172.21.15.2:0/1494695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07dc102a50 0x7f07dc198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 >> 172.21.15.2:0/1494695410 conn(0x7f07dc0fe320 msgr2=0x7f07dc106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 shutdown_connections 2024-09-10T23:16:01.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.103+0000 7f07e370e640 1 -- 172.21.15.2:0/1494695410 wait complete. 2024-09-10T23:16:01.316 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:01.353 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi002') 2024-09-10T23:16:01.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 -- 172.21.15.2:0/3702498142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c104560 msgr2=0x7fdf0c10aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 --2- 172.21.15.2:0/3702498142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c104560 0x7fdf0c10aee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009cd0 tx=0x7fdf0402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 -- 172.21.15.2:0/3702498142 shutdown_connections 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 --2- 172.21.15.2:0/3702498142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c104560 0x7fdf0c10aee0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 --2- 172.21.15.2:0/3702498142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 --2- 172.21.15.2:0/3702498142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c102a40 0x7fdf0c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 -- 172.21.15.2:0/3702498142 >> 172.21.15.2:0/3702498142 conn(0x7fdf0c0fe2f0 msgr2=0x7fdf0c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 -- 172.21.15.2:0/3702498142 shutdown_connections 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.901+0000 7fdf13a38640 1 -- 172.21.15.2:0/3702498142 wait complete. 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 Processor -- start 2024-09-10T23:16:01.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 -- start start 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c102a40 0x7fdf0c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c104560 0x7fdf0c19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c10e6a0 con 0x7fdf0c103ba0 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c10e520 con 0x7fdf0c104560 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf13a38640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c10e820 con 0x7fdf0c102a40 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51466/0 (socket says 172.21.15.2:51466) 2024-09-10T23:16:01.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 -- 172.21.15.2:0/479285345 learned_addr learned my addr 172.21.15.2:0/479285345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf117d4640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c102a40 0x7fdf0c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf11fd5640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c104560 0x7fdf0c19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 -- 172.21.15.2:0/479285345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c102a40 msgr2=0x7fdf0c198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c102a40 0x7fdf0c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 -- 172.21.15.2:0/479285345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c104560 msgr2=0x7fdf0c19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c104560 0x7fdf0c19a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.902+0000 7fdf10fd3640 1 -- 172.21.15.2:0/479285345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c19a8a0 con 0x7fdf0c103ba0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.903+0000 7fdf10fd3640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c1993c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c920 tx=0x7fdefc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.903+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc007c70 con 0x7fdf0c103ba0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.903+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c19ab90 con 0x7fdf0c103ba0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.903+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdefc007e10 con 0x7fdf0c103ba0 2024-09-10T23:16:01.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.903+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc018820 con 0x7fdf0c103ba0 2024-09-10T23:16:01.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.903+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c1a1270 con 0x7fdf0c103ba0 2024-09-10T23:16:01.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.904+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c109cf0 con 0x7fdf0c103ba0 2024-09-10T23:16:01.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.905+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fdefc00f450 con 0x7fdf0c103ba0 2024-09-10T23:16:01.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.906+0000 7fdf027fc640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdef80b52d0 0x7fdef80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.906+0000 7fdf117d4640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdef80b52d0 0x7fdef80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.906+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdefc0e4190 con 0x7fdf0c103ba0 2024-09-10T23:16:01.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.907+0000 7fdf117d4640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdef80b52d0 0x7fdef80b7790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005fd0 tx=0x7fdf08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:01.910+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdefc014030 con 0x7fdf0c103ba0 2024-09-10T23:16:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.096+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fdf0c02e5c0 con 0x7fdf0c103ba0 2024-09-10T23:16:02.097 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:01 smithi002 ceph-mon[31150]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:02.098 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:01 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1235606744' entity='client.admin' 2024-09-10T23:16:02.098 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:01 smithi002 ceph-mon[31150]: from='client.? ' entity='client.admin' 2024-09-10T23:16:02.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.100+0000 7fdf027fc640 1 -- 172.21.15.2:0/479285345 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v23)=0 v23) ==== 127+0+0 (secure 0 0 0) 0x7fdefc0acc80 con 0x7fdf0c103ba0 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdef80b52d0 msgr2=0x7fdef80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdef80b52d0 0x7fdef80b7790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005fd0 tx=0x7fdf08005850 comp rx=0 tx=0).stop 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 msgr2=0x7fdf0c1993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c1993c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c920 tx=0x7fdefc00cde0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 shutdown_connections 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdef80b52d0 0x7fdef80b7790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c104560 0x7fdf0c19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf0c103ba0 0x7fdf0c1993c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 --2- 172.21.15.2:0/479285345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf0c102a40 0x7fdf0c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 >> 172.21.15.2:0/479285345 conn(0x7fdf0c0fe2f0 msgr2=0x7fdf0c106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 shutdown_connections 2024-09-10T23:16:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.103+0000 7fdf13a38640 1 -- 172.21.15.2:0/479285345 wait complete. 2024-09-10T23:16:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:01 smithi177 ceph-mon[35760]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:01 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1235606744' entity='client.admin' 2024-09-10T23:16:02.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:01 smithi177 ceph-mon[35760]: from='client.? ' entity='client.admin' 2024-09-10T23:16:02.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:01 smithi154 ceph-mon[35136]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:02.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:01 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1235606744' entity='client.admin' 2024-09-10T23:16:02.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:01 smithi154 ceph-mon[35136]: from='client.? ' entity='client.admin' 2024-09-10T23:16:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.589+0000 7f4afb9f9640 1 -- 172.21.15.2:0/3900011897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af406c000 msgr2=0x7f4af41056f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.589+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/3900011897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af406c000 0x7f4af41056f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009900 tx=0x7f4af002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- 172.21.15.2:0/3900011897 shutdown_connections 2024-09-10T23:16:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/3900011897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4af4108760 0x7f4af410ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/3900011897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4105c30 0x7f4af4108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/3900011897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af406c000 0x7f4af41056f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- 172.21.15.2:0/3900011897 >> 172.21.15.2:0/3900011897 conn(0x7f4af40fd200 msgr2=0x7f4af40ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- 172.21.15.2:0/3900011897 shutdown_connections 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- 172.21.15.2:0/3900011897 wait complete. 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 Processor -- start 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- start start 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4af406c000 0x7f4af4198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 0x7f4af4199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4108760 0x7f4af419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4af410e700 con 0x7f4af4105c30 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4af410e580 con 0x7f4af4108760 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.590+0000 7f4afb9f9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4af410e880 con 0x7f4af406c000 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 0x7f4af4199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 0x7f4af4199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51474/0 (socket says 172.21.15.2:51474) 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 -- 172.21.15.2:0/1520226200 learned_addr learned my addr 172.21.15.2:0/1520226200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af9795640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4af406c000 0x7f4af4198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af9f96640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4108760 0x7f4af419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 -- 172.21.15.2:0/1520226200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4af406c000 msgr2=0x7f4af4198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4af406c000 0x7f4af4198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 -- 172.21.15.2:0/1520226200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4108760 msgr2=0x7f4af419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4108760 0x7f4af419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 -- 172.21.15.2:0/1520226200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af419a920 con 0x7f4af4105c30 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af9f96640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4108760 0x7f4af419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4af8f94640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 0x7f4af4199440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400d950 tx=0x7f4ae400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017070 con 0x7f4af4105c30 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae4009c30 con 0x7f4af4105c30 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af419ac10 con 0x7f4af4105c30 2024-09-10T23:16:02.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400f620 con 0x7f4af4105c30 2024-09-10T23:16:02.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.591+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af41a12f0 con 0x7f4af4105c30 2024-09-10T23:16:02.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.592+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af40fecf0 con 0x7f4af4105c30 2024-09-10T23:16:02.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.594+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f4ae4010460 con 0x7f4af4105c30 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.595+0000 7f4aea7fc640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4ae00b5250 0x7f4ae00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.595+0000 7f4af9795640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4ae00b5250 0x7f4ae00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.595+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4ae40e3ba0 con 0x7f4af4105c30 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.595+0000 7f4af9795640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4ae00b5250 0x7f4ae00b7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4af0031500 tx=0x7f4af0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.597+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ae40ac690 con 0x7f4af4105c30 2024-09-10T23:16:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.790+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f4af402e5c0 con 0x7f4af4105c30 2024-09-10T23:16:02.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.794+0000 7f4aea7fc640 1 -- 172.21.15.2:0/1520226200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f4ae4009de0 con 0x7f4af4105c30 2024-09-10T23:16:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4ae00b5250 msgr2=0x7f4ae00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4ae00b5250 0x7f4ae00b7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4af0031500 tx=0x7f4af0005a20 comp rx=0 tx=0).stop 2024-09-10T23:16:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 msgr2=0x7f4af4199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 0x7f4af4199440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400d950 tx=0x7f4ae400de10 comp rx=0 tx=0).stop 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 shutdown_connections 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4ae00b5250 0x7f4ae00b7710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af4108760 0x7f4af419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4105c30 0x7f4af4199440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 --2- 172.21.15.2:0/1520226200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4af406c000 0x7f4af4198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 >> 172.21.15.2:0/1520226200 conn(0x7f4af40fd200 msgr2=0x7f4af4103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 shutdown_connections 2024-09-10T23:16:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:02.796+0000 7f4afb9f9640 1 -- 172.21.15.2:0/1520226200 wait complete. 2024-09-10T23:16:03.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:03 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/479285345' entity='client.admin' 2024-09-10T23:16:03.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:03 smithi002 ceph-mon[31150]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:03 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1520226200' entity='client.admin' 2024-09-10T23:16:03.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:03 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/479285345' entity='client.admin' 2024-09-10T23:16:03.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:03 smithi177 ceph-mon[35760]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:03 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1520226200' entity='client.admin' 2024-09-10T23:16:03.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:03 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/479285345' entity='client.admin' 2024-09-10T23:16:03.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:03 smithi154 ceph-mon[35136]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:03 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1520226200' entity='client.admin' 2024-09-10T23:16:04.782 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:04.782 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:04.783 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:04.783 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:05.454 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:05 smithi002 ceph-mon[31150]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:05.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:05 smithi177 ceph-mon[35760]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:05.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:05 smithi154 ceph-mon[35136]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 -- 172.21.15.2:0/2609601056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 msgr2=0x7fdf70102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 --2- 172.21.15.2:0/2609601056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf70102e40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009930 tx=0x7fdf6c02a420 comp rx=0 tx=0).stop 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 -- 172.21.15.2:0/2609601056 shutdown_connections 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 --2- 172.21.15.2:0/2609601056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf70104560 0x7fdf7010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 --2- 172.21.15.2:0/2609601056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf70103ba0 0x7fdf70104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 --2- 172.21.15.2:0/2609601056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf70102e40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 -- 172.21.15.2:0/2609601056 >> 172.21.15.2:0/2609601056 conn(0x7fdf700fe2f0 msgr2=0x7fdf70100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 -- 172.21.15.2:0/2609601056 shutdown_connections 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.542+0000 7fdf777d1640 1 -- 172.21.15.2:0/2609601056 wait complete. 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 Processor -- start 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 -- start start 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf7019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf70103ba0 0x7fdf7019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf70104560 0x7fdf7019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7010e6c0 con 0x7fdf70102a40 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7010e540 con 0x7fdf70103ba0 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf777d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7010e840 con 0x7fdf70104560 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf7556d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf7019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf7556d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf7019aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51480/0 (socket says 172.21.15.2:51480) 2024-09-10T23:16:05.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf7556d640 1 -- 172.21.15.2:0/923722251 learned_addr learned my addr 172.21.15.2:0/923722251 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf74d6c640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf70103ba0 0x7fdf7019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.543+0000 7fdf75d6e640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf70104560 0x7fdf7019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf7556d640 1 -- 172.21.15.2:0/923722251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf70104560 msgr2=0x7fdf7019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf7556d640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf70104560 0x7fdf7019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf7556d640 1 -- 172.21.15.2:0/923722251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf70103ba0 msgr2=0x7fdf7019b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf7556d640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf70103ba0 0x7fdf7019b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf7556d640 1 -- 172.21.15.2:0/923722251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7019cb20 con 0x7fdf70102a40 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf7556d640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf7019aff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005ab0 tx=0x7fdf6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c03f030 con 0x7fdf70102a40 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf6c032e40 con 0x7fdf70102a40 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7019cdb0 con 0x7fdf70102a40 2024-09-10T23:16:05.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c035070 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.544+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf701a34f0 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.545+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf70102e40 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.547+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fdf6c03ba60 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.547+0000 7fdf627fc640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf5c0b52d0 0x7fdf5c0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.547+0000 7fdf74d6c640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf5c0b52d0 0x7fdf5c0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.548+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdf6c104990 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.548+0000 7fdf74d6c640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf5c0b52d0 0x7fdf5c0b7790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009bd0 tx=0x7fdf64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.550+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf6c0cced0 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.743+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fdf701a3830 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.746+0000 7fdf627fc640 1 -- 172.21.15.2:0/923722251 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) ==== 120+0+0 (secure 0 0 0) 0x7fdf6c0d1900 con 0x7fdf70102a40 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.748+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf5c0b52d0 msgr2=0x7fdf5c0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.748+0000 7fdf777d1640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf5c0b52d0 0x7fdf5c0b7790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009bd0 tx=0x7fdf64005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 msgr2=0x7fdf7019aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf7019aff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005ab0 tx=0x7fdf6c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 shutdown_connections 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf5c0b52d0 0x7fdf5c0b7790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf70104560 0x7fdf7019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf70103ba0 0x7fdf7019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 --2- 172.21.15.2:0/923722251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf70102a40 0x7fdf7019aff0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 >> 172.21.15.2:0/923722251 conn(0x7fdf700fe2f0 msgr2=0x7fdf70109330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 shutdown_connections 2024-09-10T23:16:05.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:05.749+0000 7fdf777d1640 1 -- 172.21.15.2:0/923722251 wait complete. 2024-09-10T23:16:06.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:06 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/923722251' entity='client.admin' 2024-09-10T23:16:06.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 -- 172.21.15.2:0/78016697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 msgr2=0x7f0fb810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/78016697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb810aee0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009cd0 tx=0x7f0fb002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 -- 172.21.15.2:0/78016697 shutdown_connections 2024-09-10T23:16:06.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/78016697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb810aee0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/78016697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fb8103ba0 0x7f0fb8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/78016697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb8102a40 0x7f0fb8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 -- 172.21.15.2:0/78016697 >> 172.21.15.2:0/78016697 conn(0x7f0fb80fe2f0 msgr2=0x7f0fb8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.912+0000 7f0fbdfab640 1 -- 172.21.15.2:0/78016697 shutdown_connections 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.913+0000 7f0fbdfab640 1 -- 172.21.15.2:0/78016697 wait complete. 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.913+0000 7f0fbdfab640 1 Processor -- start 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.913+0000 7f0fbdfab640 1 -- start start 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fb8102a40 0x7f0fb8076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb8103ba0 0x7f0fb8075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb8075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb810e6c0 con 0x7f0fb8104560 2024-09-10T23:16:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb810e540 con 0x7f0fb8103ba0 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb810e840 con 0x7f0fb8102a40 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb8075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb8075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51494/0 (socket says 172.21.15.2:51494) 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 -- 172.21.15.2:0/4165356680 learned_addr learned my addr 172.21.15.2:0/4165356680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb77fe640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fb8102a40 0x7f0fb8076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0faeffd640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb8103ba0 0x7f0fb8075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 -- 172.21.15.2:0/4165356680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fb8102a40 msgr2=0x7f0fb8076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fb8102a40 0x7f0fb8076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 -- 172.21.15.2:0/4165356680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb8103ba0 msgr2=0x7f0fb8075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb8103ba0 0x7f0fb8075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 -- 172.21.15.2:0/4165356680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb8076340 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb7fff640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb8075a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00317d0 tx=0x7f0fb0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0004250 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb81a2e20 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fb00305a0 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.914+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb003b660 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.915+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81a32d0 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.916+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb8109cf0 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.917+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f0fb004c020 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.918+0000 7f0fb57fa640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0fa40b5250 0x7f0fa40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.918+0000 7f0fb77fe640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0fa40b5250 0x7f0fa40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.918+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0fb002e030 con 0x7f0fb8104560 2024-09-10T23:16:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.918+0000 7f0fb77fe640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0fa40b5250 0x7f0fa40b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800abe0 tx=0x7f0fa800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:06.922+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0fb00cd3a0 con 0x7f0fb8104560 2024-09-10T23:16:07.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:06 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/923722251' entity='client.admin' 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 -- 172.21.15.2:0/2861322425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c108730 msgr2=0x7f7d6c10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 --2- 172.21.15.2:0/2861322425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c108730 0x7f7d6c10abf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009ca0 tx=0x7f7d6402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 -- 172.21.15.2:0/2861322425 shutdown_connections 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 --2- 172.21.15.2:0/2861322425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c108730 0x7f7d6c10abf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 --2- 172.21.15.2:0/2861322425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 0x7f7d6c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 --2- 172.21.15.2:0/2861322425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.109+0000 7f7d72566640 1 -- 172.21.15.2:0/2861322425 >> 172.21.15.2:0/2861322425 conn(0x7f7d6c0fd1e0 msgr2=0x7f7d6c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.110+0000 7f7d72566640 1 -- 172.21.15.2:0/2861322425 shutdown_connections 2024-09-10T23:16:07.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.110+0000 7f7d72566640 1 -- 172.21.15.2:0/2861322425 wait complete. 2024-09-10T23:16:07.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.110+0000 7f7d72566640 1 Processor -- start 2024-09-10T23:16:07.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.110+0000 7f7d72566640 1 -- start start 2024-09-10T23:16:07.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.110+0000 7f7d72566640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d72566640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 0x7f7d6c101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d72566640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d6c108730 0x7f7d6c101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.110+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f0fb8063d50 con 0x7f0fb8104560 2024-09-10T23:16:07.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d72566640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c10e680 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d72566640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c10e500 con 0x7f7d6c105b80 2024-09-10T23:16:07.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d72566640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c10e800 con 0x7f7d6c108730 2024-09-10T23:16:07.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51520/0 (socket says 172.21.15.2:51520) 2024-09-10T23:16:07.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 -- 172.21.15.2:0/3867953529 learned_addr learned my addr 172.21.15.2:0/3867953529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6b7fe640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 0x7f7d6c101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d70b03640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d6c108730 0x7f7d6c101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 -- 172.21.15.2:0/3867953529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d6c108730 msgr2=0x7f7d6c101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d6c108730 0x7f7d6c101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 -- 172.21.15.2:0/3867953529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 msgr2=0x7f7d6c101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 0x7f7d6c101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 -- 172.21.15.2:0/3867953529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c102390 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6b7fe640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 0x7f7d6c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.111+0000 7f7d6bfff640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c102d20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00ccb0 tx=0x7f7d5c007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.112+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c007ca0 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.112+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c1a2e60 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.112+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d5c007e40 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.112+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c004a00 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.112+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c1a32c0 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.113+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6c0fecd0 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.114+0000 7f0fb57fa640 1 -- 172.21.15.2:0/4165356680 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v26)=0 v26) ==== 108+0+0 (secure 0 0 0) 0x7f0fb00ccca0 con 0x7f0fb8104560 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0fa40b5250 msgr2=0x7f0fa40b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0fa40b5250 0x7f0fa40b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800abe0 tx=0x7f0fa800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 msgr2=0x7f0fb8075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb8075a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00317d0 tx=0x7f0fb0003c10 comp rx=0 tx=0).stop 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 shutdown_connections 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0fa40b5250 0x7f0fa40b7710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8104560 0x7f0fb8075a80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb8103ba0 0x7f0fb8075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 --2- 172.21.15.2:0/4165356680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fb8102a40 0x7f0fb8076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 >> 172.21.15.2:0/4165356680 conn(0x7f0fb80fe2f0 msgr2=0x7f0fb8106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 shutdown_connections 2024-09-10T23:16:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.117+0000 7f0fbdfab640 1 -- 172.21.15.2:0/4165356680 wait complete. 2024-09-10T23:16:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.118+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f7d5c0050b0 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.119+0000 7f7d697fa640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d540b5250 0x7f7d540b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.119+0000 7f7d6b7fe640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d540b5250 0x7f7d540b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.119+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7d5c0e3e90 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.119+0000 7f7d6b7fe640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d540b5250 0x7f7d540b7710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c06bb90 tx=0x7f7d6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.121+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7d5c014030 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:06 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/923722251' entity='client.admin' 2024-09-10T23:16:07.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.307+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7d6c02e5c0 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.311+0000 7f7d697fa640 1 -- 172.21.15.2:0/3867953529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f7d5c0ac3d0 con 0x7f7d6c06b6e0 2024-09-10T23:16:07.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d540b5250 msgr2=0x7f7d540b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d540b5250 0x7f7d540b7710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c06bb90 tx=0x7f7d6000b390 comp rx=0 tx=0).stop 2024-09-10T23:16:07.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 msgr2=0x7f7d6c102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c102d20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00ccb0 tx=0x7f7d5c007590 comp rx=0 tx=0).stop 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 shutdown_connections 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d540b5250 0x7f7d540b7710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d6c108730 0x7f7d6c101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d6c105b80 0x7f7d6c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 --2- 172.21.15.2:0/3867953529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d6c06b6e0 0x7f7d6c102d20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 >> 172.21.15.2:0/3867953529 conn(0x7f7d6c0fd1e0 msgr2=0x7f7d6c103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.313+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 shutdown_connections 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.314+0000 7f7d72566640 1 -- 172.21.15.2:0/3867953529 wait complete. 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 -- 172.21.15.2:0/134923682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260105bd0 msgr2=0x7f2260107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 --2- 172.21.15.2:0/134923682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260105bd0 0x7f2260107fe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2254009900 tx=0x7f225402a410 comp rx=0 tx=0).stop 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 -- 172.21.15.2:0/134923682 shutdown_connections 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 --2- 172.21.15.2:0/134923682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260108720 0x7f226010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 --2- 172.21.15.2:0/134923682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260105bd0 0x7f2260107fe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 --2- 172.21.15.2:0/134923682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 0x7f2260105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 -- 172.21.15.2:0/134923682 >> 172.21.15.2:0/134923682 conn(0x7f22600fd1e0 msgr2=0x7f22600ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 -- 172.21.15.2:0/134923682 shutdown_connections 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.916+0000 7f2265372640 1 -- 172.21.15.2:0/134923682 wait complete. 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 Processor -- start 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 -- start start 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 0x7f2260198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260105bd0 0x7f2260199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 0x7f226019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f226010e6c0 con 0x7f2260108720 2024-09-10T23:16:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f226010e540 con 0x7f2260105bd0 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f2265372640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f226010e840 con 0x7f226006b640 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 0x7f226019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 0x7f226019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51540/0 (socket says 172.21.15.2:51540) 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.917+0000 7f225f7fe640 1 -- 172.21.15.2:0/926260379 learned_addr learned my addr 172.21.15.2:0/926260379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225effd640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 0x7f2260198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225e7fc640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260105bd0 0x7f2260199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225f7fe640 1 -- 172.21.15.2:0/926260379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 msgr2=0x7f2260198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225f7fe640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 0x7f2260198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225f7fe640 1 -- 172.21.15.2:0/926260379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260105bd0 msgr2=0x7f2260199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225f7fe640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260105bd0 0x7f2260199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225f7fe640 1 -- 172.21.15.2:0/926260379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226019a920 con 0x7f2260108720 2024-09-10T23:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225effd640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 0x7f2260198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225e7fc640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260105bd0 0x7f2260199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f225f7fe640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 0x7f226019a080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f225800c970 tx=0x7f225800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258007bb0 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2258007d50 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226019ac10 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258004e60 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.918+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22601a12f0 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.919+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22600fecd0 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.921+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f2258005000 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.921+0000 7f2247fff640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22480b52d0 0x7f22480b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.921+0000 7f225effd640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22480b52d0 0x7f22480b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.922+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f22580e3fd0 con 0x7f2260108720 2024-09-10T23:16:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.922+0000 7f225effd640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22480b52d0 0x7f22480b7790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2250005fd0 tx=0x7f2250009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:07.924+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2258014030 con 0x7f2260108720 2024-09-10T23:16:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:07 smithi002 ceph-mon[31150]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:07 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4165356680' entity='client.admin' 2024-09-10T23:16:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:07 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3867953529' entity='client.admin' 2024-09-10T23:16:08.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.115+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f226002e5c0 con 0x7f2260108720 2024-09-10T23:16:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.119+0000 7f2247fff640 1 -- 172.21.15.2:0/926260379 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f22580acbe0 con 0x7f2260108720 2024-09-10T23:16:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22480b52d0 msgr2=0x7f22480b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22480b52d0 0x7f22480b7790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2250005fd0 tx=0x7f2250009500 comp rx=0 tx=0).stop 2024-09-10T23:16:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 msgr2=0x7f226019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 0x7f226019a080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f225800c970 tx=0x7f225800ce30 comp rx=0 tx=0).stop 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 shutdown_connections 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22480b52d0 0x7f22480b7790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2260108720 0x7f226019a080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2260105bd0 0x7f2260199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 --2- 172.21.15.2:0/926260379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f226006b640 0x7f2260198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 >> 172.21.15.2:0/926260379 conn(0x7f22600fd1e0 msgr2=0x7f2260103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 shutdown_connections 2024-09-10T23:16:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.122+0000 7f2265372640 1 -- 172.21.15.2:0/926260379 wait complete. 2024-09-10T23:16:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:07 smithi177 ceph-mon[35760]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:07 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4165356680' entity='client.admin' 2024-09-10T23:16:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:07 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3867953529' entity='client.admin' 2024-09-10T23:16:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:07 smithi154 ceph-mon[35136]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:07 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4165356680' entity='client.admin' 2024-09-10T23:16:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:07 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3867953529' entity='client.admin' 2024-09-10T23:16:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 -- 172.21.15.2:0/3849036598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 msgr2=0x7f34d4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 --2- 172.21.15.2:0/3849036598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d4102ef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009930 tx=0x7f34c802a420 comp rx=0 tx=0).stop 2024-09-10T23:16:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 -- 172.21.15.2:0/3849036598 shutdown_connections 2024-09-10T23:16:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 --2- 172.21.15.2:0/3849036598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d4103430 0x7f34d4109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 --2- 172.21.15.2:0/3849036598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d4102ef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 --2- 172.21.15.2:0/3849036598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34d4101910 0x7f34d4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 -- 172.21.15.2:0/3849036598 >> 172.21.15.2:0/3849036598 conn(0x7f34d40fd1e0 msgr2=0x7f34d40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 -- 172.21.15.2:0/3849036598 shutdown_connections 2024-09-10T23:16:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.334+0000 7f34da6f9640 1 -- 172.21.15.2:0/3849036598 wait complete. 2024-09-10T23:16:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 Processor -- start 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 -- start start 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34d4101910 0x7f34d406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d4103430 0x7f34d41a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34d410d570 con 0x7f34d4102a70 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34d410d3f0 con 0x7f34d4103430 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34da6f9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34d410d6f0 con 0x7f34d4101910 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51562/0 (socket says 172.21.15.2:51562) 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34d37fe640 1 -- 172.21.15.2:0/1334848553 learned_addr learned my addr 172.21.15.2:0/1334848553 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.335+0000 7f34d3fff640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34d4101910 0x7f34d406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d8c96640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d4103430 0x7f34d41a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d37fe640 1 -- 172.21.15.2:0/1334848553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34d4101910 msgr2=0x7f34d406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d37fe640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34d4101910 0x7f34d406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d37fe640 1 -- 172.21.15.2:0/1334848553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d4103430 msgr2=0x7f34d41a0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d37fe640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d4103430 0x7f34d41a0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d37fe640 1 -- 172.21.15.2:0/1334848553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d41a09d0 con 0x7f34d4102a70 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d37fe640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d419db20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009230 tx=0x7f34c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c803f030 con 0x7f34d4102a70 2024-09-10T23:16:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34c8003cb0 con 0x7f34d4102a70 2024-09-10T23:16:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d41a0c60 con 0x7f34d4102a70 2024-09-10T23:16:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8035070 con 0x7f34d4102a70 2024-09-10T23:16:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.336+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d41a1140 con 0x7f34d4102a70 2024-09-10T23:16:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.337+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d4108c30 con 0x7f34d4102a70 2024-09-10T23:16:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.339+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f34c803bc20 con 0x7f34d4102a70 2024-09-10T23:16:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.339+0000 7f34d17fa640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34bc0b5250 0x7f34bc0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.340+0000 7f34d3fff640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34bc0b5250 0x7f34bc0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.340+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f34c8104b00 con 0x7f34d4102a70 2024-09-10T23:16:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.340+0000 7f34d3fff640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34bc0b5250 0x7f34bc0b7710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34c400abe0 tx=0x7f34c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.344+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f34c80cd690 con 0x7f34d4102a70 2024-09-10T23:16:08.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.529+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f34d4063d50 con 0x7f34d4102a70 2024-09-10T23:16:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.533+0000 7f34d17fa640 1 -- 172.21.15.2:0/1334848553 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7f34c80ccf90 con 0x7f34d4102a70 2024-09-10T23:16:08.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.535+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34bc0b5250 msgr2=0x7f34bc0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.535+0000 7f34da6f9640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34bc0b5250 0x7f34bc0b7710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34c400abe0 tx=0x7f34c400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.535+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 msgr2=0x7f34d419db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.535+0000 7f34da6f9640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d419db20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009230 tx=0x7f34c80042f0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 shutdown_connections 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34bc0b5250 0x7f34bc0b7710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d4103430 0x7f34d41a0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34d4102a70 0x7f34d419db20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 --2- 172.21.15.2:0/1334848553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34d4101910 0x7f34d406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 >> 172.21.15.2:0/1334848553 conn(0x7f34d40fd1e0 msgr2=0x7f34d4105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 shutdown_connections 2024-09-10T23:16:08.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.536+0000 7f34da6f9640 1 -- 172.21.15.2:0/1334848553 wait complete. 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 -- 172.21.15.2:0/960044640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 msgr2=0x7f5924101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 --2- 172.21.15.2:0/960044640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924101d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5914009930 tx=0x7f591402a420 comp rx=0 tx=0).stop 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 -- 172.21.15.2:0/960044640 shutdown_connections 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 --2- 172.21.15.2:0/960044640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5924103430 0x7f5924109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 --2- 172.21.15.2:0/960044640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5924102a70 0x7f5924102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 --2- 172.21.15.2:0/960044640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924101d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 -- 172.21.15.2:0/960044640 >> 172.21.15.2:0/960044640 conn(0x7f59240fd1e0 msgr2=0x7f59240ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 -- 172.21.15.2:0/960044640 shutdown_connections 2024-09-10T23:16:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.920+0000 7f592a49d640 1 -- 172.21.15.2:0/960044640 wait complete. 2024-09-10T23:16:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 Processor -- start 2024-09-10T23:16:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 -- start start 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5924102a70 0x7f5924199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5924103430 0x7f592419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f592410d590 con 0x7f5924101910 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f592410d410 con 0x7f5924102a70 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.921+0000 7f592a49d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f592410d710 con 0x7f5924103430 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51586/0 (socket says 172.21.15.2:51586) 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 -- 172.21.15.2:0/2565673559 learned_addr learned my addr 172.21.15.2:0/2565673559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5928a3a640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5924103430 0x7f592419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f59237fe640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5924102a70 0x7f5924199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 -- 172.21.15.2:0/2565673559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5924103430 msgr2=0x7f592419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5924103430 0x7f592419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 -- 172.21.15.2:0/2565673559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5924102a70 msgr2=0x7f5924199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5924102a70 0x7f5924199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 -- 172.21.15.2:0/2565673559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592419a900 con 0x7f5924101910 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f5923fff640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924198dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5914005740 tx=0x7f59140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591403f030 con 0x7f5924101910 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5914003cb0 con 0x7f5924101910 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914035070 con 0x7f5924101910 2024-09-10T23:16:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.922+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592419ab90 con 0x7f5924101910 2024-09-10T23:16:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.923+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59241a1100 con 0x7f5924101910 2024-09-10T23:16:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.923+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59241a1330 con 0x7f5924101910 2024-09-10T23:16:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.925+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f5914003800 con 0x7f5924101910 2024-09-10T23:16:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.926+0000 7f59217fa640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f590c0b5250 0x7f590c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.926+0000 7f59237fe640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f590c0b5250 0x7f590c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.926+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5914104a60 con 0x7f5924101910 2024-09-10T23:16:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.926+0000 7f59237fe640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f590c0b5250 0x7f590c0b7710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5918009bd0 tx=0x7f5918005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:08.929+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f59140ccfa0 con 0x7f5924101910 2024-09-10T23:16:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.116+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f59241a1500 con 0x7f5924101910 2024-09-10T23:16:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.120+0000 7f59217fa640 1 -- 172.21.15.2:0/2565673559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f59140d19d0 con 0x7f5924101910 2024-09-10T23:16:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f590c0b5250 msgr2=0x7f590c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f590c0b5250 0x7f590c0b7710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5918009bd0 tx=0x7f5918005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 msgr2=0x7f5924198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924198dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5914005740 tx=0x7f59140042f0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 shutdown_connections 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f590c0b5250 0x7f590c0b7710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5924103430 0x7f592419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5924102a70 0x7f5924199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 --2- 172.21.15.2:0/2565673559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5924101910 0x7f5924198dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.122+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 >> 172.21.15.2:0/2565673559 conn(0x7f59240fd1e0 msgr2=0x7f59240fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.123+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 shutdown_connections 2024-09-10T23:16:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:09.123+0000 7f592a49d640 1 -- 172.21.15.2:0/2565673559 wait complete. 2024-09-10T23:16:09.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:09 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/926260379' entity='client.admin' 2024-09-10T23:16:09.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:09 smithi177 ceph-mon[35760]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:09.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:09 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1334848553' entity='client.admin' 2024-09-10T23:16:09.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:09 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/926260379' entity='client.admin' 2024-09-10T23:16:09.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:09 smithi002 ceph-mon[31150]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:09.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:09 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1334848553' entity='client.admin' 2024-09-10T23:16:09.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:09 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/926260379' entity='client.admin' 2024-09-10T23:16:09.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:09 smithi154 ceph-mon[35136]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:09.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:09 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1334848553' entity='client.admin' 2024-09-10T23:16:10.375 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2565673559' entity='client.admin' 2024-09-10T23:16:10.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2565673559' entity='client.admin' 2024-09-10T23:16:10.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 -- 172.21.15.2:0/1840746979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44102a40 msgr2=0x7fdb44102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1840746979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44102a40 0x7fdb44102e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009930 tx=0x7fdb4002a420 comp rx=0 tx=0).stop 2024-09-10T23:16:10.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 -- 172.21.15.2:0/1840746979 shutdown_connections 2024-09-10T23:16:10.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1840746979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb44104560 0x7fdb4410aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1840746979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44103ba0 0x7fdb44104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1840746979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44102a40 0x7fdb44102e40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 -- 172.21.15.2:0/1840746979 >> 172.21.15.2:0/1840746979 conn(0x7fdb440fe2f0 msgr2=0x7fdb44100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 -- 172.21.15.2:0/1840746979 shutdown_connections 2024-09-10T23:16:10.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.465+0000 7fdb4b358640 1 -- 172.21.15.2:0/1840746979 wait complete. 2024-09-10T23:16:10.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 Processor -- start 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 -- start start 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44102a40 0x7fdb44076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb44103ba0 0x7fdb44075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 0x7fdb44075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4410e6f0 con 0x7fdb44104560 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4410e570 con 0x7fdb44103ba0 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb4b358640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4410e870 con 0x7fdb44102a40 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb498f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 0x7fdb44075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb498f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 0x7fdb44075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51592/0 (socket says 172.21.15.2:51592) 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb498f5640 1 -- 172.21.15.2:0/1268681457 learned_addr learned my addr 172.21.15.2:0/1268681457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.466+0000 7fdb488f3640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb44103ba0 0x7fdb44075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb490f4640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44102a40 0x7fdb44076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb498f5640 1 -- 172.21.15.2:0/1268681457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44102a40 msgr2=0x7fdb44076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb498f5640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44102a40 0x7fdb44076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb498f5640 1 -- 172.21.15.2:0/1268681457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb44103ba0 msgr2=0x7fdb44075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb498f5640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb44103ba0 0x7fdb44075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb498f5640 1 -- 172.21.15.2:0/1268681457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb44076340 con 0x7fdb44104560 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb490f4640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44102a40 0x7fdb44076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb498f5640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 0x7fdb44075a80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00eaa0 tx=0x7fdb3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00cdb0 con 0x7fdb44104560 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb3c005020 con 0x7fdb44104560 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb441a2ee0 con 0x7fdb44104560 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0116d0 con 0x7fdb44104560 2024-09-10T23:16:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.467+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb441a3340 con 0x7fdb44104560 2024-09-10T23:16:10.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.468+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb44109dc0 con 0x7fdb44104560 2024-09-10T23:16:10.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.470+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fdb3c00f040 con 0x7fdb44104560 2024-09-10T23:16:10.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.471+0000 7fdb3a7fc640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb300b52d0 0x7fdb300b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.471+0000 7fdb490f4640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb300b52d0 0x7fdb300b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.471+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdb3c0e4160 con 0x7fdb44104560 2024-09-10T23:16:10.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.471+0000 7fdb490f4640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb300b52d0 0x7fdb300b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009900 tx=0x7fdb40031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.474+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdb3c016030 con 0x7fdb44104560 2024-09-10T23:16:10.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2565673559' entity='client.admin' 2024-09-10T23:16:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.666+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fdb4402e5c0 con 0x7fdb44104560 2024-09-10T23:16:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.670+0000 7fdb3a7fc640 1 -- 172.21.15.2:0/1268681457 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v31)=0 v31) ==== 117+0+0 (secure 0 0 0) 0x7fdb3c0acc50 con 0x7fdb44104560 2024-09-10T23:16:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb300b52d0 msgr2=0x7fdb300b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb300b52d0 0x7fdb300b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009900 tx=0x7fdb40031450 comp rx=0 tx=0).stop 2024-09-10T23:16:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 msgr2=0x7fdb44075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 0x7fdb44075a80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00eaa0 tx=0x7fdb3c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:16:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 shutdown_connections 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb300b52d0 0x7fdb300b7790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb44104560 0x7fdb44075a80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb44103ba0 0x7fdb44075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 --2- 172.21.15.2:0/1268681457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44102a40 0x7fdb44076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 >> 172.21.15.2:0/1268681457 conn(0x7fdb440fe2f0 msgr2=0x7fdb44106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 shutdown_connections 2024-09-10T23:16:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:10.672+0000 7fdb4b358640 1 -- 172.21.15.2:0/1268681457 wait complete. 2024-09-10T23:16:11.560 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.921 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:11 smithi002 ceph-mon[31150]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:11.921 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1268681457' entity='client.admin' 2024-09-10T23:16:11.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.957 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.958 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.958 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2f953db4-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi002') 2024-09-10T23:16:11.958 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T23:16:11.958 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:16:11.958 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:16:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:11 smithi177 ceph-mon[35760]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1268681457' entity='client.admin' 2024-09-10T23:16:11.979 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:16:11.979 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-10T23:16:12.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:11 smithi154 ceph-mon[35136]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:12.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1268681457' entity='client.admin' 2024-09-10T23:16:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:16:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:12.036 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T23:16:12.037 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:12.037 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:12.037 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 23:15:04.997607402 +0000 2024-09-10T23:16:12.037 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 23:10:25.912009869 +0000 2024-09-10T23:16:12.037 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 23:10:25.912009869 +0000 2024-09-10T23:16:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 23:10:25.912009869 +0000 2024-09-10T23:16:12.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:16:12.105 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T23:16:12.105 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T23:16:12.105 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000125326 s, 4.1 MB/s 2024-09-10T23:16:12.107 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:16:12.166 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 23:15:05.031606602 +0000 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 23:10:26.235002215 +0000 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 23:10:26.235002215 +0000 2024-09-10T23:16:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 23:10:26.235002215 +0000 2024-09-10T23:16:12.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:16:12.291 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T23:16:12.292 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T23:16:12.292 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000103264 s, 5.0 MB/s 2024-09-10T23:16:12.293 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:16:12.353 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-10T23:16:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:16:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 23:15:05.065605802 +0000 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 23:10:26.555994608 +0000 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 23:10:26.555994608 +0000 2024-09-10T23:16:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 23:10:26.555994608 +0000 2024-09-10T23:16:12.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:16:12.474 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T23:16:12.475 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T23:16:12.475 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.9183e-05 s, 5.2 MB/s 2024-09-10T23:16:12.476 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:16:12.534 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-10T23:16:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 23:15:05.107604814 +0000 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 23:10:26.880986907 +0000 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 23:10:26.880986907 +0000 2024-09-10T23:16:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 23:10:26.880986907 +0000 2024-09-10T23:16:12.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:16:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T23:16:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T23:16:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000119249 s, 4.3 MB/s 2024-09-10T23:16:12.659 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:16:12.718 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T23:16:12.718 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:16:12.739 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:16:12.740 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 23:15:53.497157511 +0000 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 23:10:34.873337139 +0000 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 23:10:34.873337139 +0000 2024-09-10T23:16:12.799 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 23:10:34.873337139 +0000 2024-09-10T23:16:12.800 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:16:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T23:16:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T23:16:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000291556 s, 1.8 MB/s 2024-09-10T23:16:12.870 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:16:12.930 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 23:15:53.497157511 +0000 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 23:10:35.205328121 +0000 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 23:10:35.205328121 +0000 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 23:10:35.205328121 +0000 2024-09-10T23:16:12.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:16:13.054 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T23:16:13.055 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T23:16:13.055 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000188289 s, 2.7 MB/s 2024-09-10T23:16:13.056 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:16:13.114 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 23:15:53.497157511 +0000 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 23:10:35.531319264 +0000 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 23:10:35.531319264 +0000 2024-09-10T23:16:13.171 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 23:10:35.531319264 +0000 2024-09-10T23:16:13.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:16:13.236 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T23:16:13.236 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T23:16:13.236 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.0002109 s, 2.4 MB/s 2024-09-10T23:16:13.237 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:16:13.295 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 23:15:53.498157485 +0000 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 23:10:35.871310027 +0000 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 23:10:35.871310027 +0000 2024-09-10T23:16:13.351 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 23:10:35.871310027 +0000 2024-09-10T23:16:13.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:16:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T23:16:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T23:16:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00020707 s, 2.5 MB/s 2024-09-10T23:16:13.416 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:16:13.473 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-10T23:16:13.473 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:16:13.493 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:16:13.493 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-09-10T23:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-10 23:15:51.103114950 +0000 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-10 23:10:38.147455834 +0000 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-10 23:10:38.147455834 +0000 2024-09-10T23:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-10 23:10:38.147455834 +0000 2024-09-10T23:16:13.553 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:16:13.621 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-10T23:16:13.621 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-10T23:16:13.621 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000255029 s, 2.0 MB/s 2024-09-10T23:16:13.622 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:16:13.681 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-09-10T23:16:13.737 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:16:13.739 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-10T23:16:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-10 23:15:51.103114950 +0000 2024-09-10T23:16:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-10 23:10:38.465446408 +0000 2024-09-10T23:16:13.740 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-10 23:10:38.465446408 +0000 2024-09-10T23:16:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-10 23:10:38.465446408 +0000 2024-09-10T23:16:13.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:16:13.803 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-10T23:16:13.803 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-10T23:16:13.803 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000204474 s, 2.5 MB/s 2024-09-10T23:16:13.804 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:16:13.862 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-10 23:15:51.103114950 +0000 2024-09-10T23:16:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-10 23:10:38.801436449 +0000 2024-09-10T23:16:13.919 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-10 23:10:38.801436449 +0000 2024-09-10T23:16:13.919 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-10 23:10:38.801436449 +0000 2024-09-10T23:16:13.919 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:16:13.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:13 smithi177 ceph-mon[35760]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:13.983 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-10T23:16:13.983 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-10T23:16:13.983 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000204473 s, 2.5 MB/s 2024-09-10T23:16:13.984 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:16:13.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:13 smithi002 ceph-mon[31150]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:14.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:13 smithi154 ceph-mon[35136]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:14.041 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-09-10T23:16:14.097 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-10 23:15:51.104114922 +0000 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-10 23:10:39.131426667 +0000 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-10 23:10:39.131426667 +0000 2024-09-10T23:16:14.098 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-10 23:10:39.131426667 +0000 2024-09-10T23:16:14.098 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:16:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-10T23:16:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-10T23:16:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00020225 s, 2.5 MB/s 2024-09-10T23:16:14.163 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:16:14.220 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-10T23:16:14.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:16:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:15.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:15 smithi002 ceph-mon[31150]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:15 smithi177 ceph-mon[35760]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:15 smithi154 ceph-mon[35136]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:16.813 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:16:16.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-10T23:16:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 -- 172.21.15.2:0/635387710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc103ba0 msgr2=0x7f37fc104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 --2- 172.21.15.2:0/635387710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc103ba0 0x7f37fc104020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009930 tx=0x7f37f002a420 comp rx=0 tx=0).stop 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 -- 172.21.15.2:0/635387710 shutdown_connections 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 --2- 172.21.15.2:0/635387710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 0x7f37fc10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 --2- 172.21.15.2:0/635387710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc103ba0 0x7f37fc104020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 --2- 172.21.15.2:0/635387710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc102a40 0x7f37fc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 -- 172.21.15.2:0/635387710 >> 172.21.15.2:0/635387710 conn(0x7f37fc0fe2f0 msgr2=0x7f37fc100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 -- 172.21.15.2:0/635387710 shutdown_connections 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.520+0000 7f3802746640 1 -- 172.21.15.2:0/635387710 wait complete. 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 Processor -- start 2024-09-10T23:16:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 -- start start 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 0x7f37fc076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc103ba0 0x7f37fc075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 0x7f37fc075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc10e6c0 con 0x7f37fc102a40 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc10e540 con 0x7f37fc104560 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f3802746640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc10e840 con 0x7f37fc103ba0 2024-09-10T23:16:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f37fbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 0x7f37fc076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f37fbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 0x7f37fc076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36118/0 (socket says 172.21.15.2:36118) 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.521+0000 7f37fbfff640 1 -- 172.21.15.2:0/3768489835 learned_addr learned my addr 172.21.15.2:0/3768489835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fb7fe640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc103ba0 0x7f37fc075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fbfff640 1 -- 172.21.15.2:0/3768489835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc103ba0 msgr2=0x7f37fc075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f3800ce3640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 0x7f37fc075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fbfff640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc103ba0 0x7f37fc075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fbfff640 1 -- 172.21.15.2:0/3768489835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 msgr2=0x7f37fc075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fbfff640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 0x7f37fc075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fbfff640 1 -- 172.21.15.2:0/3768489835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc076340 con 0x7f37fc102a40 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fb7fe640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc103ba0 0x7f37fc075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f3800ce3640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 0x7f37fc075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37fbfff640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 0x7f37fc076cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00d770 tx=0x7f37ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec017070 con 0x7f37fc102a40 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37ec0054d0 con 0x7f37fc102a40 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc1a2eb0 con 0x7f37fc102a40 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec004c30 con 0x7f37fc102a40 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.522+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc1a3300 con 0x7f37fc102a40 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.523+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37fc109d40 con 0x7f37fc102a40 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.524+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f37ec004dd0 con 0x7f37fc102a40 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.525+0000 7f37f97fa640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37e40b52d0 0x7f37e40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.525+0000 7f37fb7fe640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37e40b52d0 0x7f37e40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.525+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f37ec0e3e10 con 0x7f37fc102a40 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.526+0000 7f37fb7fe640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37e40b52d0 0x7f37e40b7790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f37f00096c0 tx=0x7f37f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.528+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37ec0ac980 con 0x7f37fc102a40 2024-09-10T23:16:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:17.724+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f37fc063590 con 0x7f37e40b52d0 2024-09-10T23:16:17.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:17 smithi177 ceph-mon[35760]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:17.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:17 smithi002 ceph-mon[31150]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:17 smithi154 ceph-mon[35136]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:18.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:18 smithi177 ceph-mon[35760]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:18.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:18 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:16:18.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:18 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:16:18.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:18 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:18.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:18 smithi002 ceph-mon[31150]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:18.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:18 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:16:18.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:18 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:16:18.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:18 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:19.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:18 smithi154 ceph-mon[35136]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:19.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:18 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:16:19.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:18 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:16:19.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:18 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:19 smithi177 ceph-mon[35760]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:19.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:19 smithi002 ceph-mon[31150]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:19 smithi154 ceph-mon[35136]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:20.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:20 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2647615463' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "519e53ed-0182-44f2-bf22-cf88e408fcd1"} : dispatch 2024-09-10T23:16:20.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:20 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2647615463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "519e53ed-0182-44f2-bf22-cf88e408fcd1"}]': finished 2024-09-10T23:16:20.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:20 smithi177 ceph-mon[35760]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T23:16:20.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:20 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:20.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:20 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/284715566' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:16:20.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2647615463' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "519e53ed-0182-44f2-bf22-cf88e408fcd1"} : dispatch 2024-09-10T23:16:20.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2647615463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "519e53ed-0182-44f2-bf22-cf88e408fcd1"}]': finished 2024-09-10T23:16:20.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:20 smithi002 ceph-mon[31150]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T23:16:20.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:20 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:20.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/284715566' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:16:21.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:20 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2647615463' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "519e53ed-0182-44f2-bf22-cf88e408fcd1"} : dispatch 2024-09-10T23:16:21.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:20 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2647615463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "519e53ed-0182-44f2-bf22-cf88e408fcd1"}]': finished 2024-09-10T23:16:21.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:20 smithi154 ceph-mon[35136]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T23:16:21.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:20 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:21.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:20 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/284715566' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:16:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:21 smithi177 ceph-mon[35760]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:21.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:21 smithi002 ceph-mon[31150]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:22.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:21 smithi154 ceph-mon[35136]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:23.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:23 smithi177 ceph-mon[35760]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:23.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:23 smithi002 ceph-mon[31150]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:23 smithi154 ceph-mon[35136]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:25.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:25 smithi177 ceph-mon[35760]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:25.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:25 smithi002 ceph-mon[31150]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:25 smithi154 ceph-mon[35136]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:27.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:27 smithi002 ceph-mon[31150]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:27 smithi177 ceph-mon[35760]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:27 smithi154 ceph-mon[35136]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:28.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:16:28.816 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:28.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:16:28.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:29.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:16:29.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:29.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:29 smithi002 ceph-mon[31150]: Deploying daemon osd.0 on smithi002 2024-09-10T23:16:29.889 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:29 smithi002 ceph-mon[31150]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:29.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:29 smithi177 ceph-mon[35760]: Deploying daemon osd.0 on smithi002 2024-09-10T23:16:29.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:29 smithi177 ceph-mon[35760]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:30.042 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:29 smithi154 ceph-mon[35136]: Deploying daemon osd.0 on smithi002 2024-09-10T23:16:30.042 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:29 smithi154 ceph-mon[35136]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:31.766 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:31 smithi002 ceph-mon[31150]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:31.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:31 smithi177 ceph-mon[35760]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:31 smithi154 ceph-mon[35136]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:33.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:33 smithi002 ceph-mon[31150]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:33.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:33 smithi177 ceph-mon[35760]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:33 smithi154 ceph-mon[35136]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:34.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:34.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:34.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:35.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:35.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:35.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:35.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:35.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:35.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:35.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:35 smithi002 ceph-mon[31150]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:35 smithi154 ceph-mon[35136]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:36.115 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:35 smithi177 ceph-mon[35760]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:38.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:37 smithi177 ceph-mon[35760]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:38.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:38.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:37 smithi002 ceph-mon[31150]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:37 smithi154 ceph-mon[35136]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.670+0000 7f37f97fa640 1 -- 172.21.15.2:0/3768489835 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f37fc063590 con 0x7f37e40b52d0 2024-09-10T23:16:38.672 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37e40b52d0 msgr2=0x7f37e40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37e40b52d0 0x7f37e40b7790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f37f00096c0 tx=0x7f37f0000bc0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 msgr2=0x7f37fc076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 0x7f37fc076cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00d770 tx=0x7f37ec00dc30 comp rx=0 tx=0).stop 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 shutdown_connections 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37e40b52d0 0x7f37e40b7790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37fc104560 0x7f37fc075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc103ba0 0x7f37fc075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 --2- 172.21.15.2:0/3768489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37fc102a40 0x7f37fc076cd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 >> 172.21.15.2:0/3768489835 conn(0x7f37fc0fe2f0 msgr2=0x7f37fc106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:38.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 shutdown_connections 2024-09-10T23:16:38.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:16:38.673+0000 7f3802746640 1 -- 172.21.15.2:0/3768489835 wait complete. 2024-09-10T23:16:38.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:38.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:38.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:39.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:39.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:39.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:39.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:39.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:39.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:39.356 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T23:16:39.358 INFO:tasks.cephadm:Deploying osd.1 on smithi154 with /dev/vg_nvme/lv_4... 2024-09-10T23:16:39.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:16:39.610 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:16:40.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:39 smithi154 ceph-mon[35136]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:40.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:39 smithi002 ceph-mon[31150]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:39 smithi177 ceph-mon[35760]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:40.487 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:16:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0[47333]: 2024-09-10T23:16:40.182+0000 7fde178f5640 -1 osd.0 0 log_to_monitors true 2024-09-10T23:16:41.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:40 smithi154 ceph-mon[35136]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:16:41.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:40 smithi177 ceph-mon[35760]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:16:41.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:40 smithi002 ceph-mon[31150]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:16:42.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:41 smithi002 ceph-mon[31150]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:42.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:41 smithi002 ceph-mon[31150]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:16:42.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:41 smithi002 ceph-mon[31150]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:16:42.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:41 smithi002 ceph-mon[31150]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:16:42.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:42.174 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:41 smithi154 ceph-mon[35136]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:42.174 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:41 smithi154 ceph-mon[35136]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:16:42.174 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:41 smithi154 ceph-mon[35136]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:16:42.174 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:41 smithi154 ceph-mon[35136]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:16:42.175 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:42.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:16:42.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-09-10T23:16:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:41 smithi177 ceph-mon[35760]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:41 smithi177 ceph-mon[35760]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:16:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:41 smithi177 ceph-mon[35760]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:16:42.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:41 smithi177 ceph-mon[35760]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:16:42.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:42.463 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:16:42.486 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0[47333]: 2024-09-10T23:16:42.287+0000 7fde1408c640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:16:42.486 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0[47333]: 2024-09-10T23:16:42.290+0000 7fde0b697640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:16:42.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 -- 172.21.15.154:0/1942586616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 msgr2=0x7fd0dc102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/1942586616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc102f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009930 tx=0x7fd0cc02a420 comp rx=0 tx=0).stop 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 -- 172.21.15.154:0/1942586616 shutdown_connections 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/1942586616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc103450 0x7fd0dc109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/1942586616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc102f10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/1942586616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0dc101930 0x7fd0dc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 -- 172.21.15.154:0/1942586616 >> 172.21.15.154:0/1942586616 conn(0x7fd0dc0fd200 msgr2=0x7fd0dc0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 -- 172.21.15.154:0/1942586616 shutdown_connections 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.918+0000 7fd0e42b0640 1 -- 172.21.15.154:0/1942586616 wait complete. 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 Processor -- start 2024-09-10T23:16:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 -- start start 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc101930 0x7fd0dc19afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0dc103450 0x7fd0dc19c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc10d590 con 0x7fd0dc101930 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc10d410 con 0x7fd0dc102a90 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e42b0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc10d710 con 0x7fd0dc103450 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc19b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47756/0 (socket says 172.21.15.154:47756) 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 -- 172.21.15.154:0/3307896744 learned_addr learned my addr 172.21.15.154:0/3307896744 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e204c640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc101930 0x7fd0dc19afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 -- 172.21.15.154:0/3307896744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0dc103450 msgr2=0x7fd0dc19c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0dc103450 0x7fd0dc19c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 -- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc101930 msgr2=0x7fd0dc19afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc101930 0x7fd0dc19afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e184b640 1 -- 172.21.15.154:0/3307896744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc19cae0 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.919+0000 7fd0e204c640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc101930 0x7fd0dc19afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.920+0000 7fd0e184b640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc19b600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc005740 tx=0x7fd0cc0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.920+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc03f030 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.920+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc19cd70 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.920+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0cc032e20 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.920+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc035070 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.920+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1a32e0 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.921+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc1a3540 con 0x7fd0dc102a90 2024-09-10T23:16:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.922+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fd0cc03baa0 con 0x7fd0dc102a90 2024-09-10T23:16:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.923+0000 7fd0d37fe640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b5250 0x7fd0c80b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.923+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fd0cc104d60 con 0x7fd0dc102a90 2024-09-10T23:16:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.923+0000 7fd0e204c640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b5250 0x7fd0c80b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.924+0000 7fd0e204c640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b5250 0x7fd0c80b7710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800abe0 tx=0x7fd0d800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:42.926+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd0cc0cd710 con 0x7fd0dc102a90 2024-09-10T23:16:43.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:16:43.111+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd0dc0ff3b0 con 0x7fd0c80b5250 2024-09-10T23:16:43.113 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:16:43.113 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.114 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:42 smithi154 ceph-mon[35136]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' 2024-09-10T23:16:43.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:43.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:43.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:42 smithi177 ceph-mon[35760]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:16:43.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:42 smithi002 ceph-mon[31150]: from='osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420]' entity='osd.0' 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi002 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:16:44.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:16:44.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:44.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] boot 2024-09-10T23:16:44.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T23:16:44.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:16:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:16:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi002 2024-09-10T23:16:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] boot 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T23:16:44.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:16:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:16:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi002 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: osd.0 [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] boot 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T23:16:44.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:16:45.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:44 smithi154 ceph-mon[35136]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:45.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:44 smithi177 ceph-mon[35760]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:45.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:44 smithi002 ceph-mon[31150]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:45.977 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:45.977 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:16:45.977 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/3560383746' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"} : dispatch 2024-09-10T23:16:45.977 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"} : dispatch 2024-09-10T23:16:45.977 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"}]': finished 2024-09-10T23:16:45.978 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T23:16:45.978 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:16:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:16:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/3560383746' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"} : dispatch 2024-09-10T23:16:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"} : dispatch 2024-09-10T23:16:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"}]': finished 2024-09-10T23:16:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T23:16:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/3560383746' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"} : dispatch 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"} : dispatch 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3a75885-bb7f-436b-999f-33d290e0c742"}]': finished 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T23:16:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:16:47.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:46 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/2292808606' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:16:47.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:46 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/2292808606' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:16:47.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:46 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/2292808606' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:16:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:47 smithi177 ceph-mon[35760]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:47 smithi002 ceph-mon[31150]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:48.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:47 smithi154 ceph-mon[35136]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:49 smithi177 ceph-mon[35760]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:50.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:49 smithi002 ceph-mon[31150]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:49 smithi154 ceph-mon[35136]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:52.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:51 smithi154 ceph-mon[35136]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:51 smithi177 ceph-mon[35760]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:51 smithi002 ceph-mon[31150]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:53 smithi154 ceph-mon[35136]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:16:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:53 smithi177 ceph-mon[35760]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:16:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:53 smithi002 ceph-mon[31150]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:16:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:55.128 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:54 smithi154 ceph-mon[35136]: Deploying daemon osd.1 on smithi154 2024-09-10T23:16:55.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:54 smithi177 ceph-mon[35760]: Deploying daemon osd.1 on smithi154 2024-09-10T23:16:55.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:54 smithi002 ceph-mon[31150]: Deploying daemon osd.1 on smithi154 2024-09-10T23:16:56.161 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:55 smithi154 ceph-mon[35136]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:55 smithi177 ceph-mon[35760]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:55 smithi002 ceph-mon[31150]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:57 smithi177 ceph-mon[35760]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:58.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:57 smithi002 ceph-mon[31150]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:16:58.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:57 smithi154 ceph-mon[35136]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:59 smithi154 ceph-mon[35136]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:16:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:59 smithi177 ceph-mon[35760]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:16:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:59 smithi002 ceph-mon[31150]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:16:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:02.189 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:01 smithi154 ceph-mon[35136]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:01 smithi177 ceph-mon[35760]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:02.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:01 smithi002 ceph-mon[31150]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:03.723 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:03 smithi154 ceph-mon[35136]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:03.723 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.723 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.723 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:03.723 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:03.723 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:03 smithi002 ceph-mon[31150]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:03.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:03.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:03.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:03 smithi177 ceph-mon[35760]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:03.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:03.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:03.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:03.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:04.050 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 1 on host 'smithi154' 2024-09-10T23:17:04.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.049+0000 7fd0d37fe640 1 -- 172.21.15.154:0/3307896744 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd0dc0ff3b0 con 0x7fd0c80b5250 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b5250 msgr2=0x7fd0c80b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b5250 0x7fd0c80b7710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800abe0 tx=0x7fd0d800a5c0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 msgr2=0x7fd0dc19b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc19b600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc005740 tx=0x7fd0cc0042f0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 shutdown_connections 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b5250 0x7fd0c80b7710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0dc103450 0x7fd0dc19c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc102a90 0x7fd0dc19b600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 --2- 172.21.15.154:0/3307896744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0dc101930 0x7fd0dc19afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 >> 172.21.15.154:0/3307896744 conn(0x7fd0dc0fd200 msgr2=0x7fd0dc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 shutdown_connections 2024-09-10T23:17:04.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:04.052+0000 7fd0e42b0640 1 -- 172.21.15.154:0/3307896744 wait complete. 2024-09-10T23:17:04.669 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:04 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:04.669 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:04 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:04.669 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:04 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:04.695 DEBUG:teuthology.orchestra.run.smithi154:osd.1> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T23:17:04.697 INFO:tasks.cephadm:Deploying osd.2 on smithi177 with /dev/vg_nvme/lv_4... 2024-09-10T23:17:04.698 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:17:04.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:04 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:04.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:04 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:04.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:04 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:04.948 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:17:04.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:04 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:04.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:04 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:04.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:04 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:05 smithi177 ceph-mon[35760]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:05.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:05 smithi002 ceph-mon[31150]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:05.768 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:05 smithi154 ceph-mon[35136]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:06.320 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1[39587]: 2024-09-10T23:17:06.165+0000 7fdb7dc81640 -1 osd.1 0 log_to_monitors true 2024-09-10T23:17:06.628 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:06 smithi177 ceph-mon[35760]: from='osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:06.628 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:06 smithi177 ceph-mon[35760]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:06.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:06 smithi002 ceph-mon[31150]: from='osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:06.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:06 smithi002 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:06.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:06 smithi154 ceph-mon[35136]: from='osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:06.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:06 smithi154 ceph-mon[35136]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:07.339 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:17:07.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_4 2024-09-10T23:17:07.617 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:17:07.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:07 smithi177 ceph-mon[35760]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:07.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:07 smithi177 ceph-mon[35760]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:17:07.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:07 smithi177 ceph-mon[35760]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:17:07.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:07.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:07 smithi177 ceph-mon[35760]: from='osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:17:07.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:07 smithi177 ceph-mon[35760]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:17:07.779 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1[39587]: 2024-09-10T23:17:07.493+0000 7fdb79c04640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:17:07.779 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1[39587]: 2024-09-10T23:17:07.499+0000 7fdb75a2b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:17:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-mon[35136]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-mon[35136]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:17:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-mon[35136]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:17:07.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:07.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-mon[35136]: from='osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:17:07.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:07 smithi154 ceph-mon[35136]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:17:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:07 smithi002 ceph-mon[31150]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:07 smithi002 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:17:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:07 smithi002 ceph-mon[31150]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:17:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:07 smithi002 ceph-mon[31150]: from='osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:17:07.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:07 smithi002 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:17:08.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 -- 172.21.15.177:0/1021412582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 msgr2=0x7f8844109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:08.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 --2- 172.21.15.177:0/1021412582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f8844109dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f883c009d00 tx=0x7f883c02a910 comp rx=0 tx=0).stop 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 -- 172.21.15.177:0/1021412582 shutdown_connections 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 --2- 172.21.15.177:0/1021412582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f8844109dc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 --2- 172.21.15.177:0/1021412582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8844102a80 0x7f8844102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 --2- 172.21.15.177:0/1021412582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 0x7f8844101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 -- 172.21.15.177:0/1021412582 >> 172.21.15.177:0/1021412582 conn(0x7f88440fd210 msgr2=0x7f88440ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 -- 172.21.15.177:0/1021412582 shutdown_connections 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.032+0000 7f8849114640 1 -- 172.21.15.177:0/1021412582 wait complete. 2024-09-10T23:17:08.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 Processor -- start 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 -- start start 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 0x7f8844198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8844102a80 0x7f8844199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f884419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f884410d5d0 con 0x7f8844102a80 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f884410d450 con 0x7f8844101920 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8849114640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f884410d750 con 0x7f8844103440 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f884359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f884419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:08.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f884359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f884419a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52938/0 (socket says 172.21.15.177:52938) 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f884359e640 1 -- 172.21.15.177:0/1154693986 learned_addr learned my addr 172.21.15.177:0/1154693986 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f8842d9d640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 0x7f8844198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.033+0000 7f884259c640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8844102a80 0x7f8844199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8842d9d640 1 -- 172.21.15.177:0/1154693986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 msgr2=0x7f884419a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8842d9d640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f884419a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8842d9d640 1 -- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8844102a80 msgr2=0x7f8844199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8842d9d640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8844102a80 0x7f8844199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8842d9d640 1 -- 172.21.15.177:0/1154693986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884419a8e0 con 0x7f8844101920 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f884359e640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f884419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8842d9d640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 0x7f8844198db0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f883400e9f0 tx=0x7f883400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883400ccc0 con 0x7f8844101920 2024-09-10T23:17:08.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88340108e0 con 0x7f8844101920 2024-09-10T23:17:08.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884419abd0 con 0x7f8844101920 2024-09-10T23:17:08.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340188e0 con 0x7f8844101920 2024-09-10T23:17:08.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.034+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88441a12b0 con 0x7f8844101920 2024-09-10T23:17:08.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.035+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88441a1480 con 0x7f8844101920 2024-09-10T23:17:08.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.036+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f8834010430 con 0x7f8844101920 2024-09-10T23:17:08.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.037+0000 7f882bfff640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f882c0b52d0 0x7f882c0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:08.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.037+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f88340e4630 con 0x7f8844101920 2024-09-10T23:17:08.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.037+0000 7f884259c640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f882c0b52d0 0x7f882c0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:08.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.038+0000 7f884259c640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f882c0b52d0 0x7f882c0b7790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8838005fd0 tx=0x7f8838005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:08.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.040+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88340acdc0 con 0x7f8844101920 2024-09-10T23:17:08.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:08.227+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f88440ff320 con 0x7f882c0b52d0 2024-09-10T23:17:08.757 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:17:08.757 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:17:08.757 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:08.757 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi154 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:08.758 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi154 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:08.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi154 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:08.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] boot 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T23:17:09.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:09 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:17:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:17:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] boot 2024-09-10T23:17:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T23:17:09.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:09 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: osd.1 [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] boot 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T23:17:09.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:09 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:10.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:10 smithi177 ceph-mon[35760]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:17:10.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/2896314535' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"} : dispatch 2024-09-10T23:17:10.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:10 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"} : dispatch 2024-09-10T23:17:10.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:10 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"}]': finished 2024-09-10T23:17:10.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:10 smithi177 ceph-mon[35760]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:17:10.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:10 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:10.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:10 smithi002 ceph-mon[31150]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:17:10.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/2896314535' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"} : dispatch 2024-09-10T23:17:10.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:10 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"} : dispatch 2024-09-10T23:17:10.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:10 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"}]': finished 2024-09-10T23:17:10.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:10 smithi002 ceph-mon[31150]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:17:10.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:10 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:11.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:10 smithi154 ceph-mon[35136]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:17:11.036 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/2896314535' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"} : dispatch 2024-09-10T23:17:11.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:10 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"} : dispatch 2024-09-10T23:17:11.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:10 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cb0306d-145f-4ca5-a4aa-cb66fa3648f2"}]': finished 2024-09-10T23:17:11.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:10 smithi154 ceph-mon[35136]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:17:11.037 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:10 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:11 smithi177 ceph-mon[35760]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:11.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/3471594572' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:11.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:11 smithi002 ceph-mon[31150]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:11.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/3471594572' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:12.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:11 smithi154 ceph-mon[35136]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:12.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/3471594572' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:13.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:13 smithi177 ceph-mon[35760]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:13.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:13 smithi002 ceph-mon[31150]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:14.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:13 smithi154 ceph-mon[35136]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:15 smithi177 ceph-mon[35760]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:15.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:15 smithi002 ceph-mon[31150]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:15 smithi154 ceph-mon[35136]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:17.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:17 smithi154 ceph-mon[35136]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:17.927 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:17 smithi177 ceph-mon[35760]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:17.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:17 smithi002 ceph-mon[31150]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:19 smithi177 ceph-mon[35760]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:17:19.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:19.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:19 smithi177 ceph-mon[35760]: Deploying daemon osd.2 on smithi177 2024-09-10T23:17:19.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:19 smithi002 ceph-mon[31150]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:19.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:17:19.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:19.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:19 smithi002 ceph-mon[31150]: Deploying daemon osd.2 on smithi177 2024-09-10T23:17:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:19 smithi154 ceph-mon[35136]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:17:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:19 smithi154 ceph-mon[35136]: Deploying daemon osd.2 on smithi177 2024-09-10T23:17:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:21 smithi177 ceph-mon[35760]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:21 smithi002 ceph-mon[31150]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:22.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:21 smithi154 ceph-mon[35136]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:23.763 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:23 smithi177 ceph-mon[35760]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:23.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:23 smithi002 ceph-mon[31150]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:23 smithi154 ceph-mon[35136]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:25.689 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:25 smithi177 ceph-mon[35760]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:25.690 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:25.690 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:25.690 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:25.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:25 smithi002 ceph-mon[31150]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:25.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:25.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:25.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:25 smithi154 ceph-mon[35136]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:27 smithi177 ceph-mon[35760]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:27.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:27.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:27.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:27.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:27 smithi002 ceph-mon[31150]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:27 smithi154 ceph-mon[35136]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:29.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.176+0000 7f882bfff640 1 -- 172.21.15.177:0/1154693986 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f88440ff320 con 0x7f882c0b52d0 2024-09-10T23:17:29.178 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 2 on host 'smithi177' 2024-09-10T23:17:29.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f882c0b52d0 msgr2=0x7f882c0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f882c0b52d0 0x7f882c0b7790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8838005fd0 tx=0x7f8838005850 comp rx=0 tx=0).stop 2024-09-10T23:17:29.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 msgr2=0x7f8844198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 0x7f8844198db0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f883400e9f0 tx=0x7f883400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 shutdown_connections 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f882c0b52d0 0x7f882c0b7790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8844103440 0x7f884419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8844102a80 0x7f8844199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 --2- 172.21.15.177:0/1154693986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8844101920 0x7f8844198db0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.179+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 >> 172.21.15.177:0/1154693986 conn(0x7f88440fd210 msgr2=0x7f88440fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.180+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 shutdown_connections 2024-09-10T23:17:29.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:17:29.180+0000 7f8849114640 1 -- 172.21.15.177:0/1154693986 wait complete. 2024-09-10T23:17:29.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:29 smithi177 ceph-mon[35760]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:29.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:29.750 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:29.750 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:29.776 DEBUG:teuthology.orchestra.run.smithi177:osd.2> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T23:17:29.778 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-10T23:17:29.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:17:29.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:29 smithi002 ceph-mon[31150]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:29.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:29.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:29.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:30.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:29 smithi154 ceph-mon[35136]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:30.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:30.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:30.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:30.048 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:17:30.654 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:30 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2[40745]: 2024-09-10T23:17:30.288+0000 7f5a25a25640 -1 osd.2 0 log_to_monitors true 2024-09-10T23:17:30.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:30 smithi177 ceph-mon[35760]: from='osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:17:30.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:30 smithi177 ceph-mon[35760]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:17:30.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:30 smithi002 ceph-mon[31150]: from='osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:17:30.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:30 smithi002 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:17:31.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:30 smithi154 ceph-mon[35136]: from='osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:17:31.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:30 smithi154 ceph-mon[35136]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:17:31.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:31 smithi002 ceph-mon[31150]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:31.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:31 smithi002 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:17:31.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:31 smithi002 ceph-mon[31150]: from='osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:17:31.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:31 smithi002 ceph-mon[31150]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:17:31.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:31.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:31 smithi002 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:17:31.944 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-mon[35760]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:31.944 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-mon[35760]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:17:31.945 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-mon[35760]: from='osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:17:31.945 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-mon[35760]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:17:31.945 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:31.945 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-mon[35760]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:17:31.945 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2[40745]: 2024-09-10T23:17:31.662+0000 7f5a219a8640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:17:31.945 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2[40745]: 2024-09-10T23:17:31.666+0000 7f5a1d7cf640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:17:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:31 smithi154 ceph-mon[35136]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:31 smithi154 ceph-mon[35136]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:17:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:31 smithi154 ceph-mon[35136]: from='osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:17:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:31 smithi154 ceph-mon[35136]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:17:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:32.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:31 smithi154 ceph-mon[35136]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:17:32.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:17:32.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-10T23:17:32.817 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:17:32.842 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:17:32.842 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:17:32.842 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:32.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:17:32.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:32.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:33.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:17:33.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:17:33.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:33.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:33.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:33.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:33.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:33.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:33.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:33.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:33.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 -- 172.21.15.2:0/3624285497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc103450 msgr2=0x7f5fbc109dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/3624285497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc103450 0x7f5fbc109dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009cd0 tx=0x7f5fb402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 -- 172.21.15.2:0/3624285497 shutdown_connections 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/3624285497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc103450 0x7f5fbc109dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/3624285497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc102a90 0x7f5fbc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/3624285497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc101930 0x7f5fbc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 -- 172.21.15.2:0/3624285497 >> 172.21.15.2:0/3624285497 conn(0x7f5fbc0fd200 msgr2=0x7f5fbc0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 -- 172.21.15.2:0/3624285497 shutdown_connections 2024-09-10T23:17:33.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.301+0000 7f5fc14e6640 1 -- 172.21.15.2:0/3624285497 wait complete. 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 Processor -- start 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 -- start start 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 0x7f5fbc1056f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc102a90 0x7f5fbc103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc103450 0x7f5fbc1044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10d590 con 0x7f5fbc101930 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10d410 con 0x7f5fbc103450 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.302+0000 7f5fc14e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10d710 con 0x7f5fbc102a90 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 0x7f5fbc1056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 0x7f5fbc1056f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38824/0 (socket says 172.21.15.2:38824) 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 -- 172.21.15.2:0/2526000173 learned_addr learned my addr 172.21.15.2:0/2526000173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:17:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbb7fe640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc103450 0x7f5fbc1044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fba7fc640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc102a90 0x7f5fbc103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 -- 172.21.15.2:0/2526000173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc102a90 msgr2=0x7f5fbc103f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc102a90 0x7f5fbc103f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 -- 172.21.15.2:0/2526000173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc103450 msgr2=0x7f5fbc1044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc103450 0x7f5fbc1044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 -- 172.21.15.2:0/2526000173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc104d60 con 0x7f5fbc101930 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fba7fc640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc102a90 0x7f5fbc103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fbaffd640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 0x7f5fbc1056f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c890 tx=0x7f5fac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac004220 con 0x7f5fbc101930 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc1a2f40 con 0x7f5fbc101930 2024-09-10T23:17:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fac0043c0 con 0x7f5fbc101930 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac004a00 con 0x7f5fbc101930 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.303+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc1a3390 con 0x7f5fbc101930 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.304+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc1a3680 con 0x7f5fbc101930 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.306+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f5fac0079b0 con 0x7f5fbc101930 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.306+0000 7f5fa3fff640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5fa40b5250 0x7f5fa40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.307+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f5fac0e4660 con 0x7f5fbc101930 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.307+0000 7f5fba7fc640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5fa40b5250 0x7f5fa40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.307+0000 7f5fba7fc640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5fa40b5250 0x7f5fa40b7710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00058c0 tx=0x7f5fb0005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:33.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.310+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5fac014030 con 0x7f5fbc101930 2024-09-10T23:17:33.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:33.509+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5fbc1a3910 con 0x7f5fa40b5250 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi177 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi177 to 17087M 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] boot 2024-09-10T23:17:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:17:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:33.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi177 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi177 to 17087M 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] boot 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:33.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi177 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi177 to 17087M 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: osd.2 [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] boot 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:17:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:17:34.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:34.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:34.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:34.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:34 smithi177 ceph-mon[35760]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:34.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:34 smithi177 ceph-mon[35760]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:17:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:17:34.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:34 smithi002 ceph-mon[31150]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:34.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:34 smithi002 ceph-mon[31150]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:17:34.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:17:35.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:34 smithi154 ceph-mon[35136]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:35.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:34 smithi154 ceph-mon[35136]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:17:35.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:17:35.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:35 smithi154 ceph-mon[35136]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:35.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:17:35.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:35 smithi154 ceph-mon[35136]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:17:35.798 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 ceph-mon[31150]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 ceph-mon[31150]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52145]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52145]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:35.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:35.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52145]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52119]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52119]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52119]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52122]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52122]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:35.941 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52122]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 ceph-mon[35760]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:17:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 ceph-mon[35760]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:17:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44356]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44356]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44356]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44359]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44359]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:35.965 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44359]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52148]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:17:36.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52148]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:35 smithi002 sudo[52148]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43728]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43728]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43728]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43731]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43731]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:17:35 smithi154 sudo[43731]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43738]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43738]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43738]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43745]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43745]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 sudo[43745]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44362]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:17:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44362]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44362]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44365]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:17:36.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44365]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:17:36.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:17:36.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:35 smithi177 sudo[44365]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:17:36.721 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:17:36.722 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:17:36.722 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:36.722 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:36.722 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:36.722 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:36.723 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:36.723 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:36.723 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:36.723 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:36.723 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:36.724 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:36.724 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:36.724 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:36.724 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:36.724 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:36.724 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:36.725 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:36.725 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:36.725 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:36.725 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1791572797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d4bc460-5421-4710-9aca-415a54129b1f"} : dispatch 2024-09-10T23:17:36.725 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1791572797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d4bc460-5421-4710-9aca-415a54129b1f"}]': finished 2024-09-10T23:17:36.726 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:17:36.726 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:36.726 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:36 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3744891758' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:36.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1791572797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d4bc460-5421-4710-9aca-415a54129b1f"} : dispatch 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1791572797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d4bc460-5421-4710-9aca-415a54129b1f"}]': finished 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:36.989 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:36 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3744891758' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:17:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:17:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:17:37.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:17:37.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:17:37.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1791572797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d4bc460-5421-4710-9aca-415a54129b1f"} : dispatch 2024-09-10T23:17:37.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1791572797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d4bc460-5421-4710-9aca-415a54129b1f"}]': finished 2024-09-10T23:17:37.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:17:37.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:37.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:36 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3744891758' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:37.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:37.068+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f5fac0a86c0 con 0x7f5fbc101930 2024-09-10T23:17:37.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:37 smithi177 ceph-mon[35760]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:37.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:37 smithi177 ceph-mon[35760]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T23:17:37.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:37 smithi002 ceph-mon[31150]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:37.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:37 smithi002 ceph-mon[31150]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T23:17:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:37 smithi154 ceph-mon[35136]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:37 smithi154 ceph-mon[35136]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T23:17:39.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:39 smithi177 ceph-mon[35760]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:39.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:39 smithi002 ceph-mon[31150]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:40.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:39 smithi154 ceph-mon[35136]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:41 smithi177 ceph-mon[35760]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:41.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:41 smithi002 ceph-mon[31150]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:41 smithi154 ceph-mon[35136]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:43 smithi177 ceph-mon[35760]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:43.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:43 smithi002 ceph-mon[31150]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:44.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:43 smithi154 ceph-mon[35136]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:44.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:17:44.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:44 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:44.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:17:44.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:44 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:45.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:17:45.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:44 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:45.909 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:45 smithi002 ceph-mon[31150]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:45.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:45 smithi002 ceph-mon[31150]: Deploying daemon osd.3 on smithi002 2024-09-10T23:17:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:45 smithi177 ceph-mon[35760]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:45 smithi177 ceph-mon[35760]: Deploying daemon osd.3 on smithi002 2024-09-10T23:17:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:45 smithi154 ceph-mon[35136]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:45 smithi154 ceph-mon[35136]: Deploying daemon osd.3 on smithi002 2024-09-10T23:17:47.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:47 smithi177 ceph-mon[35760]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:47.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:47 smithi002 ceph-mon[31150]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:48.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:47 smithi154 ceph-mon[35136]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:49.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:49 smithi177 ceph-mon[35760]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:49 smithi002 ceph-mon[31150]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:50.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:49 smithi154 ceph-mon[35136]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:51 smithi002 ceph-mon[31150]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:51 smithi177 ceph-mon[35760]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:52.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:51 smithi154 ceph-mon[35136]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:52.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:52.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:52.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:53.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:53 smithi002 ceph-mon[31150]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:53.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:53.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:53.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:53.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:53.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:53 smithi154 ceph-mon[35136]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:54.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:54.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:54.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:53 smithi177 ceph-mon[35760]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.983+0000 7f5fa3fff640 1 -- 172.21.15.2:0/2526000173 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5fbc1a3910 con 0x7f5fa40b5250 2024-09-10T23:17:54.984 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-09-10T23:17:54.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5fa40b5250 msgr2=0x7f5fa40b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5fa40b5250 0x7f5fa40b7710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00058c0 tx=0x7f5fb0005ec0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 msgr2=0x7f5fbc1056f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 0x7f5fbc1056f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c890 tx=0x7f5fac00cd50 comp rx=0 tx=0).stop 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 shutdown_connections 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5fa40b5250 0x7f5fa40b7710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc103450 0x7f5fbc1044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fbc102a90 0x7f5fbc103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 --2- 172.21.15.2:0/2526000173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fbc101930 0x7f5fbc1056f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.985+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 >> 172.21.15.2:0/2526000173 conn(0x7f5fbc0fd200 msgr2=0x7f5fbc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.986+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 shutdown_connections 2024-09-10T23:17:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:17:54.986+0000 7f5fc14e6640 1 -- 172.21.15.2:0/2526000173 wait complete. 2024-09-10T23:17:55.623 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T23:17:55.625 INFO:tasks.cephadm:Deploying osd.4 on smithi154 with /dev/vg_nvme/lv_3... 2024-09-10T23:17:55.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:17:55.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:55 smithi002 ceph-mon[31150]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:55.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:55.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:55.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:55.883 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:17:56.004 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:55 smithi154 ceph-mon[35136]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:56.005 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:56.005 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:56.005 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:55 smithi177 ceph-mon[35760]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:56.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:56.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:56.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:56.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:56 smithi002 ceph-mon[31150]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:17:56.875 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:17:56 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:17:56.619+0000 7f090aabd640 -1 osd.3 0 log_to_monitors true 2024-09-10T23:17:57.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:56 smithi154 ceph-mon[35136]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:17:57.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:56 smithi177 ceph-mon[35760]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:17:57.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:57 smithi002 ceph-mon[31150]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:57.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:57 smithi002 ceph-mon[31150]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:17:57.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:57 smithi002 ceph-mon[31150]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:17:57.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:57 smithi002 ceph-mon[31150]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:17:57.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:57 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:57 smithi154 ceph-mon[35136]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:57 smithi154 ceph-mon[35136]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:17:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:57 smithi154 ceph-mon[35136]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:17:58.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:57 smithi154 ceph-mon[35136]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:17:58.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:57 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:57 smithi177 ceph-mon[35760]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:57 smithi177 ceph-mon[35760]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:17:58.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:57 smithi177 ceph-mon[35760]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:17:58.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:57 smithi177 ceph-mon[35760]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:17:58.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:57 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.486 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:17:58.191+0000 7f0907254640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:17:58.487 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:17:58.197+0000 7f08fe85f640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:17:58.613 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:17:58.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-09-10T23:17:58.900 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:17:58.928 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:17:58.928 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:17:58.928 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.928 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] boot 2024-09-10T23:17:58.929 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:17:58.930 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:58.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:58.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:58.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] boot 2024-09-10T23:17:58.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:17:58.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:59.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952]' entity='osd.3' 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:17:59.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: osd.3 [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] boot 2024-09-10T23:17:59.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:17:59.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 -- 172.21.15.154:0/8530529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0102a50 msgr2=0x7f4ab0102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/8530529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0102a50 0x7f4ab0102e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009930 tx=0x7f4aa402a420 comp rx=0 tx=0).stop 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 -- 172.21.15.154:0/8530529 shutdown_connections 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/8530529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab0104570 0x7f4ab010aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/8530529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0103bb0 0x7f4ab0104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/8530529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0102a50 0x7f4ab0102e50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 -- 172.21.15.154:0/8530529 >> 172.21.15.154:0/8530529 conn(0x7f4ab00fe320 msgr2=0x7f4ab0100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 -- 172.21.15.154:0/8530529 shutdown_connections 2024-09-10T23:17:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.382+0000 7f4ab6d41640 1 -- 172.21.15.154:0/8530529 wait complete. 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 Processor -- start 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 -- start start 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 0x7f4ab0076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab0103bb0 0x7f4ab0075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0104570 0x7f4ab0075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab010e730 con 0x7f4ab0102a50 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab010e5b0 con 0x7f4ab0104570 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab6d41640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab010e8b0 con 0x7f4ab0103bb0 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab4add640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 0x7f4ab0076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab52de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0104570 0x7f4ab0075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab4add640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 0x7f4ab0076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.154:44352/0 (socket says 172.21.15.154:44352) 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab4add640 1 -- 172.21.15.154:0/768656881 learned_addr learned my addr 172.21.15.154:0/768656881 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4aaffff640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab0103bb0 0x7f4ab0075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab52de640 1 -- 172.21.15.154:0/768656881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab0103bb0 msgr2=0x7f4ab0075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab52de640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab0103bb0 0x7f4ab0075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab52de640 1 -- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 msgr2=0x7f4ab0076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab52de640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 0x7f4ab0076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab52de640 1 -- 172.21.15.154:0/768656881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab0076340 con 0x7f4ab0104570 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.383+0000 7f4ab4add640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 0x7f4ab0076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.384+0000 7f4ab52de640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0104570 0x7f4ab0075a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800be20 tx=0x7f4aa800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.384+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8019070 con 0x7f4ab0104570 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.384+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa80148f0 con 0x7f4ab0104570 2024-09-10T23:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.384+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab01a2fb0 con 0x7f4ab0104570 2024-09-10T23:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.384+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8012840 con 0x7f4ab0104570 2024-09-10T23:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.384+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab01a3470 con 0x7f4ab0104570 2024-09-10T23:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.385+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab0109e50 con 0x7f4ab0104570 2024-09-10T23:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.386+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f4aa8014440 con 0x7f4ab0104570 2024-09-10T23:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.387+0000 7f4aadffb640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4aa00b5360 0x7f4aa00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.387+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f4aa80e4360 con 0x7f4ab0104570 2024-09-10T23:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.388+0000 7f4ab4add640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4aa00b5360 0x7f4aa00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.388+0000 7f4ab4add640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4aa00b5360 0x7f4aa00b7820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4000c00 tx=0x7f4aa4031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:59.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.395+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4aa80abdd0 con 0x7f4ab0104570 2024-09-10T23:17:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:17:59.587+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4ab0063590 con 0x7f4aa00b5360 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi002 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:59.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:17:59 smithi154 ceph-mon[35136]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:18:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:18:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:18:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi002 2024-09-10T23:18:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-10T23:18:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:00.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:17:59 smithi177 ceph-mon[35760]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi002 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:00.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:17:59 smithi002 ceph-mon[31150]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:18:01.003 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:00 smithi154 ceph-mon[35136]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:01.003 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:00 smithi154 ceph-mon[35136]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:18:01.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:00 smithi177 ceph-mon[35760]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:01.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:00 smithi177 ceph-mon[35760]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:18:01.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:00 smithi002 ceph-mon[31150]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:01.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:00 smithi002 ceph-mon[31150]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:18:02.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:01 smithi154 ceph-mon[35136]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:01 smithi177 ceph-mon[35760]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:02.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:01 smithi002 ceph-mon[31150]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:02 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/2663657341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"} : dispatch 2024-09-10T23:18:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:02 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"} : dispatch 2024-09-10T23:18:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:02 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"}]': finished 2024-09-10T23:18:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:02 smithi154 ceph-mon[35136]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:18:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:02 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/875766985' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:02 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/2663657341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"} : dispatch 2024-09-10T23:18:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:02 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"} : dispatch 2024-09-10T23:18:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:02 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"}]': finished 2024-09-10T23:18:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:02 smithi177 ceph-mon[35760]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:18:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:02 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/875766985' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:03.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:02 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/2663657341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"} : dispatch 2024-09-10T23:18:03.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:02 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"} : dispatch 2024-09-10T23:18:03.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:02 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97973d11-680e-43c6-81ee-5a2cbfc57bf5"}]': finished 2024-09-10T23:18:03.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:02 smithi002 ceph-mon[31150]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:18:03.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:03.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:02 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/875766985' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:04.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:03 smithi154 ceph-mon[35136]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:03 smithi177 ceph-mon[35760]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:03 smithi002 ceph-mon[31150]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:06.016 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:05 smithi177 ceph-mon[35760]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:06.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:05 smithi154 ceph-mon[35136]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:06.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:05 smithi002 ceph-mon[31150]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:08.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:07 smithi154 ceph-mon[35136]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:18:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:07 smithi177 ceph-mon[35760]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:18:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:07 smithi002 ceph-mon[31150]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:18:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:09 smithi154 ceph-mon[35136]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:18:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:09 smithi177 ceph-mon[35760]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:18:10.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:09 smithi002 ceph-mon[31150]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:18:11.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:10 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:18:11.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:10 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:10 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:18:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:10 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:10 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:18:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:10 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:12.017 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:11 smithi154 ceph-mon[35136]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:18:12.017 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:11 smithi154 ceph-mon[35136]: Deploying daemon osd.4 on smithi154 2024-09-10T23:18:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:11 smithi177 ceph-mon[35760]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:18:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:11 smithi177 ceph-mon[35760]: Deploying daemon osd.4 on smithi154 2024-09-10T23:18:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:11 smithi002 ceph-mon[31150]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:18:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:11 smithi002 ceph-mon[31150]: Deploying daemon osd.4 on smithi154 2024-09-10T23:18:13.916 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:13 smithi154 ceph-mon[35136]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-10T23:18:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:13 smithi177 ceph-mon[35760]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-10T23:18:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:13 smithi002 ceph-mon[31150]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-10T23:18:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:15 smithi154 ceph-mon[35136]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:18:16.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:15 smithi002 ceph-mon[31150]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:18:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:15 smithi177 ceph-mon[35760]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:18:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:17 smithi154 ceph-mon[35136]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:18:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:17 smithi177 ceph-mon[35760]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:18:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:17 smithi002 ceph-mon[31150]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:18:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:19 smithi154 ceph-mon[35136]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:19 smithi177 ceph-mon[35760]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:20.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:20.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:19 smithi002 ceph-mon[31150]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:20.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.688+0000 7f4aadffb640 1 -- 172.21.15.154:0/768656881 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4ab0063590 con 0x7f4aa00b5360 2024-09-10T23:18:20.689 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 4 on host 'smithi154' 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4aa00b5360 msgr2=0x7f4aa00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4aa00b5360 0x7f4aa00b7820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4000c00 tx=0x7f4aa4031430 comp rx=0 tx=0).stop 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0104570 msgr2=0x7f4ab0075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0104570 0x7f4ab0075a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800be20 tx=0x7f4aa800bf10 comp rx=0 tx=0).stop 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 shutdown_connections 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4aa00b5360 0x7f4aa00b7820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ab0104570 0x7f4ab0075a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab0103bb0 0x7f4ab0075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 --2- 172.21.15.154:0/768656881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab0102a50 0x7f4ab0076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 >> 172.21.15.154:0/768656881 conn(0x7f4ab00fe320 msgr2=0x7f4ab0107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 shutdown_connections 2024-09-10T23:18:20.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:18:20.690+0000 7f4ab6d41640 1 -- 172.21.15.154:0/768656881 wait complete. 2024-09-10T23:18:21.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:20 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:21.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:20 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:21.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:20 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:21.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:20 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:21.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:20 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:21.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:20 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:21.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:20 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:21.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:20 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:21.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:20 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:21.348 DEBUG:teuthology.orchestra.run.smithi154:osd.4> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T23:18:21.350 INFO:tasks.cephadm:Deploying osd.5 on smithi177 with /dev/vg_nvme/lv_3... 2024-09-10T23:18:21.351 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:18:21.604 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:18:21.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:21 smithi154 ceph-mon[35136]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:22.063 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:21 smithi177 ceph-mon[35760]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:21 smithi002 ceph-mon[31150]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:22.919 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:18:22 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4[46475]: 2024-09-10T23:18:22.805+0000 7f6c4dc92640 -1 osd.4 0 log_to_monitors true 2024-09-10T23:18:24.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:23 smithi154 ceph-mon[35136]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:23 smithi154 ceph-mon[35136]: from='osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:18:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:23 smithi154 ceph-mon[35136]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:18:24.125 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:23 smithi177 ceph-mon[35760]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:24.125 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:23 smithi177 ceph-mon[35760]: from='osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:18:24.125 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:23 smithi177 ceph-mon[35760]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:18:24.155 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_3 2024-09-10T23:18:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:23 smithi002 ceph-mon[31150]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:23 smithi002 ceph-mon[31150]: from='osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:18:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:23 smithi002 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:18:24.402 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 -- 172.21.15.177:0/4209965310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50103b90 msgr2=0x7f0b50104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 --2- 172.21.15.177:0/4209965310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50103b90 0x7f0b50104010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009960 tx=0x7f0b3802a460 comp rx=0 tx=0).stop 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 -- 172.21.15.177:0/4209965310 shutdown_connections 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 --2- 172.21.15.177:0/4209965310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 0x7f0b5010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 --2- 172.21.15.177:0/4209965310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50103b90 0x7f0b50104010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 --2- 172.21.15.177:0/4209965310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50102a30 0x7f0b50102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 -- 172.21.15.177:0/4209965310 >> 172.21.15.177:0/4209965310 conn(0x7f0b500fe320 msgr2=0x7f0b50100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 -- 172.21.15.177:0/4209965310 shutdown_connections 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.902+0000 7f0b55677640 1 -- 172.21.15.177:0/4209965310 wait complete. 2024-09-10T23:18:24.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 Processor -- start 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 -- start start 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 0x7f0b50198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50103b90 0x7f0b501994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 0x7f0b5019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010e6b0 con 0x7f0b50103b90 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010e530 con 0x7f0b50104550 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b55677640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010e830 con 0x7f0b50102a30 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 0x7f0b50198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 0x7f0b50198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55360/0 (socket says 172.21.15.177:55360) 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 -- 172.21.15.177:0/961257416 learned_addr learned my addr 172.21.15.177:0/961257416 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-10T23:18:24.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4f7fe640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 0x7f0b5019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b47fff640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50103b90 0x7f0b501994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 -- 172.21.15.177:0/961257416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 msgr2=0x7f0b5019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 0x7f0b5019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 -- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50103b90 msgr2=0x7f0b501994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50103b90 0x7f0b501994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 -- 172.21.15.177:0/961257416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5019a9c0 con 0x7f0b50102a30 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4f7fe640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 0x7f0b5019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b47fff640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50103b90 0x7f0b501994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.903+0000 7f0b4effd640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 0x7f0b50198e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000d950 tx=0x7f0b4000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.904+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40017070 con 0x7f0b50102a30 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.904+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b40009c30 con 0x7f0b50102a30 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.904+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5019acb0 con 0x7f0b50102a30 2024-09-10T23:18:24.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.904+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000f620 con 0x7f0b50102a30 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.904+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501a1390 con 0x7f0b50102a30 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.905+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b501a1560 con 0x7f0b50102a30 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.906+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f0b40010460 con 0x7f0b50102a30 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.907+0000 7f0b4cff9640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b3c0b52e0 0x7f0b3c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.907+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f0b400e4790 con 0x7f0b50102a30 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.907+0000 7f0b47fff640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b3c0b52e0 0x7f0b3c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.908+0000 7f0b47fff640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b3c0b52e0 0x7f0b3c0b77a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b38005ec0 tx=0x7f0b38000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:24.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:24.911+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0b400ac7e0 con 0x7f0b50102a30 2024-09-10T23:18:25.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:25.095+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0b50105620 con 0x7f0b3c0b52e0 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:25.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:25.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:25.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:25.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.164 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:18:25.164 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:18:25.164 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:18:25.164 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:25.164 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:18:25.164 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:25.165 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:25.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:25.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:25.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:25.529 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4[46475]: 2024-09-10T23:18:25.162+0000 7f6c49c15640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:18:25.529 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4[46475]: 2024-09-10T23:18:25.168+0000 7f6c41a34640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:18:26.176 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:26.176 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi154 2024-09-10T23:18:26.176 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:26.177 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:25 smithi177 ceph-mon[35760]: from='osd.4 ' entity='osd.4' 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi154 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:26.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:26.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:25 smithi002 ceph-mon[31150]: from='osd.4 ' entity='osd.4' 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi154 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:26.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:26.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:26.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:25 smithi154 ceph-mon[35136]: from='osd.4 ' entity='osd.4' 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] boot 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:18:26.854 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:26 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] boot 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:18:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:26 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: osd.4 [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] boot 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:18:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:26 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/3420105629' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"} : dispatch 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"} : dispatch 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"}]': finished 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:18:28.135 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/3420105629' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"} : dispatch 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"} : dispatch 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"}]': finished 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:18:28.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:18:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:18:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/3420105629' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"} : dispatch 2024-09-10T23:18:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"} : dispatch 2024-09-10T23:18:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cf7fb9f-277c-41b2-8522-d629c87d02ac"}]': finished 2024-09-10T23:18:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:18:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:29.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:28 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/3315667761' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:29.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:28 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/3315667761' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:29.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:28 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/3315667761' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:30.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:29 smithi177 ceph-mon[35760]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:29 smithi002 ceph-mon[31150]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:30.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:29 smithi154 ceph-mon[35136]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:32.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:31 smithi177 ceph-mon[35760]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:31 smithi002 ceph-mon[31150]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:32.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:31 smithi154 ceph-mon[35136]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:34.072 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:33 smithi177 ceph-mon[35760]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:33 smithi002 ceph-mon[31150]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:33 smithi154 ceph-mon[35136]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:36.009 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:35 smithi177 ceph-mon[35760]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:36.081 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:35 smithi154 ceph-mon[35136]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:35 smithi002 ceph-mon[31150]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:36.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:18:36.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:37.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:18:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:37.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:18:37.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:37.994 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:37 smithi177 ceph-mon[35760]: Deploying daemon osd.5 on smithi177 2024-09-10T23:18:37.994 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:37 smithi177 ceph-mon[35760]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:37 smithi002 ceph-mon[31150]: Deploying daemon osd.5 on smithi177 2024-09-10T23:18:38.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:37 smithi002 ceph-mon[31150]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:37 smithi154 ceph-mon[35136]: Deploying daemon osd.5 on smithi177 2024-09-10T23:18:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:37 smithi154 ceph-mon[35136]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:39 smithi177 ceph-mon[35760]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:40.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:39 smithi002 ceph-mon[31150]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:40.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:39 smithi154 ceph-mon[35136]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:42.047 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:41 smithi177 ceph-mon[35760]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:42.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:41 smithi002 ceph-mon[31150]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:42.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:41 smithi154 ceph-mon[35136]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:43.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:43.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:43.098 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:43.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:43.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:43.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:43.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:44.044 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:43 smithi177 ceph-mon[35760]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:44.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:43 smithi002 ceph-mon[31150]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:44.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:43 smithi154 ceph-mon[35136]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:46.086 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:45 smithi177 ceph-mon[35760]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:46.086 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.086 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.086 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:46.086 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:46.087 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:45 smithi002 ceph-mon[31150]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:46.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:45 smithi154 ceph-mon[35136]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:46.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.366+0000 7f0b4cff9640 1 -- 172.21.15.177:0/961257416 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0b50105620 con 0x7f0b3c0b52e0 2024-09-10T23:18:46.368 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 5 on host 'smithi177' 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b3c0b52e0 msgr2=0x7f0b3c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b3c0b52e0 0x7f0b3c0b77a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b38005ec0 tx=0x7f0b38000bc0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 msgr2=0x7f0b50198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 0x7f0b50198e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000d950 tx=0x7f0b4000de10 comp rx=0 tx=0).stop 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 shutdown_connections 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b3c0b52e0 0x7f0b3c0b77a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b50104550 0x7f0b5019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b50103b90 0x7f0b501994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 --2- 172.21.15.177:0/961257416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b50102a30 0x7f0b50198e90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 >> 172.21.15.177:0/961257416 conn(0x7f0b500fe320 msgr2=0x7f0b50104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 shutdown_connections 2024-09-10T23:18:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:18:46.369+0000 7f0b55677640 1 -- 172.21.15.177:0/961257416 wait complete. 2024-09-10T23:18:47.083 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:47.083 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:47.084 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:46 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:47.110 DEBUG:teuthology.orchestra.run.smithi177:osd.5> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T23:18:47.113 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-10T23:18:47.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:18:47.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:47.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:47.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:46 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:47.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:47.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:47.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:46 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:18:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:47 smithi177 ceph-mon[35760]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:47 smithi002 ceph-mon[31150]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:48.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:47 smithi154 ceph-mon[35136]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:48.542 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:18:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:18:48.359+0000 7f784f3f8640 -1 osd.5 0 log_to_monitors true 2024-09-10T23:18:49.098 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:48 smithi002 ceph-mon[31150]: from='osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:18:49.098 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:48 smithi002 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:18:49.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:48 smithi177 ceph-mon[35760]: from='osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:18:49.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:48 smithi177 ceph-mon[35760]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:18:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:48 smithi154 ceph-mon[35136]: from='osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:18:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:48 smithi154 ceph-mon[35136]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:18:50.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:49 smithi002 ceph-mon[31150]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:50.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:49 smithi002 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:18:50.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:49 smithi002 ceph-mon[31150]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:18:50.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:49 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:50.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:49 smithi002 ceph-mon[31150]: from='osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:18:50.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:49 smithi002 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:18:50.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:18:50.097 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-10T23:18:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:49 smithi177 ceph-mon[35760]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:49 smithi177 ceph-mon[35760]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:18:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:49 smithi177 ceph-mon[35760]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:18:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:49 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:50.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:49 smithi177 ceph-mon[35760]: from='osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:18:50.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:49 smithi177 ceph-mon[35760]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:18:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:49 smithi154 ceph-mon[35136]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:49 smithi154 ceph-mon[35136]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:18:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:49 smithi154 ceph-mon[35136]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:18:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:49 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:49 smithi154 ceph-mon[35136]: from='osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:18:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:49 smithi154 ceph-mon[35136]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:18:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:18:50.714 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:18:50.238+0000 7f784b37b640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:18:50.714 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:18:50.244+0000 7f784319a640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.849+0000 7f6979663640 1 -- 172.21.15.2:0/3329551831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 msgr2=0x7f6974075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.849+0000 7f6979663640 1 --2- 172.21.15.2:0/3329551831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f6974075fa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f695c009900 tx=0x7f695c02a410 comp rx=0 tx=0).stop 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 -- 172.21.15.2:0/3329551831 shutdown_connections 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 --2- 172.21.15.2:0/3329551831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f697410a970 0x7f697410ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 --2- 172.21.15.2:0/3329551831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f6974075fa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 --2- 172.21.15.2:0/3329551831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6974076f80 0x7f69740755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 -- 172.21.15.2:0/3329551831 >> 172.21.15.2:0/3329551831 conn(0x7f69740fe2f0 msgr2=0x7f6974100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 -- 172.21.15.2:0/3329551831 shutdown_connections 2024-09-10T23:18:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 -- 172.21.15.2:0/3329551831 wait complete. 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 Processor -- start 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 -- start start 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f697419afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6974076f80 0x7f697419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.850+0000 7f6979663640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f697410a970 0x7f697419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6979663640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6974110880 con 0x7f6974075b20 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6979663640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6974110700 con 0x7f697410a970 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6979663640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6974110a00 con 0x7f6974076f80 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f697419afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f697419afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58952/0 (socket says 172.21.15.2:58952) 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 -- 172.21.15.2:0/3350851522 learned_addr learned my addr 172.21.15.2:0/3350851522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f69727fc640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6974076f80 0x7f697419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f69737fe640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f697410a970 0x7f697419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 -- 172.21.15.2:0/3350851522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6974076f80 msgr2=0x7f697419b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6974076f80 0x7f697419b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 -- 172.21.15.2:0/3350851522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f697410a970 msgr2=0x7f697419c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f697410a970 0x7f697419c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 -- 172.21.15.2:0/3350851522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697419cad0 con 0x7f6974075b20 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f69737fe640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f697410a970 0x7f697419c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.851+0000 7f6972ffd640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f697419afa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f696400cce0 tx=0x7f696400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.852+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964004b20 con 0x7f6974075b20 2024-09-10T23:18:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.852+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6964004cc0 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.852+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697419cdc0 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.852+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696400f6b0 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.852+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69741a34a0 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.853+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69741a36d0 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.854+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f696400f850 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.855+0000 7f696bfff640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69600b5360 0x7f69600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.855+0000 7f69727fc640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69600b5360 0x7f69600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.856+0000 7f69727fc640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69600b5360 0x7f69600b7820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f695c000c00 tx=0x7f695c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.857+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f69640e38a0 con 0x7f6974075b20 2024-09-10T23:18:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:50.862+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6964014030 con 0x7f6974075b20 2024-09-10T23:18:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:18:51.059+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f69741a38a0 con 0x7f69600b5360 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi177 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi177 to 8543M 2024-09-10T23:18:51.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:51.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:51.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:50 smithi002 ceph-mon[31150]: from='osd.5 ' entity='osd.5' 2024-09-10T23:18:51.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:18:51.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi177 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi177 to 8543M 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:51.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:50 smithi177 ceph-mon[35760]: from='osd.5 ' entity='osd.5' 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi177 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi177 to 8543M 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:18:51.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:50 smithi154 ceph-mon[35136]: from='osd.5 ' entity='osd.5' 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] boot 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:52.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:18:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:18:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:52.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] boot 2024-09-10T23:18:52.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:18:52.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:52.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:52.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:52.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:18:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:18:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:18:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: osd.5 [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] boot 2024-09-10T23:18:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:18:52.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:18:52.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:52.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:52.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:53.093 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:52 smithi002 ceph-mon[31150]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:53.093 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:52 smithi002 ceph-mon[31150]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:18:53.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:52 smithi177 ceph-mon[35760]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:53.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:52 smithi177 ceph-mon[35760]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:18:53.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:52 smithi154 ceph-mon[35136]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:53.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:52 smithi154 ceph-mon[35136]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:18:54.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:53 smithi002 ceph-mon[31150]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:18:54.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:53 smithi002 ceph-mon[31150]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:18:54.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:53 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4246890340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "843cbdb2-0356-4d03-bd97-472b65618974"} : dispatch 2024-09-10T23:18:54.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:53 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4246890340' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "843cbdb2-0356-4d03-bd97-472b65618974"}]': finished 2024-09-10T23:18:54.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:53 smithi002 ceph-mon[31150]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:18:54.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:18:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:53 smithi177 ceph-mon[35760]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:18:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:53 smithi177 ceph-mon[35760]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:18:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:53 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4246890340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "843cbdb2-0356-4d03-bd97-472b65618974"} : dispatch 2024-09-10T23:18:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:53 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4246890340' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "843cbdb2-0356-4d03-bd97-472b65618974"}]': finished 2024-09-10T23:18:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:53 smithi177 ceph-mon[35760]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:18:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:18:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:53 smithi154 ceph-mon[35136]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:18:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:53 smithi154 ceph-mon[35136]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:18:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:53 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4246890340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "843cbdb2-0356-4d03-bd97-472b65618974"} : dispatch 2024-09-10T23:18:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:53 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4246890340' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "843cbdb2-0356-4d03-bd97-472b65618974"}]': finished 2024-09-10T23:18:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:53 smithi154 ceph-mon[35136]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:18:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:18:55.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:54 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3121823478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:55.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:54 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3121823478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:55.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:54 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3121823478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:55 smithi177 ceph-mon[35760]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:18:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:55 smithi002 ceph-mon[31150]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:18:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:55 smithi154 ceph-mon[35136]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:18:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:57 smithi177 ceph-mon[35760]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T23:18:58.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:57 smithi002 ceph-mon[31150]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T23:18:58.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:57 smithi154 ceph-mon[35136]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T23:19:00.169 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:18:59 smithi002 ceph-mon[31150]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T23:19:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:18:59 smithi177 ceph-mon[35760]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T23:19:00.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:18:59 smithi154 ceph-mon[35136]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T23:19:02.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:01 smithi002 ceph-mon[31150]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:19:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:01 smithi177 ceph-mon[35760]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:19:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:01 smithi154 ceph-mon[35136]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:19:03.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:19:03.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:19:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:03.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:19:03.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:04.176 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:03 smithi002 ceph-mon[31150]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:19:04.176 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:03 smithi002 ceph-mon[31150]: Deploying daemon osd.6 on smithi002 2024-09-10T23:19:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:03 smithi177 ceph-mon[35760]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:19:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:03 smithi177 ceph-mon[35760]: Deploying daemon osd.6 on smithi002 2024-09-10T23:19:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:03 smithi154 ceph-mon[35136]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:19:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:03 smithi154 ceph-mon[35136]: Deploying daemon osd.6 on smithi002 2024-09-10T23:19:06.160 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:05 smithi002 ceph-mon[31150]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:19:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:05 smithi177 ceph-mon[35760]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:19:06.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:05 smithi154 ceph-mon[35136]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:19:07.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:07 smithi002 ceph-mon[31150]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:19:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:07 smithi177 ceph-mon[35760]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:19:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:07 smithi154 ceph-mon[35136]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:19:09.164 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:09.164 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:09.164 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:10.204 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:09 smithi002 ceph-mon[31150]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:09 smithi177 ceph-mon[35760]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:10.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:09 smithi154 ceph-mon[35136]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:12.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:11 smithi002 ceph-mon[31150]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:12.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:12.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:12.153 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:11 smithi177 ceph-mon[35760]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:12.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:12.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:11 smithi154 ceph-mon[35136]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:12.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:12.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:12.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.501+0000 7f696bfff640 1 -- 172.21.15.2:0/3350851522 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f69741a38a0 con 0x7f69600b5360 2024-09-10T23:19:12.503 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-09-10T23:19:12.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69600b5360 msgr2=0x7f69600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:12.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69600b5360 0x7f69600b7820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f695c000c00 tx=0x7f695c0314a0 comp rx=0 tx=0).stop 2024-09-10T23:19:12.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 msgr2=0x7f697419afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:12.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f697419afa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f696400cce0 tx=0x7f696400a620 comp rx=0 tx=0).stop 2024-09-10T23:19:12.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 shutdown_connections 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69600b5360 0x7f69600b7820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f697410a970 0x7f697419c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6974076f80 0x7f697419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 --2- 172.21.15.2:0/3350851522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6974075b20 0x7f697419afa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 >> 172.21.15.2:0/3350851522 conn(0x7f69740fe2f0 msgr2=0x7f69740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 shutdown_connections 2024-09-10T23:19:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:19:12.503+0000 7f6979663640 1 -- 172.21.15.2:0/3350851522 wait complete. 2024-09-10T23:19:13.174 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:13.174 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:13.175 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:12 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:13.208 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T23:19:13.211 INFO:tasks.cephadm:Deploying osd.7 on smithi154 with /dev/vg_nvme/lv_2... 2024-09-10T23:19:13.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:19:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:12 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:12 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:12 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:13.238 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:12 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:13.238 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:12 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:13.238 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:12 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:19:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:13 smithi177 ceph-mon[35760]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:13 smithi002 ceph-mon[31150]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:13 smithi154 ceph-mon[35136]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:14.601 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:19:14 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:19:14.256+0000 7f972be98640 -1 osd.6 0 log_to_monitors true 2024-09-10T23:19:15.190 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:14 smithi154 ceph-mon[35136]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:19:15.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:14 smithi177 ceph-mon[35760]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:19:15.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:14 smithi002 ceph-mon[31150]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:19:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:15 smithi177 ceph-mon[35760]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:15 smithi177 ceph-mon[35760]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:19:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:15 smithi177 ceph-mon[35760]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:15 smithi177 ceph-mon[35760]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:15 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-mon[31150]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-mon[31150]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-mon[31150]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-mon[31150]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:19:16.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:16.216 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:19:15.924+0000 7f9727e1b640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:19:16.216 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:19:15 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:19:15.932+0000 7f9723c42640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:19:16.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:15 smithi154 ceph-mon[35136]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:16.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:15 smithi154 ceph-mon[35136]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:19:16.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:15 smithi154 ceph-mon[35136]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:19:16.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:15 smithi154 ceph-mon[35136]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:19:16.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:15 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:16.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:19:16.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-09-10T23:19:16.609 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.016 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:17.017 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:17.017 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 -- 172.21.15.154:0/3152305487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808104550 msgr2=0x7ff80810aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/3152305487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808104550 0x7ff80810aed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff800009cd0 tx=0x7ff80002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 -- 172.21.15.154:0/3152305487 shutdown_connections 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/3152305487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808104550 0x7ff80810aed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/3152305487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 0x7ff808104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/3152305487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808102a30 0x7ff808102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:17.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 -- 172.21.15.154:0/3152305487 >> 172.21.15.154:0/3152305487 conn(0x7ff8080fe320 msgr2=0x7ff808100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 -- 172.21.15.154:0/3152305487 shutdown_connections 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.098+0000 7ff80f5a2640 1 -- 172.21.15.154:0/3152305487 wait complete. 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 Processor -- start 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 -- start start 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 0x7ff808198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 0x7ff808199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808104550 0x7ff80819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff80810e710 con 0x7ff808104550 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff80810e590 con 0x7ff808102a30 2024-09-10T23:19:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80f5a2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff80810e890 con 0x7ff808103b90 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 0x7ff808198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 0x7ff808198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53094/0 (socket says 172.21.15.154:53094) 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 -- 172.21.15.154:0/1825678032 learned_addr learned my addr 172.21.15.154:0/1825678032 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80db3f640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808104550 0x7ff80819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 -- 172.21.15.154:0/1825678032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 msgr2=0x7ff808199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80cb3d640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 0x7ff808199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 0x7ff808199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 -- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808104550 msgr2=0x7ff80819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808104550 0x7ff80819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80d33e640 1 -- 172.21.15.154:0/1825678032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80819a950 con 0x7ff808102a30 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80db3f640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808104550 0x7ff80819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:17.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.099+0000 7ff80cb3d640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 0x7ff808199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.100+0000 7ff80d33e640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 0x7ff808198e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c920 tx=0x7ff80400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.100+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804007c70 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.100+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff804007e10 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.100+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80819ac40 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.100+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804018820 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.100+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8081a1320 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.101+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff808109ce0 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.102+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7ff80400f450 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.103+0000 7ff7fe7fc640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff7f40b52e0 0x7ff7f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.103+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4965+0+0 (secure 0 0 0) 0x7ff8040e5340 con 0x7ff808102a30 2024-09-10T23:19:17.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.103+0000 7ff80cb3d640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff7f40b52e0 0x7ff7f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:17.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.104+0000 7ff80cb3d640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff7f40b52e0 0x7ff7f40b77a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8006fd0 tx=0x7ff7f8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:17.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.106+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff804014030 con 0x7ff808102a30 2024-09-10T23:19:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:17.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:17.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:17.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:17.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:17.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:17.293+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff808063590 con 0x7ff7f40b52e0 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi002 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] boot 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:18.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:18.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:17 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:19:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi002 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] boot 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:18.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:17 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:19:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi002 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: osd.6 [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] boot 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:17 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:19.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:18 smithi154 ceph-mon[35136]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:19.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:18 smithi154 ceph-mon[35136]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:19:19.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:18 smithi177 ceph-mon[35760]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:19.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:18 smithi177 ceph-mon[35760]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:19:19.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:18 smithi002 ceph-mon[31150]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:19.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:18 smithi002 ceph-mon[31150]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:19:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:19 smithi177 ceph-mon[35760]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:19 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/3512741203' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"} : dispatch 2024-09-10T23:19:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:19 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"} : dispatch 2024-09-10T23:19:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:19 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"}]': finished 2024-09-10T23:19:20.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:19 smithi177 ceph-mon[35760]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:19:20.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:19 smithi002 ceph-mon[31150]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:19 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/3512741203' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"} : dispatch 2024-09-10T23:19:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:19 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"} : dispatch 2024-09-10T23:19:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:19 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"}]': finished 2024-09-10T23:19:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:19 smithi002 ceph-mon[31150]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:19:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:19 smithi154 ceph-mon[35136]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:19 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/3512741203' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"} : dispatch 2024-09-10T23:19:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:19 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"} : dispatch 2024-09-10T23:19:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:19 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4429311c-fcfa-4d52-b1bf-627c2d65bc97"}]': finished 2024-09-10T23:19:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:19 smithi154 ceph-mon[35136]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:19:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:21.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:20 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/445018309' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:21.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/445018309' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:21.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:20 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/445018309' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:21 smithi177 ceph-mon[35760]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:21 smithi002 ceph-mon[31150]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:21 smithi154 ceph-mon[35136]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:24.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:23 smithi177 ceph-mon[35760]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:23 smithi002 ceph-mon[31150]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:23 smithi154 ceph-mon[35136]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:26.053 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:25 smithi154 ceph-mon[35136]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:25 smithi177 ceph-mon[35760]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:25 smithi002 ceph-mon[31150]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:28.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:27 smithi177 ceph-mon[35760]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:27 smithi002 ceph-mon[31150]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:28.240 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:27 smithi154 ceph-mon[35136]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:29.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:19:29.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:19:29.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:19:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.989 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:29 smithi154 ceph-mon[35136]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:29.990 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:29 smithi154 ceph-mon[35136]: Deploying daemon osd.7 on smithi154 2024-09-10T23:19:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:29 smithi002 ceph-mon[31150]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:30.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:29 smithi002 ceph-mon[31150]: Deploying daemon osd.7 on smithi154 2024-09-10T23:19:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:29 smithi177 ceph-mon[35760]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:29 smithi177 ceph-mon[35760]: Deploying daemon osd.7 on smithi154 2024-09-10T23:19:32.094 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:31 smithi154 ceph-mon[35136]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:31 smithi002 ceph-mon[31150]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:31 smithi177 ceph-mon[35760]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:33.245 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:33 smithi154 ceph-mon[35136]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:33.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:33 smithi177 ceph-mon[35760]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:33.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:33 smithi002 ceph-mon[31150]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:35.255 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:35 smithi154 ceph-mon[35136]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:35.255 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:35.255 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:35.256 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:35.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:35 smithi002 ceph-mon[31150]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:35.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:35.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:35.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:35 smithi177 ceph-mon[35760]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:37.450 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:37 smithi154 ceph-mon[35136]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:37.516 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:37 smithi177 ceph-mon[35760]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:37.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:37 smithi002 ceph-mon[31150]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:38.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.110+0000 7ff7fe7fc640 1 -- 172.21.15.154:0/1825678032 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff808063590 con 0x7ff7f40b52e0 2024-09-10T23:19:38.113 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 7 on host 'smithi154' 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff7f40b52e0 msgr2=0x7ff7f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff7f40b52e0 0x7ff7f40b77a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8006fd0 tx=0x7ff7f8008040 comp rx=0 tx=0).stop 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 msgr2=0x7ff808198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 0x7ff808198e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c920 tx=0x7ff80400cde0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 shutdown_connections 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff7f40b52e0 0x7ff7f40b77a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff808104550 0x7ff80819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff808103b90 0x7ff808199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 --2- 172.21.15.154:0/1825678032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff808102a30 0x7ff808198e20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 >> 172.21.15.154:0/1825678032 conn(0x7ff8080fe320 msgr2=0x7ff808106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 shutdown_connections 2024-09-10T23:19:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:19:38.114+0000 7ff80f5a2640 1 -- 172.21.15.154:0/1825678032 wait complete. 2024-09-10T23:19:38.798 DEBUG:teuthology.orchestra.run.smithi154:osd.7> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T23:19:38.801 INFO:tasks.cephadm:Deploying osd.8 on smithi177 with /dev/vg_nvme/lv_2... 2024-09-10T23:19:38.801 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:19:39.057 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:19:39.428 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:39 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.428 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:39 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.428 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:39 smithi177 ceph-mon[35760]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:39.428 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:39 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.428 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:39 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:39 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:39 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:39 smithi154 ceph-mon[35136]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:39.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:39 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:39 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:39 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:39 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:39 smithi002 ceph-mon[31150]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:39.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:39 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:39.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:39 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:41.029 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:19:40 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:19:40.866+0000 7fe9b53d7640 -1 osd.7 0 log_to_monitors true 2024-09-10T23:19:41.393 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:41 smithi177 ceph-mon[35760]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:41.393 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:41 smithi177 ceph-mon[35760]: from='osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:19:41.393 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:41 smithi177 ceph-mon[35760]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:19:41.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:41 smithi154 ceph-mon[35136]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:41.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:41 smithi154 ceph-mon[35136]: from='osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:19:41.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:41 smithi154 ceph-mon[35136]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:19:41.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:41 smithi002 ceph-mon[31150]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:41.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:41 smithi002 ceph-mon[31150]: from='osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:19:41.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:41 smithi002 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:19:41.920 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:19:41.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_2 2024-09-10T23:19:42.197 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:42.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.608 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:19:42.608 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:42.610 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:42.610 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:42.610 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 -- 172.21.15.177:0/388020880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8103430 msgr2=0x7fabb8109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 --2- 172.21.15.177:0/388020880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8103430 0x7fabb8109db0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009d00 tx=0x7fabb002a910 comp rx=0 tx=0).stop 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 -- 172.21.15.177:0/388020880 shutdown_connections 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 --2- 172.21.15.177:0/388020880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8103430 0x7fabb8109db0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 --2- 172.21.15.177:0/388020880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8102a70 0x7fabb8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 --2- 172.21.15.177:0/388020880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 0x7fabb8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 -- 172.21.15.177:0/388020880 >> 172.21.15.177:0/388020880 conn(0x7fabb80fd1e0 msgr2=0x7fabb80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 -- 172.21.15.177:0/388020880 shutdown_connections 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.688+0000 7fabbe61b640 1 -- 172.21.15.177:0/388020880 wait complete. 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 Processor -- start 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 -- start start 2024-09-10T23:19:42.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 0x7fabb806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 0x7fabb819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8103430 0x7fabb81a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fabb810d570 con 0x7fabb8101910 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabb810d3f0 con 0x7fabb8103430 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbe61b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fabb810d6f0 con 0x7fabb8102a70 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabb77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 0x7fabb819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabb77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 0x7fabb819daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40598/0 (socket says 172.21.15.177:40598) 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabb77fe640 1 -- 172.21.15.177:0/3161795623 learned_addr learned my addr 172.21.15.177:0/3161795623 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabbcbb8640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8103430 0x7fabb81a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.689+0000 7fabb7fff640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 0x7fabb806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb77fe640 1 -- 172.21.15.177:0/3161795623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8103430 msgr2=0x7fabb81a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb77fe640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8103430 0x7fabb81a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb77fe640 1 -- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 msgr2=0x7fabb806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb77fe640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 0x7fabb806b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb77fe640 1 -- 172.21.15.177:0/3161795623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb81a0950 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb7fff640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 0x7fabb806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb77fe640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 0x7fabb819daa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fabac00e9f0 tx=0x7fabac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac00cd80 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb81a0c40 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabac0108e0 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac018980 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.690+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb81a1180 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.691+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb8108c30 con 0x7fabb8102a70 2024-09-10T23:19:42.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.692+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fabac010430 con 0x7fabb8102a70 2024-09-10T23:19:42.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.693+0000 7fabb57fa640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faba00b52e0 0x7faba00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.694+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7fabac0e5400 con 0x7fabb8102a70 2024-09-10T23:19:42.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.694+0000 7fabb7fff640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faba00b52e0 0x7faba00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.694+0000 7fabb7fff640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faba00b52e0 0x7faba00b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faba8009b40 tx=0x7faba8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.698+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fabac0acf40 con 0x7fabb8102a70 2024-09-10T23:19:42.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:42.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:19:42.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:19:42.885+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fabb8063590 con 0x7faba00b52e0 2024-09-10T23:19:43.029 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:19:42.645+0000 7fe9b1b6e640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:19:43.029 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:19:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:19:42.653+0000 7fe9a9179640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:19:43.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi154 2024-09-10T23:19:43.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-10T23:19:43.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:43.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:19:43.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='osd.7 ' entity='osd.7' 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] boot 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:19:43.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:43 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi154 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='osd.7 ' entity='osd.7' 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] boot 2024-09-10T23:19:43.542 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:19:43.543 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:43 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi154 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='osd.7 ' entity='osd.7' 2024-09-10T23:19:43.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:43.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:43.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:43.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:43.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: osd.7 [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] boot 2024-09-10T23:19:43.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:19:43.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:43 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:19:44.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:44 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:19:44.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:44 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:19:44.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:44 smithi177 ceph-mon[35760]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:19:45.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:44 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:19:45.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:44 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:19:45.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:44 smithi154 ceph-mon[35136]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:19:45.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:44 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:19:45.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:44 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:19:45.253 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:44 smithi002 ceph-mon[31150]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:19:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:19:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/4270416805' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"} : dispatch 2024-09-10T23:19:45.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"} : dispatch 2024-09-10T23:19:45.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"}]': finished 2024-09-10T23:19:45.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:19:45.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/4270416805' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"} : dispatch 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"} : dispatch 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"}]': finished 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:19:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:19:46.138 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:46.138 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:19:46.138 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/4270416805' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"} : dispatch 2024-09-10T23:19:46.138 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"} : dispatch 2024-09-10T23:19:46.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23e4001a-571b-4bf0-a4d9-04e1a2589298"}]': finished 2024-09-10T23:19:46.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:19:46.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:19:47.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:46 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/1979104653' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:47.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:46 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/1979104653' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:47.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:46 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/1979104653' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:48.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:47 smithi154 ceph-mon[35136]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:47 smithi177 ceph-mon[35760]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:47 smithi002 ceph-mon[31150]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:50.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:49 smithi154 ceph-mon[35136]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:50.190 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:49 smithi177 ceph-mon[35760]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:50.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:49 smithi002 ceph-mon[31150]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:19:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:51 smithi177 ceph-mon[35760]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:19:52.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:51 smithi154 ceph-mon[35136]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:19:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:51 smithi002 ceph-mon[31150]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:19:53.821 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:53 smithi177 ceph-mon[35760]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:19:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:53 smithi002 ceph-mon[31150]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:19:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:53 smithi154 ceph-mon[35136]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:19:54.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:54 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:19:54.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:54 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:54.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:54 smithi177 ceph-mon[35760]: Deploying daemon osd.8 on smithi177 2024-09-10T23:19:55.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:54 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:19:55.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:54 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:55.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:54 smithi002 ceph-mon[31150]: Deploying daemon osd.8 on smithi177 2024-09-10T23:19:55.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:54 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:19:55.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:54 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:55.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:54 smithi154 ceph-mon[35136]: Deploying daemon osd.8 on smithi177 2024-09-10T23:19:55.805 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:55 smithi177 ceph-mon[35760]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:19:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:55 smithi002 ceph-mon[31150]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:19:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:55 smithi154 ceph-mon[35136]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:19:58.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:57 smithi177 ceph-mon[35760]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T23:19:58.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:57 smithi002 ceph-mon[31150]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T23:19:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:57 smithi154 ceph-mon[35136]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T23:19:59.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:19:59 smithi177 ceph-mon[35760]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:00.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:19:59 smithi002 ceph-mon[31150]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:19:59 smithi154 ceph-mon[35136]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:00.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:00 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:00.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:00 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:00.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:00 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:00.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:00 smithi177 ceph-mon[35760]: overall HEALTH_OK 2024-09-10T23:20:01.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:00 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:01.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:00 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:01.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:00 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:01.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:00 smithi002 ceph-mon[31150]: overall HEALTH_OK 2024-09-10T23:20:01.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:00 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:01.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:00 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:01.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:00 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:01.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:00 smithi154 ceph-mon[35136]: overall HEALTH_OK 2024-09-10T23:20:02.146 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:01 smithi177 ceph-mon[35760]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:02.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:01 smithi002 ceph-mon[31150]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:02.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:01 smithi154 ceph-mon[35136]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:03.099 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 8 on host 'smithi177' 2024-09-10T23:20:03.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.098+0000 7fabb57fa640 1 -- 172.21.15.177:0/3161795623 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fabb8063590 con 0x7faba00b52e0 2024-09-10T23:20:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.100+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faba00b52e0 msgr2=0x7faba00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.100+0000 7fabbe61b640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faba00b52e0 0x7faba00b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faba8009b40 tx=0x7faba8005e50 comp rx=0 tx=0).stop 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.100+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 msgr2=0x7fabb819daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.100+0000 7fabbe61b640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 0x7fabb819daa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fabac00e9f0 tx=0x7fabac00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 shutdown_connections 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faba00b52e0 0x7faba00b77a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8103430 0x7fabb81a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb8102a70 0x7fabb819daa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 --2- 172.21.15.177:0/3161795623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb8101910 0x7fabb806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 >> 172.21.15.177:0/3161795623 conn(0x7fabb80fd1e0 msgr2=0x7fabb8105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 shutdown_connections 2024-09-10T23:20:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:03.101+0000 7fabbe61b640 1 -- 172.21.15.177:0/3161795623 wait complete. 2024-09-10T23:20:03.749 DEBUG:teuthology.orchestra.run.smithi177:osd.8> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T23:20:03.752 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-09-10T23:20:03.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:20:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:20:04.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:03 smithi002 ceph-mon[31150]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:04.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:03 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:03 smithi177 ceph-mon[35760]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:03 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:03 smithi154 ceph-mon[35136]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:03 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:05.540 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:20:05 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:20:05.490+0000 7f7aae283640 -1 osd.8 0 log_to_monitors true 2024-09-10T23:20:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:05 smithi177 ceph-mon[35760]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:05 smithi177 ceph-mon[35760]: from='osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:20:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:05 smithi177 ceph-mon[35760]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:20:06.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:05 smithi002 ceph-mon[31150]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:06.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:05 smithi002 ceph-mon[31150]: from='osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:20:06.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:05 smithi002 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:20:06.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:05 smithi154 ceph-mon[35136]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:06.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:05 smithi154 ceph-mon[35136]: from='osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:20:06.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:05 smithi154 ceph-mon[35136]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:20:06.866 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:20:06.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-09-10T23:20:07.171 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:20:07.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-mon[35760]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:20:07.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-mon[35760]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:20:07.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:07.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-mon[35760]: from='osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:20:07.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-mon[35760]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:20:07.215 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:20:06.952+0000 7f7aaa206640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T23:20:07.215 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:20:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:20:06.968+0000 7f7aa602d640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:20:07.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:06 smithi002 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:20:07.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:06 smithi002 ceph-mon[31150]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:20:07.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:06 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:07.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:06 smithi002 ceph-mon[31150]: from='osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:20:07.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:06 smithi002 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:20:07.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:06 smithi154 ceph-mon[35136]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:20:07.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:06 smithi154 ceph-mon[35136]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:20:07.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:06 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:07.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:06 smithi154 ceph-mon[35136]: from='osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:20:07.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:06 smithi154 ceph-mon[35136]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 -- 172.21.15.2:0/3591821296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 msgr2=0x7f041c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 --2- 172.21.15.2:0/3591821296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c102ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0410009cd0 tx=0x7f041002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 -- 172.21.15.2:0/3591821296 shutdown_connections 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 --2- 172.21.15.2:0/3591821296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f041c103430 0x7f041c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 --2- 172.21.15.2:0/3591821296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c102ef0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 --2- 172.21.15.2:0/3591821296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 0x7f041c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 -- 172.21.15.2:0/3591821296 >> 172.21.15.2:0/3591821296 conn(0x7f041c0fd1e0 msgr2=0x7f041c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 -- 172.21.15.2:0/3591821296 shutdown_connections 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.701+0000 7f0423d8b640 1 -- 172.21.15.2:0/3591821296 wait complete. 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 Processor -- start 2024-09-10T23:20:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 -- start start 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 0x7f041c06b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f041c103430 0x7f041c1a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f041c10d570 con 0x7f041c102a70 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f041c10d3f0 con 0x7f041c101910 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0423d8b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f041c10d6f0 con 0x7f041c103430 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c19ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57978/0 (socket says 172.21.15.2:57978) 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 -- 172.21.15.2:0/2881546301 learned_addr learned my addr 172.21.15.2:0/2881546301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421b27640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 0x7f041c06b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0422328640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f041c103430 0x7f041c1a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 -- 172.21.15.2:0/2881546301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f041c103430 msgr2=0x7f041c1a24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f041c103430 0x7f041c1a24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 -- 172.21.15.2:0/2881546301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 msgr2=0x7f041c06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 0x7f041c06b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421326640 1 -- 172.21.15.2:0/2881546301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c1a2bf0 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.702+0000 7f0421b27640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 0x7f041c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.703+0000 7f0421326640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c19ff50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04100098d0 tx=0x7f0410003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.703+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410004450 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.703+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04100045f0 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.703+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c1a2e80 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.703+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410045670 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.703+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c1a3330 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.704+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c108c30 con 0x7f041c102a70 2024-09-10T23:20:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.705+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f041004d070 con 0x7f041c102a70 2024-09-10T23:20:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.706+0000 7f040effd640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04080b52e0 0x7f04080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.706+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5549+0+0 (secure 0 0 0) 0x7f041002e030 con 0x7f041c102a70 2024-09-10T23:20:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.706+0000 7f0421b27640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04080b52e0 0x7f04080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.707+0000 7f0421b27640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04080b52e0 0x7f04080b77a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f041800abe0 tx=0x7f041800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.709+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f041004a060 con 0x7f041c102a70 2024-09-10T23:20:07.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:07.906+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f041c063590 con 0x7f04080b52e0 2024-09-10T23:20:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:20:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:08.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:08.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:08.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:08.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:08.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:08.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:08.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:08.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:08.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:08.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:20:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:20:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi177 2024-09-10T23:20:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi177 to 5695M 2024-09-10T23:20:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:09.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:09.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] boot 2024-09-10T23:20:09.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:20:09.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:09.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:08 smithi177 ceph-mon[35760]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:20:09.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi177 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi177 to 5695M 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] boot 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:09.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:08 smithi002 ceph-mon[31150]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi177 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi177 to 5695M 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: osd.8 [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] boot 2024-09-10T23:20:09.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:20:09.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:20:09.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:08 smithi154 ceph-mon[35136]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:20:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:09 smithi177 ceph-mon[35760]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:09 smithi177 ceph-mon[35760]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:20:10.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:09 smithi002 ceph-mon[31150]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:10.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:09 smithi002 ceph-mon[31150]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:20:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:09 smithi154 ceph-mon[35136]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:10.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:09 smithi154 ceph-mon[35136]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:20:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1927880517' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac4ba62-a52e-4008-b126-e8a29957fcf5"} : dispatch 2024-09-10T23:20:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1927880517' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ac4ba62-a52e-4008-b126-e8a29957fcf5"}]': finished 2024-09-10T23:20:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:10 smithi177 ceph-mon[35760]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:20:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:10 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1927880517' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac4ba62-a52e-4008-b126-e8a29957fcf5"} : dispatch 2024-09-10T23:20:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1927880517' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ac4ba62-a52e-4008-b126-e8a29957fcf5"}]': finished 2024-09-10T23:20:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:10 smithi002 ceph-mon[31150]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:20:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:10 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:11.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1927880517' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac4ba62-a52e-4008-b126-e8a29957fcf5"} : dispatch 2024-09-10T23:20:11.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1927880517' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ac4ba62-a52e-4008-b126-e8a29957fcf5"}]': finished 2024-09-10T23:20:11.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:10 smithi154 ceph-mon[35136]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:20:11.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:10 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:11 smithi177 ceph-mon[35760]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3525956791' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:11 smithi002 ceph-mon[31150]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3525956791' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:11 smithi154 ceph-mon[35136]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3525956791' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:13 smithi002 ceph-mon[31150]: pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:14.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:13 smithi154 ceph-mon[35136]: pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:14.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:13 smithi177 ceph-mon[35760]: pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:16.118 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:15 smithi002 ceph-mon[31150]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:20:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:15 smithi154 ceph-mon[35136]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:20:16.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:15 smithi177 ceph-mon[35760]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:20:18.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:17 smithi002 ceph-mon[31150]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T23:20:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:17 smithi154 ceph-mon[35136]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T23:20:18.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:17 smithi177 ceph-mon[35760]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T23:20:20.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:19 smithi002 ceph-mon[31150]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-10T23:20:20.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:20:20.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:19 smithi154 ceph-mon[35136]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-10T23:20:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:20:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:19 smithi177 ceph-mon[35760]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-10T23:20:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:20:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:21.180 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:20 smithi002 ceph-mon[31150]: Deploying daemon osd.9 on smithi002 2024-09-10T23:20:21.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:20 smithi154 ceph-mon[35136]: Deploying daemon osd.9 on smithi002 2024-09-10T23:20:21.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:20 smithi177 ceph-mon[35760]: Deploying daemon osd.9 on smithi002 2024-09-10T23:20:22.134 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:21 smithi002 ceph-mon[31150]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:20:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:21 smithi154 ceph-mon[35136]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:20:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:21 smithi177 ceph-mon[35760]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:20:23.144 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:22 smithi002 ceph-mon[31150]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T23:20:23.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:22 smithi154 ceph-mon[35136]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T23:20:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:22 smithi177 ceph-mon[35760]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T23:20:25.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:25 smithi002 ceph-mon[31150]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:25.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:25.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:25.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:25.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:25 smithi154 ceph-mon[35136]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:25.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:25.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:25.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:25 smithi177 ceph-mon[35760]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:20:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:27.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:27 smithi002 ceph-mon[31150]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:27.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:27 smithi154 ceph-mon[35136]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:27 smithi177 ceph-mon[35760]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:28.860 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-09-10T23:20:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.859+0000 7f040effd640 1 -- 172.21.15.2:0/2881546301 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f041c063590 con 0x7f04080b52e0 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04080b52e0 msgr2=0x7f04080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04080b52e0 0x7f04080b77a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f041800abe0 tx=0x7f041800a5c0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 msgr2=0x7f041c19ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c19ff50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04100098d0 tx=0x7f0410003c20 comp rx=0 tx=0).stop 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 shutdown_connections 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04080b52e0 0x7f04080b77a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f041c103430 0x7f041c1a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f041c102a70 0x7f041c19ff50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 --2- 172.21.15.2:0/2881546301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f041c101910 0x7f041c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 >> 172.21.15.2:0/2881546301 conn(0x7f041c0fd1e0 msgr2=0x7f041c105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 shutdown_connections 2024-09-10T23:20:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:20:28.862+0000 7f0423d8b640 1 -- 172.21.15.2:0/2881546301 wait complete. 2024-09-10T23:20:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:29.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:29.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:29.614 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T23:20:29.617 INFO:tasks.cephadm:Deploying osd.10 on smithi154 with /dev/vg_nvme/lv_1... 2024-09-10T23:20:29.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:20:29.874 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:20:30.755 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:20:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:20:30.498+0000 7f2c14c22640 -1 osd.9 0 log_to_monitors true 2024-09-10T23:20:31.347 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:31 smithi154 ceph-mon[35136]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:31.353 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:31 smithi154 ceph-mon[35136]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:20:31.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:31 smithi002 ceph-mon[31150]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:31.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:31 smithi002 ceph-mon[31150]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:20:31.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:31 smithi177 ceph-mon[35760]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:31.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:31 smithi177 ceph-mon[35760]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:20:32.375 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:32 smithi002 ceph-mon[31150]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:20:32.376 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:32 smithi002 ceph-mon[31150]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:20:32.376 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:32 smithi002 ceph-mon[31150]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:20:32.376 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:32.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:32 smithi154 ceph-mon[35136]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:20:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:32 smithi154 ceph-mon[35136]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:20:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:32 smithi154 ceph-mon[35136]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:20:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T23:20:32.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:32 smithi177 ceph-mon[35760]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:20:32.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:32 smithi177 ceph-mon[35760]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:20:32.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:32 smithi177 ceph-mon[35760]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]} : dispatch 2024-09-10T23:20:32.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:32.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-09-10T23:20:32.974 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:20:32.986 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:20:32 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:20:32.701+0000 7f2c113b9640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T23:20:32.986 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:20:32 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:20:32.711+0000 7f2c089c4640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:20:33.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi002 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.439 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.440 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:33 smithi154 ceph-mon[35136]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' 2024-09-10T23:20:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 -- 172.21.15.154:0/604535265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 msgr2=0x7f434c102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 --2- 172.21.15.154:0/604535265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c102e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f433c009cd0 tx=0x7f433c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 -- 172.21.15.154:0/604535265 shutdown_connections 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 --2- 172.21.15.154:0/604535265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c104560 0x7f434c10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 --2- 172.21.15.154:0/604535265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 0x7f434c104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 --2- 172.21.15.154:0/604535265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c102e40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 -- 172.21.15.154:0/604535265 >> 172.21.15.154:0/604535265 conn(0x7f434c0fe2f0 msgr2=0x7f434c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 -- 172.21.15.154:0/604535265 shutdown_connections 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.521+0000 7f4351c91640 1 -- 172.21.15.154:0/604535265 wait complete. 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 Processor -- start 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 -- start start 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 0x7f434c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c104560 0x7f434c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f434c10e6a0 con 0x7f434c104560 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f434c10e520 con 0x7f434c102a40 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f4351c91640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f434c10e820 con 0x7f434c103ba0 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.522+0000 7f434b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45812/0 (socket says 172.21.15.154:45812) 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 -- 172.21.15.154:0/380908087 learned_addr learned my addr 172.21.15.154:0/380908087 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434affd640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 0x7f434c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 -- 172.21.15.154:0/380908087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 msgr2=0x7f434c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 0x7f434c199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434bfff640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c104560 0x7f434c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 -- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c104560 msgr2=0x7f434c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c104560 0x7f434c19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 -- 172.21.15.154:0/380908087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c19a9f0 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434affd640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 0x7f434c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f434b7fe640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c198ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f433c0098d0 tx=0x7f433c003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c004450 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f433c0045f0 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434c19ac80 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c045670 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.523+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434c1a13c0 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.524+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434c109dc0 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.525+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f433c04d070 con 0x7f434c102a40 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.526+0000 7f4348ff9640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43340b5360 0x7f43340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.526+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5981+0+0 (secure 0 0 0) 0x7f433c02e030 con 0x7f434c102a40 2024-09-10T23:20:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.527+0000 7f434affd640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43340b5360 0x7f43340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.527+0000 7f434affd640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43340b5360 0x7f43340b7820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4340009b40 tx=0x7f4340005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.529+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f433c04a060 con 0x7f434c102a40 2024-09-10T23:20:33.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:33.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:20:33.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi002 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-10T23:20:33.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:33.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:33.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:33 smithi177 ceph-mon[35760]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' 2024-09-10T23:20:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:33.715+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f434c063590 con 0x7f43340b5360 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi002 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:33 smithi002 ceph-mon[31150]: from='osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854]' entity='osd.9' 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] boot 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:34.408 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:34.409 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:34.409 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:34.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:20:34.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:20:34.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:34.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] boot 2024-09-10T23:20:34.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:20:34.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:34.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:34.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:34.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:34.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:34.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:20:34.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:20:34.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: osd.9 [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] boot 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:34.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:35 smithi177 ceph-mon[35760]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:35 smithi177 ceph-mon[35760]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:20:35.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:35 smithi002 ceph-mon[31150]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:35 smithi002 ceph-mon[31150]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:20:36.023 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:35 smithi154 ceph-mon[35136]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:20:36.023 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:35 smithi154 ceph-mon[35136]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:20:36.976 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:36 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/1108630047' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"} : dispatch 2024-09-10T23:20:36.976 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:36 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"} : dispatch 2024-09-10T23:20:36.976 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:36 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"}]': finished 2024-09-10T23:20:36.976 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:36 smithi154 ceph-mon[35136]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:20:36.976 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:36.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:36 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/1108630047' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"} : dispatch 2024-09-10T23:20:36.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:36 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"} : dispatch 2024-09-10T23:20:36.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:36 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"}]': finished 2024-09-10T23:20:36.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:36 smithi002 ceph-mon[31150]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:20:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:37.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:36 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/1108630047' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"} : dispatch 2024-09-10T23:20:37.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:36 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"} : dispatch 2024-09-10T23:20:37.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:36 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2258f977-145d-4b91-b6f7-ace80b9a09e5"}]': finished 2024-09-10T23:20:37.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:36 smithi177 ceph-mon[35760]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:20:37.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:37.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:37 smithi002 ceph-mon[31150]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:37.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:37 smithi002 ceph-mon[31150]: from='client.? 172.21.15.154:0/702662672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:38.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:37 smithi154 ceph-mon[35136]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.154:0/702662672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:38.115 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:37 smithi177 ceph-mon[35760]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:38.116 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:37 smithi177 ceph-mon[35760]: from='client.? 172.21.15.154:0/702662672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:39.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:39 smithi002 ceph-mon[31150]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:40.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:39 smithi154 ceph-mon[35136]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:39 smithi177 ceph-mon[35760]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:41.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:41 smithi002 ceph-mon[31150]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:41 smithi154 ceph-mon[35136]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:41 smithi177 ceph-mon[35760]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:43.915 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:43 smithi154 ceph-mon[35136]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:43.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:43 smithi002 ceph-mon[31150]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:43 smithi177 ceph-mon[35760]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:45.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:45 smithi002 ceph-mon[31150]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:45.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:20:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:45 smithi002 ceph-mon[31150]: Deploying daemon osd.10 on smithi154 2024-09-10T23:20:46.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:45 smithi154 ceph-mon[35136]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:20:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:45 smithi154 ceph-mon[35136]: Deploying daemon osd.10 on smithi154 2024-09-10T23:20:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:45 smithi177 ceph-mon[35760]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:20:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:45 smithi177 ceph-mon[35760]: Deploying daemon osd.10 on smithi154 2024-09-10T23:20:47.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:47 smithi154 ceph-mon[35136]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:47.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:47 smithi002 ceph-mon[31150]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:47 smithi177 ceph-mon[35760]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:49.892 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:49 smithi154 ceph-mon[35136]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:49 smithi002 ceph-mon[31150]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:49 smithi177 ceph-mon[35760]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:52.008 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:51 smithi154 ceph-mon[35136]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:52.008 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:52.008 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:52.008 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:51 smithi177 ceph-mon[35760]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:51 smithi002 ceph-mon[31150]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:52.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:52.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:52.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:53.996 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:53 smithi154 ceph-mon[35136]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:53 smithi177 ceph-mon[35760]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:53 smithi002 ceph-mon[31150]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:55.067 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 10 on host 'smithi154' 2024-09-10T23:20:55.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.066+0000 7f4348ff9640 1 -- 172.21.15.154:0/380908087 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f434c063590 con 0x7f43340b5360 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43340b5360 msgr2=0x7f43340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43340b5360 0x7f43340b7820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4340009b40 tx=0x7f4340005e50 comp rx=0 tx=0).stop 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 msgr2=0x7f434c198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c198ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f433c0098d0 tx=0x7f433c003c20 comp rx=0 tx=0).stop 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 shutdown_connections 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43340b5360 0x7f43340b7820 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c104560 0x7f434c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:55.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f434c103ba0 0x7f434c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:55.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 --2- 172.21.15.154:0/380908087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f434c102a40 0x7f434c198ec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:55.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 >> 172.21.15.154:0/380908087 conn(0x7f434c0fe2f0 msgr2=0x7f434c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:55.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 shutdown_connections 2024-09-10T23:20:55.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T23:20:55.069+0000 7f4351c91640 1 -- 172.21.15.154:0/380908087 wait complete. 2024-09-10T23:20:55.748 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.776 DEBUG:teuthology.orchestra.run.smithi154:osd.10> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T23:20:55.779 INFO:tasks.cephadm:Deploying osd.11 on smithi177 with /dev/vg_nvme/lv_1... 2024-09-10T23:20:55.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:20:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:55.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:55.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:55.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:55.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:55.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:55.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:55.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:55.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:56.034 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:20:57.602 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:20:57 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:20:57.300+0000 7f4d8f270640 -1 osd.10 0 log_to_monitors true 2024-09-10T23:20:57.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:57 smithi177 ceph-mon[35760]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:57.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:57 smithi177 ceph-mon[35760]: from='osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:20:57.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:57 smithi177 ceph-mon[35760]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:20:57.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:57 smithi002 ceph-mon[31150]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:57.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:57 smithi002 ceph-mon[31150]: from='osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:20:57.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:57 smithi002 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:20:58.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:57 smithi154 ceph-mon[35136]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:58.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:57 smithi154 ceph-mon[35136]: from='osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:20:58.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:57 smithi154 ceph-mon[35136]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:20:58.582 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-10T23:20:58.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_1 2024-09-10T23:20:58.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-mon[35136]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:20:58.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-mon[35136]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:20:58.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-mon[35136]: from='osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:20:58.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:58.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-mon[35136]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:20:58.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-mon[35136]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:20:58.865 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:20:58.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:58 smithi177 ceph-mon[35760]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:20:58.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:58 smithi177 ceph-mon[35760]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:20:58.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:58 smithi177 ceph-mon[35760]: from='osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:20:58.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:58 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:58.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:58 smithi177 ceph-mon[35760]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:20:58.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:58 smithi177 ceph-mon[35760]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:20:58.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:58 smithi002 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:20:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:58 smithi002 ceph-mon[31150]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:20:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:58 smithi002 ceph-mon[31150]: from='osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:20:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:58 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:58 smithi002 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T23:20:58.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:58 smithi002 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T23:20:59.278 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:20:58 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:20:58.994+0000 7f4d8b1f3640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T23:20:59.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:20:59.004+0000 7f4d83012640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:20:59.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 -- 172.21.15.177:0/771199195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e4105b80 msgr2=0x7fe8e4107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:59.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 --2- 172.21.15.177:0/771199195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e4105b80 0x7fe8e4107ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009900 tx=0x7fe8d402a410 comp rx=0 tx=0).stop 2024-09-10T23:20:59.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 -- 172.21.15.177:0/771199195 shutdown_connections 2024-09-10T23:20:59.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 --2- 172.21.15.177:0/771199195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e4108730 0x7fe8e410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 --2- 172.21.15.177:0/771199195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e4105b80 0x7fe8e4107ff0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 --2- 172.21.15.177:0/771199195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e406b6e0 0x7fe8e41055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 -- 172.21.15.177:0/771199195 >> 172.21.15.177:0/771199195 conn(0x7fe8e40fd1e0 msgr2=0x7fe8e40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 -- 172.21.15.177:0/771199195 shutdown_connections 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.322+0000 7fe8eb457640 1 -- 172.21.15.177:0/771199195 wait complete. 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 Processor -- start 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 -- start start 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 0x7fe8e4198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4105b80 0x7fe8e41994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e4108730 0x7fe8e419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e410e6e0 con 0x7fe8e4108730 2024-09-10T23:20:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e410e560 con 0x7fe8e4105b80 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8eb457640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e410e860 con 0x7fe8e406b6e0 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 0x7fe8e4198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 0x7fe8e4198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36062/0 (socket says 172.21.15.177:36062) 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 -- 172.21.15.177:0/3036708012 learned_addr learned my addr 172.21.15.177:0/3036708012 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e89f2640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4105b80 0x7fe8e41994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e99f4640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e4108730 0x7fe8e419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 -- 172.21.15.177:0/3036708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4105b80 msgr2=0x7fe8e41994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4105b80 0x7fe8e41994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 -- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e4108730 msgr2=0x7fe8e419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e4108730 0x7fe8e419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.323+0000 7fe8e91f3640 1 -- 172.21.15.177:0/3036708012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e419a9a0 con 0x7fe8e406b6e0 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.324+0000 7fe8e91f3640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 0x7fe8e4198e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000b4a0 tx=0x7fe8e000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.324+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0014070 con 0x7fe8e406b6e0 2024-09-10T23:20:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.324+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e0010ac0 con 0x7fe8e406b6e0 2024-09-10T23:20:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.324+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e419ac90 con 0x7fe8e406b6e0 2024-09-10T23:20:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.324+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0017c30 con 0x7fe8e406b6e0 2024-09-10T23:20:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.324+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41a1370 con 0x7fe8e406b6e0 2024-09-10T23:20:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.325+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e40fecd0 con 0x7fe8e406b6e0 2024-09-10T23:20:59.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.327+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fe8e0010610 con 0x7fe8e406b6e0 2024-09-10T23:20:59.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.328+0000 7fe8da7fc640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe8d00b52e0 0x7fe8d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:59.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.328+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6414+0+0 (secure 0 0 0) 0x7fe8e00e4d30 con 0x7fe8e406b6e0 2024-09-10T23:20:59.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.328+0000 7fe8e89f2640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe8d00b52e0 0x7fe8d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:59.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.329+0000 7fe8e89f2640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe8d00b52e0 0x7fe8d00b77a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009230 tx=0x7fe8d40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:59.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.331+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe8e00abd10 con 0x7fe8e406b6e0 2024-09-10T23:20:59.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:20:59.523+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe8e4063590 con 0x7fe8d00b52e0 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi154 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.888 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='osd.10 ' entity='osd.10' 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:59.889 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:59.890 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:59.890 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:20:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:59.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi154 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:59.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='osd.10 ' entity='osd.10' 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:59.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:20:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi154 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:00.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='osd.10 ' entity='osd.10' 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:00.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:00.031 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:20:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:00.907 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:00 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:21:00.908 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:00 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:21:00.908 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:00 smithi177 ceph-mon[35760]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:00.908 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:00 smithi177 ceph-mon[35760]: osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] boot 2024-09-10T23:21:00.908 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:00 smithi177 ceph-mon[35760]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:21:00.908 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:00 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:00.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:00 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:21:00.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:00 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:21:00.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:00 smithi002 ceph-mon[31150]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:00.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:00 smithi002 ceph-mon[31150]: osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] boot 2024-09-10T23:21:00.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:00 smithi002 ceph-mon[31150]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:21:00.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:00 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:01.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:00 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:21:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:00 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:21:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:00 smithi154 ceph-mon[35136]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:00 smithi154 ceph-mon[35136]: osd.10 [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] boot 2024-09-10T23:21:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:00 smithi154 ceph-mon[35136]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:21:01.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:00 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:21:01.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:01 smithi177 ceph-mon[35760]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:21:01.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:01 smithi177 ceph-mon[35760]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:21:01.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:01 smithi002 ceph-mon[31150]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:21:01.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:01 smithi002 ceph-mon[31150]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:21:02.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:01 smithi154 ceph-mon[35136]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:21:02.039 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:01 smithi154 ceph-mon[35136]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:21:02.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:02 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/1478957394' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"} : dispatch 2024-09-10T23:21:02.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:02 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"} : dispatch 2024-09-10T23:21:02.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:02 smithi177 ceph-mon[35760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"}]': finished 2024-09-10T23:21:02.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:02 smithi177 ceph-mon[35760]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T23:21:02.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:02.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:02 smithi177 ceph-mon[35760]: from='client.? 172.21.15.177:0/2548519118' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:02.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:02 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/1478957394' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"} : dispatch 2024-09-10T23:21:02.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:02 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"} : dispatch 2024-09-10T23:21:02.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:02 smithi002 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"}]': finished 2024-09-10T23:21:02.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:02 smithi002 ceph-mon[31150]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T23:21:02.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:02.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:02 smithi002 ceph-mon[31150]: from='client.? 172.21.15.177:0/2548519118' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:02 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/1478957394' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"} : dispatch 2024-09-10T23:21:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:02 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"} : dispatch 2024-09-10T23:21:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:02 smithi154 ceph-mon[35136]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f03df9f-bd81-43d7-aae6-63e3630ab331"}]': finished 2024-09-10T23:21:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:02 smithi154 ceph-mon[35136]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T23:21:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:02 smithi154 ceph-mon[35136]: from='client.? 172.21.15.177:0/2548519118' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:03 smithi177 ceph-mon[35760]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:03 smithi002 ceph-mon[31150]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:04.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:03 smithi154 ceph-mon[35136]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:05 smithi177 ceph-mon[35760]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-10T23:21:06.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:05 smithi002 ceph-mon[31150]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-10T23:21:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:05 smithi154 ceph-mon[35136]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-10T23:21:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:07 smithi177 ceph-mon[35760]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T23:21:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:07 smithi002 ceph-mon[31150]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T23:21:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:07 smithi154 ceph-mon[35136]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T23:21:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:09 smithi177 ceph-mon[35760]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:21:10.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:09 smithi002 ceph-mon[31150]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:21:10.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:09 smithi154 ceph-mon[35136]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:21:11.020 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:10 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:21:11.020 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:10 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:10 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:21:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:10 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:10 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:21:11.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:10 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:12.075 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:11 smithi177 ceph-mon[35760]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T23:21:12.075 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:11 smithi177 ceph-mon[35760]: Deploying daemon osd.11 on smithi177 2024-09-10T23:21:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:11 smithi002 ceph-mon[31150]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T23:21:12.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:11 smithi002 ceph-mon[31150]: Deploying daemon osd.11 on smithi177 2024-09-10T23:21:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:11 smithi154 ceph-mon[35136]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T23:21:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:11 smithi154 ceph-mon[35136]: Deploying daemon osd.11 on smithi177 2024-09-10T23:21:14.121 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:13 smithi177 ceph-mon[35760]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T23:21:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:13 smithi002 ceph-mon[31150]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T23:21:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:13 smithi154 ceph-mon[35136]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T23:21:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:15 smithi177 ceph-mon[35760]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:21:16.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:15 smithi002 ceph-mon[31150]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:21:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:15 smithi154 ceph-mon[35136]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:21:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:16 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:17.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:17.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:17.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:16 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:17.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:17.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:17.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:16 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:17 smithi177 ceph-mon[35760]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:17 smithi002 ceph-mon[31150]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:18.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:17 smithi154 ceph-mon[35136]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:19.647 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 11 on host 'smithi177' 2024-09-10T23:21:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.646+0000 7fe8da7fc640 1 -- 172.21.15.177:0/3036708012 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe8e4063590 con 0x7fe8d00b52e0 2024-09-10T23:21:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe8d00b52e0 msgr2=0x7fe8d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe8d00b52e0 0x7fe8d00b77a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009230 tx=0x7fe8d40314a0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 msgr2=0x7fe8e4198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 0x7fe8e4198e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000b4a0 tx=0x7fe8e000b960 comp rx=0 tx=0).stop 2024-09-10T23:21:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 shutdown_connections 2024-09-10T23:21:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe8d00b52e0 0x7fe8d00b77a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e4108730 0x7fe8e419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4105b80 0x7fe8e41994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 --2- 172.21.15.177:0/3036708012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e406b6e0 0x7fe8e4198e70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.648+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 >> 172.21.15.177:0/3036708012 conn(0x7fe8e40fd1e0 msgr2=0x7fe8e4103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.649+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 shutdown_connections 2024-09-10T23:21:19.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:19.649+0000 7fe8eb457640 1 -- 172.21.15.177:0/3036708012 wait complete. 2024-09-10T23:21:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:19 smithi177 ceph-mon[35760]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:19 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:19 smithi002 ceph-mon[31150]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:20.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:19 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:19 smithi154 ceph-mon[35136]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:19 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:20.293 DEBUG:teuthology.orchestra.run.smithi177:osd.11> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T23:21:20.296 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T23:21:20.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:21:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:21.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 -- 172.21.15.2:0/1473451322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4104550 msgr2=0x7f62a410aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 --2- 172.21.15.2:0/1473451322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4104550 0x7f62a410aed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f629c009cd0 tx=0x7f629c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 -- 172.21.15.2:0/1473451322 shutdown_connections 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 --2- 172.21.15.2:0/1473451322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4104550 0x7f62a410aed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 --2- 172.21.15.2:0/1473451322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62a4103b90 0x7f62a4104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 --2- 172.21.15.2:0/1473451322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a4102a30 0x7f62a4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 -- 172.21.15.2:0/1473451322 >> 172.21.15.2:0/1473451322 conn(0x7f62a40fe320 msgr2=0x7f62a4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 -- 172.21.15.2:0/1473451322 shutdown_connections 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 -- 172.21.15.2:0/1473451322 wait complete. 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 Processor -- start 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.052+0000 7f62aa883640 1 -- start start 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 0x7f62a4076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62a4103b90 0x7f62a4075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a4104550 0x7f62a4075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f62a410e780 con 0x7f62a4102a30 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62a410e600 con 0x7f62a4104550 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62a410e900 con 0x7f62a4103b90 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 0x7f62a4076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 0x7f62a4076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41366/0 (socket says 172.21.15.2:41366) 2024-09-10T23:21:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 -- 172.21.15.2:0/2931048290 learned_addr learned my addr 172.21.15.2:0/2931048290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a37fe640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62a4103b90 0x7f62a4075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a8e20640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a4104550 0x7f62a4075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 -- 172.21.15.2:0/2931048290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62a4103b90 msgr2=0x7f62a4075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62a4103b90 0x7f62a4075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 -- 172.21.15.2:0/2931048290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a4104550 msgr2=0x7f62a4075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a4104550 0x7f62a4075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 -- 172.21.15.2:0/2931048290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a4076340 con 0x7f62a4102a30 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a3fff640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 0x7f62a4076cd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f629400b4a0 tx=0x7f629400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294014070 con 0x7f62a4102a30 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 -- 172.21.15.2:0/2931048290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a41a2f30 con 0x7f62a4102a30 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6294010ac0 con 0x7f62a4102a30 2024-09-10T23:21:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294017c30 con 0x7f62a4102a30 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.053+0000 7f62aa883640 1 -- 172.21.15.2:0/2931048290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a41a3410 con 0x7f62a4102a30 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.054+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6284005290 con 0x7f62a4102a30 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.056+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f6294010610 con 0x7f62a4102a30 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.057+0000 7f62a17fa640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f628c0b52e0 0x7f628c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.057+0000 7f62a37fe640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f628c0b52e0 0x7f628c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.057+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6809+0+0 (secure 0 0 0) 0x7f62940e4e70 con 0x7f62a4102a30 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.057+0000 7f62a37fe640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f628c0b52e0 0x7f628c0b77a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6298005fd0 tx=0x7f629800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.060+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f62940ac310 con 0x7f62a4102a30 2024-09-10T23:21:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.245+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6284005850 con 0x7f62a4102a30 2024-09-10T23:21:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.245+0000 7f62a17fa640 1 -- 172.21.15.2:0/2931048290 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f62940abc10 con 0x7f62a4102a30 2024-09-10T23:21:21.246 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f628c0b52e0 msgr2=0x7f628c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f628c0b52e0 0x7f628c0b77a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6298005fd0 tx=0x7f629800b390 comp rx=0 tx=0).stop 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 msgr2=0x7f62a4076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 0x7f62a4076cd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f629400b4a0 tx=0x7f629400b960 comp rx=0 tx=0).stop 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 shutdown_connections 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f628c0b52e0 0x7f628c0b77a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a4104550 0x7f62a4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62a4103b90 0x7f62a4075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 --2- 172.21.15.2:0/2931048290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62a4102a30 0x7f62a4076cd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 >> 172.21.15.2:0/2931048290 conn(0x7f62a40fe320 msgr2=0x7f62a4106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:21.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 shutdown_connections 2024-09-10T23:21:21.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:21.247+0000 7f628affd640 1 -- 172.21.15.2:0/2931048290 wait complete. 2024-09-10T23:21:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:21 smithi177 ceph-mon[35760]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:21 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:21 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:21 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2931048290' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:21.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:21 smithi002 ceph-mon[31150]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:21.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:21 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:21.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:21 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:21.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:21 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2931048290' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:21 smithi154 ceph-mon[35136]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:21 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:21 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:21 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2931048290' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:22.015 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726010459,"num_in_osds":12,"osd_in_since":1726010461,"num_remapped_pgs":0} 2024-09-10T23:21:22.447 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:21:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:21:22.236+0000 7f801f8ac640 -1 osd.11 0 log_to_monitors true 2024-09-10T23:21:22.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:22 smithi177 ceph-mon[35760]: from='osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:21:22.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:22 smithi177 ceph-mon[35760]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:21:22.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:22 smithi002 ceph-mon[31150]: from='osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:21:22.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:22 smithi002 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:21:22.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:22 smithi154 ceph-mon[35136]: from='osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:21:22.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:22 smithi154 ceph-mon[35136]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:21:23.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:21:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:23.632 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:21:23.454+0000 7f801b82f640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T23:21:23.633 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:21:23.464+0000 7f8017656640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:21:23.633 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-mon[35760]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:23.633 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-mon[35760]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:21:23.633 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-mon[35760]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:21:23.633 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:23.633 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-mon[35760]: from='osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:21:23.633 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:23 smithi177 ceph-mon[35760]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:21:23.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:23 smithi002 ceph-mon[31150]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:23.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:23 smithi002 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:21:23.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:23 smithi002 ceph-mon[31150]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:21:23.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:23 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:23.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:23 smithi002 ceph-mon[31150]: from='osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:21:23.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:23 smithi002 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:21:23.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:23 smithi154 ceph-mon[35136]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:23 smithi154 ceph-mon[35136]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:21:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:23 smithi154 ceph-mon[35136]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:21:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:23 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:23 smithi154 ceph-mon[35136]: from='osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:21:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:23 smithi154 ceph-mon[35136]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-09-10T23:21:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 -- 172.21.15.2:0/3908871803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44103440 msgr2=0x7efc44109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 --2- 172.21.15.2:0/3908871803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44103440 0x7efc44109dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009cd0 tx=0x7efc3c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 -- 172.21.15.2:0/3908871803 shutdown_connections 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 --2- 172.21.15.2:0/3908871803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44103440 0x7efc44109dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 --2- 172.21.15.2:0/3908871803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44102a80 0x7efc44102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 --2- 172.21.15.2:0/3908871803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc44101920 0x7efc44101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 -- 172.21.15.2:0/3908871803 >> 172.21.15.2:0/3908871803 conn(0x7efc440fd1f0 msgr2=0x7efc440ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 -- 172.21.15.2:0/3908871803 shutdown_connections 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.769+0000 7efc492ba640 1 -- 172.21.15.2:0/3908871803 wait complete. 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 Processor -- start 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 -- start start 2024-09-10T23:21:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc44101920 0x7efc441056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 0x7efc44103f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44103440 0x7efc44104490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc4410d600 con 0x7efc44102a80 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc4410d480 con 0x7efc44103440 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc492ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc4410d780 con 0x7efc44101920 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.770+0000 7efc427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 0x7efc44103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 0x7efc44103f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41380/0 (socket says 172.21.15.2:41380) 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 -- 172.21.15.2:0/329132565 learned_addr learned my addr 172.21.15.2:0/329132565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc42ffd640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc44101920 0x7efc441056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc437fe640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44103440 0x7efc44104490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 -- 172.21.15.2:0/329132565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc44101920 msgr2=0x7efc441056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc44101920 0x7efc441056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 -- 172.21.15.2:0/329132565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44103440 msgr2=0x7efc44104490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44103440 0x7efc44104490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 -- 172.21.15.2:0/329132565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc44104d50 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc437fe640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44103440 0x7efc44104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc427fc640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 0x7efc44103f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc3800b4a0 tx=0x7efc3800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38014070 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc441a2ff0 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc38010ac0 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38017c30 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.771+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc441a3570 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.773+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc441a3800 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.774+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7efc38010610 con 0x7efc44102a80 2024-09-10T23:21:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.775+0000 7efc2bfff640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efc2c0b52e0 0x7efc2c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.775+0000 7efc42ffd640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efc2c0b52e0 0x7efc2c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.775+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6847+0+0 (secure 0 0 0) 0x7efc380e4f30 con 0x7efc44102a80 2024-09-10T23:21:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.776+0000 7efc42ffd640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efc2c0b52e0 0x7efc2c0b77a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc34009bd0 tx=0x7efc34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.778+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efc380ac310 con 0x7efc44102a80 2024-09-10T23:21:23.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.966+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7efc441a3af0 con 0x7efc44102a80 2024-09-10T23:21:23.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.967+0000 7efc2bfff640 1 -- 172.21.15.2:0/329132565 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7efc380abc10 con 0x7efc44102a80 2024-09-10T23:21:23.968 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efc2c0b52e0 msgr2=0x7efc2c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efc2c0b52e0 0x7efc2c0b77a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc34009bd0 tx=0x7efc34005f90 comp rx=0 tx=0).stop 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 msgr2=0x7efc44103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 0x7efc44103f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc3800b4a0 tx=0x7efc3800b960 comp rx=0 tx=0).stop 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 shutdown_connections 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efc2c0b52e0 0x7efc2c0b77a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44103440 0x7efc44104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc44102a80 0x7efc44103f50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 --2- 172.21.15.2:0/329132565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc44101920 0x7efc441056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 >> 172.21.15.2:0/329132565 conn(0x7efc440fd1f0 msgr2=0x7efc440fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:23.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 shutdown_connections 2024-09-10T23:21:23.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:23.970+0000 7efc492ba640 1 -- 172.21.15.2:0/329132565 wait complete. 2024-09-10T23:21:24.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:21:24.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:21:24.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:24.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:24.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: Detected new or changed devices on smithi177 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi177 to 4271M 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:24.687 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:24.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:24 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/329132565' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:24.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: Detected new or changed devices on smithi177 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi177 to 4271M 2024-09-10T23:21:24.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:24 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/329132565' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:24.717 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726010459,"num_in_osds":12,"osd_in_since":1726010461,"num_remapped_pgs":0} 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: Detected new or changed devices on smithi177 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi177 to 4271M 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:24.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:24.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:24.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:24.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:24 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/329132565' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:25 smithi177 ceph-mon[35760]: purged_snaps scrub starts 2024-09-10T23:21:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:25 smithi177 ceph-mon[35760]: purged_snaps scrub ok 2024-09-10T23:21:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:25 smithi177 ceph-mon[35760]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:25 smithi177 ceph-mon[35760]: osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] boot 2024-09-10T23:21:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:25 smithi177 ceph-mon[35760]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T23:21:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:25.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:21:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:25 smithi002 ceph-mon[31150]: purged_snaps scrub starts 2024-09-10T23:21:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:25 smithi002 ceph-mon[31150]: purged_snaps scrub ok 2024-09-10T23:21:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:25 smithi002 ceph-mon[31150]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:25 smithi002 ceph-mon[31150]: osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] boot 2024-09-10T23:21:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:25 smithi002 ceph-mon[31150]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T23:21:25.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:25.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:25 smithi154 ceph-mon[35136]: purged_snaps scrub starts 2024-09-10T23:21:25.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:25 smithi154 ceph-mon[35136]: purged_snaps scrub ok 2024-09-10T23:21:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:25 smithi154 ceph-mon[35136]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:21:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:25 smithi154 ceph-mon[35136]: osd.11 [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] boot 2024-09-10T23:21:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:25 smithi154 ceph-mon[35136]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T23:21:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:21:25.989 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 -- 172.21.15.2:0/797340608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4108730 msgr2=0x7f20d410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 --2- 172.21.15.2:0/797340608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4108730 0x7f20d410abf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009ca0 tx=0x7f20c402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 -- 172.21.15.2:0/797340608 shutdown_connections 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 --2- 172.21.15.2:0/797340608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4108730 0x7f20d410abf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 --2- 172.21.15.2:0/797340608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4105b80 0x7f20d4107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 --2- 172.21.15.2:0/797340608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 0x7f20d41055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 -- 172.21.15.2:0/797340608 >> 172.21.15.2:0/797340608 conn(0x7f20d40fd1e0 msgr2=0x7f20d40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 -- 172.21.15.2:0/797340608 shutdown_connections 2024-09-10T23:21:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 -- 172.21.15.2:0/797340608 wait complete. 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 Processor -- start 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.467+0000 7f20db87e640 1 -- start start 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 0x7f20d4102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 0x7f20d4101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4108730 0x7f20d4101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410e6a0 con 0x7f20d4105b80 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410e520 con 0x7f20d4108730 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410e820 con 0x7f20d406b6e0 2024-09-10T23:21:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 0x7f20d4101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 0x7f20d4101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41396/0 (socket says 172.21.15.2:41396) 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 -- 172.21.15.2:0/2730157576 learned_addr learned my addr 172.21.15.2:0/2730157576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d961a640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 0x7f20d4102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d9e1b640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4108730 0x7f20d4101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 -- 172.21.15.2:0/2730157576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 msgr2=0x7f20d4102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 0x7f20d4102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 -- 172.21.15.2:0/2730157576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4108730 msgr2=0x7f20d4101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4108730 0x7f20d4101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 -- 172.21.15.2:0/2730157576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d4102390 con 0x7f20d4105b80 2024-09-10T23:21:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d9e1b640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4108730 0x7f20d4101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d961a640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 0x7f20d4102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d8e19640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 0x7f20d4101590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d770 tx=0x7f20c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8017070 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c8009c30 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d41a2e60 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.468+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c800f620 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.469+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41a3310 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.470+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d40fecd0 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.471+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f20c8010460 con 0x7f20d4105b80 2024-09-10T23:21:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.472+0000 7f20d27fc640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f20bc0b52e0 0x7f20bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.472+0000 7f20d961a640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f20bc0b52e0 0x7f20bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.472+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f20c80e5610 con 0x7f20d4105b80 2024-09-10T23:21:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.472+0000 7f20d961a640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f20bc0b52e0 0x7f20bc0b77a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20cc005fd0 tx=0x7f20cc005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.475+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20c80ac8d0 con 0x7f20d4105b80 2024-09-10T23:21:26.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.662+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f20d402e7c0 con 0x7f20d4105b80 2024-09-10T23:21:26.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.662+0000 7f20d27fc640 1 -- 172.21.15.2:0/2730157576 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f20c8009de0 con 0x7f20d4105b80 2024-09-10T23:21:26.663 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.664+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f20bc0b52e0 msgr2=0x7f20bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.664+0000 7f20db87e640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f20bc0b52e0 0x7f20bc0b77a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20cc005fd0 tx=0x7f20cc005ea0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.664+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 msgr2=0x7f20d4101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.664+0000 7f20db87e640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 0x7f20d4101590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d770 tx=0x7f20c800dc30 comp rx=0 tx=0).stop 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 shutdown_connections 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f20bc0b52e0 0x7f20bc0b77a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4108730 0x7f20d4101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20d4105b80 0x7f20d4101590 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 --2- 172.21.15.2:0/2730157576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20d406b6e0 0x7f20d4102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 >> 172.21.15.2:0/2730157576 conn(0x7f20d40fd1e0 msgr2=0x7f20d4103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 shutdown_connections 2024-09-10T23:21:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:26.665+0000 7f20db87e640 1 -- 172.21.15.2:0/2730157576 wait complete. 2024-09-10T23:21:26.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:26 smithi002 ceph-mon[31150]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:21:26.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:26 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2730157576' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:27.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:26 smithi177 ceph-mon[35760]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:21:27.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:26 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2730157576' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:26 smithi154 ceph-mon[35136]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:21:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:26 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2730157576' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:21:27.573 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726010484,"num_in_osds":12,"osd_in_since":1726010461,"num_remapped_pgs":0} 2024-09-10T23:21:27.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:21:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:28.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:27 smithi002 ceph-mon[31150]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:28.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:27 smithi177 ceph-mon[35760]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:27 smithi154 ceph-mon[35136]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 -- 172.21.15.2:0/1913765254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a9810d100 msgr2=0x7f3a9810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 --2- 172.21.15.2:0/1913765254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a9810d100 0x7f3a9810f560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009900 tx=0x7f3a9002a410 comp rx=0 tx=0).stop 2024-09-10T23:21:28.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 -- 172.21.15.2:0/1913765254 shutdown_connections 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 --2- 172.21.15.2:0/1913765254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a9810d100 0x7f3a9810f560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 --2- 172.21.15.2:0/1913765254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a981045c0 0x7f3a9810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 --2- 172.21.15.2:0/1913765254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a98103ca0 0x7f3a98104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 -- 172.21.15.2:0/1913765254 >> 172.21.15.2:0/1913765254 conn(0x7f3a980fd700 msgr2=0x7f3a980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 -- 172.21.15.2:0/1913765254 shutdown_connections 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 -- 172.21.15.2:0/1913765254 wait complete. 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.335+0000 7f3a9f825640 1 Processor -- start 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 -- start start 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a98103ca0 0x7f3a98101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 0x7f3a98101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a9810d100 0x7f3a981023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98112d70 con 0x7f3a981045c0 2024-09-10T23:21:28.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98112bf0 con 0x7f3a98103ca0 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9f825640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98112ef0 con 0x7f3a9810d100 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 0x7f3a98101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 0x7f3a98101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41414/0 (socket says 172.21.15.2:41414) 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 -- 172.21.15.2:0/217552900 learned_addr learned my addr 172.21.15.2:0/217552900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9d5c1640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a98103ca0 0x7f3a98101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9ddc2640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a9810d100 0x7f3a981023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 -- 172.21.15.2:0/217552900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a9810d100 msgr2=0x7f3a981023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a9810d100 0x7f3a981023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 -- 172.21.15.2:0/217552900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a98103ca0 msgr2=0x7f3a98101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a98103ca0 0x7f3a98101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 -- 172.21.15.2:0/217552900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a981a7540 con 0x7f3a981045c0 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.336+0000 7f3a9cdc0640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 0x7f3a98101e90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c970 tx=0x7f3a8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:28.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.337+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c007bb0 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.337+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a8c007d50 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.337+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00f7b0 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.337+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a981a7830 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.337+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a981a7dc0 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.338+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a98104080 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.339+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f3a8c018480 con 0x7f3a981045c0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.340+0000 7f3a967fc640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a800b5360 0x7f3a800b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.340+0000 7f3a9d5c1640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a800b5360 0x7f3a800b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.340+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f3a8c0e5970 con 0x7f3a981045c0 2024-09-10T23:21:28.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.340+0000 7f3a9d5c1640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a800b5360 0x7f3a800b7820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a88007ec0 tx=0x7f3a880075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:28.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.344+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a8c0acd60 con 0x7f3a981045c0 2024-09-10T23:21:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.531+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a9802e5c0 con 0x7f3a981045c0 2024-09-10T23:21:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.532+0000 7f3a967fc640 1 -- 172.21.15.2:0/217552900 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18444 (secure 0 0 0) 0x7f3a8c0ac660 con 0x7f3a981045c0 2024-09-10T23:21:28.533 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:28.533 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:21:25.796125+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a800b5360 msgr2=0x7f3a800b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a800b5360 0x7f3a800b7820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a88007ec0 tx=0x7f3a880075b0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 msgr2=0x7f3a98101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 0x7f3a98101e90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c970 tx=0x7f3a8c00ce30 comp rx=0 tx=0).stop 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 shutdown_connections 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a800b5360 0x7f3a800b7820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a9810d100 0x7f3a981023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a981045c0 0x7f3a98101e90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 --2- 172.21.15.2:0/217552900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a98103ca0 0x7f3a98101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 >> 172.21.15.2:0/217552900 conn(0x7f3a980fd700 msgr2=0x7f3a98104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:28.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 shutdown_connections 2024-09-10T23:21:28.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:28.535+0000 7f3a9f825640 1 -- 172.21.15.2:0/217552900 wait complete. 2024-09-10T23:21:29.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:28 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/217552900' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:21:29.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:28 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/217552900' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:21:29.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:28 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/217552900' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:21:29.315 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:17:34.596978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:21:29.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T23:21:29.571 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:29.962 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:29 smithi002 ceph-mon[31150]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.046+0000 7f1194fbc640 1 -- 172.21.15.2:0/1625386096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 msgr2=0x7f119010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.046+0000 7f1194fbc640 1 --2- 172.21.15.2:0/1625386096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119010f560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1188009ca0 tx=0x7f118802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 -- 172.21.15.2:0/1625386096 shutdown_connections 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 --2- 172.21.15.2:0/1625386096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119010f560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 --2- 172.21.15.2:0/1625386096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11901045c0 0x7f119010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 --2- 172.21.15.2:0/1625386096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1190103ca0 0x7f1190104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 -- 172.21.15.2:0/1625386096 >> 172.21.15.2:0/1625386096 conn(0x7f11900fd700 msgr2=0x7f11900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 -- 172.21.15.2:0/1625386096 shutdown_connections 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 -- 172.21.15.2:0/1625386096 wait complete. 2024-09-10T23:21:30.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 Processor -- start 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.047+0000 7f1194fbc640 1 -- start start 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f1194fbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1190103ca0 0x7f1190199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f1194fbc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11901045c0 0x7f11901997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f1194fbc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f1194fbc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1190112d70 con 0x7f119010d100 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f1194fbc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1190112bf0 con 0x7f1190103ca0 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f1194fbc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1190112ef0 con 0x7f11901045c0 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41434/0 (socket says 172.21.15.2:41434) 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 -- 172.21.15.2:0/2536033657 learned_addr learned my addr 172.21.15.2:0/2536033657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118e59c640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1190103ca0 0x7f1190199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118dd9b640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11901045c0 0x7f11901997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 -- 172.21.15.2:0/2536033657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11901045c0 msgr2=0x7f11901997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11901045c0 0x7f11901997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 -- 172.21.15.2:0/2536033657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1190103ca0 msgr2=0x7f1190199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1190103ca0 0x7f1190199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 -- 172.21.15.2:0/2536033657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119019f310 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.048+0000 7f118ed9d640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119019eb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1188005cc0 tx=0x7f118802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.049+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188003cf0 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.049+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119019f5a0 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.049+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11880044f0 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.049+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118802fd10 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.049+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11901a5cc0 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.050+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1190104080 con 0x7f119010d100 2024-09-10T23:21:30.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.052+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f1188004040 con 0x7f119010d100 2024-09-10T23:21:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.053+0000 7f117f7fe640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11780b52e0 0x7f11780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.053+0000 7f118e59c640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11780b52e0 0x7f11780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.053+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f1188106f90 con 0x7f119010d100 2024-09-10T23:21:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.053+0000 7f118e59c640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11780b52e0 0x7f11780b77a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11800058c0 tx=0x7f118000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.056+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f11880ce250 con 0x7f119010d100 2024-09-10T23:21:30.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:29 smithi177 ceph-mon[35760]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.240+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f11901a6070 con 0x7f119010d100 2024-09-10T23:21:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.240+0000 7f117f7fe640 1 -- 172.21.15.2:0/2536033657 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f11880b50f0 con 0x7f119010d100 2024-09-10T23:21:30.241 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11780b52e0 msgr2=0x7f11780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11780b52e0 0x7f11780b77a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11800058c0 tx=0x7f118000a250 comp rx=0 tx=0).stop 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 msgr2=0x7f119019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119019eb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1188005cc0 tx=0x7f118802f470 comp rx=0 tx=0).stop 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 shutdown_connections 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11780b52e0 0x7f11780b77a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f119010d100 0x7f119019eb40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11901045c0 0x7f11901997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 --2- 172.21.15.2:0/2536033657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1190103ca0 0x7f1190199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 >> 172.21.15.2:0/2536033657 conn(0x7f11900fd700 msgr2=0x7f119010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 shutdown_connections 2024-09-10T23:21:30.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:30.242+0000 7f1194fbc640 1 -- 172.21.15.2:0/2536033657 wait complete. 2024-09-10T23:21:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:29 smithi154 ceph-mon[35136]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:30.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:30 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2536033657' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:21:31.051 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-09-10T23:21:31.051 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-09-10T23:21:31.051 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-09-10T23:21:31.051 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-09-10T23:21:31.051 INFO:tasks.cephadm:Adding mds.b on smithi154 2024-09-10T23:21:31.051 INFO:tasks.cephadm:Adding mds.e on smithi154 2024-09-10T23:21:31.052 INFO:tasks.cephadm:Adding mds.h on smithi154 2024-09-10T23:21:31.052 INFO:tasks.cephadm:Adding mds.k on smithi154 2024-09-10T23:21:31.052 INFO:tasks.cephadm:Adding mds.c on smithi177 2024-09-10T23:21:31.052 INFO:tasks.cephadm:Adding mds.f on smithi177 2024-09-10T23:21:31.052 INFO:tasks.cephadm:Adding mds.i on smithi177 2024-09-10T23:21:31.052 INFO:tasks.cephadm:Adding mds.l on smithi177 2024-09-10T23:21:31.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l' 2024-09-10T23:21:31.081 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:30 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2536033657' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:21:31.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:30 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2536033657' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:21:31.312 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 -- 172.21.15.177:0/3983076986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 msgr2=0x7f01dc109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 --2- 172.21.15.177:0/3983076986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc109db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009d00 tx=0x7f01d402a910 comp rx=0 tx=0).stop 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 -- 172.21.15.177:0/3983076986 shutdown_connections 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 --2- 172.21.15.177:0/3983076986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc109db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 --2- 172.21.15.177:0/3983076986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc102a70 0x7f01dc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 --2- 172.21.15.177:0/3983076986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc101910 0x7f01dc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 -- 172.21.15.177:0/3983076986 >> 172.21.15.177:0/3983076986 conn(0x7f01dc0fd1e0 msgr2=0x7f01dc0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 -- 172.21.15.177:0/3983076986 shutdown_connections 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.812+0000 7f01e47f9640 1 -- 172.21.15.177:0/3983076986 wait complete. 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 Processor -- start 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 -- start start 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc101910 0x7f01dc06b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc102a70 0x7f01dc19d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc1a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10d590 con 0x7f01dc102a70 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10d410 con 0x7f01dc101910 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e47f9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10d710 con 0x7f01dc103430 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc1a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc1a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48112/0 (socket says 172.21.15.177:48112) 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 -- 172.21.15.177:0/48304017 learned_addr learned my addr 172.21.15.177:0/48304017 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2595640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc101910 0x7f01dc06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e1d94640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc102a70 0x7f01dc19d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 -- 172.21.15.177:0/48304017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc101910 msgr2=0x7f01dc06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc101910 0x7f01dc06b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 -- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc102a70 msgr2=0x7f01dc19d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc102a70 0x7f01dc19d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2d96640 1 -- 172.21.15.177:0/48304017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc1a08c0 con 0x7f01dc103430 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e2595640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc101910 0x7f01dc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.813+0000 7f01e1d94640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc102a70 0x7f01dc19d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.814+0000 7f01e2d96640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc1a0000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01d40319f0 tx=0x7f01d4003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:31.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.814+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d40317d0 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.814+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d4030a80 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.814+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc1a0b50 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.814+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d402fdd0 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.814+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc1a10e0 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.815+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc108bc0 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.816+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f01d40305d0 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.817+0000 7f01d37fe640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01c80b5500 0x7f01c80b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.817+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f01d4106c30 con 0x7f01dc103430 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.817+0000 7f01e2595640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01c80b5500 0x7f01c80b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.818+0000 7f01e2595640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01c80b5500 0x7f01c80b79c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01d800baa0 tx=0x7f01d8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:31.820+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01d40cdf70 con 0x7f01dc103430 2024-09-10T23:21:31.986 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:31 smithi177 ceph-mon[35760]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:32.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.012+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}) -- 0x7f01dc063690 con 0x7f01c80b5500 2024-09-10T23:21:32.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.020+0000 7f01d37fe640 1 -- 172.21.15.177:0/48304017 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f01dc063690 con 0x7f01c80b5500 2024-09-10T23:21:32.021 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mds.all update... 2024-09-10T23:21:32.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01c80b5500 msgr2=0x7f01c80b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01c80b5500 0x7f01c80b79c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01d800baa0 tx=0x7f01d8005d90 comp rx=0 tx=0).stop 2024-09-10T23:21:32.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 msgr2=0x7f01dc1a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc1a0000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01d40319f0 tx=0x7f01d4003ba0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 shutdown_connections 2024-09-10T23:21:32.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01c80b5500 0x7f01c80b79c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01dc103430 0x7f01dc1a0000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01dc102a70 0x7f01dc19d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 --2- 172.21.15.177:0/48304017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01dc101910 0x7f01dc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 >> 172.21.15.177:0/48304017 conn(0x7f01dc0fd1e0 msgr2=0x7f01dc105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:32.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 shutdown_connections 2024-09-10T23:21:32.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-10T23:21:32.022+0000 7f01e47f9640 1 -- 172.21.15.177:0/48304017 wait complete. 2024-09-10T23:21:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:31 smithi002 ceph-mon[31150]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:31 smithi154 ceph-mon[35136]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:32.744 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T23:21:32.747 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T23:21:32.790 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T23:21:32.834 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T23:21:32.877 DEBUG:teuthology.orchestra.run.smithi154:mds.b> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T23:21:32.880 DEBUG:teuthology.orchestra.run.smithi154:mds.e> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T23:21:32.924 DEBUG:teuthology.orchestra.run.smithi154:mds.h> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T23:21:32.967 DEBUG:teuthology.orchestra.run.smithi154:mds.k> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T23:21:33.010 DEBUG:teuthology.orchestra.run.smithi177:mds.c> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T23:21:33.013 DEBUG:teuthology.orchestra.run.smithi177:mds.f> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T23:21:33.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:33.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-10T23:21:33.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:33.056 DEBUG:teuthology.orchestra.run.smithi177:mds.i> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T23:21:33.100 DEBUG:teuthology.orchestra.run.smithi177:mds.l> sudo journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T23:21:33.143 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T23:21:33.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:33.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:33.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:33.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:33 smithi154 ceph-mon[35136]: Deploying daemon mds.l on smithi177 2024-09-10T23:21:33.346 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:33.346 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-10T23:21:33.346 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:33.347 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:33.347 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:33.347 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.347 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:33.347 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:33.347 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:33.348 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:33.348 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.348 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:33 smithi177 ceph-mon[35760]: Deploying daemon mds.l on smithi177 2024-09-10T23:21:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:33.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:33.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:33.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:33 smithi002 ceph-mon[31150]: Deploying daemon mds.l on smithi177 2024-09-10T23:21:33.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 -- 172.21.15.2:0/3316710615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378101870 msgr2=0x7fe378101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/3316710615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378101870 0x7fe378101c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe374009900 tx=0x7fe37402a410 comp rx=0 tx=0).stop 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 -- 172.21.15.2:0/3316710615 shutdown_connections 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/3316710615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810f420 0x7fe378111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/3316710615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378102190 0x7fe37810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/3316710615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378101870 0x7fe378101c50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 -- 172.21.15.2:0/3316710615 >> 172.21.15.2:0/3316710615 conn(0x7fe3780fd700 msgr2=0x7fe3780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 -- 172.21.15.2:0/3316710615 shutdown_connections 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.886+0000 7fe37ff2d640 1 -- 172.21.15.2:0/3316710615 wait complete. 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 Processor -- start 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 -- start start 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378101870 0x7fe37819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102190 0x7fe37819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 0x7fe3781a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe378114f70 con 0x7fe37810f420 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe378114df0 con 0x7fe378102190 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37ff2d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781150f0 con 0x7fe378101870 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 0x7fe3781a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 0x7fe3781a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35098/0 (socket says 172.21.15.2:35098) 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 -- 172.21.15.2:0/1209255045 learned_addr learned my addr 172.21.15.2:0/1209255045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37d4c8640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102190 0x7fe37819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37dcc9640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378101870 0x7fe37819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 -- 172.21.15.2:0/1209255045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378101870 msgr2=0x7fe37819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378101870 0x7fe37819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 -- 172.21.15.2:0/1209255045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102190 msgr2=0x7fe37819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102190 0x7fe37819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37e4ca640 1 -- 172.21.15.2:0/1209255045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3781a1550 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.887+0000 7fe37dcc9640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378101870 0x7fe37819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.888+0000 7fe37e4ca640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 0x7fe3781a0d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e9d0 tx=0x7fe37000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.888+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37000cd80 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.888+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe370005020 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.888+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3781a1840 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.888+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3700116d0 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.888+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3781a7f00 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.889+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe378101c50 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.890+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fe37000f040 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.892+0000 7fe36affd640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b52e0 0x7fe3640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.892+0000 7fe37dcc9640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b52e0 0x7fe3640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.892+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fe3700e5a50 con 0x7fe37810f420 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.892+0000 7fe37dcc9640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b52e0 0x7fe3640b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe374031440 tx=0x7fe374005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:33.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:33.895+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe370016030 con 0x7fe37810f420 2024-09-10T23:21:34.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.119+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3781a82d0 con 0x7fe37810f420 2024-09-10T23:21:34.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.119+0000 7fe36affd640 1 -- 172.21.15.2:0/1209255045 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fe3700acd90 con 0x7fe37810f420 2024-09-10T23:21:34.120 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:34.120 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"btime":"2024-09-10T23:14:03:974933+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T23:21:34.121 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 1 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b52e0 msgr2=0x7fe3640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b52e0 0x7fe3640b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe374031440 tx=0x7fe374005a20 comp rx=0 tx=0).stop 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 msgr2=0x7fe3781a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 0x7fe3781a0d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e9d0 tx=0x7fe37000ee90 comp rx=0 tx=0).stop 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 shutdown_connections 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b52e0 0x7fe3640b77a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810f420 0x7fe3781a0d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102190 0x7fe37819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 --2- 172.21.15.2:0/1209255045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378101870 0x7fe37819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 >> 172.21.15.2:0/1209255045 conn(0x7fe3780fd700 msgr2=0x7fe3780ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:34.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 shutdown_connections 2024-09-10T23:21:34.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:34.122+0000 7fe37ff2d640 1 -- 172.21.15.2:0/1209255045 wait complete. 2024-09-10T23:21:34.424 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:34 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1209255045' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:34.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:34 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1209255045' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:34.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:34 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1209255045' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:34.964 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:34 smithi177 systemd[1]: Starting Ceph mds.l for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:35.362 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:35 smithi177 ceph-mon[35760]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:35.363 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 podman[65475]: 2024-09-10 23:21:34.999087631 +0000 UTC m=+0.015801396 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:35.363 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 podman[65475]: 2024-09-10 23:21:35.110209809 +0000 UTC m=+0.126923615 container create dd1a9f1e01f8fbd2e736d9a5a7ff0a1c04c7d85cb94367765c4de1698e6f5583 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:21:35.363 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 podman[65475]: 2024-09-10 23:21:35.36310399 +0000 UTC m=+0.379817758 container init dd1a9f1e01f8fbd2e736d9a5a7ff0a1c04c7d85cb94367765c4de1698e6f5583 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T23:21:35.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:35 smithi002 ceph-mon[31150]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:35.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:35 smithi154 ceph-mon[35136]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:35.714 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 podman[65475]: 2024-09-10 23:21:35.365965831 +0000 UTC m=+0.382679596 container start dd1a9f1e01f8fbd2e736d9a5a7ff0a1c04c7d85cb94367765c4de1698e6f5583 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T23:21:35.714 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 ceph-mds[65494]: -- 172.21.15.177:0/835257862 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561696b29860 con 0x561696b07000 2024-09-10T23:21:35.714 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l[65490]: starting mds.l at 2024-09-10T23:21:35.714 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 bash[65475]: dd1a9f1e01f8fbd2e736d9a5a7ff0a1c04c7d85cb94367765c4de1698e6f5583 2024-09-10T23:21:35.715 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:21:35 smithi177 systemd[1]: Started Ceph mds.l for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:36.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6832/4014999302,v1:172.21.15.177:6833/4014999302] up:boot 2024-09-10T23:21:36.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: fsmap 1 up:standby 2024-09-10T23:21:36.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:21:36.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6832/4014999302,v1:172.21.15.177:6833/4014999302] up:boot 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: fsmap 1 up:standby 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:36.541 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:36.542 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:36.542 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:36 smithi154 ceph-mon[35136]: Deploying daemon mds.k on smithi154 2024-09-10T23:21:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6832/4014999302,v1:172.21.15.177:6833/4014999302] up:boot 2024-09-10T23:21:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: fsmap 1 up:standby 2024-09-10T23:21:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:36 smithi177 ceph-mon[35760]: Deploying daemon mds.k on smithi154 2024-09-10T23:21:36.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:36.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:36.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:36.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:36 smithi002 ceph-mon[31150]: Deploying daemon mds.k on smithi154 2024-09-10T23:21:36.902 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:37.581 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:37 smithi002 ceph-mon[31150]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 -- 172.21.15.2:0/775648054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda841087d0 msgr2=0x7fda84108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 --2- 172.21.15.2:0/775648054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda841087d0 0x7fda84108c10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009900 tx=0x7fda6c02a410 comp rx=0 tx=0).stop 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 -- 172.21.15.2:0/775648054 shutdown_connections 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 --2- 172.21.15.2:0/775648054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda84109150 0x7fda8410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 --2- 172.21.15.2:0/775648054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda841087d0 0x7fda84108c10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 --2- 172.21.15.2:0/775648054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda84102dc0 0x7fda841031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 -- 172.21.15.2:0/775648054 >> 172.21.15.2:0/775648054 conn(0x7fda840fe830 msgr2=0x7fda84100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 -- 172.21.15.2:0/775648054 shutdown_connections 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 -- 172.21.15.2:0/775648054 wait complete. 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 Processor -- start 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.662+0000 7fda89c4f640 1 -- start start 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda89c4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 0x7fda841991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda89c4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda841087d0 0x7fda84199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda89c4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda84109150 0x7fda8419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda89c4f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda84112da0 con 0x7fda84102dc0 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda89c4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda84112c20 con 0x7fda841087d0 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda89c4f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fda84112f20 con 0x7fda84109150 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 0x7fda841991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 0x7fda841991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35118/0 (socket says 172.21.15.2:35118) 2024-09-10T23:21:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 -- 172.21.15.2:0/1582913694 learned_addr learned my addr 172.21.15.2:0/1582913694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda7bfff640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda841087d0 0x7fda84199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda83fff640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda84109150 0x7fda8419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 -- 172.21.15.2:0/1582913694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda84109150 msgr2=0x7fda8419ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda84109150 0x7fda8419ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 -- 172.21.15.2:0/1582913694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda841087d0 msgr2=0x7fda84199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda841087d0 0x7fda84199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 -- 172.21.15.2:0/1582913694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8419f2a0 con 0x7fda84102dc0 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda837fe640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 0x7fda841991f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c920 tx=0x7fda7400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.663+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74007c70 con 0x7fda84102dc0 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.664+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8419f590 con 0x7fda84102dc0 2024-09-10T23:21:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.664+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda74007e10 con 0x7fda84102dc0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.664+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74018820 con 0x7fda84102dc0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.664+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda841a5e20 con 0x7fda84102dc0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.665+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda841031a0 con 0x7fda84102dc0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.666+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fda7400f450 con 0x7fda84102dc0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.667+0000 7fda817fa640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda700b52e0 0x7fda700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.667+0000 7fda7bfff640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda700b52e0 0x7fda700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.667+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fda740e5a60 con 0x7fda84102dc0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.667+0000 7fda7bfff640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda700b52e0 0x7fda700b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda6c031440 tx=0x7fda6c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.670+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fda74014030 con 0x7fda84102dc0 2024-09-10T23:21:37.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:37 smithi154 ceph-mon[35136]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:37.779 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:37 smithi154 systemd[1]: Starting Ceph mds.k for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:37.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.893+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda8419a320 con 0x7fda84102dc0 2024-09-10T23:21:37.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.894+0000 7fda817fa640 1 -- 172.21.15.2:0/1582913694 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fda8419a320 con 0x7fda84102dc0 2024-09-10T23:21:37.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:37.895 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"btime":"2024-09-10T23:21:35:394213+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:21:37.895 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda700b52e0 msgr2=0x7fda700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda700b52e0 0x7fda700b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda6c031440 tx=0x7fda6c005b50 comp rx=0 tx=0).stop 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 msgr2=0x7fda841991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 0x7fda841991f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c920 tx=0x7fda7400cde0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 shutdown_connections 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda700b52e0 0x7fda700b77a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda84109150 0x7fda8419ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda841087d0 0x7fda84199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 --2- 172.21.15.2:0/1582913694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84102dc0 0x7fda841991f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 >> 172.21.15.2:0/1582913694 conn(0x7fda840fe830 msgr2=0x7fda84100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:37.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 shutdown_connections 2024-09-10T23:21:37.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:37.896+0000 7fda89c4f640 1 -- 172.21.15.2:0/1582913694 wait complete. 2024-09-10T23:21:37.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:37 smithi177 ceph-mon[35760]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:38.152 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:37 smithi154 podman[64687]: 2024-09-10 23:21:37.69837987 +0000 UTC m=+0.015730575 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:38.153 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:37 smithi154 podman[64687]: 2024-09-10 23:21:37.849919728 +0000 UTC m=+0.167270426 container create 694ae7bc01491b10995fb73c004ae6cd43460c485e32642bc24e66afa80fb0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:21:38.153 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:38 smithi154 podman[64687]: 2024-09-10 23:21:38.152677659 +0000 UTC m=+0.470028369 container init 694ae7bc01491b10995fb73c004ae6cd43460c485e32642bc24e66afa80fb0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:21:38.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:38 smithi154 podman[64687]: 2024-09-10 23:21:38.155762061 +0000 UTC m=+0.473112768 container start 694ae7bc01491b10995fb73c004ae6cd43460c485e32642bc24e66afa80fb0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T23:21:38.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mds[64706]: -- 172.21.15.154:0/860942518 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56553baddc20 con 0x56553babb400 2024-09-10T23:21:38.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k[64702]: starting mds.k at 2024-09-10T23:21:38.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:38 smithi154 bash[64687]: 694ae7bc01491b10995fb73c004ae6cd43460c485e32642bc24e66afa80fb0d9 2024-09-10T23:21:38.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:21:38 smithi154 systemd[1]: Started Ceph mds.k for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1582913694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:38.637 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1582913694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:38.866 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1582913694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:39.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:39 smithi154 ceph-mon[35136]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:39 smithi154 ceph-mon[35136]: Deploying daemon mds.j on smithi002 2024-09-10T23:21:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:39 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6832/940548947,v1:172.21.15.154:6833/940548947] up:boot 2024-09-10T23:21:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:39 smithi154 ceph-mon[35136]: fsmap 2 up:standby 2024-09-10T23:21:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:39 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:21:39.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:39 smithi177 ceph-mon[35760]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:39.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:39 smithi177 ceph-mon[35760]: Deploying daemon mds.j on smithi002 2024-09-10T23:21:39.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:39 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6832/940548947,v1:172.21.15.154:6833/940548947] up:boot 2024-09-10T23:21:39.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:39 smithi177 ceph-mon[35760]: fsmap 2 up:standby 2024-09-10T23:21:39.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:39 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:21:39.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:39 smithi002 ceph-mon[31150]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:39.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:39 smithi002 ceph-mon[31150]: Deploying daemon mds.j on smithi002 2024-09-10T23:21:39.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:39 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6832/940548947,v1:172.21.15.154:6833/940548947] up:boot 2024-09-10T23:21:39.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:39 smithi002 ceph-mon[31150]: fsmap 2 up:standby 2024-09-10T23:21:39.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:39 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:40.690 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 systemd[1]: Starting Ceph mds.j for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:40.968 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 podman[73233]: 2024-09-10 23:21:40.5931355 +0000 UTC m=+0.016668918 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:40.968 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 podman[73233]: 2024-09-10 23:21:40.715041784 +0000 UTC m=+0.138575188 container create ad87c0dc222dc29cb1a81573f355309969a8597a2456d7e23a4b2135a4bcde93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:21:40.968 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 podman[73233]: 2024-09-10 23:21:40.968042315 +0000 UTC m=+0.391575721 container init ad87c0dc222dc29cb1a81573f355309969a8597a2456d7e23a4b2135a4bcde93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:21:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:41.236 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 podman[73233]: 2024-09-10 23:21:40.971196674 +0000 UTC m=+0.394730079 container start ad87c0dc222dc29cb1a81573f355309969a8597a2456d7e23a4b2135a4bcde93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T23:21:41.236 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 ceph-mds[73281]: -- 172.21.15.2:0/1049790410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee004ef860 con 0x55ee004cc800 2024-09-10T23:21:41.237 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j[73266]: starting mds.j at 2024-09-10T23:21:41.237 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:41 smithi002 bash[73233]: ad87c0dc222dc29cb1a81573f355309969a8597a2456d7e23a4b2135a4bcde93 2024-09-10T23:21:41.237 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:21:41 smithi002 systemd[1]: Started Ceph mds.j for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 -- 172.21.15.2:0/400112925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 msgr2=0x7fdf34107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 --2- 172.21.15.2:0/400112925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf34107ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009900 tx=0x7fdf2802a410 comp rx=0 tx=0).stop 2024-09-10T23:21:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 -- 172.21.15.2:0/400112925 shutdown_connections 2024-09-10T23:21:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 --2- 172.21.15.2:0/400112925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf34108020 0x7fdf3410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 --2- 172.21.15.2:0/400112925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf34107ae0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 --2- 172.21.15.2:0/400112925 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf34101c90 0x7fdf34102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 -- 172.21.15.2:0/400112925 >> 172.21.15.2:0/400112925 conn(0x7fdf340fd700 msgr2=0x7fdf340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 -- 172.21.15.2:0/400112925 shutdown_connections 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.623+0000 7fdf39055640 1 -- 172.21.15.2:0/400112925 wait complete. 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 Processor -- start 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 -- start start 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf34101c90 0x7fdf3419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf3419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf34108020 0x7fdf3419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34111ca0 con 0x7fdf341076a0 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34111b20 con 0x7fdf34101c90 2024-09-10T23:21:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf39055640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34111e20 con 0x7fdf34108020 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf3259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf3419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf3259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf3419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40956/0 (socket says 172.21.15.2:40956) 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf3259c640 1 -- 172.21.15.2:0/2676647533 learned_addr learned my addr 172.21.15.2:0/2676647533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.624+0000 7fdf32d9d640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf34101c90 0x7fdf3419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3359e640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf34108020 0x7fdf3419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3259c640 1 -- 172.21.15.2:0/2676647533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf34108020 msgr2=0x7fdf3419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3259c640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf34108020 0x7fdf3419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3259c640 1 -- 172.21.15.2:0/2676647533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf34101c90 msgr2=0x7fdf3419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3259c640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf34101c90 0x7fdf3419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3259c640 1 -- 172.21.15.2:0/2676647533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf341a5550 con 0x7fdf341076a0 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf3259c640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf3419a6b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005940 tx=0x7fdf280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2803f030 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf341a57e0 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf28003cb0 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28035070 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.625+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf341a5cc0 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.626+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf34102070 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.628+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fdf2803bbf0 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.628+0000 7fdf1bfff640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf1c0b52e0 0x7fdf1c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.629+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fdf28106470 con 0x7fdf341076a0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.629+0000 7fdf32d9d640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf1c0b52e0 0x7fdf1c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.629+0000 7fdf32d9d640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf1c0b52e0 0x7fdf1c0b77a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.632+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf280cd180 con 0x7fdf341076a0 2024-09-10T23:21:41.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:41.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:41.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:41.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:41.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:41.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:41.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:41 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.865+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf3406aec0 con 0x7fdf341076a0 2024-09-10T23:21:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.865+0000 7fdf1bfff640 1 -- 172.21.15.2:0/2676647533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7fdf280d1bb0 con 0x7fdf341076a0 2024-09-10T23:21:41.866 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"btime":"2024-09-10T23:21:41:538273+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:21:41.867 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-09-10T23:21:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf1c0b52e0 msgr2=0x7fdf1c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf1c0b52e0 0x7fdf1c0b77a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2400b390 comp rx=0 tx=0).stop 2024-09-10T23:21:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 msgr2=0x7fdf3419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf3419a6b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005940 tx=0x7fdf280042f0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 shutdown_connections 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf1c0b52e0 0x7fdf1c0b77a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf34108020 0x7fdf3419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf341076a0 0x7fdf3419a6b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 --2- 172.21.15.2:0/2676647533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf34101c90 0x7fdf3419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.868+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 >> 172.21.15.2:0/2676647533 conn(0x7fdf340fd700 msgr2=0x7fdf340ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.869+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 shutdown_connections 2024-09-10T23:21:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:41.869+0000 7fdf39055640 1 -- 172.21.15.2:0/2676647533 wait complete. 2024-09-10T23:21:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:41.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:41.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:41 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:41 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:42.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:42 smithi002 ceph-mon[31150]: Deploying daemon mds.d on smithi002 2024-09-10T23:21:42.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:42 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.2:6834/348830467,v1:172.21.15.2:6835/348830467] up:boot 2024-09-10T23:21:42.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:42 smithi002 ceph-mon[31150]: fsmap 3 up:standby 2024-09-10T23:21:42.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:42 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:21:42.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:42 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2676647533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:42.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:42 smithi177 ceph-mon[35760]: Deploying daemon mds.d on smithi002 2024-09-10T23:21:42.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:42 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.2:6834/348830467,v1:172.21.15.2:6835/348830467] up:boot 2024-09-10T23:21:42.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:42 smithi177 ceph-mon[35760]: fsmap 3 up:standby 2024-09-10T23:21:42.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:42 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:21:42.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:42 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2676647533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:43.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:42 smithi154 ceph-mon[35136]: Deploying daemon mds.d on smithi002 2024-09-10T23:21:43.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:42 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.2:6834/348830467,v1:172.21.15.2:6835/348830467] up:boot 2024-09-10T23:21:43.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:42 smithi154 ceph-mon[35136]: fsmap 3 up:standby 2024-09-10T23:21:43.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:42 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:21:43.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:42 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2676647533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:43.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:43 smithi002 ceph-mon[31150]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:43 smithi177 ceph-mon[35760]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:44.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:43 smithi154 ceph-mon[35136]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:44.397 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 systemd[1]: Starting Ceph mds.d for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:44.669 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 podman[73647]: 2024-09-10 23:21:44.396519698 +0000 UTC m=+0.104926833 container create fd702a6b184a116a576669e013d4eea95b707cad3905149ab7273f8f0b777127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T23:21:44.669 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 podman[73647]: 2024-09-10 23:21:44.308511171 +0000 UTC m=+0.016918320 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:44.669 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 podman[73647]: 2024-09-10 23:21:44.641283084 +0000 UTC m=+0.349690221 container init fd702a6b184a116a576669e013d4eea95b707cad3905149ab7273f8f0b777127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:21:44.669 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 podman[73647]: 2024-09-10 23:21:44.644207115 +0000 UTC m=+0.352614250 container start fd702a6b184a116a576669e013d4eea95b707cad3905149ab7273f8f0b777127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T23:21:44.670 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 ceph-mds[73667]: -- 172.21.15.2:0/67062197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5595b36ddc20 con 0x5595b36bb000 2024-09-10T23:21:44.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:44.986 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d[73663]: starting mds.d at 2024-09-10T23:21:44.986 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 bash[73647]: fd702a6b184a116a576669e013d4eea95b707cad3905149ab7273f8f0b777127 2024-09-10T23:21:44.987 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:21:44 smithi002 systemd[1]: Started Ceph mds.d for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 -- 172.21.15.2:0/1169962450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94101c90 msgr2=0x7f9f94102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/1169962450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94101c90 0x7f9f94102070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009900 tx=0x7f9f8402a410 comp rx=0 tx=0).stop 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 -- 172.21.15.2:0/1169962450 shutdown_connections 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/1169962450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f94108020 0x7f9f9410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/1169962450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f941076a0 0x7f9f94107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/1169962450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94101c90 0x7f9f94102070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 -- 172.21.15.2:0/1169962450 >> 172.21.15.2:0/1169962450 conn(0x7f9f940fd700 msgr2=0x7f9f940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 -- 172.21.15.2:0/1169962450 shutdown_connections 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.496+0000 7f9f9ae29640 1 -- 172.21.15.2:0/1169962450 wait complete. 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 Processor -- start 2024-09-10T23:21:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 -- start start 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f94101c90 0x7f9f94197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f941076a0 0x7f9f941984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 0x7f9f94198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94111d20 con 0x7f9f94108020 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94111ba0 con 0x7f9f94101c90 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f9ae29640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94111ea0 con 0x7f9f941076a0 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 0x7f9f94198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 0x7f9f94198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41002/0 (socket says 172.21.15.2:41002) 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 -- 172.21.15.2:0/3837521683 learned_addr learned my addr 172.21.15.2:0/3837521683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f98bc5640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f94101c90 0x7f9f94197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f93fff640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f941076a0 0x7f9f941984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 -- 172.21.15.2:0/3837521683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f941076a0 msgr2=0x7f9f941984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f941076a0 0x7f9f941984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 -- 172.21.15.2:0/3837521683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f94101c90 msgr2=0x7f9f94197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f94101c90 0x7f9f94197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.497+0000 7f9f993c6640 1 -- 172.21.15.2:0/3837521683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f941a77c0 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.498+0000 7f9f993c6640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 0x7f9f94198a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00b970 tx=0x7f9f8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.498+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c019070 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.498+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f941a7ab0 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.498+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f8c014440 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.498+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0075d0 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.498+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f941a8070 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.499+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f941020f0 con 0x7f9f94108020 2024-09-10T23:21:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.500+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f9f8c00cb40 con 0x7f9f94108020 2024-09-10T23:21:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.501+0000 7f9f91ffb640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f800b52e0 0x7f9f800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.501+0000 7f9f98bc5640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f800b52e0 0x7f9f800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.501+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f9f8c0e4f50 con 0x7f9f94108020 2024-09-10T23:21:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.502+0000 7f9f98bc5640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f800b52e0 0x7f9f800b77a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f84031440 tx=0x7f9f84005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.505+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9f8c0abbc0 con 0x7f9f94108020 2024-09-10T23:21:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.729+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f9402e5c0 con 0x7f9f94108020 2024-09-10T23:21:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.729+0000 7f9f91ffb640 1 -- 172.21.15.2:0/3837521683 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3901 (secure 0 0 0) 0x7f9f8c0b05f0 con 0x7f9f94108020 2024-09-10T23:21:45.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:45.730 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"btime":"2024-09-10T23:21:45:553086+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:21:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f800b52e0 msgr2=0x7f9f800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f800b52e0 0x7f9f800b77a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f84031440 tx=0x7f9f84005e80 comp rx=0 tx=0).stop 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 msgr2=0x7f9f94198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 0x7f9f94198a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00b970 tx=0x7f9f8c00be30 comp rx=0 tx=0).stop 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 shutdown_connections 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f800b52e0 0x7f9f800b77a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f94108020 0x7f9f94198a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f941076a0 0x7f9f941984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 --2- 172.21.15.2:0/3837521683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f94101c90 0x7f9f94197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 >> 172.21.15.2:0/3837521683 conn(0x7f9f940fd700 msgr2=0x7f9f940ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 shutdown_connections 2024-09-10T23:21:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:45.733+0000 7f9f9ae29640 1 -- 172.21.15.2:0/3837521683 wait complete. 2024-09-10T23:21:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:45.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:45.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:45.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: Deploying daemon mds.e on smithi154 2024-09-10T23:21:45.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.2:6836/366884472,v1:172.21.15.2:6837/366884472] up:boot 2024-09-10T23:21:45.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: fsmap 4 up:standby 2024-09-10T23:21:45.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:21:45.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:45 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3837521683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: Deploying daemon mds.e on smithi154 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.2:6836/366884472,v1:172.21.15.2:6837/366884472] up:boot 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: fsmap 4 up:standby 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:21:46.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:45 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3837521683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: Deploying daemon mds.e on smithi154 2024-09-10T23:21:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.2:6836/366884472,v1:172.21.15.2:6837/366884472] up:boot 2024-09-10T23:21:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: fsmap 4 up:standby 2024-09-10T23:21:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:21:46.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:45 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3837521683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:47.181 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 podman[64990]: 2024-09-10 23:21:47.036979233 +0000 UTC m=+0.015798629 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:47.182 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 podman[64990]: 2024-09-10 23:21:47.181526592 +0000 UTC m=+0.160346028 container create 0d901baa415dfafd26dd036b4fc112988bc69522483f3874da4db401886ca8ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T23:21:47.779 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 podman[64990]: 2024-09-10 23:21:47.45096298 +0000 UTC m=+0.429782385 container init 0d901baa415dfafd26dd036b4fc112988bc69522483f3874da4db401886ca8ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:21:47.779 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 podman[64990]: 2024-09-10 23:21:47.453758398 +0000 UTC m=+0.432577803 container start 0d901baa415dfafd26dd036b4fc112988bc69522483f3874da4db401886ca8ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:21:47.779 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mds[65008]: -- 172.21.15.154:0/1845906497 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f0a98d860 con 0x559f0a96b400 2024-09-10T23:21:47.779 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e[65004]: starting mds.e at 2024-09-10T23:21:47.779 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 bash[64990]: 0d901baa415dfafd26dd036b4fc112988bc69522483f3874da4db401886ca8ad 2024-09-10T23:21:47.779 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:21:47 smithi154 systemd[1]: Started Ceph mds.e for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:48.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:48.312 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.312 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.312 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.312 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:48.312 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:48.312 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:47 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:48.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:48.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:47 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:48.314 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:47 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:48.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:49.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:48 smithi177 ceph-mon[35760]: Deploying daemon mds.f on smithi177 2024-09-10T23:21:49.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:48 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6834/157862185,v1:172.21.15.154:6835/157862185] up:boot 2024-09-10T23:21:49.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:48 smithi177 ceph-mon[35760]: fsmap 5 up:standby 2024-09-10T23:21:49.097 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:48 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:21:49.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:48 smithi002 ceph-mon[31150]: Deploying daemon mds.f on smithi177 2024-09-10T23:21:49.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:48 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6834/157862185,v1:172.21.15.154:6835/157862185] up:boot 2024-09-10T23:21:49.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:48 smithi002 ceph-mon[31150]: fsmap 5 up:standby 2024-09-10T23:21:49.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:48 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:21:49.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.244+0000 7f689ee13640 1 -- 172.21.15.2:0/4117215708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68981076a0 msgr2=0x7f6898107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.244+0000 7f689ee13640 1 --2- 172.21.15.2:0/4117215708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68981076a0 0x7f6898107ae0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6884009900 tx=0x7f688402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- 172.21.15.2:0/4117215708 shutdown_connections 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 --2- 172.21.15.2:0/4117215708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6898108020 0x7f689810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 --2- 172.21.15.2:0/4117215708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68981076a0 0x7f6898107ae0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 --2- 172.21.15.2:0/4117215708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6898101c90 0x7f6898102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- 172.21.15.2:0/4117215708 >> 172.21.15.2:0/4117215708 conn(0x7f68980fd700 msgr2=0x7f68980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- 172.21.15.2:0/4117215708 shutdown_connections 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- 172.21.15.2:0/4117215708 wait complete. 2024-09-10T23:21:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 Processor -- start 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- start start 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 0x7f68981992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68981076a0 0x7f68981997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6898108020 0x7f689819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6898111ca0 con 0x7f6898101c90 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6898111b20 con 0x7f68981076a0 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.245+0000 7f689ee13640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6898111e20 con 0x7f6898108020 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 0x7f68981992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 0x7f68981992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41022/0 (socket says 172.21.15.2:41022) 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 -- 172.21.15.2:0/597286711 learned_addr learned my addr 172.21.15.2:0/597286711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689d3b0640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6898108020 0x7f689819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f6897fff640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68981076a0 0x7f68981997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 -- 172.21.15.2:0/597286711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6898108020 msgr2=0x7f689819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6898108020 0x7f689819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 -- 172.21.15.2:0/597286711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68981076a0 msgr2=0x7f68981997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68981076a0 0x7f68981997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 -- 172.21.15.2:0/597286711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689819f360 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689cbaf640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 0x7f68981992b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f688c00d950 tx=0x7f688c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c017030 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f688c004020 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0047a0 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.246+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689819f650 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.247+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68981a5d10 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.248+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6898102070 con 0x7f6898101c90 2024-09-10T23:21:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.250+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f688c009a30 con 0x7f6898101c90 2024-09-10T23:21:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.250+0000 7f6895ffb640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68880b5360 0x7f68880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.251+0000 7f6897fff640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68880b5360 0x7f68880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.251+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f688c0e5060 con 0x7f6898101c90 2024-09-10T23:21:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.251+0000 7f6897fff640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68880b5360 0x7f68880b7820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6884031440 tx=0x7f6884005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.255+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f688c0ac3c0 con 0x7f6898101c90 2024-09-10T23:21:49.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:48 smithi154 ceph-mon[35136]: Deploying daemon mds.f on smithi177 2024-09-10T23:21:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:48 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6834/157862185,v1:172.21.15.154:6835/157862185] up:boot 2024-09-10T23:21:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:48 smithi154 ceph-mon[35136]: fsmap 5 up:standby 2024-09-10T23:21:49.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:48 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:21:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.477+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68981a6060 con 0x7f6898101c90 2024-09-10T23:21:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.477+0000 7f6895ffb640 1 -- 172.21.15.2:0/597286711 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7f688c0abcc0 con 0x7f6898101c90 2024-09-10T23:21:49.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:49.479 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"btime":"2024-09-10T23:21:47:820272+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:21:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.480+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68880b5360 msgr2=0x7f68880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.480+0000 7f689ee13640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68880b5360 0x7f68880b7820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6884031440 tx=0x7f6884005b50 comp rx=0 tx=0).stop 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 msgr2=0x7f68981992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 0x7f68981992b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f688c00d950 tx=0x7f688c00de10 comp rx=0 tx=0).stop 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 shutdown_connections 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68880b5360 0x7f68880b7820 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6898108020 0x7f689819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68981076a0 0x7f68981997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 --2- 172.21.15.2:0/597286711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6898101c90 0x7f68981992b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 >> 172.21.15.2:0/597286711 conn(0x7f68980fd700 msgr2=0x7f689806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 shutdown_connections 2024-09-10T23:21:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:49.481+0000 7f689ee13640 1 -- 172.21.15.2:0/597286711 wait complete. 2024-09-10T23:21:49.714 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:49 smithi177 systemd[1]: Starting Ceph mds.f for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:50.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:49 smithi177 ceph-mon[35760]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:50.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:49 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/597286711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:50.069 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:49 smithi177 podman[65779]: 2024-09-10 23:21:49.695594387 +0000 UTC m=+0.015775882 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:50.069 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:49 smithi177 podman[65779]: 2024-09-10 23:21:49.824239537 +0000 UTC m=+0.144421027 container create 4ae7aae5102a63c19c257c7b73db63b3c83529b54a7a9b33cb99d2b2cdc1e313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T23:21:50.069 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:50 smithi177 podman[65779]: 2024-09-10 23:21:50.06896509 +0000 UTC m=+0.389146578 container init 4ae7aae5102a63c19c257c7b73db63b3c83529b54a7a9b33cb99d2b2cdc1e313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T23:21:50.126 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:49 smithi002 ceph-mon[31150]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:50.126 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:49 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/597286711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:49 smithi154 ceph-mon[35136]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:49 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/597286711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:50.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:50 smithi177 podman[65779]: 2024-09-10 23:21:50.071909334 +0000 UTC m=+0.392090831 container start 4ae7aae5102a63c19c257c7b73db63b3c83529b54a7a9b33cb99d2b2cdc1e313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T23:21:50.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:50 smithi177 ceph-mds[65798]: -- 172.21.15.177:0/2605593277 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b255eb9860 con 0x55b255e96800 2024-09-10T23:21:50.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f[65794]: starting mds.f at 2024-09-10T23:21:50.465 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:50 smithi177 bash[65779]: 4ae7aae5102a63c19c257c7b73db63b3c83529b54a7a9b33cb99d2b2cdc1e313 2024-09-10T23:21:50.465 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:21:50 smithi177 systemd[1]: Started Ceph mds.f for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:51.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:51.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: Deploying daemon mds.c on smithi177 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] up:boot 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: fsmap 6 up:standby 2024-09-10T23:21:51.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:21:51.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:51.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: Deploying daemon mds.c on smithi177 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] up:boot 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: fsmap 6 up:standby 2024-09-10T23:21:51.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:21:51.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:51.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: Deploying daemon mds.c on smithi177 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] up:boot 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: fsmap 6 up:standby 2024-09-10T23:21:51.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:21:52.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:52.464 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 systemd[1]: Starting Ceph mds.c for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:52.809 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 podman[66082]: 2024-09-10 23:21:52.396402646 +0000 UTC m=+0.015776995 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:52.809 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 podman[66082]: 2024-09-10 23:21:52.50575088 +0000 UTC m=+0.125125278 container create deafac7a9bac084e7e22feb0ec92629bbfda843b7b3a0db2dcfb4a3faf312c78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T23:21:52.809 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 podman[66082]: 2024-09-10 23:21:52.809174956 +0000 UTC m=+0.428549302 container init deafac7a9bac084e7e22feb0ec92629bbfda843b7b3a0db2dcfb4a3faf312c78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-10T23:21:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 -- 172.21.15.2:0/3630503298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc1076a0 msgr2=0x7f2fdc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/3630503298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc1076a0 0x7f2fdc107ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009900 tx=0x7f2fd002a410 comp rx=0 tx=0).stop 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 -- 172.21.15.2:0/3630503298 shutdown_connections 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/3630503298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc108020 0x7f2fdc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/3630503298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc1076a0 0x7f2fdc107ae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/3630503298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fdc101c90 0x7f2fdc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 -- 172.21.15.2:0/3630503298 >> 172.21.15.2:0/3630503298 conn(0x7f2fdc0fd700 msgr2=0x7f2fdc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 -- 172.21.15.2:0/3630503298 shutdown_connections 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.956+0000 7f2fe2f65640 1 -- 172.21.15.2:0/3630503298 wait complete. 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 Processor -- start 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 -- start start 2024-09-10T23:21:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 0x7f2fdc1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fdc1076a0 0x7f2fdc199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc108020 0x7f2fdc19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc111ca0 con 0x7f2fdc101c90 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc111b20 con 0x7f2fdc1076a0 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe2f65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc111e20 con 0x7f2fdc108020 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 0x7f2fdc1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 0x7f2fdc1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55124/0 (socket says 172.21.15.2:55124) 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 -- 172.21.15.2:0/1940814523 learned_addr learned my addr 172.21.15.2:0/1940814523 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe1502640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc108020 0x7f2fdc19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fdbfff640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fdc1076a0 0x7f2fdc199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 -- 172.21.15.2:0/1940814523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc108020 msgr2=0x7f2fdc19eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc108020 0x7f2fdc19eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 -- 172.21.15.2:0/1940814523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fdc1076a0 msgr2=0x7f2fdc199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.957+0000 7f2fe0d01640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fdc1076a0 0x7f2fdc199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.958+0000 7f2fe0d01640 1 -- 172.21.15.2:0/1940814523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc19f370 con 0x7f2fdc101c90 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.958+0000 7f2fe0d01640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 0x7f2fdc1992c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00db80 tx=0x7f2fcc00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.959+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc017070 con 0x7f2fdc101c90 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.960+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc19f660 con 0x7f2fdc101c90 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.960+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fcc003b70 con 0x7f2fdc101c90 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.960+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0106c0 con 0x7f2fdc101c90 2024-09-10T23:21:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.960+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc1a5ef0 con 0x7f2fdc101c90 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.961+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fdc102f40 con 0x7f2fdc101c90 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.962+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f2fcc023060 con 0x7f2fdc101c90 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.963+0000 7f2fd9ffb640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2fc40b52e0 0x7f2fc40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.964+0000 7f2fdbfff640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2fc40b52e0 0x7f2fc40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.964+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f2fcc0e5410 con 0x7f2fdc101c90 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.964+0000 7f2fdbfff640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2fc40b52e0 0x7f2fc40b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0031440 tx=0x7f2fd0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:52.970+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2fcc0ac770 con 0x7f2fdc101c90 2024-09-10T23:21:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.192+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fdc1a60c0 con 0x7f2fdc101c90 2024-09-10T23:21:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.193+0000 7f2fd9ffb640 1 -- 172.21.15.2:0/1940814523 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5554 (secure 0 0 0) 0x7f2fcc0ac070 con 0x7f2fdc101c90 2024-09-10T23:21:53.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:53.194 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"btime":"2024-09-10T23:21:50:834172+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-10T23:21:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-09-10T23:21:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2fc40b52e0 msgr2=0x7f2fc40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2fc40b52e0 0x7f2fc40b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0031440 tx=0x7f2fd0005b50 comp rx=0 tx=0).stop 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 msgr2=0x7f2fdc1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 0x7f2fdc1992c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00db80 tx=0x7f2fcc00b630 comp rx=0 tx=0).stop 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 shutdown_connections 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2fc40b52e0 0x7f2fc40b77a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc108020 0x7f2fdc19eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fdc1076a0 0x7f2fdc199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 --2- 172.21.15.2:0/1940814523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc101c90 0x7f2fdc1992c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 >> 172.21.15.2:0/1940814523 conn(0x7f2fdc0fd700 msgr2=0x7f2fdc1047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 shutdown_connections 2024-09-10T23:21:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:53.196+0000 7f2fe2f65640 1 -- 172.21.15.2:0/1940814523 wait complete. 2024-09-10T23:21:53.214 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 podman[66082]: 2024-09-10 23:21:52.812404802 +0000 UTC m=+0.431779146 container start deafac7a9bac084e7e22feb0ec92629bbfda843b7b3a0db2dcfb4a3faf312c78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T23:21:53.214 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 ceph-mds[66101]: -- 172.21.15.177:0/2259460836 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e93a19d860 con 0x55e93a17a800 2024-09-10T23:21:53.214 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c[66097]: starting mds.c at 2024-09-10T23:21:53.215 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 bash[66082]: deafac7a9bac084e7e22feb0ec92629bbfda843b7b3a0db2dcfb4a3faf312c78 2024-09-10T23:21:53.215 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:21:52 smithi177 systemd[1]: Started Ceph mds.c for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: Deploying daemon mds.h on smithi154 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1940814523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] up:boot 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: fsmap 7 up:standby 2024-09-10T23:21:54.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:53 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: Deploying daemon mds.h on smithi154 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1940814523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] up:boot 2024-09-10T23:21:54.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: fsmap 7 up:standby 2024-09-10T23:21:54.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:53 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: Deploying daemon mds.h on smithi154 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1940814523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] up:boot 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: fsmap 7 up:standby 2024-09-10T23:21:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:53 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:21:55.256 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 systemd[1]: Starting Ceph mds.h for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:55.529 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 podman[65289]: 2024-09-10 23:21:55.158992243 +0000 UTC m=+0.015977586 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:55.529 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 podman[65289]: 2024-09-10 23:21:55.285395342 +0000 UTC m=+0.142380728 container create 40f74786f163c4ba10f077b262ebe79d89929d9b0de0581ea8ee31ea146171bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T23:21:55.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:55.959 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 podman[65289]: 2024-09-10 23:21:55.591459156 +0000 UTC m=+0.448444508 container init 40f74786f163c4ba10f077b262ebe79d89929d9b0de0581ea8ee31ea146171bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:21:55.959 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 podman[65289]: 2024-09-10 23:21:55.594420195 +0000 UTC m=+0.451405538 container start 40f74786f163c4ba10f077b262ebe79d89929d9b0de0581ea8ee31ea146171bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T23:21:55.959 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mds[65309]: -- 172.21.15.154:0/2330987183 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562391663860 con 0x562391640800 2024-09-10T23:21:55.959 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h[65305]: starting mds.h at 2024-09-10T23:21:55.959 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 bash[65289]: 40f74786f163c4ba10f077b262ebe79d89929d9b0de0581ea8ee31ea146171bc 2024-09-10T23:21:55.959 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:21:55 smithi154 systemd[1]: Started Ceph mds.h for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:56.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:56.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:55 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:56.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:56.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:55 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:55 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2276698840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8101cd0 msgr2=0x7fe1f81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2276698840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8101cd0 0x7fe1f81020b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009900 tx=0x7fe1e802a410 comp rx=0 tx=0).stop 2024-09-10T23:21:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2276698840 shutdown_connections 2024-09-10T23:21:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2276698840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f8108060 0x7fe1f810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2276698840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f81076e0 0x7fe1f8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2276698840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8101cd0 0x7fe1f81020b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2276698840 >> 172.21.15.2:0/2276698840 conn(0x7fe1f80fd720 msgr2=0x7fe1f80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2276698840 shutdown_connections 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2276698840 wait complete. 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.635+0000 7fe1fe09c640 1 Processor -- start 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 -- start start 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f8101cd0 0x7fe1f8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f81076e0 0x7fe1f8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 0x7fe1f819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8111d20 con 0x7fe1f8108060 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8111ba0 con 0x7fe1f81076e0 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1fe09c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8111ea0 con 0x7fe1f8101cd0 2024-09-10T23:21:56.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 0x7fe1f819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 0x7fe1f819ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55134/0 (socket says 172.21.15.2:55134) 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 -- 172.21.15.2:0/2207715758 learned_addr learned my addr 172.21.15.2:0/2207715758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f77fe640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f8101cd0 0x7fe1f8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f6ffd640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f81076e0 0x7fe1f8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 -- 172.21.15.2:0/2207715758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f8101cd0 msgr2=0x7fe1f8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f8101cd0 0x7fe1f8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 -- 172.21.15.2:0/2207715758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f81076e0 msgr2=0x7fe1f8199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f81076e0 0x7fe1f8199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.636+0000 7fe1f7fff640 1 -- 172.21.15.2:0/2207715758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f819f3b0 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.637+0000 7fe1f7fff640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 0x7fe1f819ebe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000cad0 tx=0x7fe1f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.637+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000ae20 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.637+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1f0005020 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.637+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f819f6a0 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.637+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000f6b0 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.637+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f81a5d60 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.638+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f81020b0 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.639+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fe1f00054f0 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.640+0000 7fe1f4ff9640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe1e00b52e0 0x7fe1e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.640+0000 7fe1f77fe640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe1e00b52e0 0x7fe1e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.640+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fe1f00e5c00 con 0x7fe1f8108060 2024-09-10T23:21:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.641+0000 7fe1f77fe640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe1e00b52e0 0x7fe1e00b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8031440 tx=0x7fe1e8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.643+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe1f0014030 con 0x7fe1f8108060 2024-09-10T23:21:56.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.866+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1f819a430 con 0x7fe1f8108060 2024-09-10T23:21:56.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.867+0000 7fe1f4ff9640 1 -- 172.21.15.2:0/2207715758 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7fe1f819a430 con 0x7fe1f8108060 2024-09-10T23:21:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:21:56.869 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T23:21:55:951749+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T23:21:56.869 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T23:21:56.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe1e00b52e0 msgr2=0x7fe1e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe1e00b52e0 0x7fe1e00b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8031440 tx=0x7fe1e8005b50 comp rx=0 tx=0).stop 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 msgr2=0x7fe1f819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 0x7fe1f819ebe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000cad0 tx=0x7fe1f000cf90 comp rx=0 tx=0).stop 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 shutdown_connections 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe1e00b52e0 0x7fe1e00b77a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1f8108060 0x7fe1f819ebe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f81076e0 0x7fe1f8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 --2- 172.21.15.2:0/2207715758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1f8101cd0 0x7fe1f8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 >> 172.21.15.2:0/2207715758 conn(0x7fe1f80fd720 msgr2=0x7fe1f806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 shutdown_connections 2024-09-10T23:21:56.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:21:56.869+0000 7fe1fe09c640 1 -- 172.21.15.2:0/2207715758 wait complete. 2024-09-10T23:21:57.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:56 smithi177 ceph-mon[35760]: Deploying daemon mds.i on smithi177 2024-09-10T23:21:57.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:56 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] up:boot 2024-09-10T23:21:57.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:56 smithi177 ceph-mon[35760]: fsmap 8 up:standby 2024-09-10T23:21:57.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:56 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:21:57.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2207715758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:57.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:56 smithi002 ceph-mon[31150]: Deploying daemon mds.i on smithi177 2024-09-10T23:21:57.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:56 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] up:boot 2024-09-10T23:21:57.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:56 smithi002 ceph-mon[31150]: fsmap 8 up:standby 2024-09-10T23:21:57.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:56 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:21:57.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2207715758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:57.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:56 smithi154 ceph-mon[35136]: Deploying daemon mds.i on smithi177 2024-09-10T23:21:57.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:56 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] up:boot 2024-09-10T23:21:57.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:56 smithi154 ceph-mon[35136]: fsmap 8 up:standby 2024-09-10T23:21:57.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:56 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:21:57.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2207715758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:21:57.890 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:57 smithi177 systemd[1]: Starting Ceph mds.i for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:21:58.173 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:57 smithi177 ceph-mon[35760]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:58.173 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:57 smithi177 podman[66381]: 2024-09-10 23:21:57.792676863 +0000 UTC m=+0.015599365 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:21:58.173 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:57 smithi177 podman[66381]: 2024-09-10 23:21:57.928644789 +0000 UTC m=+0.151567279 container create 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:21:58.173 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:58 smithi177 podman[66381]: 2024-09-10 23:21:58.173313694 +0000 UTC m=+0.396236177 container init 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:21:58.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:57 smithi002 ceph-mon[31150]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:57 smithi154 ceph-mon[35136]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:58.464 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:58 smithi177 podman[66381]: 2024-09-10 23:21:58.176338794 +0000 UTC m=+0.399261278 container start 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T23:21:58.464 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:58 smithi177 ceph-mds[66400]: -- 172.21.15.177:0/1645613568 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557258b6d860 con 0x557258b4b000 2024-09-10T23:21:58.464 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: starting mds.i at 2024-09-10T23:21:58.464 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:58 smithi177 bash[66381]: 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 2024-09-10T23:21:58.464 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:21:58 smithi177 systemd[1]: Started Ceph mds.i for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:21:59.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:21:59.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:59.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: Deploying daemon mds.g on smithi002 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] up:boot 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: fsmap 9 up:standby 2024-09-10T23:21:59.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:21:59 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:21:59.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:59.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: Deploying daemon mds.g on smithi002 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] up:boot 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: fsmap 9 up:standby 2024-09-10T23:21:59.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:21:59 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: Deploying daemon mds.g on smithi002 2024-09-10T23:21:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] up:boot 2024-09-10T23:21:59.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: fsmap 9 up:standby 2024-09-10T23:21:59.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:21:59 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/2300140384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0109150 msgr2=0x7fb6c010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/2300140384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0109150 0x7fb6c010f950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009ca0 tx=0x7fb6b802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/2300140384 shutdown_connections 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/2300140384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0109150 0x7fb6c010f950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/2300140384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c01087d0 0x7fb6c0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/2300140384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6c0102dc0 0x7fb6c01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/2300140384 >> 172.21.15.2:0/2300140384 conn(0x7fb6c00fe830 msgr2=0x7fb6c0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/2300140384 shutdown_connections 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/2300140384 wait complete. 2024-09-10T23:22:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.523+0000 7fb6c6b0a640 1 Processor -- start 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 -- start start 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 0x7fb6c019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6c01087d0 0x7fb6c019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c0109150 0x7fb6c01a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0112e10 con 0x7fb6c0102dc0 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0112c90 con 0x7fb6c0109150 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c6b0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0112f90 con 0x7fb6c01087d0 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 0x7fb6c019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 0x7fb6c019b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55162/0 (socket says 172.21.15.2:55162) 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 -- 172.21.15.2:0/1458810316 learned_addr learned my addr 172.21.15.2:0/1458810316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c50a7640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c0109150 0x7fb6c01a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6bffff640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6c01087d0 0x7fb6c019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 -- 172.21.15.2:0/1458810316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6c01087d0 msgr2=0x7fb6c019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6c01087d0 0x7fb6c019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 -- 172.21.15.2:0/1458810316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c0109150 msgr2=0x7fb6c01a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c0109150 0x7fb6c01a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 -- 172.21.15.2:0/1458810316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c01a1540 con 0x7fb6c0102dc0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c50a7640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c0109150 0x7fb6c01a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.524+0000 7fb6c48a6640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 0x7fb6c019b490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b4a0 tx=0x7fb6b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.525+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0014070 con 0x7fb6c0102dc0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.525+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c01a1830 con 0x7fb6c0102dc0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.525+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6b0010ac0 con 0x7fb6c0102dc0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.525+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0017c30 con 0x7fb6c0102dc0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.525+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01a7f70 con 0x7fb6c0102dc0 2024-09-10T23:22:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.526+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c01031a0 con 0x7fb6c0102dc0 2024-09-10T23:22:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.527+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fb6b0010610 con 0x7fb6c0102dc0 2024-09-10T23:22:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.528+0000 7fb6bdffb640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6a80b52e0 0x7fb6a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.528+0000 7fb6bffff640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6a80b52e0 0x7fb6a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.528+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fb6b00e50f0 con 0x7fb6c0102dc0 2024-09-10T23:22:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.529+0000 7fb6bffff640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6a80b52e0 0x7fb6a80b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4005e10 tx=0x7fb6b4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.531+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb6b00ac3b0 con 0x7fb6c0102dc0 2024-09-10T23:22:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.762+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6c019c5c0 con 0x7fb6c0102dc0 2024-09-10T23:22:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.762+0000 7fb6bdffb640 1 -- 172.21.15.2:0/1458810316 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7fb6b00abcb0 con 0x7fb6c0102dc0 2024-09-10T23:22:00.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:00.764 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"btime":"2024-09-10T23:21:58:963509+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T23:22:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2024-09-10T23:22:00.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6a80b52e0 msgr2=0x7fb6a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6a80b52e0 0x7fb6a80b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4005e10 tx=0x7fb6b4005da0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 msgr2=0x7fb6c019b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 0x7fb6c019b490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b4a0 tx=0x7fb6b000b960 comp rx=0 tx=0).stop 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 shutdown_connections 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6a80b52e0 0x7fb6a80b77a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6c0109150 0x7fb6c01a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6c01087d0 0x7fb6c019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 --2- 172.21.15.2:0/1458810316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c0102dc0 0x7fb6c019b490 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.764+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 >> 172.21.15.2:0/1458810316 conn(0x7fb6c00fe830 msgr2=0x7fb6c0105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.765+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 shutdown_connections 2024-09-10T23:22:00.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:00.765+0000 7fb6c6b0a640 1 -- 172.21.15.2:0/1458810316 wait complete. 2024-09-10T23:22:01.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:01 smithi002 ceph-mon[31150]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:01.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:01 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1458810316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:01.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:01 smithi177 ceph-mon[35760]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:01.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:01 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1458810316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:01.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:01 smithi154 ceph-mon[35136]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:01.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:01 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1458810316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:01.988 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:22:01 smithi002 systemd[1]: Started Ceph mds.g for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:03.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: Deploying daemon mds.a on smithi002 2024-09-10T23:22:03.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.2:6838/1174009300,v1:172.21.15.2:6839/1174009300] up:boot 2024-09-10T23:22:03.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: fsmap 10 up:standby 2024-09-10T23:22:03.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:02 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:22:03.201 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.201 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.201 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.201 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:22:03.202 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:22:03.202 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:03.202 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: Deploying daemon mds.a on smithi002 2024-09-10T23:22:03.202 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.2:6838/1174009300,v1:172.21.15.2:6839/1174009300] up:boot 2024-09-10T23:22:03.202 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: fsmap 10 up:standby 2024-09-10T23:22:03.202 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:02 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:22:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:22:03.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:22:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: Deploying daemon mds.a on smithi002 2024-09-10T23:22:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.2:6838/1174009300,v1:172.21.15.2:6839/1174009300] up:boot 2024-09-10T23:22:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: fsmap 10 up:standby 2024-09-10T23:22:03.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:02 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:22:03.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:22:03.775 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:03 smithi002 systemd[1]: Starting Ceph mds.a for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:22:04.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:03 smithi154 ceph-mon[35136]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:04.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:03 smithi002 ceph-mon[31150]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:04.069 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:03 smithi002 podman[74856]: 2024-09-10 23:22:03.836777875 +0000 UTC m=+0.020728800 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:22:04.069 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:03 smithi002 podman[74856]: 2024-09-10 23:22:03.945063678 +0000 UTC m=+0.129014593 container create a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:22:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:03 smithi177 ceph-mon[35760]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:04.450 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:04 smithi002 podman[74856]: 2024-09-10 23:22:04.181389972 +0000 UTC m=+0.365340888 container init a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T23:22:04.450 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:04 smithi002 podman[74856]: 2024-09-10 23:22:04.184469198 +0000 UTC m=+0.368420120 container start a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T23:22:04.450 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:04 smithi002 ceph-mds[74900]: -- 172.21.15.2:0/3858511904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558527729c20 con 0x558527706800 2024-09-10T23:22:04.450 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a[74883]: starting mds.a at 2024-09-10T23:22:04.450 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:04 smithi002 bash[74856]: a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 2024-09-10T23:22:04.450 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:22:04 smithi002 systemd[1]: Started Ceph mds.a for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:22:04.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 -- 172.21.15.2:0/2981722013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 msgr2=0x7f573c10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 --2- 172.21.15.2:0/2981722013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c10cb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f572c009900 tx=0x7f572c02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 -- 172.21.15.2:0/2981722013 shutdown_connections 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 --2- 172.21.15.2:0/2981722013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c10d120 0x7f573c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 --2- 172.21.15.2:0/2981722013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c10cb50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 --2- 172.21.15.2:0/2981722013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 0x7f573c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 -- 172.21.15.2:0/2981722013 >> 172.21.15.2:0/2981722013 conn(0x7f573c0fd700 msgr2=0x7f573c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 -- 172.21.15.2:0/2981722013 shutdown_connections 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 -- 172.21.15.2:0/2981722013 wait complete. 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 Processor -- start 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.787+0000 7f5744735640 1 -- start start 2024-09-10T23:22:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 0x7f573c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c10d120 0x7f573c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f573c112da0 con 0x7f573c104570 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f573c112c20 con 0x7f573c10d120 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f573c112f20 con 0x7f573c103b70 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49214/0 (socket says 172.21.15.2:49214) 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 -- 172.21.15.2:0/4283818035 learned_addr learned my addr 172.21.15.2:0/4283818035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5742cd2640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c10d120 0x7f573c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 -- 172.21.15.2:0/4283818035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 msgr2=0x7f573c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f57424d1640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 0x7f573c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 0x7f573c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 -- 172.21.15.2:0/4283818035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c10d120 msgr2=0x7f573c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c10d120 0x7f573c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 -- 172.21.15.2:0/4283818035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c19f340 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f57424d1640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 0x7f573c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5741cd0640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c1997d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f572c005940 tx=0x7f572c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c03f030 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c19f5d0 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f572c003aa0 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c035070 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.788+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c1a5cf0 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.789+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c103f50 con 0x7f573c104570 2024-09-10T23:22:04.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.792+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f572c03bcc0 con 0x7f573c104570 2024-09-10T23:22:04.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.792+0000 7f57337fe640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57280b52e0 0x7f57280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.792+0000 7f57424d1640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57280b52e0 0x7f57280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.792+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f572c1063a0 con 0x7f573c104570 2024-09-10T23:22:04.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.793+0000 7f57424d1640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57280b52e0 0x7f57280b77a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5738009b40 tx=0x7f5738005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:04.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:04.795+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f572c0cd700 con 0x7f573c104570 2024-09-10T23:22:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.024+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f573c1a5f20 con 0x7f573c104570 2024-09-10T23:22:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.025+0000 7f57337fe640 1 -- 172.21.15.2:0/4283818035 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f572c0cd000 con 0x7f573c104570 2024-09-10T23:22:05.026 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:05.026 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"btime":"2024-09-10T23:22:04:796706+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14712,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T23:22:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57280b52e0 msgr2=0x7f57280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57280b52e0 0x7f57280b77a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5738009b40 tx=0x7f5738005e50 comp rx=0 tx=0).stop 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 msgr2=0x7f573c1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c1997d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f572c005940 tx=0x7f572c004270 comp rx=0 tx=0).stop 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 shutdown_connections 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57280b52e0 0x7f57280b77a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c10d120 0x7f573c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573c104570 0x7f573c1997d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 --2- 172.21.15.2:0/4283818035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c103b70 0x7f573c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 >> 172.21.15.2:0/4283818035 conn(0x7f573c0fd700 msgr2=0x7f573c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 shutdown_connections 2024-09-10T23:22:05.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:05.027+0000 7f5744735640 1 -- 172.21.15.2:0/4283818035 wait complete. 2024-09-10T23:22:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: Deploying daemon mds.b on smithi154 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.2:6840/2991165185,v1:172.21.15.2:6841/2991165185] up:boot 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: fsmap 11 up:standby 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:05 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4283818035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:05.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: Deploying daemon mds.b on smithi154 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.2:6840/2991165185,v1:172.21.15.2:6841/2991165185] up:boot 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: fsmap 11 up:standby 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:22:05.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:05 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4283818035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: Deploying daemon mds.b on smithi154 2024-09-10T23:22:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.2:6840/2991165185,v1:172.21.15.2:6841/2991165185] up:boot 2024-09-10T23:22:05.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: fsmap 11 up:standby 2024-09-10T23:22:05.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:22:05.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:05 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4283818035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:06.529 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 systemd[1]: Starting Ceph mds.b for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:22:06.915 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 podman[65589]: 2024-09-10 23:22:06.538592327 +0000 UTC m=+0.016728537 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:22:06.915 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 podman[65589]: 2024-09-10 23:22:06.65392946 +0000 UTC m=+0.132065662 container create d5bcc9c007995f6de818e33798a27db4d34ecdf7f3a25db69337c17a542601f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:22:06.915 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 podman[65589]: 2024-09-10 23:22:06.914941771 +0000 UTC m=+0.393077970 container init d5bcc9c007995f6de818e33798a27db4d34ecdf7f3a25db69337c17a542601f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T23:22:07.279 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 podman[65589]: 2024-09-10 23:22:06.918114639 +0000 UTC m=+0.396250838 container start d5bcc9c007995f6de818e33798a27db4d34ecdf7f3a25db69337c17a542601f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:22:07.279 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 ceph-mds[65609]: -- 172.21.15.154:0/1511373003 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ec39015860 con 0x55ec38ff2800 2024-09-10T23:22:07.279 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b[65605]: starting mds.b at 2024-09-10T23:22:07.279 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:07 smithi154 bash[65589]: d5bcc9c007995f6de818e33798a27db4d34ecdf7f3a25db69337c17a542601f6 2024-09-10T23:22:07.279 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:22:07 smithi154 systemd[1]: Started Ceph mds.b for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:22:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:07 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:07 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:07.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:22:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:07 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:08.458 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:08 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] up:boot 2024-09-10T23:22:08.458 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:08 smithi002 ceph-mon[31150]: fsmap 12 up:standby 2024-09-10T23:22:08.458 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:08 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:22:08.515 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:08 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] up:boot 2024-09-10T23:22:08.515 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:08 smithi177 ceph-mon[35760]: fsmap 12 up:standby 2024-09-10T23:22:08.515 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:08 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:22:08.567 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:08 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] up:boot 2024-09-10T23:22:08.567 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:08 smithi154 ceph-mon[35136]: fsmap 12 up:standby 2024-09-10T23:22:08.567 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:08 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:22:09.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 -- 172.21.15.2:0/2803254282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102de0 msgr2=0x7fef801031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 --2- 172.21.15.2:0/2803254282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102de0 0x7fef801031c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009900 tx=0x7fef7c02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:09.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 -- 172.21.15.2:0/2803254282 shutdown_connections 2024-09-10T23:22:09.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 --2- 172.21.15.2:0/2803254282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef80109170 0x7fef8010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 --2- 172.21.15.2:0/2803254282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef801087f0 0x7fef80108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 --2- 172.21.15.2:0/2803254282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102de0 0x7fef801031c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.996+0000 7fef87e37640 1 -- 172.21.15.2:0/2803254282 >> 172.21.15.2:0/2803254282 conn(0x7fef800fe830 msgr2=0x7fef80100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 -- 172.21.15.2:0/2803254282 shutdown_connections 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 -- 172.21.15.2:0/2803254282 wait complete. 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 Processor -- start 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 -- start start 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef80102de0 0x7fef801992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 0x7fef801997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef80109170 0x7fef8019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef80112e80 con 0x7fef801087f0 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef80112d00 con 0x7fef80109170 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.997+0000 7fef87e37640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef80113000 con 0x7fef80102de0 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 0x7fef801997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 0x7fef801997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49230/0 (socket says 172.21.15.2:49230) 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 -- 172.21.15.2:0/2559300410 learned_addr learned my addr 172.21.15.2:0/2559300410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef85bd3640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef80102de0 0x7fef801992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef863d4640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef80109170 0x7fef8019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 -- 172.21.15.2:0/2559300410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef80102de0 msgr2=0x7fef801992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef80102de0 0x7fef801992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 -- 172.21.15.2:0/2559300410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef80109170 msgr2=0x7fef8019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef80109170 0x7fef8019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 -- 172.21.15.2:0/2559300410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8019f360 con 0x7fef801087f0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef853d2640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 0x7fef801997f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef7000d950 tx=0x7fef7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70017070 con 0x7fef801087f0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef70009c30 con 0x7fef801087f0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8019f650 con 0x7fef801087f0 2024-09-10T23:22:09.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7000f620 con 0x7fef801087f0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.998+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801a5d10 con 0x7fef801087f0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:08.999+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef801031c0 con 0x7fef801087f0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.001+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fef70010460 con 0x7fef801087f0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.001+0000 7fef76ffd640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fef6c0b52e0 0x7fef6c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.001+0000 7fef85bd3640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fef6c0b52e0 0x7fef6c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.002+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fef700e52c0 con 0x7fef801087f0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.002+0000 7fef85bd3640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fef6c0b52e0 0x7fef6c0b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005ab0 tx=0x7fef7c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:09.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.004+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fef70009de0 con 0x7fef801087f0 2024-09-10T23:22:09.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.235+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef801a6090 con 0x7fef801087f0 2024-09-10T23:22:09.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.236+0000 7fef76ffd640 1 -- 172.21.15.2:0/2559300410 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7fef700abfd0 con 0x7fef801087f0 2024-09-10T23:22:09.237 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:09.237 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"btime":"2024-09-10T23:22:07:319705+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14712,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24488,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T23:22:09.237 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fef6c0b52e0 msgr2=0x7fef6c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fef6c0b52e0 0x7fef6c0b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005ab0 tx=0x7fef7c005a20 comp rx=0 tx=0).stop 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 msgr2=0x7fef801997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 0x7fef801997f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef7000d950 tx=0x7fef7000de10 comp rx=0 tx=0).stop 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 shutdown_connections 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fef6c0b52e0 0x7fef6c0b77a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef80109170 0x7fef8019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef801087f0 0x7fef801997f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 --2- 172.21.15.2:0/2559300410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef80102de0 0x7fef801992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 >> 172.21.15.2:0/2559300410 conn(0x7fef800fe830 msgr2=0x7fef800fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 shutdown_connections 2024-09-10T23:22:09.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:09.238+0000 7fef87e37640 1 -- 172.21.15.2:0/2559300410 wait complete. 2024-09-10T23:22:09.879 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:09 smithi002 ceph-mon[31150]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:09.879 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:09 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.879 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:09 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.879 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:09 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.879 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:09 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:09 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2559300410' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:09.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T23:22:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:09 smithi177 ceph-mon[35760]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:09 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:09 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:09 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:09 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:09.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:09 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2559300410' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:09 smithi154 ceph-mon[35136]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:09 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:09 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:09 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:09 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:10.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:09 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2559300410' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:10.198 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:10.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.743+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/1453144348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68102190 msgr2=0x7f4e6810eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.743+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/1453144348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68102190 0x7f4e6810eee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009900 tx=0x7f4e5002a480 comp rx=0 tx=0).stop 2024-09-10T23:22:10.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.743+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/1453144348 shutdown_connections 2024-09-10T23:22:10.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.743+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/1453144348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6810f420 0x7f4e68111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.743+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/1453144348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e68102190 0x7f4e6810eee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.743+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/1453144348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e68101870 0x7f4e68101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/1453144348 >> 172.21.15.2:0/1453144348 conn(0x7f4e680fd720 msgr2=0x7f4e680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/1453144348 shutdown_connections 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/1453144348 wait complete. 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 Processor -- start 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- start start 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e68101870 0x7f4e6819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e68102190 0x7f4e6819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 0x7f4e681a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68114fb0 con 0x7f4e6810f420 2024-09-10T23:22:10.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68114e30 con 0x7f4e68101870 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e6e0ac640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68115130 con 0x7f4e68102190 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.744+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 0x7f4e681a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 0x7f4e681a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49246/0 (socket says 172.21.15.2:49246) 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 -- 172.21.15.2:0/829629911 learned_addr learned my addr 172.21.15.2:0/829629911 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e5ffff640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e68102190 0x7f4e6819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e677fe640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e68101870 0x7f4e6819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 -- 172.21.15.2:0/829629911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e68102190 msgr2=0x7f4e6819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e68102190 0x7f4e6819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 -- 172.21.15.2:0/829629911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e68101870 msgr2=0x7f4e6819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e68101870 0x7f4e6819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 -- 172.21.15.2:0/829629911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e681a1520 con 0x7f4e6810f420 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e67fff640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 0x7f4e681a0d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000cce0 tx=0x7f4e6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000f450 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e681a1810 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e6000faa0 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60018b70 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.745+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e681a7ed0 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.746+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68101c50 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.748+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f4e6000f5f0 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.748+0000 7f4e657fa640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e540b52e0 0x7f4e540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.748+0000 7f4e677fe640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e540b52e0 0x7f4e540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.749+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f4e600e5e00 con 0x7f4e6810f420 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.749+0000 7f4e677fe640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e540b52e0 0x7f4e540b77a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e580058c0 tx=0x7f4e5800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:10.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.752+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e60014030 con 0x7f4e6810f420 2024-09-10T23:22:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.948+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4e681a81f0 con 0x7f4e6810f420 2024-09-10T23:22:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.948+0000 7f4e657fa640 1 -- 172.21.15.2:0/829629911 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f4e600ad160 con 0x7f4e6810f420 2024-09-10T23:22:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:10.949 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-10T23:22:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:22:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-10T23:22:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-10T23:22:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:22:10.950 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-10T23:22:10.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e540b52e0 msgr2=0x7f4e540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e540b52e0 0x7f4e540b77a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e580058c0 tx=0x7f4e5800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 msgr2=0x7f4e681a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 0x7f4e681a0d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000cce0 tx=0x7f4e6000a620 comp rx=0 tx=0).stop 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 shutdown_connections 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e540b52e0 0x7f4e540b77a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e6810f420 0x7f4e681a0d50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e68102190 0x7f4e6819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 --2- 172.21.15.2:0/829629911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e68101870 0x7f4e6819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 >> 172.21.15.2:0/829629911 conn(0x7f4e680fd720 msgr2=0x7f4e68111610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 shutdown_connections 2024-09-10T23:22:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:10.951+0000 7f4e6e0ac640 1 -- 172.21.15.2:0/829629911 wait complete. 2024-09-10T23:22:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:11.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/829629911' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:22:11.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:11.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/829629911' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:11.406 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/829629911' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:22:11.606 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:22:11.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:22:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 -- 172.21.15.2:0/4278183716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109150 msgr2=0x7fb59810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 --2- 172.21.15.2:0/4278183716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109150 0x7fb59810f950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb590009ca0 tx=0x7fb59002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 -- 172.21.15.2:0/4278183716 shutdown_connections 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 --2- 172.21.15.2:0/4278183716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109150 0x7fb59810f950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 --2- 172.21.15.2:0/4278183716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5981087d0 0x7fb598108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 --2- 172.21.15.2:0/4278183716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb598102dc0 0x7fb5981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 -- 172.21.15.2:0/4278183716 >> 172.21.15.2:0/4278183716 conn(0x7fb5980fe830 msgr2=0x7fb598100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 -- 172.21.15.2:0/4278183716 shutdown_connections 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 -- 172.21.15.2:0/4278183716 wait complete. 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 Processor -- start 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.041+0000 7fb59ed58640 1 -- start start 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 0x7fb598199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5981087d0 0x7fb598199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb598109150 0x7fb59819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb598112e10 con 0x7fb598102dc0 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb598112c90 con 0x7fb5981087d0 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb598112f90 con 0x7fb598109150 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 0x7fb598199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 0x7fb598199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53644/0 (socket says 172.21.15.2:53644) 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 -- 172.21.15.2:0/2395095480 learned_addr learned my addr 172.21.15.2:0/2395095480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59d2f5640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb598109150 0x7fb59819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb597fff640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5981087d0 0x7fb598199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 -- 172.21.15.2:0/2395095480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb598109150 msgr2=0x7fb59819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb598109150 0x7fb59819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 -- 172.21.15.2:0/2395095480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5981087d0 msgr2=0x7fb598199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5981087d0 0x7fb598199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 -- 172.21.15.2:0/2395095480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59819f2f0 con 0x7fb598102dc0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59caf4640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 0x7fb598199240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d770 tx=0x7fb58800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588017070 con 0x7fb598102dc0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5880054d0 con 0x7fb598102dc0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59819f5e0 con 0x7fb598102dc0 2024-09-10T23:22:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.042+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588004c30 con 0x7fb598102dc0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.043+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5981a5ca0 con 0x7fb598102dc0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.044+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5981031a0 con 0x7fb598102dc0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.045+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fb588004e10 con 0x7fb598102dc0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.046+0000 7fb595ffb640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb5800b5360 0x7fb5800b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.046+0000 7fb597fff640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb5800b5360 0x7fb5800b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.046+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fb5880e5100 con 0x7fb598102dc0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.046+0000 7fb597fff640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb5800b5360 0x7fb5800b7820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5981082b0 tx=0x7fb58c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:13.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.050+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb5880abe10 con 0x7fb598102dc0 2024-09-10T23:22:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.243+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb5981a5fd0 con 0x7fb598102dc0 2024-09-10T23:22:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.284+0000 7fb595ffb640 1 -- 172.21.15.2:0/2395095480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7fb5880b0840 con 0x7fb598102dc0 2024-09-10T23:22:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-10T23:22:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.288+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb5800b5360 msgr2=0x7fb5800b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.288+0000 7fb59ed58640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb5800b5360 0x7fb5800b7820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5981082b0 tx=0x7fb58c00b390 comp rx=0 tx=0).stop 2024-09-10T23:22:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.288+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 msgr2=0x7fb598199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.288+0000 7fb59ed58640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 0x7fb598199240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d770 tx=0x7fb58800dc30 comp rx=0 tx=0).stop 2024-09-10T23:22:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 shutdown_connections 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb5800b5360 0x7fb5800b7820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb598109150 0x7fb59819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5981087d0 0x7fb598199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 --2- 172.21.15.2:0/2395095480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598102dc0 0x7fb598199240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 >> 172.21.15.2:0/2395095480 conn(0x7fb5980fe830 msgr2=0x7fb598100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 shutdown_connections 2024-09-10T23:22:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:13.289+0000 7fb59ed58640 1 -- 172.21.15.2:0/2395095480 wait complete. 2024-09-10T23:22:13.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:13 smithi154 ceph-mon[35136]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:13.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:13 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:13 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:13 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:13 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:13 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2395095480' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:22:13.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:13 smithi002 ceph-mon[31150]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:13.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:13 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:13 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:13 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:13 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:13 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2395095480' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:22:13.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:13 smithi177 ceph-mon[35760]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:13.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:13 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:13 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:13 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:13 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:13.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:13 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2395095480' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:22:14.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:22:14.280 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2395095480' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:14.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:14 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2395095480' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:22:14.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:22:14.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:14.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:14.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:14 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2395095480' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:14 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:22:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 -- 172.21.15.2:0/3484087545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec075e60 msgr2=0x7f64ec1135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 --2- 172.21.15.2:0/3484087545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec075e60 0x7f64ec1135e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009900 tx=0x7f64dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 -- 172.21.15.2:0/3484087545 shutdown_connections 2024-09-10T23:22:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 --2- 172.21.15.2:0/3484087545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ec113b20 0x7f64ec115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 --2- 172.21.15.2:0/3484087545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec075e60 0x7f64ec1135e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 --2- 172.21.15.2:0/3484087545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ec075540 0x7f64ec075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.802+0000 7f64f3716640 1 -- 172.21.15.2:0/3484087545 >> 172.21.15.2:0/3484087545 conn(0x7f64ec0fe830 msgr2=0x7f64ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.803+0000 7f64f3716640 1 -- 172.21.15.2:0/3484087545 shutdown_connections 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.803+0000 7f64f3716640 1 -- 172.21.15.2:0/3484087545 wait complete. 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.803+0000 7f64f3716640 1 Processor -- start 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.803+0000 7f64f3716640 1 -- start start 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ec075540 0x7f64ec19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ec075e60 0x7f64ec19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 0x7f64ec1a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec1193b0 con 0x7f64ec113b20 2024-09-10T23:22:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec119230 con 0x7f64ec075540 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec119530 con 0x7f64ec075e60 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 0x7f64ec1a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 0x7f64ec1a51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53674/0 (socket says 172.21.15.2:53674) 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 -- 172.21.15.2:0/2224447823 learned_addr learned my addr 172.21.15.2:0/2224447823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f14b2640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ec075540 0x7f64ec19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f0cb1640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ec075e60 0x7f64ec19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 -- 172.21.15.2:0/2224447823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ec075e60 msgr2=0x7f64ec19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ec075e60 0x7f64ec19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 -- 172.21.15.2:0/2224447823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ec075540 msgr2=0x7f64ec19f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ec075540 0x7f64ec19f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 -- 172.21.15.2:0/2224447823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec1a59b0 con 0x7f64ec113b20 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f1cb3640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 0x7f64ec1a51e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f64e400e9d0 tx=0x7f64e400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e400cd80 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e4005020 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec1a5ca0 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e40116d0 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.804+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec1ac360 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.805+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec075920 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.807+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f64e400f040 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.808+0000 7f64e27fc640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64d80b52e0 0x7f64d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.808+0000 7f64f14b2640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64d80b52e0 0x7f64d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.808+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7497+0+0 (secure 0 0 0) 0x7f64e40e5a40 con 0x7f64ec113b20 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.809+0000 7f64f14b2640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64d80b52e0 0x7f64d80b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f64e8005d00 tx=0x7f64e800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:14.812+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64e4016030 con 0x7f64ec113b20 2024-09-10T23:22:15.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.000+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f64ec1ac6c0 con 0x7f64ec113b20 2024-09-10T23:22:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.299+0000 7f64e27fc640 1 -- 172.21.15.2:0/2224447823 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f64e40acc10 con 0x7f64ec113b20 2024-09-10T23:22:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64d80b52e0 msgr2=0x7f64d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64d80b52e0 0x7f64d80b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f64e8005d00 tx=0x7f64e800b410 comp rx=0 tx=0).stop 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 msgr2=0x7f64ec1a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 0x7f64ec1a51e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f64e400e9d0 tx=0x7f64e400ee90 comp rx=0 tx=0).stop 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 shutdown_connections 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64d80b52e0 0x7f64d80b77a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64ec113b20 0x7f64ec1a51e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ec075e60 0x7f64ec19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 --2- 172.21.15.2:0/2224447823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64ec075540 0x7f64ec19f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 >> 172.21.15.2:0/2224447823 conn(0x7f64ec0fe830 msgr2=0x7f64ec0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 shutdown_connections 2024-09-10T23:22:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:15.302+0000 7f64f3716640 1 -- 172.21.15.2:0/2224447823 wait complete. 2024-09-10T23:22:15.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:15 smithi002 ceph-mon[31150]: pgmap v283: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:15.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:15 smithi002 ceph-mon[31150]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:22:15.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:15 smithi002 ceph-mon[31150]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:22:15.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:15 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2224447823' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:22:15.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:15 smithi177 ceph-mon[35760]: pgmap v283: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:15.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:15 smithi177 ceph-mon[35760]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:22:15.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:15 smithi177 ceph-mon[35760]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:22:15.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:15 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2224447823' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:22:15.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:15 smithi154 ceph-mon[35136]: pgmap v283: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:15.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:15 smithi154 ceph-mon[35136]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:22:15.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:15 smithi154 ceph-mon[35136]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:22:15.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:15 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2224447823' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:22:15.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:22:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:16.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:16 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2224447823' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:22:16.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:16 smithi002 ceph-mon[31150]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:22:16.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:16 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2224447823' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:22:16.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:16 smithi177 ceph-mon[35760]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:22:16.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:16 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2224447823' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:22:16.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:16 smithi154 ceph-mon[35136]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:22:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 -- 172.21.15.2:0/2797893652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3438075f40 msgr2=0x7f343810ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2797893652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3438075f40 0x7f343810ee10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3428009900 tx=0x7f342802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 -- 172.21.15.2:0/2797893652 shutdown_connections 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2797893652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343810f3e0 0x7f34381117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2797893652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3438075f40 0x7f343810ee10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2797893652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3438075540 0x7f3438075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 -- 172.21.15.2:0/2797893652 >> 172.21.15.2:0/2797893652 conn(0x7f34380fe830 msgr2=0x7f3438100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.766+0000 7f343fa1b640 1 -- 172.21.15.2:0/2797893652 shutdown_connections 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 -- 172.21.15.2:0/2797893652 wait complete. 2024-09-10T23:22:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 Processor -- start 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 -- start start 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3438075540 0x7f343819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3438075f40 0x7f343819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 0x7f34381a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3438114ff0 con 0x7f343810f3e0 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3438114e70 con 0x7f3438075f40 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343fa1b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3438115170 con 0x7f3438075540 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 0x7f34381a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343dfb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 0x7f34381a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53694/0 (socket says 172.21.15.2:53694) 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.767+0000 7f343dfb8640 1 -- 172.21.15.2:0/2405358227 learned_addr learned my addr 172.21.15.2:0/2405358227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343cfb6640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3438075f40 0x7f343819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343d7b7640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3438075540 0x7f343819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343dfb8640 1 -- 172.21.15.2:0/2405358227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3438075540 msgr2=0x7f343819b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343dfb8640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3438075540 0x7f343819b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343dfb8640 1 -- 172.21.15.2:0/2405358227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3438075f40 msgr2=0x7f343819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343dfb8640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3438075f40 0x7f343819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343dfb8640 1 -- 172.21.15.2:0/2405358227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34381a15d0 con 0x7f343810f3e0 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343dfb8640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 0x7f34381a0e00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f343000b9e0 tx=0x7f343000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430019070 con 0x7f343810f3e0 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3430014440 con 0x7f343810f3e0 2024-09-10T23:22:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34381a18c0 con 0x7f343810f3e0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430012580 con 0x7f343810f3e0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.768+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34381a7f80 con 0x7f343810f3e0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.769+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3438075920 con 0x7f343810f3e0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.771+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f343000ca60 con 0x7f343810f3e0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.771+0000 7f342e7fc640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34240b5360 0x7f34240b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.772+0000 7f343d7b7640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34240b5360 0x7f34240b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.772+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7879+0+0 (secure 0 0 0) 0x7f34300e54f0 con 0x7f343810f3e0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.772+0000 7f343d7b7640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34240b5360 0x7f34240b7820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f343400abe0 tx=0x7f343400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:16.775+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f34300abf10 con 0x7f343810f3e0 2024-09-10T23:22:17.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.000+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f34381a82e0 con 0x7f343810f3e0 2024-09-10T23:22:17.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.306+0000 7f342e7fc640 1 -- 172.21.15.2:0/2405358227 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f34300b0940 con 0x7f343810f3e0 2024-09-10T23:22:17.307 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34240b5360 msgr2=0x7f34240b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34240b5360 0x7f34240b7820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f343400abe0 tx=0x7f343400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 msgr2=0x7f34381a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 0x7f34381a0e00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f343000b9e0 tx=0x7f343000bde0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 shutdown_connections 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34240b5360 0x7f34240b7820 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343810f3e0 0x7f34381a0e00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.308+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3438075f40 0x7f343819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.309+0000 7f343fa1b640 1 --2- 172.21.15.2:0/2405358227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3438075540 0x7f343819b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.309+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 >> 172.21.15.2:0/2405358227 conn(0x7f34380fe830 msgr2=0x7f3438111560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.309+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 shutdown_connections 2024-09-10T23:22:17.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:17.309+0000 7f343fa1b640 1 -- 172.21.15.2:0/2405358227 wait complete. 2024-09-10T23:22:17.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:17 smithi002 ceph-mon[31150]: pgmap v286: 97 pgs: 25 creating+peering, 67 unknown, 5 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:17.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:17 smithi002 ceph-mon[31150]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:22:17.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:17 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2405358227' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:22:17.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:17 smithi002 ceph-mon[31150]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T23:22:17.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:17 smithi177 ceph-mon[35760]: pgmap v286: 97 pgs: 25 creating+peering, 67 unknown, 5 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:17.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:17 smithi177 ceph-mon[35760]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:22:17.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:17 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2405358227' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:22:17.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:17 smithi177 ceph-mon[35760]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T23:22:17.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:17 smithi154 ceph-mon[35136]: pgmap v286: 97 pgs: 25 creating+peering, 67 unknown, 5 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:17.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:17 smithi154 ceph-mon[35136]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:22:17.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:17 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2405358227' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:22:17.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:17 smithi154 ceph-mon[35136]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T23:22:18.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:22:18.344 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:18.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:18 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2405358227' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:22:18.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:18 smithi002 ceph-mon[31150]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:22:18.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:18 smithi002 ceph-mon[31150]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T23:22:18.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:18 smithi002 ceph-mon[31150]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T23:22:18.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:18 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2405358227' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:22:18.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:18 smithi177 ceph-mon[35760]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:22:18.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:18 smithi177 ceph-mon[35760]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T23:22:18.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:18 smithi177 ceph-mon[35760]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T23:22:18.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:18 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2405358227' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:22:18.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:18 smithi154 ceph-mon[35136]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:22:18.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:18 smithi154 ceph-mon[35136]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T23:22:18.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:18 smithi154 ceph-mon[35136]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T23:22:18.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.830+0000 7f5f64e59640 1 -- 172.21.15.2:0/4017981150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 msgr2=0x7f5f6010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.830+0000 7f5f64e59640 1 --2- 172.21.15.2:0/4017981150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6010e820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009ca0 tx=0x7f5f5802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 -- 172.21.15.2:0/4017981150 shutdown_connections 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 --2- 172.21.15.2:0/4017981150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6010e820 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 --2- 172.21.15.2:0/4017981150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f601076a0 0x7f5f60107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 --2- 172.21.15.2:0/4017981150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f60101c90 0x7f5f60102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 -- 172.21.15.2:0/4017981150 >> 172.21.15.2:0/4017981150 conn(0x7f5f600fd700 msgr2=0x7f5f600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 -- 172.21.15.2:0/4017981150 shutdown_connections 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 -- 172.21.15.2:0/4017981150 wait complete. 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.831+0000 7f5f64e59640 1 Processor -- start 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 -- start start 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60101c90 0x7f5f60199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f601076a0 0x7f5f6019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60111ce0 con 0x7f5f60108020 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60111b60 con 0x7f5f60101c90 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f64e59640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60111e60 con 0x7f5f601076a0 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53716/0 (socket says 172.21.15.2:53716) 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 -- 172.21.15.2:0/2426834504 learned_addr learned my addr 172.21.15.2:0/2426834504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5dd9b640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f601076a0 0x7f5f6019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5e59c640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60101c90 0x7f5f60199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 -- 172.21.15.2:0/2426834504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f601076a0 msgr2=0x7f5f6019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f601076a0 0x7f5f6019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 -- 172.21.15.2:0/2426834504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60101c90 msgr2=0x7f5f60199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60101c90 0x7f5f60199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5ed9d640 1 -- 172.21.15.2:0/2426834504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f601a53b0 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.832+0000 7f5f5e59c640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60101c90 0x7f5f60199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.833+0000 7f5f5ed9d640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6019aa70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f58005cc0 tx=0x7f5f5802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.833+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58003bf0 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.833+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f58003d90 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.833+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601a5640 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.833+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5802fb20 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.833+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f601a5b80 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.834+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f60102070 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.835+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f5f58004580 con 0x7f5f60108020 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.836+0000 7f5f4f7fe640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.836+0000 7f5f5e59c640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.836+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f5f58106f70 con 0x7f5f60108020 2024-09-10T23:22:18.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.836+0000 7f5f5e59c640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f500058c0 tx=0x7f5f50005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:18.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:18.839+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5f580cdf80 con 0x7f5f60108020 2024-09-10T23:22:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.027+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f601a5f80 con 0x7f5f60108020 2024-09-10T23:22:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.028+0000 7f5f4f7fe640 1 -- 172.21.15.2:0/2426834504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22255 (secure 0 0 0) 0x7f5f580cd880 con 0x7f5f60108020 2024-09-10T23:22:19.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:19.030 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:17.001440+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 msgr2=0x7f5f480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f500058c0 tx=0x7f5f50005850 comp rx=0 tx=0).stop 2024-09-10T23:22:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 msgr2=0x7f5f6019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6019aa70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f58005cc0 tx=0x7f5f5802f380 comp rx=0 tx=0).stop 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 shutdown_connections 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f60108020 0x7f5f6019aa70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f601076a0 0x7f5f6019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 --2- 172.21.15.2:0/2426834504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f60101c90 0x7f5f60199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 >> 172.21.15.2:0/2426834504 conn(0x7f5f600fd700 msgr2=0x7f5f600ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 shutdown_connections 2024-09-10T23:22:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:19.031+0000 7f5f64e59640 1 -- 172.21.15.2:0/2426834504 wait complete. 2024-09-10T23:22:19.321 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:22:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: 2024-09-10T23:22:18.974+0000 7faa101d6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: pgmap v289: 97 pgs: 25 creating+peering, 43 unknown, 29 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: Cluster is now healthy 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] up:active 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:19.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:19 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2426834504' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:19.606 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: pgmap v289: 97 pgs: 25 creating+peering, 43 unknown, 29 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-10T23:22:19.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:22:19.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: Cluster is now healthy 2024-09-10T23:22:19.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] up:active 2024-09-10T23:22:19.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:19.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:19.607 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:19 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2426834504' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:19.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: pgmap v289: 97 pgs: 25 creating+peering, 43 unknown, 29 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: Cluster is now healthy 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] up:active 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:19 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2426834504' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 -- 172.21.15.2:0/2496232558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 msgr2=0x7f1e20103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/2496232558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e20103f10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009900 tx=0x7f1e1002a410 comp rx=0 tx=0).stop 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 -- 172.21.15.2:0/2496232558 shutdown_connections 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/2496232558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e2010d0e0 0x7f1e2010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/2496232558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e20104530 0x7f1e2010cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/2496232558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e20103f10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 -- 172.21.15.2:0/2496232558 >> 172.21.15.2:0/2496232558 conn(0x7f1e200fd700 msgr2=0x7f1e200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 -- 172.21.15.2:0/2496232558 shutdown_connections 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 -- 172.21.15.2:0/2496232558 wait complete. 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 Processor -- start 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.460+0000 7f1e26b1f640 1 -- start start 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e201992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e20104530 0x7f1e20199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e2010d0e0 0x7f1e2019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20112da0 con 0x7f1e20103b30 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20112c20 con 0x7f1e20104530 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20112f20 con 0x7f1e2010d0e0 2024-09-10T23:22:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e201992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e201992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53724/0 (socket says 172.21.15.2:53724) 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 -- 172.21.15.2:0/416736612 learned_addr learned my addr 172.21.15.2:0/416736612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e250bc640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e2010d0e0 0x7f1e2019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e1ffff640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e20104530 0x7f1e20199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 -- 172.21.15.2:0/416736612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e2010d0e0 msgr2=0x7f1e2019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e2010d0e0 0x7f1e2019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 -- 172.21.15.2:0/416736612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e20104530 msgr2=0x7f1e20199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e20104530 0x7f1e20199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 -- 172.21.15.2:0/416736612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2019f3a0 con 0x7f1e20103b30 2024-09-10T23:22:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e248bb640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e201992f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e10006010 tx=0x7f1e100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1003f030 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.461+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2019f630 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.462+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e10003800 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.462+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e10035070 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.462+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e201a5d50 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.463+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20103f10 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.464+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f1e10031b10 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.465+0000 7f1e1dffb640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1e080b52e0 0x7f1e080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.465+0000 7f1e1ffff640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1e080b52e0 0x7f1e080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.465+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f1e10106700 con 0x7f1e20103b30 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.465+0000 7f1e1ffff640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1e080b52e0 0x7f1e080b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1e2010f7c0 tx=0x7f1e1400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.468+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1e100cd710 con 0x7f1e20103b30 2024-09-10T23:22:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.654+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e2019a420 con 0x7f1e20103b30 2024-09-10T23:22:20.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.656+0000 7f1e1dffb640 1 -- 172.21.15.2:0/416736612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22255 (secure 0 0 0) 0x7f1e2019a420 con 0x7f1e20103b30 2024-09-10T23:22:20.657 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:20.657 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:17.001440+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1e080b52e0 msgr2=0x7f1e080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1e080b52e0 0x7f1e080b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1e2010f7c0 tx=0x7f1e1400a4c0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 msgr2=0x7f1e201992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e201992f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e10006010 tx=0x7f1e100042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 shutdown_connections 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1e080b52e0 0x7f1e080b77a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e2010d0e0 0x7f1e2019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e20104530 0x7f1e20199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 --2- 172.21.15.2:0/416736612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e20103b30 0x7f1e201992f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 >> 172.21.15.2:0/416736612 conn(0x7f1e200fd700 msgr2=0x7f1e200fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 shutdown_connections 2024-09-10T23:22:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:20.658+0000 7f1e26b1f640 1 -- 172.21.15.2:0/416736612 wait complete. 2024-09-10T23:22:21.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:22:21.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:21 smithi002 ceph-mon[31150]: pgmap v290: 97 pgs: 11 creating+peering, 86 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T23:22:21.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:21 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/416736612' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:21.574 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:21 smithi177 ceph-mon[35760]: pgmap v290: 97 pgs: 11 creating+peering, 86 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T23:22:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:21 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/416736612' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:21.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:21 smithi154 ceph-mon[35136]: pgmap v290: 97 pgs: 11 creating+peering, 86 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T23:22:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:21 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/416736612' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 -- 172.21.15.2:0/3043465133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101cd0 msgr2=0x7f046c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 --2- 172.21.15.2:0/3043465133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101cd0 0x7f046c1020b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f045c009900 tx=0x7f045c02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 -- 172.21.15.2:0/3043465133 shutdown_connections 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 --2- 172.21.15.2:0/3043465133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046c108060 0x7f046c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 --2- 172.21.15.2:0/3043465133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f046c1076e0 0x7f046c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 --2- 172.21.15.2:0/3043465133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c101cd0 0x7f046c1020b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 -- 172.21.15.2:0/3043465133 >> 172.21.15.2:0/3043465133 conn(0x7f046c0fd700 msgr2=0x7f046c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 -- 172.21.15.2:0/3043465133 shutdown_connections 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.087+0000 7f0472b38640 1 -- 172.21.15.2:0/3043465133 wait complete. 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 Processor -- start 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 -- start start 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046c101cd0 0x7f046c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f046c1076e0 0x7f046c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 0x7f046c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f046c111ce0 con 0x7f046c108060 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f046c111b60 con 0x7f046c1076e0 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f0472b38640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f046c111e60 con 0x7f046c101cd0 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f04710d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 0x7f046c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f04710d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 0x7f046c19aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48340/0 (socket says 172.21.15.2:48340) 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f04710d5640 1 -- 172.21.15.2:0/2454570993 learned_addr learned my addr 172.21.15.2:0/2454570993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.088+0000 7f04708d4640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046c101cd0 0x7f046c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f046bfff640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f046c1076e0 0x7f046c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f04710d5640 1 -- 172.21.15.2:0/2454570993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046c101cd0 msgr2=0x7f046c19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f04710d5640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046c101cd0 0x7f046c19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f04710d5640 1 -- 172.21.15.2:0/2454570993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f046c1076e0 msgr2=0x7f046c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f04710d5640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f046c1076e0 0x7f046c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f04710d5640 1 -- 172.21.15.2:0/2454570993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c1a5430 con 0x7f046c108060 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f04710d5640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 0x7f046c19aaf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f046400eaa0 tx=0x7f046400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046400cdb0 con 0x7f046c108060 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0464005020 con 0x7f046c108060 2024-09-10T23:22:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c1a5720 con 0x7f046c108060 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04640116d0 con 0x7f046c108060 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.089+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c1a5c10 con 0x7f046c108060 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.090+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046c1020b0 con 0x7f046c108060 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.092+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f046400f040 con 0x7f046c108060 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.092+0000 7f0469ffb640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04540b52e0 0x7f04540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.092+0000 7f04708d4640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04540b52e0 0x7f04540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.092+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f04640e59d0 con 0x7f046c108060 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.093+0000 7f04708d4640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04540b52e0 0x7f04540b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f045c031440 tx=0x7f045c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.097+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0464016030 con 0x7f046c108060 2024-09-10T23:22:22.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.322+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f046c02e5c0 con 0x7f046c108060 2024-09-10T23:22:22.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.374+0000 7f0469ffb640 1 -- 172.21.15.2:0/2454570993 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f04640ac940 con 0x7f046c108060 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04540b52e0 msgr2=0x7f04540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04540b52e0 0x7f04540b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f045c031440 tx=0x7f045c005b50 comp rx=0 tx=0).stop 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 msgr2=0x7f046c19aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 0x7f046c19aaf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f046400eaa0 tx=0x7f046400ef60 comp rx=0 tx=0).stop 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 shutdown_connections 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f04540b52e0 0x7f04540b77a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f046c108060 0x7f046c19aaf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f046c1076e0 0x7f046c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 --2- 172.21.15.2:0/2454570993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f046c101cd0 0x7f046c19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 >> 172.21.15.2:0/2454570993 conn(0x7f046c0fd700 msgr2=0x7f046c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:22.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 shutdown_connections 2024-09-10T23:22:22.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:22.377+0000 7f0472b38640 1 -- 172.21.15.2:0/2454570993 wait complete. 2024-09-10T23:22:22.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:22 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2454570993' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:22:22.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:22 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2454570993' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:22:22.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:22 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2454570993' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:22:23.107 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T23:22:23.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-10T23:22:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:23.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:23 smithi002 ceph-mon[31150]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T23:22:23.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:23 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2454570993' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:22:23.640 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:23 smithi002 ceph-mon[31150]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:23.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:23 smithi177 ceph-mon[35760]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T23:22:23.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:23 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2454570993' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:22:23.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:23 smithi177 ceph-mon[35760]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:23 smithi154 ceph-mon[35136]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T23:22:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:23 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2454570993' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:22:23.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:23 smithi154 ceph-mon[35136]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:23.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 -- 172.21.15.2:0/2825932226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe010d120 msgr2=0x7fefe010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:23.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/2825932226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe010d120 0x7fefe010f590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009900 tx=0x7fefd802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:23.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 -- 172.21.15.2:0/2825932226 shutdown_connections 2024-09-10T23:22:23.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/2825932226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe010d120 0x7fefe010f590 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:23.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/2825932226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe0104570 0x7fefe010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:23.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/2825932226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0103b70 0x7fefe0103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 -- 172.21.15.2:0/2825932226 >> 172.21.15.2:0/2825932226 conn(0x7fefe00fd700 msgr2=0x7fefe00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 -- 172.21.15.2:0/2825932226 shutdown_connections 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.873+0000 7fefe6b4c640 1 -- 172.21.15.2:0/2825932226 wait complete. 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 Processor -- start 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 -- start start 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 0x7fefe0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0104570 0x7fefe01998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe010d120 0x7fefe019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0112e60 con 0x7fefe0103b70 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0112ce0 con 0x7fefe010d120 2024-09-10T23:22:23.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe6b4c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0112fe0 con 0x7fefe0104570 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe48e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 0x7fefe0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe48e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 0x7fefe0199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48360/0 (socket says 172.21.15.2:48360) 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe48e8640 1 -- 172.21.15.2:0/3375853391 learned_addr learned my addr 172.21.15.2:0/3375853391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefdffff640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0104570 0x7fefe01998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.874+0000 7fefe50e9640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe010d120 0x7fefe019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe48e8640 1 -- 172.21.15.2:0/3375853391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0104570 msgr2=0x7fefe01998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe48e8640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0104570 0x7fefe01998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe48e8640 1 -- 172.21.15.2:0/3375853391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe010d120 msgr2=0x7fefe019ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe48e8640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe010d120 0x7fefe019ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe48e8640 1 -- 172.21.15.2:0/3375853391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe019f440 con 0x7fefe0103b70 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefdffff640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0104570 0x7fefe01998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe50e9640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe010d120 0x7fefe019ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe48e8640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 0x7fefe0199390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefc800b4a0 tx=0x7fefc800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8014070 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe019f730 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefc8010ac0 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8017c30 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.875+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe01a5fc0 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.876+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe0103fd0 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.877+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fefc8010610 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.878+0000 7fefddffb640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fefcc0b52e0 0x7fefcc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.878+0000 7fefdffff640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fefcc0b52e0 0x7fefcc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.878+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fefc80e53f0 con 0x7fefe0103b70 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.879+0000 7fefdffff640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fefcc0b52e0 0x7fefcc0b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fefe010f860 tx=0x7fefd00073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:23.882+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fefc80ac400 con 0x7fefe0103b70 2024-09-10T23:22:24.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.108+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fefe002e5c0 con 0x7fefe0103b70 2024-09-10T23:22:24.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.389+0000 7fefddffb640 1 -- 172.21.15.2:0/3375853391 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fefc80abd00 con 0x7fefe0103b70 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fefcc0b52e0 msgr2=0x7fefcc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fefcc0b52e0 0x7fefcc0b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fefe010f860 tx=0x7fefd00073c0 comp rx=0 tx=0).stop 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 msgr2=0x7fefe0199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 0x7fefe0199390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefc800b4a0 tx=0x7fefc800b960 comp rx=0 tx=0).stop 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 shutdown_connections 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fefcc0b52e0 0x7fefcc0b77a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefe010d120 0x7fefe019ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefe0104570 0x7fefe01998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 --2- 172.21.15.2:0/3375853391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe0103b70 0x7fefe0199390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 >> 172.21.15.2:0/3375853391 conn(0x7fefe00fd700 msgr2=0x7fefe00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 shutdown_connections 2024-09-10T23:22:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:24.391+0000 7fefe6b4c640 1 -- 172.21.15.2:0/3375853391 wait complete. 2024-09-10T23:22:24.720 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:24 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3375853391' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T23:22:24.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:24 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3375853391' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T23:22:24.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:24 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3375853391' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T23:22:25.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T23:22:25.374 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3375853391' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:25 smithi002 ceph-mon[31150]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T23:22:25.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T23:22:25.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:22:25.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3375853391' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T23:22:25.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:22:25.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:25.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T23:22:25.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:25 smithi177 ceph-mon[35760]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3375853391' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T23:22:25.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:25 smithi154 ceph-mon[35136]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 -- 172.21.15.2:0/218822438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 msgr2=0x7fc584107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 --2- 172.21.15.2:0/218822438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc584107b20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc578009900 tx=0x7fc57802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 -- 172.21.15.2:0/218822438 shutdown_connections 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 --2- 172.21.15.2:0/218822438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc584108060 0x7fc58410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 --2- 172.21.15.2:0/218822438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc584107b20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 --2- 172.21.15.2:0/218822438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 0x7fc5841020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 -- 172.21.15.2:0/218822438 >> 172.21.15.2:0/218822438 conn(0x7fc5840fd700 msgr2=0x7fc5840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 -- 172.21.15.2:0/218822438 shutdown_connections 2024-09-10T23:22:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.866+0000 7fc58bfae640 1 -- 172.21.15.2:0/218822438 wait complete. 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 Processor -- start 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 -- start start 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 0x7fc584199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc5841999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc584108060 0x7fc58419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc584111d60 con 0x7fc5841076e0 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc584111be0 con 0x7fc584108060 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58bfae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc584111ee0 con 0x7fc584101cd0 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc5841999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc5841999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48378/0 (socket says 172.21.15.2:48378) 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 -- 172.21.15.2:0/243137019 learned_addr learned my addr 172.21.15.2:0/243137019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc58a54b640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc584108060 0x7fc58419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589d4a640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 0x7fc584199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 -- 172.21.15.2:0/243137019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 msgr2=0x7fc584199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 0x7fc584199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 -- 172.21.15.2:0/243137019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc584108060 msgr2=0x7fc58419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc584108060 0x7fc58419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589549640 1 -- 172.21.15.2:0/243137019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58419f510 con 0x7fc5841076e0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.867+0000 7fc589d4a640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 0x7fc584199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.868+0000 7fc589549640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc5841999a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc578006010 tx=0x7fc5780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.868+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57803f030 con 0x7fc5841076e0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.868+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc578003800 con 0x7fc5841076e0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.868+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58419f7a0 con 0x7fc5841076e0 2024-09-10T23:22:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.868+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578035070 con 0x7fc5841076e0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.868+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5841a5ec0 con 0x7fc5841076e0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.869+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc584102130 con 0x7fc5841076e0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.870+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fc578031b10 con 0x7fc5841076e0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.871+0000 7fc576ffd640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5700b52e0 0x7fc5700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.871+0000 7fc589d4a640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5700b52e0 0x7fc5700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.871+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fc578106700 con 0x7fc5841076e0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.872+0000 7fc589d4a640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5700b52e0 0x7fc5700b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc580006fd0 tx=0x7fc580008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:25.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:25.874+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc5780cd710 con 0x7fc5841076e0 2024-09-10T23:22:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.096+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fc5841a60c0 con 0x7fc5841076e0 2024-09-10T23:22:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.407+0000 7fc576ffd640 1 -- 172.21.15.2:0/243137019 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fc5780cd010 con 0x7fc5841076e0 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5700b52e0 msgr2=0x7fc5700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5700b52e0 0x7fc5700b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc580006fd0 tx=0x7fc580008040 comp rx=0 tx=0).stop 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 msgr2=0x7fc5841999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc5841999a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc578006010 tx=0x7fc5780042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 shutdown_connections 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5700b52e0 0x7fc5700b77a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc584108060 0x7fc58419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5841076e0 0x7fc5841999a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 --2- 172.21.15.2:0/243137019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc584101cd0 0x7fc584199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 >> 172.21.15.2:0/243137019 conn(0x7fc5840fd700 msgr2=0x7fc58406b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 shutdown_connections 2024-09-10T23:22:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:26.410+0000 7fc58bfae640 1 -- 172.21.15.2:0/243137019 wait complete. 2024-09-10T23:22:26.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:26 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] up:active 2024-09-10T23:22:26.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:26 smithi177 ceph-mon[35760]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:22:26.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:26 smithi177 ceph-mon[35760]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T23:22:26.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:26 smithi177 ceph-mon[35760]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T23:22:26.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:26 smithi177 ceph-mon[35760]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T23:22:26.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:26 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/243137019' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:22:26.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:26 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] up:active 2024-09-10T23:22:26.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:26 smithi002 ceph-mon[31150]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:22:26.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:26 smithi002 ceph-mon[31150]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T23:22:26.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:26 smithi002 ceph-mon[31150]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T23:22:26.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:26 smithi002 ceph-mon[31150]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T23:22:26.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:26 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/243137019' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:22:26.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:26 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] up:active 2024-09-10T23:22:26.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:26 smithi154 ceph-mon[35136]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:22:26.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:26 smithi154 ceph-mon[35136]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T23:22:26.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:26 smithi154 ceph-mon[35136]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T23:22:26.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:26 smithi154 ceph-mon[35136]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T23:22:26.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:26 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/243137019' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:22:27.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T23:22:27.406 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/243137019' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] up:active 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-10T23:22:27.664 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:27 smithi002 ceph-mon[31150]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-10T23:22:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T23:22:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/243137019' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:22:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] up:active 2024-09-10T23:22:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T23:22:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T23:22:27.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-10T23:22:27.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:27 smithi177 ceph-mon[35760]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/243137019' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] up:active 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-10T23:22:27.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:27 smithi154 ceph-mon[35136]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/150650595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4810d0e0 msgr2=0x7f9a4810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/150650595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4810d0e0 0x7f9a4810f550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009900 tx=0x7f9a4002a410 comp rx=0 tx=0).stop 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/150650595 shutdown_connections 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/150650595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4810d0e0 0x7f9a4810f550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/150650595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a48104530 0x7f9a4810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/150650595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a48103b30 0x7f9a48103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/150650595 >> 172.21.15.2:0/150650595 conn(0x7f9a480fd700 msgr2=0x7f9a480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/150650595 shutdown_connections 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/150650595 wait complete. 2024-09-10T23:22:27.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.892+0000 7f9a4f5d9640 1 Processor -- start 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 -- start start 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a48103b30 0x7f9a48199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 0x7f9a48199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a4810d0e0 0x7f9a4819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112d60 con 0x7f9a48104530 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112be0 con 0x7f9a48103b30 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4f5d9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112ee0 con 0x7f9a4810d0e0 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 0x7f9a48199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 0x7f9a48199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48394/0 (socket says 172.21.15.2:48394) 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 -- 172.21.15.2:0/1231368344 learned_addr learned my addr 172.21.15.2:0/1231368344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4d375640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a48103b30 0x7f9a48199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:27.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4db76640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a4810d0e0 0x7f9a4819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 -- 172.21.15.2:0/1231368344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a4810d0e0 msgr2=0x7f9a4819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a4810d0e0 0x7f9a4819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 -- 172.21.15.2:0/1231368344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a48103b30 msgr2=0x7f9a48199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a48103b30 0x7f9a48199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 -- 172.21.15.2:0/1231368344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4819f2c0 con 0x7f9a48104530 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4db76640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a4810d0e0 0x7f9a4819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.893+0000 7f9a4cb74640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 0x7f9a48199750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00d770 tx=0x7f9a3c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.894+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c017070 con 0x7f9a48104530 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.894+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4819f5b0 con 0x7f9a48104530 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.894+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a3c0054d0 con 0x7f9a48104530 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.894+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c004c30 con 0x7f9a48104530 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.894+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a481a5c70 con 0x7f9a48104530 2024-09-10T23:22:27.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.895+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a48103f10 con 0x7f9a48104530 2024-09-10T23:22:27.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.896+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f9a3c004dd0 con 0x7f9a48104530 2024-09-10T23:22:27.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.897+0000 7f9a467fc640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a300b52e0 0x7f9a300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:27.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.897+0000 7f9a4d375640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a300b52e0 0x7f9a300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:27.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.897+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f9a3c0e5a00 con 0x7f9a48104530 2024-09-10T23:22:27.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.897+0000 7f9a4d375640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a300b52e0 0x7f9a300b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9a38005fd0 tx=0x7f9a38009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:27.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:27.900+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a3c0ac970 con 0x7f9a48104530 2024-09-10T23:22:28.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.123+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9a481a6000 con 0x7f9a48104530 2024-09-10T23:22:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.427+0000 7f9a467fc640 1 -- 172.21.15.2:0/1231368344 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f9a3c0ac270 con 0x7f9a48104530 2024-09-10T23:22:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.429+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a300b52e0 msgr2=0x7f9a300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.429+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a300b52e0 0x7f9a300b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9a38005fd0 tx=0x7f9a38009680 comp rx=0 tx=0).stop 2024-09-10T23:22:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.429+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 msgr2=0x7f9a48199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.429+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 0x7f9a48199750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00d770 tx=0x7f9a3c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 shutdown_connections 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a300b52e0 0x7f9a300b77a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a4810d0e0 0x7f9a4819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a48104530 0x7f9a48199750 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 --2- 172.21.15.2:0/1231368344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a48103b30 0x7f9a48199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 >> 172.21.15.2:0/1231368344 conn(0x7f9a480fd700 msgr2=0x7f9a480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 shutdown_connections 2024-09-10T23:22:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:28.430+0000 7f9a4f5d9640 1 -- 172.21.15.2:0/1231368344 wait complete. 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] up:active 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: Cluster is now healthy 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T23:22:28.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-10T23:22:28.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1231368344' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:22:28.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] up:active 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: Cluster is now healthy 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-10T23:22:28.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:28 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1231368344' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] up:active 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: Cluster is now healthy 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T23:22:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-10T23:22:28.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:28 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1231368344' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:22:29.196 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-10T23:22:29.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T23:22:29.430 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:22:28 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: 2024-09-10T23:22:28.975+0000 7faa101d6640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-10T23:22:29.460 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:29.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:29 smithi177 ceph-mon[35760]: pgmap v294: 97 pgs: 97 active+clean; 582 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s wr, 8 op/s 2024-09-10T23:22:29.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:29 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1231368344' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:22:29.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:29 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] up:active 2024-09-10T23:22:29.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:29 smithi177 ceph-mon[35760]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T23:22:29.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:29 smithi177 ceph-mon[35760]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T23:22:29.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:29 smithi002 ceph-mon[31150]: pgmap v294: 97 pgs: 97 active+clean; 582 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s wr, 8 op/s 2024-09-10T23:22:29.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:29 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1231368344' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:22:29.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:29 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] up:active 2024-09-10T23:22:29.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:29 smithi002 ceph-mon[31150]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T23:22:29.726 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:29 smithi002 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T23:22:29.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:29 smithi154 ceph-mon[35136]: pgmap v294: 97 pgs: 97 active+clean; 582 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s wr, 8 op/s 2024-09-10T23:22:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:29 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1231368344' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:22:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:29 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] up:active 2024-09-10T23:22:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:29 smithi154 ceph-mon[35136]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T23:22:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:29 smithi154 ceph-mon[35136]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T23:22:29.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.961+0000 7f6babc7a640 1 -- 172.21.15.2:0/4245588537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 msgr2=0x7f6ba4101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:29.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.961+0000 7f6babc7a640 1 --2- 172.21.15.2:0/4245588537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba4101110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009900 tx=0x7f6ba002a410 comp rx=0 tx=0).stop 2024-09-10T23:22:29.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 -- 172.21.15.2:0/4245588537 shutdown_connections 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 --2- 172.21.15.2:0/4245588537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba4108030 0x7f6ba410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 --2- 172.21.15.2:0/4245588537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba41076b0 0x7f6ba4107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 --2- 172.21.15.2:0/4245588537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba4101110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 -- 172.21.15.2:0/4245588537 >> 172.21.15.2:0/4245588537 conn(0x7f6ba40fca20 msgr2=0x7f6ba40fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 -- 172.21.15.2:0/4245588537 shutdown_connections 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 -- 172.21.15.2:0/4245588537 wait complete. 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 Processor -- start 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 -- start start 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.962+0000 7f6babc7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076b0 0x7f6ba419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6babc7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba4108030 0x7f6ba41a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:29.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6babc7a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4112de0 con 0x7f6ba4100d30 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6babc7a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4112c60 con 0x7f6ba41076b0 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6babc7a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4112f60 con 0x7f6ba4108030 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48418/0 (socket says 172.21.15.2:48418) 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 -- 172.21.15.2:0/826788641 learned_addr learned my addr 172.21.15.2:0/826788641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9215640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076b0 0x7f6ba419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6baa217640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba4108030 0x7f6ba41a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 -- 172.21.15.2:0/826788641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba4108030 msgr2=0x7f6ba41a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba4108030 0x7f6ba41a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:29.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 -- 172.21.15.2:0/826788641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076b0 msgr2=0x7f6ba419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076b0 0x7f6ba419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 -- 172.21.15.2:0/826788641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba41a15d0 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9215640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076b0 0x7f6ba419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6ba9a16640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba419b520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0005940 tx=0x7f6ba00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba003f030 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba41a1860 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0003cb0 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0035070 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.963+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba41a7f80 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.964+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba4101110 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.966+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f6ba003bbf0 con 0x7f6ba4100d30 2024-09-10T23:22:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.966+0000 7f6b9affd640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6b900b52e0 0x7f6b900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:29.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.967+0000 7f6ba9215640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6b900b52e0 0x7f6b900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:29.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.967+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f6ba01066d0 con 0x7f6ba4100d30 2024-09-10T23:22:29.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.967+0000 7f6ba9215640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6b900b52e0 0x7f6b900b77a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ba410fda0 tx=0x7f6b94008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:29.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:29.971+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6ba00cd6e0 con 0x7f6ba4100d30 2024-09-10T23:22:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.186+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6ba410e3c0 con 0x7f6b900b52e0 2024-09-10T23:22:30.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.213+0000 7f6b9affd640 1 -- 172.21.15.2:0/826788641 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ba410e3c0 con 0x7f6b900b52e0 2024-09-10T23:22:30.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6b900b52e0 msgr2=0x7f6b900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6b900b52e0 0x7f6b900b77a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ba410fda0 tx=0x7f6b94008040 comp rx=0 tx=0).stop 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 msgr2=0x7f6ba419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba419b520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0005940 tx=0x7f6ba00042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 shutdown_connections 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6b900b52e0 0x7f6b900b77a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ba4108030 0x7f6ba41a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076b0 0x7f6ba419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 --2- 172.21.15.2:0/826788641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4100d30 0x7f6ba419b520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 >> 172.21.15.2:0/826788641 conn(0x7f6ba40fca20 msgr2=0x7f6ba410dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 shutdown_connections 2024-09-10T23:22:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:30.215+0000 7f6babc7a640 1 -- 172.21.15.2:0/826788641 wait complete. 2024-09-10T23:22:30.236 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:22:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:22:30.191+0000 7fc25a8b4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:22:30.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:22:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:22:30.191+0000 7fc25a8b4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:22:30.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:22:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:22:30.191+0000 7fc25a8b4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:22:30.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:22:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:22:30.191+0000 7fc25a8b4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:22:30.237 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:22:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:22:30.191+0000 7fc25a8b4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:22:31.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T23:22:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:31.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:31 smithi002 ceph-mon[31150]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:31.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:31 smithi002 ceph-mon[31150]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 16 op/s 2024-09-10T23:22:31.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:31 smithi002 ceph-mon[31150]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T23:22:31.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:31 smithi177 ceph-mon[35760]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:31.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:31 smithi177 ceph-mon[35760]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 16 op/s 2024-09-10T23:22:31.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:31 smithi177 ceph-mon[35760]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T23:22:31.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:31 smithi154 ceph-mon[35136]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:31.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:31 smithi154 ceph-mon[35136]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 16 op/s 2024-09-10T23:22:31.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:31 smithi154 ceph-mon[35136]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T23:22:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 -- 172.21.15.2:0/3304956744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 msgr2=0x7fc8181031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 --2- 172.21.15.2:0/3304956744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc8181031a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc814009900 tx=0x7fc81402a410 comp rx=0 tx=0).stop 2024-09-10T23:22:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 -- 172.21.15.2:0/3304956744 shutdown_connections 2024-09-10T23:22:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 --2- 172.21.15.2:0/3304956744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc818109150 0x7fc81810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 --2- 172.21.15.2:0/3304956744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 0x7fc818108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 --2- 172.21.15.2:0/3304956744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc8181031a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 -- 172.21.15.2:0/3304956744 >> 172.21.15.2:0/3304956744 conn(0x7fc8180fe830 msgr2=0x7fc818100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 -- 172.21.15.2:0/3304956744 shutdown_connections 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.791+0000 7fc820465640 1 -- 172.21.15.2:0/3304956744 wait complete. 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 Processor -- start 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 -- start start 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc818199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 0x7fc8181998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc818109150 0x7fc81819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc818112dd0 con 0x7fc818102dc0 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc818112c50 con 0x7fc8181087d0 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc820465640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc818112f50 con 0x7fc818109150 2024-09-10T23:22:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc81e201640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc818199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc81e201640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc818199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42158/0 (socket says 172.21.15.2:42158) 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.792+0000 7fc81e201640 1 -- 172.21.15.2:0/293193417 learned_addr learned my addr 172.21.15.2:0/293193417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81da00640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 0x7fc8181998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81ea02640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc818109150 0x7fc81819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81e201640 1 -- 172.21.15.2:0/293193417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc818109150 msgr2=0x7fc81819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81e201640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc818109150 0x7fc81819ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81e201640 1 -- 172.21.15.2:0/293193417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 msgr2=0x7fc8181998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81e201640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 0x7fc8181998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81e201640 1 -- 172.21.15.2:0/293193417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81819f430 con 0x7fc818102dc0 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81da00640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 0x7fc8181998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc81e201640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc818199380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc814005940 tx=0x7fc8140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81403f030 con 0x7fc818102dc0 2024-09-10T23:22:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc814003cb0 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81819f6c0 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814035070 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.793+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8181a5de0 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.794+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8181031a0 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.795+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc81403bbf0 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.796+0000 7fc80f7fe640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8040b5370 0x7fc8040b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.796+0000 7fc81da00640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8040b5370 0x7fc8040b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.796+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fc8141068e0 con 0x7fc818102dc0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.797+0000 7fc81da00640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8040b5370 0x7fc8040b7830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc818107e30 tx=0x7fc808005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:31.800+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8140cd6f0 con 0x7fc818102dc0 2024-09-10T23:22:32.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.015+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc818063590 con 0x7fc8040b5370 2024-09-10T23:22:32.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.042+0000 7fc80f7fe640 1 -- 172.21.15.2:0/293193417 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc818063590 con 0x7fc8040b5370 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8040b5370 msgr2=0x7fc8040b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8040b5370 0x7fc8040b7830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc818107e30 tx=0x7fc808005e50 comp rx=0 tx=0).stop 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 msgr2=0x7fc818199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc818199380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc814005940 tx=0x7fc8140042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 shutdown_connections 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8040b5370 0x7fc8040b7830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc818109150 0x7fc81819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:32.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8181087d0 0x7fc8181998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:32.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 --2- 172.21.15.2:0/293193417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc818102dc0 0x7fc818199380 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:32.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 >> 172.21.15.2:0/293193417 conn(0x7fc8180fe830 msgr2=0x7fc818100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:32.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.044+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 shutdown_connections 2024-09-10T23:22:32.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:32.045+0000 7fc820465640 1 -- 172.21.15.2:0/293193417 wait complete. 2024-09-10T23:22:32.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T23:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:33.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:33 smithi002 ceph-mon[31150]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:33.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:33 smithi002 ceph-mon[31150]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-10T23:22:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 -- 172.21.15.2:0/4182538049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 msgr2=0x7efeb8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 --2- 172.21.15.2:0/4182538049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8108c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efeac009900 tx=0x7efeac02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 -- 172.21.15.2:0/4182538049 shutdown_connections 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 --2- 172.21.15.2:0/4182538049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb8109150 0x7efeb810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 --2- 172.21.15.2:0/4182538049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8108c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 --2- 172.21.15.2:0/4182538049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb8102dc0 0x7efeb81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 -- 172.21.15.2:0/4182538049 >> 172.21.15.2:0/4182538049 conn(0x7efeb80fe830 msgr2=0x7efeb8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 -- 172.21.15.2:0/4182538049 shutdown_connections 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.609+0000 7efebe62f640 1 -- 172.21.15.2:0/4182538049 wait complete. 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 Processor -- start 2024-09-10T23:22:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 -- start start 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb8102dc0 0x7efeb8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb8109150 0x7efeb819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8112e10 con 0x7efeb81087d0 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8112c90 con 0x7efeb8109150 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efebe62f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8112f90 con 0x7efeb8102dc0 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42170/0 (socket says 172.21.15.2:42170) 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 -- 172.21.15.2:0/1280802257 learned_addr learned my addr 172.21.15.2:0/1280802257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb7fff640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb8102dc0 0x7efeb8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 -- 172.21.15.2:0/1280802257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb8102dc0 msgr2=0x7efeb8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb8102dc0 0x7efeb8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 -- 172.21.15.2:0/1280802257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb8109150 msgr2=0x7efeb819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb8109150 0x7efeb819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.610+0000 7efeb77fe640 1 -- 172.21.15.2:0/1280802257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb819f3b0 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.611+0000 7efeb77fe640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8199840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efeac005940 tx=0x7efeac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.611+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac03f030 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.611+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeac003cb0 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.611+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb819f640 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.611+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac035070 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.611+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a5d60 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.612+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb81031a0 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.613+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7efeac03bbf0 con 0x7efeb81087d0 2024-09-10T23:22:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.614+0000 7efeb57fa640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efea00b53f0 0x7efea00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.614+0000 7efeb7fff640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efea00b53f0 0x7efea00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.614+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7efeac106760 con 0x7efeb81087d0 2024-09-10T23:22:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.615+0000 7efeb7fff640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efea00b53f0 0x7efea00b78b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efea8005fd0 tx=0x7efea8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.619+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efeac0cd670 con 0x7efeb81087d0 2024-09-10T23:22:33.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:33 smithi177 ceph-mon[35760]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:33.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:33 smithi177 ceph-mon[35760]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-10T23:22:33.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:33 smithi154 ceph-mon[35136]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:33.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:33 smithi154 ceph-mon[35136]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-10T23:22:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.835+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7efeb8063590 con 0x7efea00b53f0 2024-09-10T23:22:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.840+0000 7efeb57fa640 1 -- 172.21.15.2:0/1280802257 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7efeb8063590 con 0x7efea00b53f0 2024-09-10T23:22:33.841 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/9fa69d65-5998-4a8f-998e-d45a661acb87 2024-09-10T23:22:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.842+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efea00b53f0 msgr2=0x7efea00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.842+0000 7efebe62f640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efea00b53f0 0x7efea00b78b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efea8005fd0 tx=0x7efea8005850 comp rx=0 tx=0).stop 2024-09-10T23:22:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.842+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 msgr2=0x7efeb8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.842+0000 7efebe62f640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8199840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efeac005940 tx=0x7efeac0042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 shutdown_connections 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efea00b53f0 0x7efea00b78b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb8109150 0x7efeb819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81087d0 0x7efeb8199840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 --2- 172.21.15.2:0/1280802257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb8102dc0 0x7efeb8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 >> 172.21.15.2:0/1280802257 conn(0x7efeb80fe830 msgr2=0x7efeb8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 shutdown_connections 2024-09-10T23:22:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:33.843+0000 7efebe62f640 1 -- 172.21.15.2:0/1280802257 wait complete. 2024-09-10T23:22:34.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T23:22:34.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:34 smithi177 ceph-mon[35760]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:34.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:34 smithi002 ceph-mon[31150]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:34.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:34 smithi154 ceph-mon[35136]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2118470784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 msgr2=0x7fca841020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2118470784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca841020b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fca80009900 tx=0x7fca8002a410 comp rx=0 tx=0).stop 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2118470784 shutdown_connections 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2118470784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84108060 0x7fca8410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2118470784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca841076e0 0x7fca84107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2118470784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca841020b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2118470784 >> 172.21.15.2:0/2118470784 conn(0x7fca840fd700 msgr2=0x7fca840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2118470784 shutdown_connections 2024-09-10T23:22:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.393+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2118470784 wait complete. 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 Processor -- start 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 -- start start 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca84199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca841076e0 0x7fca841997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca84108060 0x7fca8419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca84111d20 con 0x7fca84101cd0 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca84111ba0 con 0x7fca84108060 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8c2ee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca84111ea0 con 0x7fca841076e0 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8a08a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca84199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8a08a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca84199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42190/0 (socket says 172.21.15.2:42190) 2024-09-10T23:22:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca8a08a640 1 -- 172.21.15.2:0/2085216963 learned_addr learned my addr 172.21.15.2:0/2085216963 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.394+0000 7fca89889640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca841076e0 0x7fca841997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a08a640 1 -- 172.21.15.2:0/2085216963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca841076e0 msgr2=0x7fca841997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a08a640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca841076e0 0x7fca841997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a88b640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca84108060 0x7fca8419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a08a640 1 -- 172.21.15.2:0/2085216963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca84108060 msgr2=0x7fca8419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a08a640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca84108060 0x7fca8419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a08a640 1 -- 172.21.15.2:0/2085216963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8419f310 con 0x7fca84101cd0 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca89889640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca841076e0 0x7fca841997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a88b640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca84108060 0x7fca8419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8a08a640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca84199260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca80005940 tx=0x7fca800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8003f030 con 0x7fca84101cd0 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca80003cb0 con 0x7fca84101cd0 2024-09-10T23:22:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8419f5a0 con 0x7fca84101cd0 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80035070 con 0x7fca84101cd0 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.395+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca841a5cc0 con 0x7fca84101cd0 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.396+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca841020b0 con 0x7fca84101cd0 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.397+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fca8003bbf0 con 0x7fca84101cd0 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.398+0000 7fca7b7fe640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b5370 0x7fca700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.399+0000 7fca89889640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b5370 0x7fca700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.399+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fca801067e0 con 0x7fca84101cd0 2024-09-10T23:22:35.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.399+0000 7fca89889640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b5370 0x7fca700b7830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca84106d30 tx=0x7fca7400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:35.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.403+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca800cd6f0 con 0x7fca84101cd0 2024-09-10T23:22:35.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.616+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fca84063590 con 0x7fca700b5370 2024-09-10T23:22:35.617 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:35 smithi002 ceph-mon[31150]: pgmap v297: 97 pgs: 97 active+clean; 592 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-10T23:22:35.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.641+0000 7fca7b7fe640 1 -- 172.21.15.2:0/2085216963 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fca84063590 con 0x7fca700b5370 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b5370 msgr2=0x7fca700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b5370 0x7fca700b7830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca84106d30 tx=0x7fca7400a5c0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 msgr2=0x7fca84199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca84199260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca80005940 tx=0x7fca800042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 shutdown_connections 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b5370 0x7fca700b7830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca84108060 0x7fca8419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca841076e0 0x7fca841997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 --2- 172.21.15.2:0/2085216963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca84101cd0 0x7fca84199260 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:35.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 >> 172.21.15.2:0/2085216963 conn(0x7fca840fd700 msgr2=0x7fca8406b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:35.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 shutdown_connections 2024-09-10T23:22:35.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:35.643+0000 7fca8c2ee640 1 -- 172.21.15.2:0/2085216963 wait complete. 2024-09-10T23:22:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:35 smithi177 ceph-mon[35760]: pgmap v297: 97 pgs: 97 active+clean; 592 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-10T23:22:35.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:35 smithi154 ceph-mon[35136]: pgmap v297: 97 pgs: 97 active+clean; 592 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-10T23:22:36.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T23:22:36.610 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:36 smithi177 ceph-mon[35760]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:36.732 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:36 smithi002 ceph-mon[31150]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:36.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:36 smithi154 ceph-mon[35136]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:37.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 -- 172.21.15.2:0/325922956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b01087d0 msgr2=0x7fd0b0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/325922956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b01087d0 0x7fd0b0108c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009900 tx=0x7fd0a402a410 comp rx=0 tx=0).stop 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 -- 172.21.15.2:0/325922956 shutdown_connections 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/325922956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0b0109150 0x7fd0b010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/325922956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b01087d0 0x7fd0b0108c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/325922956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0102dc0 0x7fd0b01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 -- 172.21.15.2:0/325922956 >> 172.21.15.2:0/325922956 conn(0x7fd0b00fe830 msgr2=0x7fd0b0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 -- 172.21.15.2:0/325922956 shutdown_connections 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.134+0000 7fd0b61b8640 1 -- 172.21.15.2:0/325922956 wait complete. 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 Processor -- start 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 -- start start 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 0x7fd0b0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0b01087d0 0x7fd0b0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0109150 0x7fd0b019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b0112e10 con 0x7fd0b0102dc0 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b0112c90 con 0x7fd0b0109150 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0b61b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b0112f90 con 0x7fd0b01087d0 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 0x7fd0b0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 0x7fd0b0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42200/0 (socket says 172.21.15.2:42200) 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0af7fe640 1 -- 172.21.15.2:0/2912564331 learned_addr learned my addr 172.21.15.2:0/2912564331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.135+0000 7fd0aeffd640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0b01087d0 0x7fd0b0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0affff640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0109150 0x7fd0b019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0af7fe640 1 -- 172.21.15.2:0/2912564331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0b01087d0 msgr2=0x7fd0b0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0af7fe640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0b01087d0 0x7fd0b0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0af7fe640 1 -- 172.21.15.2:0/2912564331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0109150 msgr2=0x7fd0b019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0af7fe640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0109150 0x7fd0b019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0af7fe640 1 -- 172.21.15.2:0/2912564331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b019f3d0 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0affff640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0109150 0x7fd0b019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0af7fe640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 0x7fd0b0199320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000b4a0 tx=0x7fd0a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0014070 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0a0010ac0 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b019f6c0 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0017c30 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.136+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b01a5e00 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.137+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b01031a0 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.138+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fd0a0010610 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.139+0000 7fd0acff9640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0980b5370 0x7fd0980b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.139+0000 7fd0aeffd640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0980b5370 0x7fd0980b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.139+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fd0a00e5420 con 0x7fd0b0102dc0 2024-09-10T23:22:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.140+0000 7fd0aeffd640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0980b5370 0x7fd0980b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4031440 tx=0x7fd0a4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.142+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd0a00ac330 con 0x7fd0b0102dc0 2024-09-10T23:22:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.357+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd0b0063590 con 0x7fd0980b5370 2024-09-10T23:22:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.363+0000 7fd0acff9640 1 -- 172.21.15.2:0/2912564331 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd0b0063590 con 0x7fd0980b5370 2024-09-10T23:22:37.364 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/0aec2cea-1dc8-40c2-85a1-36246124ca43 2024-09-10T23:22:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0980b5370 msgr2=0x7fd0980b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0980b5370 0x7fd0980b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4031440 tx=0x7fd0a4005b50 comp rx=0 tx=0).stop 2024-09-10T23:22:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 msgr2=0x7fd0b0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 0x7fd0b0199320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000b4a0 tx=0x7fd0a000b960 comp rx=0 tx=0).stop 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 shutdown_connections 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0980b5370 0x7fd0980b7830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b0109150 0x7fd0b019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0b01087d0 0x7fd0b0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 --2- 172.21.15.2:0/2912564331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0b0102dc0 0x7fd0b0199320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 >> 172.21.15.2:0/2912564331 conn(0x7fd0b00fe830 msgr2=0x7fd0b0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 shutdown_connections 2024-09-10T23:22:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:37.365+0000 7fd0b61b8640 1 -- 172.21.15.2:0/2912564331 wait complete. 2024-09-10T23:22:37.704 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:37 smithi154 ceph-mon[35136]: pgmap v298: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.5 KiB/s wr, 23 op/s 2024-09-10T23:22:37.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:37 smithi177 ceph-mon[35760]: pgmap v298: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.5 KiB/s wr, 23 op/s 2024-09-10T23:22:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:37 smithi002 ceph-mon[31150]: pgmap v298: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.5 KiB/s wr, 23 op/s 2024-09-10T23:22:38.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:22:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:38.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:38 smithi177 ceph-mon[35760]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:38.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:38 smithi002 ceph-mon[31150]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:38.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:38 smithi154 ceph-mon[35136]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1531293522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0109150 msgr2=0x7fa7a010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1531293522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0109150 0x7fa7a010f950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa798009900 tx=0x7fa79802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1531293522 shutdown_connections 2024-09-10T23:22:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1531293522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0109150 0x7fa7a010f950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1531293522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 0x7fa7a0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1531293522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a0102dc0 0x7fa7a01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1531293522 >> 172.21.15.2:0/1531293522 conn(0x7fa7a00fe830 msgr2=0x7fa7a0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1531293522 shutdown_connections 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.824+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1531293522 wait complete. 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 Processor -- start 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 -- start start 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 0x7fa7a019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 0x7fa7a019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a0109150 0x7fa7a01a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0112dd0 con 0x7fa7a0102dc0 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0112c50 con 0x7fa7a0109150 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a7f58640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0112f50 con 0x7fa7a01087d0 2024-09-10T23:22:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 0x7fa7a019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 0x7fa7a019b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42218/0 (socket says 172.21.15.2:42218) 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 -- 172.21.15.2:0/1685321686 learned_addr learned my addr 172.21.15.2:0/1685321686 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a64f5640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a0109150 0x7fa7a01a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a54f3640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 0x7fa7a019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 -- 172.21.15.2:0/1685321686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 msgr2=0x7fa7a019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 0x7fa7a019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 -- 172.21.15.2:0/1685321686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a0109150 msgr2=0x7fa7a01a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a0109150 0x7fa7a01a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a5cf4640 1 -- 172.21.15.2:0/1685321686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a01a1540 con 0x7fa7a0102dc0 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.825+0000 7fa7a54f3640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 0x7fa7a019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.826+0000 7fa7a5cf4640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 0x7fa7a019b490 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00db80 tx=0x7fa79c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.826+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c017070 con 0x7fa7a0102dc0 2024-09-10T23:22:38.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.826+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa79c003b70 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.826+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a01a1830 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.826+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0106c0 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.826+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a01a80c0 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.827+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a0104070 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.828+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fa79c023060 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.829+0000 7fa796ffd640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa78c0b53f0 0x7fa78c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.829+0000 7fa7a54f3640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa78c0b53f0 0x7fa78c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.829+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fa79c0e5d40 con 0x7fa7a0102dc0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.830+0000 7fa7a54f3640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa78c0b53f0 0x7fa78c0b78b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa790005fd0 tx=0x7fa790005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:38.832+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa79c0acbd0 con 0x7fa7a0102dc0 2024-09-10T23:22:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.058+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7a01a8340 con 0x7fa7a0102dc0 2024-09-10T23:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.059+0000 7fa796ffd640 1 -- 172.21.15.2:0/1685321686 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11964 (secure 0 0 0) 0x7fa79c0ac4d0 con 0x7fa7a0102dc0 2024-09-10T23:22:39.061 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-10T23:22:28:431609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:22:28.431589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24568,24563,24547,24541,24536]},"id":1}]} 2024-09-10T23:22:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:22:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.061+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa78c0b53f0 msgr2=0x7fa78c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.061+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa78c0b53f0 0x7fa78c0b78b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa790005fd0 tx=0x7fa790005850 comp rx=0 tx=0).stop 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 msgr2=0x7fa7a019b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 0x7fa7a019b490 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00db80 tx=0x7fa79c00b630 comp rx=0 tx=0).stop 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 shutdown_connections 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa78c0b53f0 0x7fa78c0b78b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a0109150 0x7fa7a01a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a01087d0 0x7fa7a019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 --2- 172.21.15.2:0/1685321686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a0102dc0 0x7fa7a019b490 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 >> 172.21.15.2:0/1685321686 conn(0x7fa7a00fe830 msgr2=0x7fa7a00753b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 shutdown_connections 2024-09-10T23:22:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:39.062+0000 7fa7a7f58640 1 -- 172.21.15.2:0/1685321686 wait complete. 2024-09-10T23:22:39.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:39 smithi002 ceph-mon[31150]: pgmap v299: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.4 KiB/s wr, 23 op/s 2024-09-10T23:22:39.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:39 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1685321686' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:39.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:22:39.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:39 smithi177 ceph-mon[35760]: pgmap v299: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.4 KiB/s wr, 23 op/s 2024-09-10T23:22:39.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:39 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1685321686' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:39.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:39 smithi154 ceph-mon[35136]: pgmap v299: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.4 KiB/s wr, 23 op/s 2024-09-10T23:22:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:39 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1685321686' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:22:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 -- 172.21.15.2:0/3077670377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 msgr2=0x7fe3b8108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3077670377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8108a60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009900 tx=0x7fe3ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 -- 172.21.15.2:0/3077670377 shutdown_connections 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3077670377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8108fa0 0x7fe3b810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3077670377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8108a60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3077670377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3b8102c10 0x7fe3b8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 -- 172.21.15.2:0/3077670377 >> 172.21.15.2:0/3077670377 conn(0x7fe3b80fe6c0 msgr2=0x7fe3b8100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 -- 172.21.15.2:0/3077670377 shutdown_connections 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.449+0000 7fe3bca03640 1 -- 172.21.15.2:0/3077670377 wait complete. 2024-09-10T23:22:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.450+0000 7fe3bca03640 1 Processor -- start 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.450+0000 7fe3bca03640 1 -- start start 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8102c10 0x7fe3b8199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3b8108fa0 0x7fe3b819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b8112c60 con 0x7fe3b8108620 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b8112ae0 con 0x7fe3b8102c10 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b8112de0 con 0x7fe3b8108fa0 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42232/0 (socket says 172.21.15.2:42232) 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 -- 172.21.15.2:0/3770832079 learned_addr learned my addr 172.21.15.2:0/3770832079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b759e640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3b8108fa0 0x7fe3b819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b6d9d640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8102c10 0x7fe3b8199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 -- 172.21.15.2:0/3770832079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3b8108fa0 msgr2=0x7fe3b819e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3b8108fa0 0x7fe3b819e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 -- 172.21.15.2:0/3770832079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8102c10 msgr2=0x7fe3b8199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8102c10 0x7fe3b8199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 -- 172.21.15.2:0/3770832079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b819f1c0 con 0x7fe3b8108620 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3b659c640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8199650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac005940 tx=0x7fe3ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac03f030 con 0x7fe3b8108620 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ac003cb0 con 0x7fe3b8108620 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.451+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b819f450 con 0x7fe3b8108620 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.452+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac035070 con 0x7fe3b8108620 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.452+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b81a5b70 con 0x7fe3b8108620 2024-09-10T23:22:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.453+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b8102ff0 con 0x7fe3b8108620 2024-09-10T23:22:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.454+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fe3ac03bbf0 con 0x7fe3b8108620 2024-09-10T23:22:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.455+0000 7fe39ffff640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3a00b5410 0x7fe3a00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.455+0000 7fe3b6d9d640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3a00b5410 0x7fe3a00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.455+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fe3ac1069b0 con 0x7fe3b8108620 2024-09-10T23:22:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.455+0000 7fe3b6d9d640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3a00b5410 0x7fe3a00b78d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800a810 tx=0x7fe3a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.458+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3ac0cd8c0 con 0x7fe3b8108620 2024-09-10T23:22:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.645+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3b819a240 con 0x7fe3b8108620 2024-09-10T23:22:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.647+0000 7fe39ffff640 1 -- 172.21.15.2:0/3770832079 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22255 (secure 0 0 0) 0x7fe3b819a240 con 0x7fe3b8108620 2024-09-10T23:22:40.649 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:17.001440+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3a00b5410 msgr2=0x7fe3a00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3a00b5410 0x7fe3a00b78d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800a810 tx=0x7fe3a8008040 comp rx=0 tx=0).stop 2024-09-10T23:22:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 msgr2=0x7fe3b8199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8199650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac005940 tx=0x7fe3ac0042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 shutdown_connections 2024-09-10T23:22:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3a00b5410 0x7fe3a00b78d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3b8108fa0 0x7fe3b819e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3b8108620 0x7fe3b8199650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 --2- 172.21.15.2:0/3770832079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8102c10 0x7fe3b8199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 >> 172.21.15.2:0/3770832079 conn(0x7fe3b80fe6c0 msgr2=0x7fe3b8100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.649+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 shutdown_connections 2024-09-10T23:22:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:40.650+0000 7fe3bca03640 1 -- 172.21.15.2:0/3770832079 wait complete. 2024-09-10T23:22:41.431 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:22:41.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:22:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:41.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:41 smithi177 ceph-mon[35760]: pgmap v300: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-09-10T23:22:41.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:41 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3770832079' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:41.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:41 smithi002 ceph-mon[31150]: pgmap v300: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-09-10T23:22:41.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:41 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3770832079' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:41.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:41 smithi154 ceph-mon[35136]: pgmap v300: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-09-10T23:22:41.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:41 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3770832079' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 -- 172.21.15.2:0/1030579162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c103bd0 msgr2=0x7f692c103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 --2- 172.21.15.2:0/1030579162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c103bd0 0x7f692c103fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f691c009900 tx=0x7f691c02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 -- 172.21.15.2:0/1030579162 shutdown_connections 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 --2- 172.21.15.2:0/1030579162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f692c10d180 0x7f692c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 --2- 172.21.15.2:0/1030579162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c1045d0 0x7f692c10cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 --2- 172.21.15.2:0/1030579162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c103bd0 0x7f692c103fb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 -- 172.21.15.2:0/1030579162 >> 172.21.15.2:0/1030579162 conn(0x7f692c0fd720 msgr2=0x7f692c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 -- 172.21.15.2:0/1030579162 shutdown_connections 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.199+0000 7f6932d69640 1 -- 172.21.15.2:0/1030579162 wait complete. 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 Processor -- start 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 -- start start 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c103bd0 0x7f692c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f692c1045d0 0x7f692c199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 0x7f692c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f692c112ed0 con 0x7f692c10d180 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f692c112d50 con 0x7f692c103bd0 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6932d69640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f692c113050 con 0x7f692c1045d0 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6931306640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 0x7f692c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6931306640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 0x7f692c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57398/0 (socket says 172.21.15.2:57398) 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.200+0000 7f6931306640 1 -- 172.21.15.2:0/2613198581 learned_addr learned my addr 172.21.15.2:0/2613198581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f692bfff640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f692c1045d0 0x7f692c199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6930b05640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c103bd0 0x7f692c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6931306640 1 -- 172.21.15.2:0/2613198581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f692c1045d0 msgr2=0x7f692c199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6931306640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f692c1045d0 0x7f692c199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6931306640 1 -- 172.21.15.2:0/2613198581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c103bd0 msgr2=0x7f692c199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6931306640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c103bd0 0x7f692c199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6931306640 1 -- 172.21.15.2:0/2613198581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c19f4d0 con 0x7f692c10d180 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6931306640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 0x7f692c19ed00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f692400b9e0 tx=0x7f692400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924019070 con 0x7f692c10d180 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c19f7c0 con 0x7f692c10d180 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6924014440 con 0x7f692c10d180 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69240125a0 con 0x7f692c10d180 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.201+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c1a5f00 con 0x7f692c10d180 2024-09-10T23:22:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.202+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c104030 con 0x7f692c10d180 2024-09-10T23:22:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.204+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f69240145f0 con 0x7f692c10d180 2024-09-10T23:22:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.205+0000 7f6929ffb640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69140b5370 0x7f69140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.205+0000 7f6930b05640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69140b5370 0x7f69140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.205+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f69240e54a0 con 0x7f692c10d180 2024-09-10T23:22:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.205+0000 7f6930b05640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69140b5370 0x7f69140b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f691c02a930 tx=0x7f691c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.209+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f69240ac2b0 con 0x7f692c10d180 2024-09-10T23:22:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.393+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f692c063590 con 0x7f69140b5370 2024-09-10T23:22:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.398+0000 7f6929ffb640 1 -- 172.21.15.2:0/2613198581 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258902 (secure 0 0 0) 0x7f692c063590 con 0x7f69140b5370 2024-09-10T23:22:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:42.403 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:22:42.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69140b5370 msgr2=0x7f69140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:42.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69140b5370 0x7f69140b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f691c02a930 tx=0x7f691c005fd0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 msgr2=0x7f692c19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 0x7f692c19ed00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f692400b9e0 tx=0x7f692400bea0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 shutdown_connections 2024-09-10T23:22:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f69140b5370 0x7f69140b7830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f692c10d180 0x7f692c19ed00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f692c1045d0 0x7f692c199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 --2- 172.21.15.2:0/2613198581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c103bd0 0x7f692c199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 >> 172.21.15.2:0/2613198581 conn(0x7f692c0fd720 msgr2=0x7f692c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 shutdown_connections 2024-09-10T23:22:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:42.401+0000 7f6932d69640 1 -- 172.21.15.2:0/2613198581 wait complete. 2024-09-10T23:22:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-09-10T23:22:42.221633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647407,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":237,"num_read_kb":207,"num_write":361,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375924,"kb_used_data":10036,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565900,"statfs":{"total":1151940427776,"available":1151555481600,"internally_reserved":0,"allocated":10276864,"data_stored":6542055,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49129,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":49,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003243"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.312057+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:22:17.312057+0000","last_peered":"2024-09-10T23:22:17.312057+0000","last_clean":"2024-09-10T23:22:17.312057+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:22:17.312057+0000","last_undegraded":"2024-09-10T23:22:17.312057+0000","last_fullsized":"2024-09-10T23:22:17.312057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322864+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:22:17.322864+0000","last_peered":"2024-09-10T23:22:17.322864+0000","last_clean":"2024-09-10T23:22:17.322864+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:22:17.322864+0000","last_undegraded":"2024-09-10T23:22:17.322864+0000","last_fullsized":"2024-09-10T23:22:17.322864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323009+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:22:17.323009+0000","last_peered":"2024-09-10T23:22:17.323009+0000","last_clean":"2024-09-10T23:22:17.323009+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:22:17.323009+0000","last_undegraded":"2024-09-10T23:22:17.323009+0000","last_fullsized":"2024-09-10T23:22:17.323009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322538+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:22:17.322538+0000","last_peered":"2024-09-10T23:22:17.322538+0000","last_clean":"2024-09-10T23:22:17.322538+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:22:17.322538+0000","last_undegraded":"2024-09-10T23:22:17.322538+0000","last_fullsized":"2024-09-10T23:22:17.322538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318359+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:22:17.318359+0000","last_peered":"2024-09-10T23:22:17.318359+0000","last_clean":"2024-09-10T23:22:17.318359+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:22:17.318359+0000","last_undegraded":"2024-09-10T23:22:17.318359+0000","last_fullsized":"2024-09-10T23:22:17.318359+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309782+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:22:17.309782+0000","last_peered":"2024-09-10T23:22:17.309782+0000","last_clean":"2024-09-10T23:22:17.309782+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:22:17.309782+0000","last_undegraded":"2024-09-10T23:22:17.309782+0000","last_fullsized":"2024-09-10T23:22:17.309782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318007+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:22:17.318007+0000","last_peered":"2024-09-10T23:22:17.318007+0000","last_clean":"2024-09-10T23:22:17.318007+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:22:17.318007+0000","last_undegraded":"2024-09-10T23:22:17.318007+0000","last_fullsized":"2024-09-10T23:22:17.318007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320314+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:22:17.320314+0000","last_peered":"2024-09-10T23:22:17.320314+0000","last_clean":"2024-09-10T23:22:17.320314+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:22:17.320314+0000","last_undegraded":"2024-09-10T23:22:17.320314+0000","last_fullsized":"2024-09-10T23:22:17.320314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320087+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:22:17.320087+0000","last_peered":"2024-09-10T23:22:17.320087+0000","last_clean":"2024-09-10T23:22:17.320087+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:22:17.320087+0000","last_undegraded":"2024-09-10T23:22:17.320087+0000","last_fullsized":"2024-09-10T23:22:17.320087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.310306+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:22:17.310306+0000","last_peered":"2024-09-10T23:22:17.310306+0000","last_clean":"2024-09-10T23:22:17.310306+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:22:17.310306+0000","last_undegraded":"2024-09-10T23:22:17.310306+0000","last_fullsized":"2024-09-10T23:22:17.310306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318802+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:22:17.318802+0000","last_peered":"2024-09-10T23:22:17.318802+0000","last_clean":"2024-09-10T23:22:17.318802+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:22:17.318802+0000","last_undegraded":"2024-09-10T23:22:17.318802+0000","last_fullsized":"2024-09-10T23:22:17.318802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322489+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:22:17.322489+0000","last_peered":"2024-09-10T23:22:17.322489+0000","last_clean":"2024-09-10T23:22:17.322489+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:22:17.322489+0000","last_undegraded":"2024-09-10T23:22:17.322489+0000","last_fullsized":"2024-09-10T23:22:17.322489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318267+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:22:17.318267+0000","last_peered":"2024-09-10T23:22:17.318267+0000","last_clean":"2024-09-10T23:22:17.318267+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:22:17.318267+0000","last_undegraded":"2024-09-10T23:22:17.318267+0000","last_fullsized":"2024-09-10T23:22:17.318267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322554+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:22:17.322554+0000","last_peered":"2024-09-10T23:22:17.322554+0000","last_clean":"2024-09-10T23:22:17.322554+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:22:17.322554+0000","last_undegraded":"2024-09-10T23:22:17.322554+0000","last_fullsized":"2024-09-10T23:22:17.322554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322677+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:22:17.322677+0000","last_peered":"2024-09-10T23:22:17.322677+0000","last_clean":"2024-09-10T23:22:17.322677+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:22:17.322677+0000","last_undegraded":"2024-09-10T23:22:17.322677+0000","last_fullsized":"2024-09-10T23:22:17.322677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318791+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:22:17.318791+0000","last_peered":"2024-09-10T23:22:17.318791+0000","last_clean":"2024-09-10T23:22:17.318791+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:22:17.318791+0000","last_undegraded":"2024-09-10T23:22:17.318791+0000","last_fullsized":"2024-09-10T23:22:17.318791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.312058+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:22:17.312058+0000","last_peered":"2024-09-10T23:22:17.312058+0000","last_clean":"2024-09-10T23:22:17.312058+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:22:17.312058+0000","last_undegraded":"2024-09-10T23:22:17.312058+0000","last_fullsized":"2024-09-10T23:22:17.312058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309473+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:22:17.309473+0000","last_peered":"2024-09-10T23:22:17.309473+0000","last_clean":"2024-09-10T23:22:17.309473+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:22:17.309473+0000","last_undegraded":"2024-09-10T23:22:17.309473+0000","last_fullsized":"2024-09-10T23:22:17.309473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320381+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:22:17.320381+0000","last_peered":"2024-09-10T23:22:17.320381+0000","last_clean":"2024-09-10T23:22:17.320381+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:22:17.320381+0000","last_undegraded":"2024-09-10T23:22:17.320381+0000","last_fullsized":"2024-09-10T23:22:17.320381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311863+0000","last_change":"2024-09-10T23:22:16.329759+0000","last_active":"2024-09-10T23:22:17.311863+0000","last_peered":"2024-09-10T23:22:17.311863+0000","last_clean":"2024-09-10T23:22:17.311863+0000","last_became_active":"2024-09-10T23:22:16.329438+0000","last_became_peered":"2024-09-10T23:22:16.329438+0000","last_unstale":"2024-09-10T23:22:17.311863+0000","last_undegraded":"2024-09-10T23:22:17.311863+0000","last_fullsized":"2024-09-10T23:22:17.311863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.587133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318851+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:22:17.318851+0000","last_peered":"2024-09-10T23:22:17.318851+0000","last_clean":"2024-09-10T23:22:17.318851+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:22:17.318851+0000","last_undegraded":"2024-09-10T23:22:17.318851+0000","last_fullsized":"2024-09-10T23:22:17.318851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318557+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:22:17.318557+0000","last_peered":"2024-09-10T23:22:17.318557+0000","last_clean":"2024-09-10T23:22:17.318557+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:22:17.318557+0000","last_undegraded":"2024-09-10T23:22:17.318557+0000","last_fullsized":"2024-09-10T23:22:17.318557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320726+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:22:17.320726+0000","last_peered":"2024-09-10T23:22:17.320726+0000","last_clean":"2024-09-10T23:22:17.320726+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:22:17.320726+0000","last_undegraded":"2024-09-10T23:22:17.320726+0000","last_fullsized":"2024-09-10T23:22:17.320726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324139+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:22:17.324139+0000","last_peered":"2024-09-10T23:22:17.324139+0000","last_clean":"2024-09-10T23:22:17.324139+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:22:17.324139+0000","last_undegraded":"2024-09-10T23:22:17.324139+0000","last_fullsized":"2024-09-10T23:22:17.324139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320762+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:22:17.320762+0000","last_peered":"2024-09-10T23:22:17.320762+0000","last_clean":"2024-09-10T23:22:17.320762+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:22:17.320762+0000","last_undegraded":"2024-09-10T23:22:17.320762+0000","last_fullsized":"2024-09-10T23:22:17.320762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323583+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:22:17.323583+0000","last_peered":"2024-09-10T23:22:17.323583+0000","last_clean":"2024-09-10T23:22:17.323583+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:22:17.323583+0000","last_undegraded":"2024-09-10T23:22:17.323583+0000","last_fullsized":"2024-09-10T23:22:17.323583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311997+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:22:17.311997+0000","last_peered":"2024-09-10T23:22:17.311997+0000","last_clean":"2024-09-10T23:22:17.311997+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:22:17.311997+0000","last_undegraded":"2024-09-10T23:22:17.311997+0000","last_fullsized":"2024-09-10T23:22:17.311997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318143+0000","last_change":"2024-09-10T23:22:16.323608+0000","last_active":"2024-09-10T23:22:17.318143+0000","last_peered":"2024-09-10T23:22:17.318143+0000","last_clean":"2024-09-10T23:22:17.318143+0000","last_became_active":"2024-09-10T23:22:16.323327+0000","last_became_peered":"2024-09-10T23:22:16.323327+0000","last_unstale":"2024-09-10T23:22:17.318143+0000","last_undegraded":"2024-09-10T23:22:17.318143+0000","last_fullsized":"2024-09-10T23:22:17.318143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:27.654797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322679+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:22:17.322679+0000","last_peered":"2024-09-10T23:22:17.322679+0000","last_clean":"2024-09-10T23:22:17.322679+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:22:17.322679+0000","last_undegraded":"2024-09-10T23:22:17.322679+0000","last_fullsized":"2024-09-10T23:22:17.322679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319244+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:22:17.319244+0000","last_peered":"2024-09-10T23:22:17.319244+0000","last_clean":"2024-09-10T23:22:17.319244+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:22:17.319244+0000","last_undegraded":"2024-09-10T23:22:17.319244+0000","last_fullsized":"2024-09-10T23:22:17.319244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320282+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:22:17.320282+0000","last_peered":"2024-09-10T23:22:17.320282+0000","last_clean":"2024-09-10T23:22:17.320282+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:22:17.320282+0000","last_undegraded":"2024-09-10T23:22:17.320282+0000","last_fullsized":"2024-09-10T23:22:17.320282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311766+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:22:17.311766+0000","last_peered":"2024-09-10T23:22:17.311766+0000","last_clean":"2024-09-10T23:22:17.311766+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:22:17.311766+0000","last_undegraded":"2024-09-10T23:22:17.311766+0000","last_fullsized":"2024-09-10T23:22:17.311766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318544+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:22:17.318544+0000","last_peered":"2024-09-10T23:22:17.318544+0000","last_clean":"2024-09-10T23:22:17.318544+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:22:17.318544+0000","last_undegraded":"2024-09-10T23:22:17.318544+0000","last_fullsized":"2024-09-10T23:22:17.318544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.459507+0000","last_change":"2024-09-10T23:22:14.301534+0000","last_active":"2024-09-10T23:22:40.459507+0000","last_peered":"2024-09-10T23:22:40.459507+0000","last_clean":"2024-09-10T23:22:40.459507+0000","last_became_active":"2024-09-10T23:22:14.301145+0000","last_became_peered":"2024-09-10T23:22:14.301145+0000","last_unstale":"2024-09-10T23:22:40.459507+0000","last_undegraded":"2024-09-10T23:22:40.459507+0000","last_fullsized":"2024-09-10T23:22:40.459507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:41.656962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324082+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:22:17.324082+0000","last_peered":"2024-09-10T23:22:17.324082+0000","last_clean":"2024-09-10T23:22:17.324082+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:22:17.324082+0000","last_undegraded":"2024-09-10T23:22:17.324082+0000","last_fullsized":"2024-09-10T23:22:17.324082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:26.423330+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:26.423330+0000","last_peered":"2024-09-10T23:22:26.423330+0000","last_clean":"2024-09-10T23:22:26.423330+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:26.423330+0000","last_undegraded":"2024-09-10T23:22:26.423330+0000","last_fullsized":"2024-09-10T23:22:26.423330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:25.415185+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:25.415185+0000","last_peered":"2024-09-10T23:22:25.415185+0000","last_clean":"2024-09-10T23:22:25.415185+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:25.415185+0000","last_undegraded":"2024-09-10T23:22:25.415185+0000","last_fullsized":"2024-09-10T23:22:25.415185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320392+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:22:17.320392+0000","last_peered":"2024-09-10T23:22:17.320392+0000","last_clean":"2024-09-10T23:22:17.320392+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:22:17.320392+0000","last_undegraded":"2024-09-10T23:22:17.320392+0000","last_fullsized":"2024-09-10T23:22:17.320392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.433106+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:27.433106+0000","last_peered":"2024-09-10T23:22:27.433106+0000","last_clean":"2024-09-10T23:22:27.433106+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:27.433106+0000","last_undegraded":"2024-09-10T23:22:27.433106+0000","last_fullsized":"2024-09-10T23:22:27.433106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309118+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:22:17.309118+0000","last_peered":"2024-09-10T23:22:17.309118+0000","last_clean":"2024-09-10T23:22:17.309118+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:22:17.309118+0000","last_undegraded":"2024-09-10T23:22:17.309118+0000","last_fullsized":"2024-09-10T23:22:17.309118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.458955+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:22:40.458955+0000","last_peered":"2024-09-10T23:22:40.458955+0000","last_clean":"2024-09-10T23:22:40.458955+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:22:40.458955+0000","last_undegraded":"2024-09-10T23:22:40.458955+0000","last_fullsized":"2024-09-10T23:22:40.458955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319807+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:22:17.319807+0000","last_peered":"2024-09-10T23:22:17.319807+0000","last_clean":"2024-09-10T23:22:17.319807+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:22:17.319807+0000","last_undegraded":"2024-09-10T23:22:17.319807+0000","last_fullsized":"2024-09-10T23:22:17.319807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.432283+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:27.432283+0000","last_peered":"2024-09-10T23:22:27.432283+0000","last_clean":"2024-09-10T23:22:27.432283+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:27.432283+0000","last_undegraded":"2024-09-10T23:22:27.432283+0000","last_fullsized":"2024-09-10T23:22:27.432283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323100+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:22:17.323100+0000","last_peered":"2024-09-10T23:22:17.323100+0000","last_clean":"2024-09-10T23:22:17.323100+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:22:17.323100+0000","last_undegraded":"2024-09-10T23:22:17.323100+0000","last_fullsized":"2024-09-10T23:22:17.323100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:26.422858+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:26.422858+0000","last_peered":"2024-09-10T23:22:26.422858+0000","last_clean":"2024-09-10T23:22:26.422858+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:26.422858+0000","last_undegraded":"2024-09-10T23:22:26.422858+0000","last_fullsized":"2024-09-10T23:22:26.422858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319303+0000","last_change":"2024-09-10T23:22:16.333890+0000","last_active":"2024-09-10T23:22:17.319303+0000","last_peered":"2024-09-10T23:22:17.319303+0000","last_clean":"2024-09-10T23:22:17.319303+0000","last_became_active":"2024-09-10T23:22:16.333579+0000","last_became_peered":"2024-09-10T23:22:16.333579+0000","last_unstale":"2024-09-10T23:22:17.319303+0000","last_undegraded":"2024-09-10T23:22:17.319303+0000","last_fullsized":"2024-09-10T23:22:17.319303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:52.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.464758+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:22:40.464758+0000","last_peered":"2024-09-10T23:22:40.464758+0000","last_clean":"2024-09-10T23:22:40.464758+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:22:40.464758+0000","last_undegraded":"2024-09-10T23:22:40.464758+0000","last_fullsized":"2024-09-10T23:22:40.464758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49601,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":64,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318783+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:22:17.318783+0000","last_peered":"2024-09-10T23:22:17.318783+0000","last_clean":"2024-09-10T23:22:17.318783+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:22:17.318783+0000","last_undegraded":"2024-09-10T23:22:17.318783+0000","last_fullsized":"2024-09-10T23:22:17.318783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:28.439109+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:28.439109+0000","last_peered":"2024-09-10T23:22:28.439109+0000","last_clean":"2024-09-10T23:22:28.439109+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:28.439109+0000","last_undegraded":"2024-09-10T23:22:28.439109+0000","last_fullsized":"2024-09-10T23:22:28.439109+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319035+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:22:17.319035+0000","last_peered":"2024-09-10T23:22:17.319035+0000","last_clean":"2024-09-10T23:22:17.319035+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:22:17.319035+0000","last_undegraded":"2024-09-10T23:22:17.319035+0000","last_fullsized":"2024-09-10T23:22:17.319035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.432920+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:27.432920+0000","last_peered":"2024-09-10T23:22:27.432920+0000","last_clean":"2024-09-10T23:22:27.432920+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:27.432920+0000","last_undegraded":"2024-09-10T23:22:27.432920+0000","last_fullsized":"2024-09-10T23:22:27.432920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319196+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:22:17.319196+0000","last_peered":"2024-09-10T23:22:17.319196+0000","last_clean":"2024-09-10T23:22:17.319196+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:22:17.319196+0000","last_undegraded":"2024-09-10T23:22:17.319196+0000","last_fullsized":"2024-09-10T23:22:17.319196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.458662+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:22:40.458662+0000","last_peered":"2024-09-10T23:22:40.458662+0000","last_clean":"2024-09-10T23:22:40.458662+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:22:40.458662+0000","last_undegraded":"2024-09-10T23:22:40.458662+0000","last_fullsized":"2024-09-10T23:22:40.458662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.317998+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:22:17.317998+0000","last_peered":"2024-09-10T23:22:17.317998+0000","last_clean":"2024-09-10T23:22:17.317998+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:22:17.317998+0000","last_undegraded":"2024-09-10T23:22:17.317998+0000","last_fullsized":"2024-09-10T23:22:17.317998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.430688+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:27.430688+0000","last_peered":"2024-09-10T23:22:27.430688+0000","last_clean":"2024-09-10T23:22:27.430688+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:27.430688+0000","last_undegraded":"2024-09-10T23:22:27.430688+0000","last_fullsized":"2024-09-10T23:22:27.430688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323219+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:22:17.323219+0000","last_peered":"2024-09-10T23:22:17.323219+0000","last_clean":"2024-09-10T23:22:17.323219+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:22:17.323219+0000","last_undegraded":"2024-09-10T23:22:17.323219+0000","last_fullsized":"2024-09-10T23:22:17.323219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.410107+0000","last_change":"2024-09-10T23:22:14.302032+0000","last_active":"2024-09-10T23:22:27.410107+0000","last_peered":"2024-09-10T23:22:27.410107+0000","last_clean":"2024-09-10T23:22:27.410107+0000","last_became_active":"2024-09-10T23:22:14.301644+0000","last_became_peered":"2024-09-10T23:22:14.301644+0000","last_unstale":"2024-09-10T23:22:27.410107+0000","last_undegraded":"2024-09-10T23:22:27.410107+0000","last_fullsized":"2024-09-10T23:22:27.410107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:46.452851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.312057+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:22:17.312057+0000","last_peered":"2024-09-10T23:22:17.312057+0000","last_clean":"2024-09-10T23:22:17.312057+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:22:17.312057+0000","last_undegraded":"2024-09-10T23:22:17.312057+0000","last_fullsized":"2024-09-10T23:22:17.312057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.430021+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:27.430021+0000","last_peered":"2024-09-10T23:22:27.430021+0000","last_clean":"2024-09-10T23:22:27.430021+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:27.430021+0000","last_undegraded":"2024-09-10T23:22:27.430021+0000","last_fullsized":"2024-09-10T23:22:27.430021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319266+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:22:17.319266+0000","last_peered":"2024-09-10T23:22:17.319266+0000","last_clean":"2024-09-10T23:22:17.319266+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:22:17.319266+0000","last_undegraded":"2024-09-10T23:22:17.319266+0000","last_fullsized":"2024-09-10T23:22:17.319266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.431844+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:27.431844+0000","last_peered":"2024-09-10T23:22:27.431844+0000","last_clean":"2024-09-10T23:22:27.431844+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:27.431844+0000","last_undegraded":"2024-09-10T23:22:27.431844+0000","last_fullsized":"2024-09-10T23:22:27.431844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:18.270779+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:22:18.270779+0000","last_peered":"2024-09-10T23:22:18.270779+0000","last_clean":"2024-09-10T23:22:18.270779+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:22:18.270779+0000","last_undegraded":"2024-09-10T23:22:18.270779+0000","last_fullsized":"2024-09-10T23:22:18.270779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:37.456268+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:22:37.456268+0000","last_peered":"2024-09-10T23:22:37.456268+0000","last_clean":"2024-09-10T23:22:37.456268+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:22:37.456268+0000","last_undegraded":"2024-09-10T23:22:37.456268+0000","last_fullsized":"2024-09-10T23:22:37.456268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319051+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:22:17.319051+0000","last_peered":"2024-09-10T23:22:17.319051+0000","last_clean":"2024-09-10T23:22:17.319051+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:22:17.319051+0000","last_undegraded":"2024-09-10T23:22:17.319051+0000","last_fullsized":"2024-09-10T23:22:17.319051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318399+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:17.318399+0000","last_peered":"2024-09-10T23:22:17.318399+0000","last_clean":"2024-09-10T23:22:17.318399+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:17.318399+0000","last_undegraded":"2024-09-10T23:22:17.318399+0000","last_fullsized":"2024-09-10T23:22:17.318399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:28.439125+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:28.439125+0000","last_peered":"2024-09-10T23:22:28.439125+0000","last_clean":"2024-09-10T23:22:28.439125+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:28.439125+0000","last_undegraded":"2024-09-10T23:22:28.439125+0000","last_fullsized":"2024-09-10T23:22:28.439125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320512+0000","last_change":"2024-09-10T23:22:16.322299+0000","last_active":"2024-09-10T23:22:17.320512+0000","last_peered":"2024-09-10T23:22:17.320512+0000","last_clean":"2024-09-10T23:22:17.320512+0000","last_became_active":"2024-09-10T23:22:16.321935+0000","last_became_peered":"2024-09-10T23:22:16.321935+0000","last_unstale":"2024-09-10T23:22:17.320512+0000","last_undegraded":"2024-09-10T23:22:17.320512+0000","last_fullsized":"2024-09-10T23:22:17.320512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:34.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:25.415889+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:25.415889+0000","last_peered":"2024-09-10T23:22:25.415889+0000","last_clean":"2024-09-10T23:22:25.415889+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:25.415889+0000","last_undegraded":"2024-09-10T23:22:25.415889+0000","last_fullsized":"2024-09-10T23:22:25.415889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.317941+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:22:17.317941+0000","last_peered":"2024-09-10T23:22:17.317941+0000","last_clean":"2024-09-10T23:22:17.317941+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:22:17.317941+0000","last_undegraded":"2024-09-10T23:22:17.317941+0000","last_fullsized":"2024-09-10T23:22:17.317941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:36.453237+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:22:36.453237+0000","last_peered":"2024-09-10T23:22:36.453237+0000","last_clean":"2024-09-10T23:22:36.453237+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:22:36.453237+0000","last_undegraded":"2024-09-10T23:22:36.453237+0000","last_fullsized":"2024-09-10T23:22:36.453237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324313+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:22:17.324313+0000","last_peered":"2024-09-10T23:22:17.324313+0000","last_clean":"2024-09-10T23:22:17.324313+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:22:17.324313+0000","last_undegraded":"2024-09-10T23:22:17.324313+0000","last_fullsized":"2024-09-10T23:22:17.324313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:36.453845+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:22:36.453845+0000","last_peered":"2024-09-10T23:22:36.453845+0000","last_clean":"2024-09-10T23:22:36.453845+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:22:36.453845+0000","last_undegraded":"2024-09-10T23:22:36.453845+0000","last_fullsized":"2024-09-10T23:22:36.453845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.310023+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:22:17.310023+0000","last_peered":"2024-09-10T23:22:17.310023+0000","last_clean":"2024-09-10T23:22:17.310023+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:22:17.310023+0000","last_undegraded":"2024-09-10T23:22:17.310023+0000","last_fullsized":"2024-09-10T23:22:17.310023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309293+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:17.309293+0000","last_peered":"2024-09-10T23:22:17.309293+0000","last_clean":"2024-09-10T23:22:17.309293+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:17.309293+0000","last_undegraded":"2024-09-10T23:22:17.309293+0000","last_fullsized":"2024-09-10T23:22:17.309293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.310318+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:22:17.310318+0000","last_peered":"2024-09-10T23:22:17.310318+0000","last_clean":"2024-09-10T23:22:17.310318+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:22:17.310318+0000","last_undegraded":"2024-09-10T23:22:17.310318+0000","last_fullsized":"2024-09-10T23:22:17.310318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.431051+0000","last_change":"2024-09-10T23:22:14.416338+0000","last_active":"2024-09-10T23:22:27.431051+0000","last_peered":"2024-09-10T23:22:27.431051+0000","last_clean":"2024-09-10T23:22:27.431051+0000","last_became_active":"2024-09-10T23:22:14.415907+0000","last_became_peered":"2024-09-10T23:22:14.415907+0000","last_unstale":"2024-09-10T23:22:27.431051+0000","last_undegraded":"2024-09-10T23:22:27.431051+0000","last_fullsized":"2024-09-10T23:22:27.431051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:31.073893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318355+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:22:17.318355+0000","last_peered":"2024-09-10T23:22:17.318355+0000","last_clean":"2024-09-10T23:22:17.318355+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:22:17.318355+0000","last_undegraded":"2024-09-10T23:22:17.318355+0000","last_fullsized":"2024-09-10T23:22:17.318355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'13","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:37.316405+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:37.316405+0000","last_peered":"2024-09-10T23:22:37.316405+0000","last_clean":"2024-09-10T23:22:37.316405+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:37.316405+0000","last_undegraded":"2024-09-10T23:22:37.316405+0000","last_fullsized":"2024-09-10T23:22:37.316405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320864+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:22:17.320864+0000","last_peered":"2024-09-10T23:22:17.320864+0000","last_clean":"2024-09-10T23:22:17.320864+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:22:17.320864+0000","last_undegraded":"2024-09-10T23:22:17.320864+0000","last_fullsized":"2024-09-10T23:22:17.320864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.430822+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:27.430822+0000","last_peered":"2024-09-10T23:22:27.430822+0000","last_clean":"2024-09-10T23:22:27.430822+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:27.430822+0000","last_undegraded":"2024-09-10T23:22:27.430822+0000","last_fullsized":"2024-09-10T23:22:27.430822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323076+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:22:17.323076+0000","last_peered":"2024-09-10T23:22:17.323076+0000","last_clean":"2024-09-10T23:22:17.323076+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:22:17.323076+0000","last_undegraded":"2024-09-10T23:22:17.323076+0000","last_fullsized":"2024-09-10T23:22:17.323076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:24.405682+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:24.405682+0000","last_peered":"2024-09-10T23:22:24.405682+0000","last_clean":"2024-09-10T23:22:24.405682+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:24.405682+0000","last_undegraded":"2024-09-10T23:22:24.405682+0000","last_fullsized":"2024-09-10T23:22:24.405682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318273+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:22:17.318273+0000","last_peered":"2024-09-10T23:22:17.318273+0000","last_clean":"2024-09-10T23:22:17.318273+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:22:17.318273+0000","last_undegraded":"2024-09-10T23:22:17.318273+0000","last_fullsized":"2024-09-10T23:22:17.318273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.429955+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:27.429955+0000","last_peered":"2024-09-10T23:22:27.429955+0000","last_clean":"2024-09-10T23:22:27.429955+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:27.429955+0000","last_undegraded":"2024-09-10T23:22:27.429955+0000","last_fullsized":"2024-09-10T23:22:27.429955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311740+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:22:17.311740+0000","last_peered":"2024-09-10T23:22:17.311740+0000","last_clean":"2024-09-10T23:22:17.311740+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:22:17.311740+0000","last_undegraded":"2024-09-10T23:22:17.311740+0000","last_fullsized":"2024-09-10T23:22:17.311740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:26.422202+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:26.422202+0000","last_peered":"2024-09-10T23:22:26.422202+0000","last_clean":"2024-09-10T23:22:26.422202+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:26.422202+0000","last_undegraded":"2024-09-10T23:22:26.422202+0000","last_fullsized":"2024-09-10T23:22:26.422202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320615+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:22:17.320615+0000","last_peered":"2024-09-10T23:22:17.320615+0000","last_clean":"2024-09-10T23:22:17.320615+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:22:17.320615+0000","last_undegraded":"2024-09-10T23:22:17.320615+0000","last_fullsized":"2024-09-10T23:22:17.320615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:24.404706+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:24.404706+0000","last_peered":"2024-09-10T23:22:24.404706+0000","last_clean":"2024-09-10T23:22:24.404706+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:24.404706+0000","last_undegraded":"2024-09-10T23:22:24.404706+0000","last_fullsized":"2024-09-10T23:22:24.404706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318381+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:22:17.318381+0000","last_peered":"2024-09-10T23:22:17.318381+0000","last_clean":"2024-09-10T23:22:17.318381+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:22:17.318381+0000","last_undegraded":"2024-09-10T23:22:17.318381+0000","last_fullsized":"2024-09-10T23:22:17.318381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324964+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:22:17.324964+0000","last_peered":"2024-09-10T23:22:17.324964+0000","last_clean":"2024-09-10T23:22:17.324964+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:22:17.324964+0000","last_undegraded":"2024-09-10T23:22:17.324964+0000","last_fullsized":"2024-09-10T23:22:17.324964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.433162+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:27.433162+0000","last_peered":"2024-09-10T23:22:27.433162+0000","last_clean":"2024-09-10T23:22:27.433162+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:27.433162+0000","last_undegraded":"2024-09-10T23:22:27.433162+0000","last_fullsized":"2024-09-10T23:22:27.433162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318575+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:22:17.318575+0000","last_peered":"2024-09-10T23:22:17.318575+0000","last_clean":"2024-09-10T23:22:17.318575+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:22:17.318575+0000","last_undegraded":"2024-09-10T23:22:17.318575+0000","last_fullsized":"2024-09-10T23:22:17.318575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:28.438847+0000","last_change":"2024-09-10T23:22:14.303065+0000","last_active":"2024-09-10T23:22:28.438847+0000","last_peered":"2024-09-10T23:22:28.438847+0000","last_clean":"2024-09-10T23:22:28.438847+0000","last_became_active":"2024-09-10T23:22:14.302139+0000","last_became_peered":"2024-09-10T23:22:14.302139+0000","last_unstale":"2024-09-10T23:22:28.438847+0000","last_undegraded":"2024-09-10T23:22:28.438847+0000","last_fullsized":"2024-09-10T23:22:28.438847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:37.482300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322868+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:22:17.322868+0000","last_peered":"2024-09-10T23:22:17.322868+0000","last_clean":"2024-09-10T23:22:17.322868+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:22:17.322868+0000","last_undegraded":"2024-09-10T23:22:17.322868+0000","last_fullsized":"2024-09-10T23:22:17.322868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323808+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:17.323808+0000","last_peered":"2024-09-10T23:22:17.323808+0000","last_clean":"2024-09-10T23:22:17.323808+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:17.323808+0000","last_undegraded":"2024-09-10T23:22:17.323808+0000","last_fullsized":"2024-09-10T23:22:17.323808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320868+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:22:17.320868+0000","last_peered":"2024-09-10T23:22:17.320868+0000","last_clean":"2024-09-10T23:22:17.320868+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:22:17.320868+0000","last_undegraded":"2024-09-10T23:22:17.320868+0000","last_fullsized":"2024-09-10T23:22:17.320868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":44,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:37.454452+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:22:37.454452+0000","last_peered":"2024-09-10T23:22:37.454452+0000","last_clean":"2024-09-10T23:22:37.454452+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:22:37.454452+0000","last_undegraded":"2024-09-10T23:22:37.454452+0000","last_fullsized":"2024-09-10T23:22:37.454452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56805,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":161,"num_read_kb":143,"num_write":236,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":170415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":385614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":1025853,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":385153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":385531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":978049,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":384870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":977727,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":819200,"data_stored":384731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":384695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":435384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":386600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:22:43.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:22:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:43.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:43 smithi002 ceph-mon[31150]: pgmap v301: 97 pgs: 97 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 16 op/s 2024-09-10T23:22:43.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:43 smithi002 ceph-mon[31150]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:22:43.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:43 smithi177 ceph-mon[35760]: pgmap v301: 97 pgs: 97 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 16 op/s 2024-09-10T23:22:43.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:43 smithi177 ceph-mon[35760]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:22:43.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:43 smithi154 ceph-mon[35136]: pgmap v301: 97 pgs: 97 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 16 op/s 2024-09-10T23:22:43.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:43 smithi154 ceph-mon[35136]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:22:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 -- 172.21.15.2:0/4033957998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 msgr2=0x7f49dc10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 --2- 172.21.15.2:0/4033957998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc10f640 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009900 tx=0x7f49d402a410 comp rx=0 tx=0).stop 2024-09-10T23:22:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 -- 172.21.15.2:0/4033957998 shutdown_connections 2024-09-10T23:22:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 --2- 172.21.15.2:0/4033957998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc10f640 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 --2- 172.21.15.2:0/4033957998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49dc10a920 0x7f49dc10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 --2- 172.21.15.2:0/4033957998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49dc101810 0x7f49dc101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 -- 172.21.15.2:0/4033957998 >> 172.21.15.2:0/4033957998 conn(0x7f49dc076f50 msgr2=0x7f49dc077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 -- 172.21.15.2:0/4033957998 shutdown_connections 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 -- 172.21.15.2:0/4033957998 wait complete. 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.019+0000 7f49e1686640 1 Processor -- start 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 -- start start 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49dc101810 0x7f49dc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49dc10a920 0x7f49dc199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc112d90 con 0x7f49dc10d250 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc112c10 con 0x7f49dc101810 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49e1686640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc112f10 con 0x7f49dc10a920 2024-09-10T23:22:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc19eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57412/0 (socket says 172.21.15.2:57412) 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 -- 172.21.15.2:0/1573584408 learned_addr learned my addr 172.21.15.2:0/1573584408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49da7fc640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49dc10a920 0x7f49dc199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 -- 172.21.15.2:0/1573584408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49dc10a920 msgr2=0x7f49dc199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49dc10a920 0x7f49dc199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 -- 172.21.15.2:0/1573584408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49dc101810 msgr2=0x7f49dc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49dc101810 0x7f49dc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.020+0000 7f49db7fe640 1 -- 172.21.15.2:0/1573584408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc19f2b0 con 0x7f49dc10d250 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.021+0000 7f49db7fe640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc19eae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49d4004770 tx=0x7f49d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.021+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d403f030 con 0x7f49dc10d250 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.021+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d4003aa0 con 0x7f49dc10d250 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.021+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc19f540 con 0x7f49dc10d250 2024-09-10T23:22:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.021+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4035070 con 0x7f49dc10d250 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.021+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc1a5c60 con 0x7f49dc10d250 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.022+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49dc101bf0 con 0x7f49dc10d250 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.023+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f49d403bb10 con 0x7f49dc10d250 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.024+0000 7f49c3fff640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f49c40b53f0 0x7f49c40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.024+0000 7f49daffd640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f49c40b53f0 0x7f49c40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.024+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f49d4106880 con 0x7f49dc10d250 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.025+0000 7f49daffd640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f49c40b53f0 0x7f49c40b78b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005fd0 tx=0x7f49cc009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.027+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49d40cd790 con 0x7f49dc10d250 2024-09-10T23:22:44.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.210+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49dc100cb0 con 0x7f49c40b53f0 2024-09-10T23:22:44.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.214+0000 7f49c3fff640 1 -- 172.21.15.2:0/1573584408 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258902 (secure 0 0 0) 0x7f49dc100cb0 con 0x7f49c40b53f0 2024-09-10T23:22:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:44.220 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:22:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f49c40b53f0 msgr2=0x7f49c40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f49c40b53f0 0x7f49c40b78b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005fd0 tx=0x7f49cc009710 comp rx=0 tx=0).stop 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 msgr2=0x7f49dc19eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc19eae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49d4004770 tx=0x7f49d4004270 comp rx=0 tx=0).stop 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 shutdown_connections 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f49c40b53f0 0x7f49c40b78b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49dc10d250 0x7f49dc19eae0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49dc10a920 0x7f49dc199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 --2- 172.21.15.2:0/1573584408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49dc101810 0x7f49dc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 >> 172.21.15.2:0/1573584408 conn(0x7f49dc076f50 msgr2=0x7f49dc1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 shutdown_connections 2024-09-10T23:22:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:44.217+0000 7f49e1686640 1 -- 172.21.15.2:0/1573584408 wait complete. 2024-09-10T23:22:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-09-10T23:22:42.221633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647407,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":237,"num_read_kb":207,"num_write":361,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375924,"kb_used_data":10036,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565900,"statfs":{"total":1151940427776,"available":1151555481600,"internally_reserved":0,"allocated":10276864,"data_stored":6542055,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49129,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":49,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003243"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.312057+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:22:17.312057+0000","last_peered":"2024-09-10T23:22:17.312057+0000","last_clean":"2024-09-10T23:22:17.312057+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:22:17.312057+0000","last_undegraded":"2024-09-10T23:22:17.312057+0000","last_fullsized":"2024-09-10T23:22:17.312057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322864+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:22:17.322864+0000","last_peered":"2024-09-10T23:22:17.322864+0000","last_clean":"2024-09-10T23:22:17.322864+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:22:17.322864+0000","last_undegraded":"2024-09-10T23:22:17.322864+0000","last_fullsized":"2024-09-10T23:22:17.322864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323009+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:22:17.323009+0000","last_peered":"2024-09-10T23:22:17.323009+0000","last_clean":"2024-09-10T23:22:17.323009+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:22:17.323009+0000","last_undegraded":"2024-09-10T23:22:17.323009+0000","last_fullsized":"2024-09-10T23:22:17.323009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322538+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:22:17.322538+0000","last_peered":"2024-09-10T23:22:17.322538+0000","last_clean":"2024-09-10T23:22:17.322538+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:22:17.322538+0000","last_undegraded":"2024-09-10T23:22:17.322538+0000","last_fullsized":"2024-09-10T23:22:17.322538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318359+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:22:17.318359+0000","last_peered":"2024-09-10T23:22:17.318359+0000","last_clean":"2024-09-10T23:22:17.318359+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:22:17.318359+0000","last_undegraded":"2024-09-10T23:22:17.318359+0000","last_fullsized":"2024-09-10T23:22:17.318359+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309782+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:22:17.309782+0000","last_peered":"2024-09-10T23:22:17.309782+0000","last_clean":"2024-09-10T23:22:17.309782+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:22:17.309782+0000","last_undegraded":"2024-09-10T23:22:17.309782+0000","last_fullsized":"2024-09-10T23:22:17.309782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318007+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:22:17.318007+0000","last_peered":"2024-09-10T23:22:17.318007+0000","last_clean":"2024-09-10T23:22:17.318007+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:22:17.318007+0000","last_undegraded":"2024-09-10T23:22:17.318007+0000","last_fullsized":"2024-09-10T23:22:17.318007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320314+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:22:17.320314+0000","last_peered":"2024-09-10T23:22:17.320314+0000","last_clean":"2024-09-10T23:22:17.320314+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:22:17.320314+0000","last_undegraded":"2024-09-10T23:22:17.320314+0000","last_fullsized":"2024-09-10T23:22:17.320314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320087+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:22:17.320087+0000","last_peered":"2024-09-10T23:22:17.320087+0000","last_clean":"2024-09-10T23:22:17.320087+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:22:17.320087+0000","last_undegraded":"2024-09-10T23:22:17.320087+0000","last_fullsized":"2024-09-10T23:22:17.320087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.310306+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:22:17.310306+0000","last_peered":"2024-09-10T23:22:17.310306+0000","last_clean":"2024-09-10T23:22:17.310306+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:22:17.310306+0000","last_undegraded":"2024-09-10T23:22:17.310306+0000","last_fullsized":"2024-09-10T23:22:17.310306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318802+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:22:17.318802+0000","last_peered":"2024-09-10T23:22:17.318802+0000","last_clean":"2024-09-10T23:22:17.318802+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:22:17.318802+0000","last_undegraded":"2024-09-10T23:22:17.318802+0000","last_fullsized":"2024-09-10T23:22:17.318802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322489+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:22:17.322489+0000","last_peered":"2024-09-10T23:22:17.322489+0000","last_clean":"2024-09-10T23:22:17.322489+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:22:17.322489+0000","last_undegraded":"2024-09-10T23:22:17.322489+0000","last_fullsized":"2024-09-10T23:22:17.322489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318267+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:22:17.318267+0000","last_peered":"2024-09-10T23:22:17.318267+0000","last_clean":"2024-09-10T23:22:17.318267+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:22:17.318267+0000","last_undegraded":"2024-09-10T23:22:17.318267+0000","last_fullsized":"2024-09-10T23:22:17.318267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322554+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:22:17.322554+0000","last_peered":"2024-09-10T23:22:17.322554+0000","last_clean":"2024-09-10T23:22:17.322554+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:22:17.322554+0000","last_undegraded":"2024-09-10T23:22:17.322554+0000","last_fullsized":"2024-09-10T23:22:17.322554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322677+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:22:17.322677+0000","last_peered":"2024-09-10T23:22:17.322677+0000","last_clean":"2024-09-10T23:22:17.322677+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:22:17.322677+0000","last_undegraded":"2024-09-10T23:22:17.322677+0000","last_fullsized":"2024-09-10T23:22:17.322677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318791+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:22:17.318791+0000","last_peered":"2024-09-10T23:22:17.318791+0000","last_clean":"2024-09-10T23:22:17.318791+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:22:17.318791+0000","last_undegraded":"2024-09-10T23:22:17.318791+0000","last_fullsized":"2024-09-10T23:22:17.318791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.312058+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:22:17.312058+0000","last_peered":"2024-09-10T23:22:17.312058+0000","last_clean":"2024-09-10T23:22:17.312058+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:22:17.312058+0000","last_undegraded":"2024-09-10T23:22:17.312058+0000","last_fullsized":"2024-09-10T23:22:17.312058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309473+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:22:17.309473+0000","last_peered":"2024-09-10T23:22:17.309473+0000","last_clean":"2024-09-10T23:22:17.309473+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:22:17.309473+0000","last_undegraded":"2024-09-10T23:22:17.309473+0000","last_fullsized":"2024-09-10T23:22:17.309473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320381+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:22:17.320381+0000","last_peered":"2024-09-10T23:22:17.320381+0000","last_clean":"2024-09-10T23:22:17.320381+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:22:17.320381+0000","last_undegraded":"2024-09-10T23:22:17.320381+0000","last_fullsized":"2024-09-10T23:22:17.320381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311863+0000","last_change":"2024-09-10T23:22:16.329759+0000","last_active":"2024-09-10T23:22:17.311863+0000","last_peered":"2024-09-10T23:22:17.311863+0000","last_clean":"2024-09-10T23:22:17.311863+0000","last_became_active":"2024-09-10T23:22:16.329438+0000","last_became_peered":"2024-09-10T23:22:16.329438+0000","last_unstale":"2024-09-10T23:22:17.311863+0000","last_undegraded":"2024-09-10T23:22:17.311863+0000","last_fullsized":"2024-09-10T23:22:17.311863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.587133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318851+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:22:17.318851+0000","last_peered":"2024-09-10T23:22:17.318851+0000","last_clean":"2024-09-10T23:22:17.318851+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:22:17.318851+0000","last_undegraded":"2024-09-10T23:22:17.318851+0000","last_fullsized":"2024-09-10T23:22:17.318851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318557+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:22:17.318557+0000","last_peered":"2024-09-10T23:22:17.318557+0000","last_clean":"2024-09-10T23:22:17.318557+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:22:17.318557+0000","last_undegraded":"2024-09-10T23:22:17.318557+0000","last_fullsized":"2024-09-10T23:22:17.318557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320726+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:22:17.320726+0000","last_peered":"2024-09-10T23:22:17.320726+0000","last_clean":"2024-09-10T23:22:17.320726+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:22:17.320726+0000","last_undegraded":"2024-09-10T23:22:17.320726+0000","last_fullsized":"2024-09-10T23:22:17.320726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324139+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:22:17.324139+0000","last_peered":"2024-09-10T23:22:17.324139+0000","last_clean":"2024-09-10T23:22:17.324139+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:22:17.324139+0000","last_undegraded":"2024-09-10T23:22:17.324139+0000","last_fullsized":"2024-09-10T23:22:17.324139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320762+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:22:17.320762+0000","last_peered":"2024-09-10T23:22:17.320762+0000","last_clean":"2024-09-10T23:22:17.320762+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:22:17.320762+0000","last_undegraded":"2024-09-10T23:22:17.320762+0000","last_fullsized":"2024-09-10T23:22:17.320762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323583+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:22:17.323583+0000","last_peered":"2024-09-10T23:22:17.323583+0000","last_clean":"2024-09-10T23:22:17.323583+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:22:17.323583+0000","last_undegraded":"2024-09-10T23:22:17.323583+0000","last_fullsized":"2024-09-10T23:22:17.323583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311997+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:22:17.311997+0000","last_peered":"2024-09-10T23:22:17.311997+0000","last_clean":"2024-09-10T23:22:17.311997+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:22:17.311997+0000","last_undegraded":"2024-09-10T23:22:17.311997+0000","last_fullsized":"2024-09-10T23:22:17.311997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318143+0000","last_change":"2024-09-10T23:22:16.323608+0000","last_active":"2024-09-10T23:22:17.318143+0000","last_peered":"2024-09-10T23:22:17.318143+0000","last_clean":"2024-09-10T23:22:17.318143+0000","last_became_active":"2024-09-10T23:22:16.323327+0000","last_became_peered":"2024-09-10T23:22:16.323327+0000","last_unstale":"2024-09-10T23:22:17.318143+0000","last_undegraded":"2024-09-10T23:22:17.318143+0000","last_fullsized":"2024-09-10T23:22:17.318143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:27.654797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322679+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:22:17.322679+0000","last_peered":"2024-09-10T23:22:17.322679+0000","last_clean":"2024-09-10T23:22:17.322679+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:22:17.322679+0000","last_undegraded":"2024-09-10T23:22:17.322679+0000","last_fullsized":"2024-09-10T23:22:17.322679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319244+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:22:17.319244+0000","last_peered":"2024-09-10T23:22:17.319244+0000","last_clean":"2024-09-10T23:22:17.319244+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:22:17.319244+0000","last_undegraded":"2024-09-10T23:22:17.319244+0000","last_fullsized":"2024-09-10T23:22:17.319244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320282+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:22:17.320282+0000","last_peered":"2024-09-10T23:22:17.320282+0000","last_clean":"2024-09-10T23:22:17.320282+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:22:17.320282+0000","last_undegraded":"2024-09-10T23:22:17.320282+0000","last_fullsized":"2024-09-10T23:22:17.320282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311766+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:22:17.311766+0000","last_peered":"2024-09-10T23:22:17.311766+0000","last_clean":"2024-09-10T23:22:17.311766+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:22:17.311766+0000","last_undegraded":"2024-09-10T23:22:17.311766+0000","last_fullsized":"2024-09-10T23:22:17.311766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318544+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:22:17.318544+0000","last_peered":"2024-09-10T23:22:17.318544+0000","last_clean":"2024-09-10T23:22:17.318544+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:22:17.318544+0000","last_undegraded":"2024-09-10T23:22:17.318544+0000","last_fullsized":"2024-09-10T23:22:17.318544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.459507+0000","last_change":"2024-09-10T23:22:14.301534+0000","last_active":"2024-09-10T23:22:40.459507+0000","last_peered":"2024-09-10T23:22:40.459507+0000","last_clean":"2024-09-10T23:22:40.459507+0000","last_became_active":"2024-09-10T23:22:14.301145+0000","last_became_peered":"2024-09-10T23:22:14.301145+0000","last_unstale":"2024-09-10T23:22:40.459507+0000","last_undegraded":"2024-09-10T23:22:40.459507+0000","last_fullsized":"2024-09-10T23:22:40.459507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:41.656962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324082+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:22:17.324082+0000","last_peered":"2024-09-10T23:22:17.324082+0000","last_clean":"2024-09-10T23:22:17.324082+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:22:17.324082+0000","last_undegraded":"2024-09-10T23:22:17.324082+0000","last_fullsized":"2024-09-10T23:22:17.324082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:26.423330+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:26.423330+0000","last_peered":"2024-09-10T23:22:26.423330+0000","last_clean":"2024-09-10T23:22:26.423330+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:26.423330+0000","last_undegraded":"2024-09-10T23:22:26.423330+0000","last_fullsized":"2024-09-10T23:22:26.423330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:25.415185+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:25.415185+0000","last_peered":"2024-09-10T23:22:25.415185+0000","last_clean":"2024-09-10T23:22:25.415185+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:25.415185+0000","last_undegraded":"2024-09-10T23:22:25.415185+0000","last_fullsized":"2024-09-10T23:22:25.415185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320392+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:22:17.320392+0000","last_peered":"2024-09-10T23:22:17.320392+0000","last_clean":"2024-09-10T23:22:17.320392+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:22:17.320392+0000","last_undegraded":"2024-09-10T23:22:17.320392+0000","last_fullsized":"2024-09-10T23:22:17.320392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.433106+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:27.433106+0000","last_peered":"2024-09-10T23:22:27.433106+0000","last_clean":"2024-09-10T23:22:27.433106+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:27.433106+0000","last_undegraded":"2024-09-10T23:22:27.433106+0000","last_fullsized":"2024-09-10T23:22:27.433106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309118+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:22:17.309118+0000","last_peered":"2024-09-10T23:22:17.309118+0000","last_clean":"2024-09-10T23:22:17.309118+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:22:17.309118+0000","last_undegraded":"2024-09-10T23:22:17.309118+0000","last_fullsized":"2024-09-10T23:22:17.309118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.458955+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:22:40.458955+0000","last_peered":"2024-09-10T23:22:40.458955+0000","last_clean":"2024-09-10T23:22:40.458955+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:22:40.458955+0000","last_undegraded":"2024-09-10T23:22:40.458955+0000","last_fullsized":"2024-09-10T23:22:40.458955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319807+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:22:17.319807+0000","last_peered":"2024-09-10T23:22:17.319807+0000","last_clean":"2024-09-10T23:22:17.319807+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:22:17.319807+0000","last_undegraded":"2024-09-10T23:22:17.319807+0000","last_fullsized":"2024-09-10T23:22:17.319807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.432283+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:27.432283+0000","last_peered":"2024-09-10T23:22:27.432283+0000","last_clean":"2024-09-10T23:22:27.432283+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:27.432283+0000","last_undegraded":"2024-09-10T23:22:27.432283+0000","last_fullsized":"2024-09-10T23:22:27.432283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323100+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:22:17.323100+0000","last_peered":"2024-09-10T23:22:17.323100+0000","last_clean":"2024-09-10T23:22:17.323100+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:22:17.323100+0000","last_undegraded":"2024-09-10T23:22:17.323100+0000","last_fullsized":"2024-09-10T23:22:17.323100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:26.422858+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:26.422858+0000","last_peered":"2024-09-10T23:22:26.422858+0000","last_clean":"2024-09-10T23:22:26.422858+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:26.422858+0000","last_undegraded":"2024-09-10T23:22:26.422858+0000","last_fullsized":"2024-09-10T23:22:26.422858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319303+0000","last_change":"2024-09-10T23:22:16.333890+0000","last_active":"2024-09-10T23:22:17.319303+0000","last_peered":"2024-09-10T23:22:17.319303+0000","last_clean":"2024-09-10T23:22:17.319303+0000","last_became_active":"2024-09-10T23:22:16.333579+0000","last_became_peered":"2024-09-10T23:22:16.333579+0000","last_unstale":"2024-09-10T23:22:17.319303+0000","last_undegraded":"2024-09-10T23:22:17.319303+0000","last_fullsized":"2024-09-10T23:22:17.319303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:52.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.464758+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:22:40.464758+0000","last_peered":"2024-09-10T23:22:40.464758+0000","last_clean":"2024-09-10T23:22:40.464758+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:22:40.464758+0000","last_undegraded":"2024-09-10T23:22:40.464758+0000","last_fullsized":"2024-09-10T23:22:40.464758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49601,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":64,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318783+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:22:17.318783+0000","last_peered":"2024-09-10T23:22:17.318783+0000","last_clean":"2024-09-10T23:22:17.318783+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:22:17.318783+0000","last_undegraded":"2024-09-10T23:22:17.318783+0000","last_fullsized":"2024-09-10T23:22:17.318783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:28.439109+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:28.439109+0000","last_peered":"2024-09-10T23:22:28.439109+0000","last_clean":"2024-09-10T23:22:28.439109+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:28.439109+0000","last_undegraded":"2024-09-10T23:22:28.439109+0000","last_fullsized":"2024-09-10T23:22:28.439109+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319035+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:22:17.319035+0000","last_peered":"2024-09-10T23:22:17.319035+0000","last_clean":"2024-09-10T23:22:17.319035+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:22:17.319035+0000","last_undegraded":"2024-09-10T23:22:17.319035+0000","last_fullsized":"2024-09-10T23:22:17.319035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.432920+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:27.432920+0000","last_peered":"2024-09-10T23:22:27.432920+0000","last_clean":"2024-09-10T23:22:27.432920+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:27.432920+0000","last_undegraded":"2024-09-10T23:22:27.432920+0000","last_fullsized":"2024-09-10T23:22:27.432920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319196+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:22:17.319196+0000","last_peered":"2024-09-10T23:22:17.319196+0000","last_clean":"2024-09-10T23:22:17.319196+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:22:17.319196+0000","last_undegraded":"2024-09-10T23:22:17.319196+0000","last_fullsized":"2024-09-10T23:22:17.319196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:40.458662+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:22:40.458662+0000","last_peered":"2024-09-10T23:22:40.458662+0000","last_clean":"2024-09-10T23:22:40.458662+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:22:40.458662+0000","last_undegraded":"2024-09-10T23:22:40.458662+0000","last_fullsized":"2024-09-10T23:22:40.458662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.317998+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:22:17.317998+0000","last_peered":"2024-09-10T23:22:17.317998+0000","last_clean":"2024-09-10T23:22:17.317998+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:22:17.317998+0000","last_undegraded":"2024-09-10T23:22:17.317998+0000","last_fullsized":"2024-09-10T23:22:17.317998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.430688+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:27.430688+0000","last_peered":"2024-09-10T23:22:27.430688+0000","last_clean":"2024-09-10T23:22:27.430688+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:27.430688+0000","last_undegraded":"2024-09-10T23:22:27.430688+0000","last_fullsized":"2024-09-10T23:22:27.430688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323219+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:22:17.323219+0000","last_peered":"2024-09-10T23:22:17.323219+0000","last_clean":"2024-09-10T23:22:17.323219+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:22:17.323219+0000","last_undegraded":"2024-09-10T23:22:17.323219+0000","last_fullsized":"2024-09-10T23:22:17.323219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.410107+0000","last_change":"2024-09-10T23:22:14.302032+0000","last_active":"2024-09-10T23:22:27.410107+0000","last_peered":"2024-09-10T23:22:27.410107+0000","last_clean":"2024-09-10T23:22:27.410107+0000","last_became_active":"2024-09-10T23:22:14.301644+0000","last_became_peered":"2024-09-10T23:22:14.301644+0000","last_unstale":"2024-09-10T23:22:27.410107+0000","last_undegraded":"2024-09-10T23:22:27.410107+0000","last_fullsized":"2024-09-10T23:22:27.410107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:46.452851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.312057+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:22:17.312057+0000","last_peered":"2024-09-10T23:22:17.312057+0000","last_clean":"2024-09-10T23:22:17.312057+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:22:17.312057+0000","last_undegraded":"2024-09-10T23:22:17.312057+0000","last_fullsized":"2024-09-10T23:22:17.312057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.430021+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:27.430021+0000","last_peered":"2024-09-10T23:22:27.430021+0000","last_clean":"2024-09-10T23:22:27.430021+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:27.430021+0000","last_undegraded":"2024-09-10T23:22:27.430021+0000","last_fullsized":"2024-09-10T23:22:27.430021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319266+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:22:17.319266+0000","last_peered":"2024-09-10T23:22:17.319266+0000","last_clean":"2024-09-10T23:22:17.319266+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:22:17.319266+0000","last_undegraded":"2024-09-10T23:22:17.319266+0000","last_fullsized":"2024-09-10T23:22:17.319266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.431844+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:27.431844+0000","last_peered":"2024-09-10T23:22:27.431844+0000","last_clean":"2024-09-10T23:22:27.431844+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:27.431844+0000","last_undegraded":"2024-09-10T23:22:27.431844+0000","last_fullsized":"2024-09-10T23:22:27.431844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:18.270779+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:22:18.270779+0000","last_peered":"2024-09-10T23:22:18.270779+0000","last_clean":"2024-09-10T23:22:18.270779+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:22:18.270779+0000","last_undegraded":"2024-09-10T23:22:18.270779+0000","last_fullsized":"2024-09-10T23:22:18.270779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:37.456268+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:22:37.456268+0000","last_peered":"2024-09-10T23:22:37.456268+0000","last_clean":"2024-09-10T23:22:37.456268+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:22:37.456268+0000","last_undegraded":"2024-09-10T23:22:37.456268+0000","last_fullsized":"2024-09-10T23:22:37.456268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.319051+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:22:17.319051+0000","last_peered":"2024-09-10T23:22:17.319051+0000","last_clean":"2024-09-10T23:22:17.319051+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:22:17.319051+0000","last_undegraded":"2024-09-10T23:22:17.319051+0000","last_fullsized":"2024-09-10T23:22:17.319051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318399+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:17.318399+0000","last_peered":"2024-09-10T23:22:17.318399+0000","last_clean":"2024-09-10T23:22:17.318399+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:17.318399+0000","last_undegraded":"2024-09-10T23:22:17.318399+0000","last_fullsized":"2024-09-10T23:22:17.318399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:28.439125+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:28.439125+0000","last_peered":"2024-09-10T23:22:28.439125+0000","last_clean":"2024-09-10T23:22:28.439125+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:28.439125+0000","last_undegraded":"2024-09-10T23:22:28.439125+0000","last_fullsized":"2024-09-10T23:22:28.439125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320512+0000","last_change":"2024-09-10T23:22:16.322299+0000","last_active":"2024-09-10T23:22:17.320512+0000","last_peered":"2024-09-10T23:22:17.320512+0000","last_clean":"2024-09-10T23:22:17.320512+0000","last_became_active":"2024-09-10T23:22:16.321935+0000","last_became_peered":"2024-09-10T23:22:16.321935+0000","last_unstale":"2024-09-10T23:22:17.320512+0000","last_undegraded":"2024-09-10T23:22:17.320512+0000","last_fullsized":"2024-09-10T23:22:17.320512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:34.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:25.415889+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:25.415889+0000","last_peered":"2024-09-10T23:22:25.415889+0000","last_clean":"2024-09-10T23:22:25.415889+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:25.415889+0000","last_undegraded":"2024-09-10T23:22:25.415889+0000","last_fullsized":"2024-09-10T23:22:25.415889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.317941+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:22:17.317941+0000","last_peered":"2024-09-10T23:22:17.317941+0000","last_clean":"2024-09-10T23:22:17.317941+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:22:17.317941+0000","last_undegraded":"2024-09-10T23:22:17.317941+0000","last_fullsized":"2024-09-10T23:22:17.317941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:36.453237+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:22:36.453237+0000","last_peered":"2024-09-10T23:22:36.453237+0000","last_clean":"2024-09-10T23:22:36.453237+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:22:36.453237+0000","last_undegraded":"2024-09-10T23:22:36.453237+0000","last_fullsized":"2024-09-10T23:22:36.453237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324313+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:22:17.324313+0000","last_peered":"2024-09-10T23:22:17.324313+0000","last_clean":"2024-09-10T23:22:17.324313+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:22:17.324313+0000","last_undegraded":"2024-09-10T23:22:17.324313+0000","last_fullsized":"2024-09-10T23:22:17.324313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:36.453845+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:22:36.453845+0000","last_peered":"2024-09-10T23:22:36.453845+0000","last_clean":"2024-09-10T23:22:36.453845+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:22:36.453845+0000","last_undegraded":"2024-09-10T23:22:36.453845+0000","last_fullsized":"2024-09-10T23:22:36.453845+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.310023+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:22:17.310023+0000","last_peered":"2024-09-10T23:22:17.310023+0000","last_clean":"2024-09-10T23:22:17.310023+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:22:17.310023+0000","last_undegraded":"2024-09-10T23:22:17.310023+0000","last_fullsized":"2024-09-10T23:22:17.310023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.309293+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:17.309293+0000","last_peered":"2024-09-10T23:22:17.309293+0000","last_clean":"2024-09-10T23:22:17.309293+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:17.309293+0000","last_undegraded":"2024-09-10T23:22:17.309293+0000","last_fullsized":"2024-09-10T23:22:17.309293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.310318+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:22:17.310318+0000","last_peered":"2024-09-10T23:22:17.310318+0000","last_clean":"2024-09-10T23:22:17.310318+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:22:17.310318+0000","last_undegraded":"2024-09-10T23:22:17.310318+0000","last_fullsized":"2024-09-10T23:22:17.310318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.431051+0000","last_change":"2024-09-10T23:22:14.416338+0000","last_active":"2024-09-10T23:22:27.431051+0000","last_peered":"2024-09-10T23:22:27.431051+0000","last_clean":"2024-09-10T23:22:27.431051+0000","last_became_active":"2024-09-10T23:22:14.415907+0000","last_became_peered":"2024-09-10T23:22:14.415907+0000","last_unstale":"2024-09-10T23:22:27.431051+0000","last_undegraded":"2024-09-10T23:22:27.431051+0000","last_fullsized":"2024-09-10T23:22:27.431051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:31.073893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318355+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:22:17.318355+0000","last_peered":"2024-09-10T23:22:17.318355+0000","last_clean":"2024-09-10T23:22:17.318355+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:22:17.318355+0000","last_undegraded":"2024-09-10T23:22:17.318355+0000","last_fullsized":"2024-09-10T23:22:17.318355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'13","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:37.316405+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:37.316405+0000","last_peered":"2024-09-10T23:22:37.316405+0000","last_clean":"2024-09-10T23:22:37.316405+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:37.316405+0000","last_undegraded":"2024-09-10T23:22:37.316405+0000","last_fullsized":"2024-09-10T23:22:37.316405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320864+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:22:17.320864+0000","last_peered":"2024-09-10T23:22:17.320864+0000","last_clean":"2024-09-10T23:22:17.320864+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:22:17.320864+0000","last_undegraded":"2024-09-10T23:22:17.320864+0000","last_fullsized":"2024-09-10T23:22:17.320864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.430822+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:27.430822+0000","last_peered":"2024-09-10T23:22:27.430822+0000","last_clean":"2024-09-10T23:22:27.430822+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:27.430822+0000","last_undegraded":"2024-09-10T23:22:27.430822+0000","last_fullsized":"2024-09-10T23:22:27.430822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323076+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:22:17.323076+0000","last_peered":"2024-09-10T23:22:17.323076+0000","last_clean":"2024-09-10T23:22:17.323076+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:22:17.323076+0000","last_undegraded":"2024-09-10T23:22:17.323076+0000","last_fullsized":"2024-09-10T23:22:17.323076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:24.405682+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:24.405682+0000","last_peered":"2024-09-10T23:22:24.405682+0000","last_clean":"2024-09-10T23:22:24.405682+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:24.405682+0000","last_undegraded":"2024-09-10T23:22:24.405682+0000","last_fullsized":"2024-09-10T23:22:24.405682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318273+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:22:17.318273+0000","last_peered":"2024-09-10T23:22:17.318273+0000","last_clean":"2024-09-10T23:22:17.318273+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:22:17.318273+0000","last_undegraded":"2024-09-10T23:22:17.318273+0000","last_fullsized":"2024-09-10T23:22:17.318273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.429955+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:27.429955+0000","last_peered":"2024-09-10T23:22:27.429955+0000","last_clean":"2024-09-10T23:22:27.429955+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:27.429955+0000","last_undegraded":"2024-09-10T23:22:27.429955+0000","last_fullsized":"2024-09-10T23:22:27.429955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.311740+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:22:17.311740+0000","last_peered":"2024-09-10T23:22:17.311740+0000","last_clean":"2024-09-10T23:22:17.311740+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:22:17.311740+0000","last_undegraded":"2024-09-10T23:22:17.311740+0000","last_fullsized":"2024-09-10T23:22:17.311740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:26.422202+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:26.422202+0000","last_peered":"2024-09-10T23:22:26.422202+0000","last_clean":"2024-09-10T23:22:26.422202+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:26.422202+0000","last_undegraded":"2024-09-10T23:22:26.422202+0000","last_fullsized":"2024-09-10T23:22:26.422202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320615+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:22:17.320615+0000","last_peered":"2024-09-10T23:22:17.320615+0000","last_clean":"2024-09-10T23:22:17.320615+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:22:17.320615+0000","last_undegraded":"2024-09-10T23:22:17.320615+0000","last_fullsized":"2024-09-10T23:22:17.320615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:24.404706+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:24.404706+0000","last_peered":"2024-09-10T23:22:24.404706+0000","last_clean":"2024-09-10T23:22:24.404706+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:24.404706+0000","last_undegraded":"2024-09-10T23:22:24.404706+0000","last_fullsized":"2024-09-10T23:22:24.404706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318381+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:22:17.318381+0000","last_peered":"2024-09-10T23:22:17.318381+0000","last_clean":"2024-09-10T23:22:17.318381+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:22:17.318381+0000","last_undegraded":"2024-09-10T23:22:17.318381+0000","last_fullsized":"2024-09-10T23:22:17.318381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.324964+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:22:17.324964+0000","last_peered":"2024-09-10T23:22:17.324964+0000","last_clean":"2024-09-10T23:22:17.324964+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:22:17.324964+0000","last_undegraded":"2024-09-10T23:22:17.324964+0000","last_fullsized":"2024-09-10T23:22:17.324964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:27.433162+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:27.433162+0000","last_peered":"2024-09-10T23:22:27.433162+0000","last_clean":"2024-09-10T23:22:27.433162+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:27.433162+0000","last_undegraded":"2024-09-10T23:22:27.433162+0000","last_fullsized":"2024-09-10T23:22:27.433162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.318575+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:22:17.318575+0000","last_peered":"2024-09-10T23:22:17.318575+0000","last_clean":"2024-09-10T23:22:17.318575+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:22:17.318575+0000","last_undegraded":"2024-09-10T23:22:17.318575+0000","last_fullsized":"2024-09-10T23:22:17.318575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:28.438847+0000","last_change":"2024-09-10T23:22:14.303065+0000","last_active":"2024-09-10T23:22:28.438847+0000","last_peered":"2024-09-10T23:22:28.438847+0000","last_clean":"2024-09-10T23:22:28.438847+0000","last_became_active":"2024-09-10T23:22:14.302139+0000","last_became_peered":"2024-09-10T23:22:14.302139+0000","last_unstale":"2024-09-10T23:22:28.438847+0000","last_undegraded":"2024-09-10T23:22:28.438847+0000","last_fullsized":"2024-09-10T23:22:28.438847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:37.482300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.322868+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:22:17.322868+0000","last_peered":"2024-09-10T23:22:17.322868+0000","last_clean":"2024-09-10T23:22:17.322868+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:22:17.322868+0000","last_undegraded":"2024-09-10T23:22:17.322868+0000","last_fullsized":"2024-09-10T23:22:17.322868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.323808+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:17.323808+0000","last_peered":"2024-09-10T23:22:17.323808+0000","last_clean":"2024-09-10T23:22:17.323808+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:17.323808+0000","last_undegraded":"2024-09-10T23:22:17.323808+0000","last_fullsized":"2024-09-10T23:22:17.323808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:17.320868+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:22:17.320868+0000","last_peered":"2024-09-10T23:22:17.320868+0000","last_clean":"2024-09-10T23:22:17.320868+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:22:17.320868+0000","last_undegraded":"2024-09-10T23:22:17.320868+0000","last_fullsized":"2024-09-10T23:22:17.320868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":44,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:22:37.454452+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:22:37.454452+0000","last_peered":"2024-09-10T23:22:37.454452+0000","last_clean":"2024-09-10T23:22:37.454452+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:22:37.454452+0000","last_undegraded":"2024-09-10T23:22:37.454452+0000","last_fullsized":"2024-09-10T23:22:37.454452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56805,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":161,"num_read_kb":143,"num_write":236,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":170415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":385614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":1025853,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":385153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":385531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":978049,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":384870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":977727,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":819200,"data_stored":384731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":384695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":435384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":386600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:22:45.042 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:22:45.043 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T23:22:45.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T23:22:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:45.730 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:45 smithi002 ceph-mon[31150]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:22:45.731 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:45 smithi002 ceph-mon[31150]: pgmap v302: 97 pgs: 97 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-10T23:22:45.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:45 smithi154 ceph-mon[35136]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:22:45.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:45 smithi154 ceph-mon[35136]: pgmap v302: 97 pgs: 97 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-10T23:22:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 -- 172.21.15.2:0/1864444763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf20108730 msgr2=0x7faf2010abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 --2- 172.21.15.2:0/1864444763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf20108730 0x7faf2010abf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faf18009900 tx=0x7faf1802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 -- 172.21.15.2:0/1864444763 shutdown_connections 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 --2- 172.21.15.2:0/1864444763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf20108730 0x7faf2010abf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 --2- 172.21.15.2:0/1864444763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf20105b80 0x7faf20107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 --2- 172.21.15.2:0/1864444763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf2006b6e0 0x7faf201055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 -- 172.21.15.2:0/1864444763 >> 172.21.15.2:0/1864444763 conn(0x7faf200fd1e0 msgr2=0x7faf200ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 -- 172.21.15.2:0/1864444763 shutdown_connections 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.822+0000 7faf258fc640 1 -- 172.21.15.2:0/1864444763 wait complete. 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 Processor -- start 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 -- start start 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 0x7faf20198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf20105b80 0x7faf20199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf20108730 0x7faf2019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf2010e780 con 0x7faf2006b6e0 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf2010e600 con 0x7faf20105b80 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf258fc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf2010e900 con 0x7faf20108730 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 0x7faf20198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 0x7faf20198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57436/0 (socket says 172.21.15.2:57436) 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.823+0000 7faf1effd640 1 -- 172.21.15.2:0/1180683978 learned_addr learned my addr 172.21.15.2:0/1180683978 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1f7fe640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf20108730 0x7faf2019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1e7fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf20105b80 0x7faf20199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1effd640 1 -- 172.21.15.2:0/1180683978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf20108730 msgr2=0x7faf2019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1effd640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf20108730 0x7faf2019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1effd640 1 -- 172.21.15.2:0/1180683978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf20105b80 msgr2=0x7faf20199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1effd640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf20105b80 0x7faf20199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1effd640 1 -- 172.21.15.2:0/1180683978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2019aa00 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1e7fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf20105b80 0x7faf20199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf1effd640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 0x7faf20198ed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf1000ba50 tx=0x7faf1000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10019070 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf1000cbe0 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2019acf0 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100075d0 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.824+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf201a13d0 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.825+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf200fecd0 con 0x7faf2006b6e0 2024-09-10T23:22:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.827+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7faf10007830 con 0x7faf2006b6e0 2024-09-10T23:22:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.828+0000 7faf248fa640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf080b5370 0x7faf080b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.828+0000 7faf1e7fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf080b5370 0x7faf080b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.828+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7faf100e5890 con 0x7faf2006b6e0 2024-09-10T23:22:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.828+0000 7faf1e7fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf080b5370 0x7faf080b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf14008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:45.830+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faf100ac7a0 con 0x7faf2006b6e0 2024-09-10T23:22:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:45 smithi177 ceph-mon[35760]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:22:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:45 smithi177 ceph-mon[35760]: pgmap v302: 97 pgs: 97 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-10T23:22:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.086+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7faf2002e810 con 0x7faf2006b6e0 2024-09-10T23:22:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.088+0000 7faf248fa640 1 -- 172.21.15.2:0/1180683978 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7faf100ac0a0 con 0x7faf2006b6e0 2024-09-10T23:22:46.089 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-10T23:22:46.089 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDG1OBmU1o2BRAAxTLzZ1zOacVlptE8F2Q4/A== 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf080b5370 msgr2=0x7faf080b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf080b5370 0x7faf080b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf14008040 comp rx=0 tx=0).stop 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 msgr2=0x7faf20198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 0x7faf20198ed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf1000ba50 tx=0x7faf1000bf10 comp rx=0 tx=0).stop 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 shutdown_connections 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf080b5370 0x7faf080b7830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf20108730 0x7faf2019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf20105b80 0x7faf20199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 --2- 172.21.15.2:0/1180683978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf2006b6e0 0x7faf20198ed0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 >> 172.21.15.2:0/1180683978 conn(0x7faf200fd1e0 msgr2=0x7faf20103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.090+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 shutdown_connections 2024-09-10T23:22:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:46.091+0000 7faf258fc640 1 -- 172.21.15.2:0/1180683978 wait complete. 2024-09-10T23:22:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:46 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1180683978' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:22:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:46 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1180683978' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:22:46.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:46 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1180683978' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:22:46.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:46 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1180683978' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:22:46.897 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:22:46.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T23:22:46.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:22:46.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T23:22:46.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:46 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1180683978' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:22:46.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:46 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1180683978' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:22:47.241 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:47.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:47 smithi002 ceph-mon[31150]: pgmap v303: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 -- 172.21.15.2:0/1208877859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101c90 msgr2=0x7fb354102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 --2- 172.21.15.2:0/1208877859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101c90 0x7fb354102070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb344009900 tx=0x7fb34402a410 comp rx=0 tx=0).stop 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 -- 172.21.15.2:0/1208877859 shutdown_connections 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 --2- 172.21.15.2:0/1208877859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354108020 0x7fb35410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 --2- 172.21.15.2:0/1208877859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3541076a0 0x7fb354107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 --2- 172.21.15.2:0/1208877859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101c90 0x7fb354102070 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 -- 172.21.15.2:0/1208877859 >> 172.21.15.2:0/1208877859 conn(0x7fb3540fd700 msgr2=0x7fb3540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 -- 172.21.15.2:0/1208877859 shutdown_connections 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.756+0000 7fb359b07640 1 -- 172.21.15.2:0/1208877859 wait complete. 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 Processor -- start 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 -- start start 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354101c90 0x7fb354199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3541076a0 0x7fb354199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 0x7fb35419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb354112dc0 con 0x7fb354108020 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb354112c40 con 0x7fb354101c90 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.757+0000 7fb359b07640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb354112f40 con 0x7fb3541076a0 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 0x7fb35419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 0x7fb35419eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57448/0 (socket says 172.21.15.2:57448) 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 -- 172.21.15.2:0/1262900192 learned_addr learned my addr 172.21.15.2:0/1262900192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb352ffd640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3541076a0 0x7fb354199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb3537fe640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354101c90 0x7fb354199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 -- 172.21.15.2:0/1262900192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3541076a0 msgr2=0x7fb354199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3541076a0 0x7fb354199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 -- 172.21.15.2:0/1262900192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354101c90 msgr2=0x7fb354199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354101c90 0x7fb354199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 -- 172.21.15.2:0/1262900192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35419f2e0 con 0x7fb354108020 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb3537fe640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354101c90 0x7fb354199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb353fff640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 0x7fb35419eb10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00eb10 tx=0x7fb34c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c004b20 con 0x7fb354108020 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb34c004cc0 con 0x7fb354108020 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35419f5d0 con 0x7fb354108020 2024-09-10T23:22:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c010670 con 0x7fb354108020 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.758+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3541a5c90 con 0x7fb354108020 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.759+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb354102070 con 0x7fb354108020 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.761+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fb34c005000 con 0x7fb354108020 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.761+0000 7fb350ff9640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb33c0b5370 0x7fb33c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.762+0000 7fb3537fe640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb33c0b5370 0x7fb33c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.762+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fb34c0e6500 con 0x7fb354108020 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.762+0000 7fb3537fe640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb33c0b5370 0x7fb33c0b7830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb344000c00 tx=0x7fb344031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.764+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb34c056220 con 0x7fb354108020 2024-09-10T23:22:47.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:47 smithi154 ceph-mon[35136]: pgmap v303: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-10T23:22:47.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.948+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fb35419a360 con 0x7fb354108020 2024-09-10T23:22:47.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.948+0000 7fb350ff9640 1 -- 172.21.15.2:0/1262900192 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v51) ==== 86+0+133 (secure 0 0 0) 0x7fb35419a360 con 0x7fb354108020 2024-09-10T23:22:47.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:47.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb33c0b5370 msgr2=0x7fb33c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb33c0b5370 0x7fb33c0b7830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb344000c00 tx=0x7fb344031400 comp rx=0 tx=0).stop 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 msgr2=0x7fb35419eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 0x7fb35419eb10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00eb10 tx=0x7fb34c00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 shutdown_connections 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb33c0b5370 0x7fb33c0b7830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354108020 0x7fb35419eb10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3541076a0 0x7fb354199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 --2- 172.21.15.2:0/1262900192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb354101c90 0x7fb354199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 >> 172.21.15.2:0/1262900192 conn(0x7fb3540fd700 msgr2=0x7fb3540ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 shutdown_connections 2024-09-10T23:22:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:47.951+0000 7fb359b07640 1 -- 172.21.15.2:0/1262900192 wait complete. 2024-09-10T23:22:47.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:47 smithi177 ceph-mon[35760]: pgmap v303: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-10T23:22:48.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:48 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1262900192' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:22:48.686 INFO:teuthology.orchestra.run.smithi002.stdout:[{"version":51,"timestamp":"2024-09-10T23:22:07.102487+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T23:22:48.686 INFO:tasks.ceph_manager:config epoch is 51 2024-09-10T23:22:48.687 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:22:48.687 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:22:48.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T23:22:48.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:48 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1262900192' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:22:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:48.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:48 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1262900192' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:22:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/344963735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc10d100 msgr2=0x7f0bcc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/344963735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc10d100 0x7f0bcc10f560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009ca0 tx=0x7f0bc402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/344963735 shutdown_connections 2024-09-10T23:22:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/344963735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc10d100 0x7f0bcc10f560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/344963735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bcc1045c0 0x7f0bcc10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/344963735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/344963735 >> 172.21.15.2:0/344963735 conn(0x7f0bcc0fd700 msgr2=0x7f0bcc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/344963735 shutdown_connections 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.458+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/344963735 wait complete. 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 Processor -- start 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 -- start start 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bcc1045c0 0x7f0bcc101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc10d100 0x7f0bcc1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc112d70 con 0x7f0bcc103ca0 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc112bf0 con 0x7f0bcc10d100 2024-09-10T23:22:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bd1dbb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc112ef0 con 0x7f0bcc1045c0 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57478/0 (socket says 172.21.15.2:57478) 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bcb7fe640 1 -- 172.21.15.2:0/3380619965 learned_addr learned my addr 172.21.15.2:0/3380619965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.459+0000 7f0bcbfff640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc10d100 0x7f0bcc1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bc2ffd640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bcc1045c0 0x7f0bcc101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcb7fe640 1 -- 172.21.15.2:0/3380619965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bcc1045c0 msgr2=0x7f0bcc101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcb7fe640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bcc1045c0 0x7f0bcc101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcb7fe640 1 -- 172.21.15.2:0/3380619965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc10d100 msgr2=0x7f0bcc1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcb7fe640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc10d100 0x7f0bcc1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcb7fe640 1 -- 172.21.15.2:0/3380619965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc1a76a0 con 0x7f0bcc103ca0 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcbfff640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc10d100 0x7f0bcc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bcb7fe640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc101950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00d950 tx=0x7f0bbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc017070 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bbc009c30 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bcc1a7990 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00f620 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.460+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bcc1a7f20 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.461+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bcc104080 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.463+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f0bbc010460 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.464+0000 7f0bc97fa640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0bb80b53f0 0x7f0bb80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.464+0000 7f0bc2ffd640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0bb80b53f0 0x7f0bb80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.464+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f0bbc0e5980 con 0x7f0bcc103ca0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.465+0000 7f0bc2ffd640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0bb80b53f0 0x7f0bb80b78b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc103440 tx=0x7f0bb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.468+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0bbc0ac790 con 0x7f0bcc103ca0 2024-09-10T23:22:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.705+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0bcc02e5c0 con 0x7f0bcc103ca0 2024-09-10T23:22:49.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:49 smithi002 ceph-mon[31150]: pgmap v304: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T23:22:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.710+0000 7f0bc97fa640 1 -- 172.21.15.2:0/3380619965 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294206 (secure 0 0 0) 0x7f0bbc009de0 con 0x7f0bcc103ca0 2024-09-10T23:22:49.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0bb80b53f0 msgr2=0x7f0bb80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0bb80b53f0 0x7f0bb80b78b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc103440 tx=0x7f0bb4005f90 comp rx=0 tx=0).stop 2024-09-10T23:22:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 msgr2=0x7f0bcc101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc101950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00d950 tx=0x7f0bbc00de10 comp rx=0 tx=0).stop 2024-09-10T23:22:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 shutdown_connections 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0bb80b53f0 0x7f0bb80b78b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bcc10d100 0x7f0bcc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bcc1045c0 0x7f0bcc101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 --2- 172.21.15.2:0/3380619965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc103ca0 0x7f0bcc101950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 >> 172.21.15.2:0/3380619965 conn(0x7f0bcc0fd700 msgr2=0x7f0bcc0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 shutdown_connections 2024-09-10T23:22:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:49.714+0000 7f0bd1dbb640 1 -- 172.21.15.2:0/3380619965 wait complete. 2024-09-10T23:22:49.719 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:49 smithi177 ceph-mon[35760]: pgmap v304: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T23:22:49.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:49 smithi154 ceph-mon[35136]: pgmap v304: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T23:22:50.477 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3310548901},{"type":"v1","addr":"172.21.15.2:6801","nonce":3310548901}]},"active_addr":"172.21.15.2:6801/3310548901","active_change":"2024-09-10T23:14:50.129336+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24128,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1546777247}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":544951218}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4289370929}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3900533474}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3253920935}]}]} 2024-09-10T23:22:50.483 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T23:22:50.483 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T23:22:50.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:22:50.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3380619965' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-10T23:22:50.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:50 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T23:22:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3380619965' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:22:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-10T23:22:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:22:50.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-10T23:22:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]} : dispatch 2024-09-10T23:22:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]} : dispatch 2024-09-10T23:22:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T23:22:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-10T23:22:50.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:50 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T23:22:50.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3380619965' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:22:50.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-10T23:22:50.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:22:50.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-10T23:22:50.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]} : dispatch 2024-09-10T23:22:50.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]} : dispatch 2024-09-10T23:22:50.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T23:22:50.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-10T23:22:50.966 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:50 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 -- 172.21.15.2:0/1007200342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c101cd0 msgr2=0x7f916c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 --2- 172.21.15.2:0/1007200342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c101cd0 0x7f916c1020b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9168009900 tx=0x7f916802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 -- 172.21.15.2:0/1007200342 shutdown_connections 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 --2- 172.21.15.2:0/1007200342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c108060 0x7f916c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 --2- 172.21.15.2:0/1007200342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c1076e0 0x7f916c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 --2- 172.21.15.2:0/1007200342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c101cd0 0x7f916c1020b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 -- 172.21.15.2:0/1007200342 >> 172.21.15.2:0/1007200342 conn(0x7f916c0fd700 msgr2=0x7f916c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 -- 172.21.15.2:0/1007200342 shutdown_connections 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 -- 172.21.15.2:0/1007200342 wait complete. 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 Processor -- start 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.250+0000 7f9173381640 1 -- start start 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c101cd0 0x7f916c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 0x7f916c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c108060 0x7f916c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f916c111ce0 con 0x7f916c1076e0 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f916c111b60 con 0x7f916c108060 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f916c111e60 con 0x7f916c101cd0 2024-09-10T23:22:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 0x7f916c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 0x7f916c0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52736/0 (socket says 172.21.15.2:52736) 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 -- 172.21.15.2:0/3569971580 learned_addr learned my addr 172.21.15.2:0/3569971580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917191e640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c108060 0x7f916c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917111d640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c101cd0 0x7f916c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 -- 172.21.15.2:0/3569971580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c101cd0 msgr2=0x7f916c0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c101cd0 0x7f916c0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 -- 172.21.15.2:0/3569971580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c108060 msgr2=0x7f916c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c108060 0x7f916c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 -- 172.21.15.2:0/3569971580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c1a75e0 con 0x7f916c1076e0 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917191e640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c108060 0x7f916c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917111d640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c101cd0 0x7f916c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f917091c640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 0x7f916c0fe140 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c920 tx=0x7f915c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c007c70 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f915c007e10 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c1a78d0 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c018820 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.251+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c1a7e60 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.252+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c1020b0 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.254+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f915c00f450 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.255+0000 7f91627fc640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91580b53f0 0x7f91580b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.255+0000 7f917111d640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91580b53f0 0x7f91580b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.255+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f915c0e6140 con 0x7f916c1076e0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.255+0000 7f917111d640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91580b53f0 0x7f91580b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9168000c00 tx=0x7f9168031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.257+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f915c014030 con 0x7f916c1076e0 2024-09-10T23:22:51.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.443+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f916c1a8290 con 0x7f916c1076e0 2024-09-10T23:22:51.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.444+0000 7f91627fc640 1 -- 172.21.15.2:0/3569971580 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22706 (secure 0 0 0) 0x7f915c0acfc0 con 0x7f916c1076e0 2024-09-10T23:22:51.445 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:51.445 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":76,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:50.474711+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91580b53f0 msgr2=0x7f91580b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91580b53f0 0x7f91580b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9168000c00 tx=0x7f9168031400 comp rx=0 tx=0).stop 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 msgr2=0x7f916c0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 0x7f916c0fe140 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c920 tx=0x7f915c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 shutdown_connections 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91580b53f0 0x7f91580b78b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f916c108060 0x7f916c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916c1076e0 0x7f916c0fe140 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 --2- 172.21.15.2:0/3569971580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f916c101cd0 0x7f916c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 >> 172.21.15.2:0/3569971580 conn(0x7f916c0fd700 msgr2=0x7f916c06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 shutdown_connections 2024-09-10T23:22:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:51.446+0000 7f9173381640 1 -- 172.21.15.2:0/3569971580 wait complete. 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: pgmap v305: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T23:22:51.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T23:22:51.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:22:51.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:51 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3569971580' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: pgmap v305: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:22:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:51 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3569971580' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: pgmap v305: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T23:22:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-10T23:22:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:22:51.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:51 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3569971580' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:52.256 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T23:22:52.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:22:52.520 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:52.772 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:52 smithi002 ceph-mon[31150]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:22:52.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:52 smithi154 ceph-mon[35136]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:22:52.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:52 smithi177 ceph-mon[35760]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:22:52.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 -- 172.21.15.2:0/955194182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba8104600 msgr2=0x7feba810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:52.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 --2- 172.21.15.2:0/955194182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba8104600 0x7feba810caf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb98009900 tx=0x7feb9802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:52.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 -- 172.21.15.2:0/955194182 shutdown_connections 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 --2- 172.21.15.2:0/955194182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba810d140 0x7feba810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 --2- 172.21.15.2:0/955194182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba8104600 0x7feba810caf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 --2- 172.21.15.2:0/955194182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8103ce0 0x7feba81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 -- 172.21.15.2:0/955194182 >> 172.21.15.2:0/955194182 conn(0x7feba80fd700 msgr2=0x7feba80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 -- 172.21.15.2:0/955194182 shutdown_connections 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.993+0000 7febaff4b640 1 -- 172.21.15.2:0/955194182 wait complete. 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 Processor -- start 2024-09-10T23:22:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 -- start start 2024-09-10T23:22:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8103ce0 0x7feba8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8104600 0x7feba81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 0x7feba819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feba8112db0 con 0x7feba810d140 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feba8112c30 con 0x7feba8104600 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febaff4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feba8112f30 con 0x7feba8103ce0 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febae4e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 0x7feba819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febae4e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 0x7feba819eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52768/0 (socket says 172.21.15.2:52768) 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febae4e8640 1 -- 172.21.15.2:0/1451435168 learned_addr learned my addr 172.21.15.2:0/1451435168 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.994+0000 7febadce7640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8103ce0 0x7feba8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febad4e6640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8104600 0x7feba81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febae4e8640 1 -- 172.21.15.2:0/1451435168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8103ce0 msgr2=0x7feba8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febae4e8640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8103ce0 0x7feba8199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febae4e8640 1 -- 172.21.15.2:0/1451435168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8104600 msgr2=0x7feba81997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febae4e8640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8104600 0x7feba81997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febae4e8640 1 -- 172.21.15.2:0/1451435168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba819f320 con 0x7feba810d140 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febae4e8640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 0x7feba819eb50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feba000cce0 tx=0x7feba000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba000f450 con 0x7feba810d140 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba819f610 con 0x7feba810d140 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba000faa0 con 0x7feba810d140 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0018b70 con 0x7feba810d140 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.995+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba81a5cd0 con 0x7feba810d140 2024-09-10T23:22:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.996+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba81040c0 con 0x7feba810d140 2024-09-10T23:22:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.998+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7feba000f5f0 con 0x7feba810d140 2024-09-10T23:22:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.998+0000 7feb9effd640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7feb940b5370 0x7feb940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.999+0000 7febadce7640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7feb940b5370 0x7feb940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:53.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.999+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7feba00e6560 con 0x7feba810d140 2024-09-10T23:22:53.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:52.999+0000 7febadce7640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7feb940b5370 0x7feb940b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feba40058c0 tx=0x7feba400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.001+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feba0014030 con 0x7feba810d140 2024-09-10T23:22:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.191+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feba819a3a0 con 0x7feba810d140 2024-09-10T23:22:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.192+0000 7feb9effd640 1 -- 172.21.15.2:0/1451435168 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7feba00ad360 con 0x7feba810d140 2024-09-10T23:22:53.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:22:53.193 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7feb940b5370 msgr2=0x7feb940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7feb940b5370 0x7feb940b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feba40058c0 tx=0x7feba400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 msgr2=0x7feba819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 0x7feba819eb50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feba000cce0 tx=0x7feba000a620 comp rx=0 tx=0).stop 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 shutdown_connections 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7feb940b5370 0x7feb940b7830 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feba810d140 0x7feba819eb50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8104600 0x7feba81997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:53.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 --2- 172.21.15.2:0/1451435168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8103ce0 0x7feba8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 >> 172.21.15.2:0/1451435168 conn(0x7feba80fd700 msgr2=0x7feba80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 shutdown_connections 2024-09-10T23:22:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:53.195+0000 7febaff4b640 1 -- 172.21.15.2:0/1451435168 wait complete. 2024-09-10T23:22:53.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:53 smithi154 ceph-mon[35136]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s; 126 B/s, 0 objects/s recovering 2024-09-10T23:22:53.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:53 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1451435168' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:53.874 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:53 smithi002 ceph-mon[31150]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s; 126 B/s, 0 objects/s recovering 2024-09-10T23:22:53.874 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:53 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1451435168' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:53.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T23:22:53.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T23:22:53.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T23:22:53.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T23:22:53.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T23:22:53.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T23:22:53.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T23:22:53.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T23:22:53.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T23:22:53.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T23:22:53.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T23:22:53.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T23:22:53.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:53 smithi177 ceph-mon[35760]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s; 126 B/s, 0 objects/s recovering 2024-09-10T23:22:53.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:53 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1451435168' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:54.574 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.934 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.934 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.934 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.938 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:55.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 -- 172.21.15.2:0/32794886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66741045d0 msgr2=0x7f667410cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 --2- 172.21.15.2:0/32794886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66741045d0 0x7f667410cbb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f665c009900 tx=0x7f665c02a410 comp rx=0 tx=0).stop 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 -- 172.21.15.2:0/32794886 shutdown_connections 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 --2- 172.21.15.2:0/32794886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667410d180 0x7f667410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 --2- 172.21.15.2:0/32794886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66741045d0 0x7f667410cbb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 --2- 172.21.15.2:0/32794886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6674103bd0 0x7f6674103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 -- 172.21.15.2:0/32794886 >> 172.21.15.2:0/32794886 conn(0x7f66740fd720 msgr2=0x7f66740ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 -- 172.21.15.2:0/32794886 shutdown_connections 2024-09-10T23:22:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.169+0000 7f667acfb640 1 -- 172.21.15.2:0/32794886 wait complete. 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 Processor -- start 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 -- start start 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674103bd0 0x7f66741992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66741045d0 0x7f6674199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667410d180 0x7f667419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6674112df0 con 0x7f6674103bd0 2024-09-10T23:22:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6674112c70 con 0x7f667410d180 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f667acfb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6674112f70 con 0x7f66741045d0 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674103bd0 0x7f66741992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674103bd0 0x7f66741992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52782/0 (socket says 172.21.15.2:52782) 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 -- 172.21.15.2:0/766062611 learned_addr learned my addr 172.21.15.2:0/766062611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6673fff640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66741045d0 0x7f6674199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 -- 172.21.15.2:0/766062611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66741045d0 msgr2=0x7f6674199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66741045d0 0x7f6674199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 -- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667410d180 msgr2=0x7f667419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667410d180 0x7f667419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.170+0000 7f6678a97640 1 -- 172.21.15.2:0/766062611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667419f380 con 0x7f6674103bd0 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.171+0000 7f6678a97640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674103bd0 0x7f66741992d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f666400d770 tx=0x7f666400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.171+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664017070 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.171+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66640054d0 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.171+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664004c30 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.171+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667419f670 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.171+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66741a5d30 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.172+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66740638e0 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.173+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f6664004dd0 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6671ffb640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66600b53f0 0x7f66600b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6673fff640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66600b53f0 0x7f66600b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f66640e5c40 con 0x7f6674103bd0 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6671ffb640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] conn(0x7f66600bee90 0x7f66600c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 --> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6664021e50 con 0x7f66600bee90 2024-09-10T23:22:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f66640e6090 con 0x7f6674103bd0 2024-09-10T23:22:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.174+0000 7f6673fff640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66600b53f0 0x7f66600b78b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f665c000c00 tx=0x7f665c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.175+0000 7f6679298640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] conn(0x7f66600bee90 0x7f66600c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.175+0000 7f6679298640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] conn(0x7f66600bee90 0x7f66600c1330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.176+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== osd.4 v2:172.21.15.154:6808/3616268167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6664021e50 con 0x7f66600bee90 2024-09-10T23:22:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.189+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 --> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6674063d60 con 0x7f66600bee90 2024-09-10T23:22:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f6671ffb640 1 -- 172.21.15.2:0/766062611 <== osd.4 v2:172.21.15.154:6808/3616268167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6674063d60 con 0x7f66600bee90 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] conn(0x7f66600bee90 msgr2=0x7f66600c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f667acfb640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] conn(0x7f66600bee90 0x7f66600c1330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66600b53f0 msgr2=0x7f66600b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f667acfb640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66600b53f0 0x7f66600b78b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f665c000c00 tx=0x7f665c031400 comp rx=0 tx=0).stop 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674103bd0 msgr2=0x7f66741992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f667acfb640 1 --2- 172.21.15.2:0/766062611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6674103bd0 0x7f66741992d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f666400d770 tx=0x7f666400dc30 comp rx=0 tx=0).stop 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.190+0000 7f6679298640 1 -- 172.21.15.2:0/766062611 reap_dead start 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.191+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 shutdown_connections 2024-09-10T23:22:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.191+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 >> 172.21.15.2:0/766062611 conn(0x7f66740fd720 msgr2=0x7f66740fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.191+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 shutdown_connections 2024-09-10T23:22:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:55.191+0000 7f667acfb640 1 -- 172.21.15.2:0/766062611 wait complete. 2024-09-10T23:22:55.414 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:55.415 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:55.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:55 smithi154 ceph-mon[35136]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:55.802 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:55 smithi002 ceph-mon[31150]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:55.959 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:55.959 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:55 smithi177 ceph-mon[35760]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:55.994 INFO:teuthology.orchestra.run.smithi002.stdout:133143986233 2024-09-10T23:22:55.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T23:22:57.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 -- 172.21.15.2:0/532945510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c1087d0 msgr2=0x7f758c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 --2- 172.21.15.2:0/532945510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c1087d0 0x7f758c108c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7574009900 tx=0x7f757402a410 comp rx=0 tx=0).stop 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 -- 172.21.15.2:0/532945510 shutdown_connections 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 --2- 172.21.15.2:0/532945510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f758c109150 0x7f758c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 --2- 172.21.15.2:0/532945510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c1087d0 0x7f758c108c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 --2- 172.21.15.2:0/532945510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f758c102dc0 0x7f758c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 -- 172.21.15.2:0/532945510 >> 172.21.15.2:0/532945510 conn(0x7f758c0fe830 msgr2=0x7f758c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 -- 172.21.15.2:0/532945510 shutdown_connections 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.528+0000 7f7590d79640 1 -- 172.21.15.2:0/532945510 wait complete. 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 Processor -- start 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 -- start start 2024-09-10T23:22:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f758c102dc0 0x7f758c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f758c1087d0 0x7f758c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c109150 0x7f758c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f758c112e60 con 0x7f758c109150 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f758c112ce0 con 0x7f758c102dc0 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f7590d79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f758c112fe0 con 0x7f758c1087d0 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.529+0000 7f758ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c109150 0x7f758c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c109150 0x7f758c19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52810/0 (socket says 172.21.15.2:52810) 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 -- 172.21.15.2:0/3707087702 learned_addr learned my addr 172.21.15.2:0/3707087702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758a59c640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f758c102dc0 0x7f758c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f7583fff640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f758c1087d0 0x7f758c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 -- 172.21.15.2:0/3707087702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f758c1087d0 msgr2=0x7f758c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f758c1087d0 0x7f758c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 -- 172.21.15.2:0/3707087702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f758c102dc0 msgr2=0x7f758c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f758c102dc0 0x7f758c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 -- 172.21.15.2:0/3707087702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c19f380 con 0x7f758c109150 2024-09-10T23:22:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758a59c640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f758c102dc0 0x7f758c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f758ad9d640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c109150 0x7f758c19ebb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f758400cce0 tx=0x7f758400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758400f450 con 0x7f758c109150 2024-09-10T23:22:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f758400faa0 con 0x7f758c109150 2024-09-10T23:22:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758c19f670 con 0x7f758c109150 2024-09-10T23:22:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584018b70 con 0x7f758c109150 2024-09-10T23:22:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.530+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758c1a5d30 con 0x7f758c109150 2024-09-10T23:22:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.531+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f758c0638e0 con 0x7f758c109150 2024-09-10T23:22:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.533+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f758400f5f0 con 0x7f758c109150 2024-09-10T23:22:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.533+0000 7f75837fe640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f75780b53f0 0x7f75780b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.533+0000 7f758a59c640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f75780b53f0 0x7f75780b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.533+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f75840e6690 con 0x7f758c109150 2024-09-10T23:22:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.534+0000 7f75837fe640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] conn(0x7f75780bee90 0x7f75780c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.534+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 --> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7584023e50 con 0x7f75780bee90 2024-09-10T23:22:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.534+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f75840e6ae0 con 0x7f758c109150 2024-09-10T23:22:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.534+0000 7f7583fff640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] conn(0x7f75780bee90 0x7f75780c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.534+0000 7f758a59c640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f75780b53f0 0x7f75780b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f757c0058c0 tx=0x7f757c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.534+0000 7f7583fff640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] conn(0x7f75780bee90 0x7f75780c1330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.535+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== osd.9 v2:172.21.15.2:6826/3955910854 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7584023e50 con 0x7f75780bee90 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 --> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f758c063d90 con 0x7f75780bee90 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f75837fe640 1 -- 172.21.15.2:0/3707087702 <== osd.9 v2:172.21.15.2:6826/3955910854 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f758c063d90 con 0x7f75780bee90 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] conn(0x7f75780bee90 msgr2=0x7f75780c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] conn(0x7f75780bee90 0x7f75780c1330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f75780b53f0 msgr2=0x7f75780b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f75780b53f0 0x7f75780b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f757c0058c0 tx=0x7f757c005850 comp rx=0 tx=0).stop 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c109150 msgr2=0x7f758c19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 --2- 172.21.15.2:0/3707087702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f758c109150 0x7f758c19ebb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f758400cce0 tx=0x7f758400a620 comp rx=0 tx=0).stop 2024-09-10T23:22:57.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f758ad9d640 1 -- 172.21.15.2:0/3707087702 reap_dead start 2024-09-10T23:22:57.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 shutdown_connections 2024-09-10T23:22:57.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 >> 172.21.15.2:0/3707087702 conn(0x7f758c0fe830 msgr2=0x7f758c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:57.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 shutdown_connections 2024-09-10T23:22:57.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:57.549+0000 7f7590d79640 1 -- 172.21.15.2:0/3707087702 wait complete. 2024-09-10T23:22:57.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:57 smithi002 ceph-mon[31150]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 143 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:57.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:57 smithi154 ceph-mon[35136]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 143 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:57.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:57 smithi177 ceph-mon[35760]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 143 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:58.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 -- 172.21.15.2:0/4085588323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 msgr2=0x7f07881020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 --2- 172.21.15.2:0/4085588323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f07881020b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0778009900 tx=0x7f077802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 -- 172.21.15.2:0/4085588323 shutdown_connections 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 --2- 172.21.15.2:0/4085588323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0788108060 0x7f078810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 --2- 172.21.15.2:0/4085588323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07881076e0 0x7f0788107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 --2- 172.21.15.2:0/4085588323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f07881020b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 -- 172.21.15.2:0/4085588323 >> 172.21.15.2:0/4085588323 conn(0x7f07880fd700 msgr2=0x7f07880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 -- 172.21.15.2:0/4085588323 shutdown_connections 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.496+0000 7f078c96c640 1 -- 172.21.15.2:0/4085588323 wait complete. 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 Processor -- start 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 -- start start 2024-09-10T23:22:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f078819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07881076e0 0x7f078819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0788108060 0x7f07881a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0788111d60 con 0x7f0788101cd0 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0788111be0 con 0x7f07881076e0 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078c96c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0788111ee0 con 0x7f0788108060 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f078819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f078819a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52836/0 (socket says 172.21.15.2:52836) 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 -- 172.21.15.2:0/2769317719 learned_addr learned my addr 172.21.15.2:0/2769317719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f0786d9d640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0788108060 0x7f07881a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f0785d9b640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07881076e0 0x7f078819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 -- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0788108060 msgr2=0x7f07881a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0788108060 0x7f07881a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 -- 172.21.15.2:0/2769317719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07881076e0 msgr2=0x7f078819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07881076e0 0x7f078819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f078659c640 1 -- 172.21.15.2:0/2769317719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07881a57d0 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f0786d9d640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0788108060 0x7f07881a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.497+0000 7f0785d9b640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07881076e0 0x7f078819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.498+0000 7f078659c640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f078819a210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0778006010 tx=0x7f07780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.498+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077803f030 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.498+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0778003800 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.498+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07881a59a0 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.498+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778035070 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.498+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07881a5e00 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.499+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07880638e0 con 0x7f0788101cd0 2024-09-10T23:22:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.500+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f0778031b10 con 0x7f0788101cd0 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.501+0000 7f07777fe640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07700b53f0 0x7f07700b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.501+0000 7f0785d9b640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07700b53f0 0x7f07700b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.501+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0778106d70 con 0x7f0788101cd0 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.501+0000 7f07777fe640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] conn(0x7f07700bee90 0x7f07700c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.501+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 --> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07700c1a00 con 0x7f07700bee90 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.501+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f07781071c0 con 0x7f0788101cd0 2024-09-10T23:22:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.502+0000 7f0785d9b640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07700b53f0 0x7f07700b78b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f078806c0f0 tx=0x7f077c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.502+0000 7f0786d9d640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] conn(0x7f07700bee90 0x7f07700c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.502+0000 7f0786d9d640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] conn(0x7f07700bee90 0x7f07700c1330 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.503+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== osd.8 v2:172.21.15.177:6816/2637144478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07700c1a00 con 0x7f07700bee90 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.517+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 --> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0788063ce0 con 0x7f07700bee90 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.517+0000 7f07777fe640 1 -- 172.21.15.2:0/2769317719 <== osd.8 v2:172.21.15.177:6816/2637144478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0788063ce0 con 0x7f07700bee90 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] conn(0x7f07700bee90 msgr2=0x7f07700c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] conn(0x7f07700bee90 0x7f07700c1330 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07700b53f0 msgr2=0x7f07700b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07700b53f0 0x7f07700b78b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f078806c0f0 tx=0x7f077c008040 comp rx=0 tx=0).stop 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 msgr2=0x7f078819a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 --2- 172.21.15.2:0/2769317719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0788101cd0 0x7f078819a210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0778006010 tx=0x7f07780042f0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f0786d9d640 1 -- 172.21.15.2:0/2769317719 reap_dead start 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 shutdown_connections 2024-09-10T23:22:58.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 >> 172.21.15.2:0/2769317719 conn(0x7f07880fd700 msgr2=0x7f07880ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:58.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 shutdown_connections 2024-09-10T23:22:58.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.518+0000 7f078c96c640 1 -- 172.21.15.2:0/2769317719 wait complete. 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 -- 172.21.15.2:0/2425290024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7390102dc0 msgr2=0x7f73901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 --2- 172.21.15.2:0/2425290024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7390102dc0 0x7f73901031a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7380009ca0 tx=0x7f738002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 -- 172.21.15.2:0/2425290024 shutdown_connections 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 --2- 172.21.15.2:0/2425290024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390109150 0x7f739010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 --2- 172.21.15.2:0/2425290024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73901087d0 0x7f7390108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 --2- 172.21.15.2:0/2425290024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7390102dc0 0x7f73901031a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 -- 172.21.15.2:0/2425290024 >> 172.21.15.2:0/2425290024 conn(0x7f73900fe830 msgr2=0x7f7390100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 -- 172.21.15.2:0/2425290024 shutdown_connections 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 -- 172.21.15.2:0/2425290024 wait complete. 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.967+0000 7f7394e2d640 1 Processor -- start 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 -- start start 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390102dc0 0x7f7390199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73901087d0 0x7f7390199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7390109150 0x7f739019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7390112e10 con 0x7f73901087d0 2024-09-10T23:22:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7390112c90 con 0x7f7390109150 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f7394e2d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7390112f90 con 0x7f7390102dc0 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73901087d0 0x7f7390199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73901087d0 0x7f7390199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52852/0 (socket says 172.21.15.2:52852) 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 -- 172.21.15.2:0/1432028076 learned_addr learned my addr 172.21.15.2:0/1432028076 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738e59c640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390102dc0 0x7f7390199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738ed9d640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7390109150 0x7f739019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 -- 172.21.15.2:0/1432028076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390102dc0 msgr2=0x7f7390199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390102dc0 0x7f7390199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 -- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7390109150 msgr2=0x7f739019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7390109150 0x7f739019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 -- 172.21.15.2:0/1432028076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739019f3b0 con 0x7f73901087d0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.968+0000 7f738dd9b640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73901087d0 0x7f7390199840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f738400d950 tx=0x7f738400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.969+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384017070 con 0x7f73901087d0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.969+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7384009c30 con 0x7f73901087d0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.969+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739019f6a0 con 0x7f73901087d0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.969+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738400f620 con 0x7f73901087d0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.969+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901a5d60 con 0x7f73901087d0 2024-09-10T23:22:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.970+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73900638e0 con 0x7f73901087d0 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.971+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f7384010460 con 0x7f73901087d0 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f737f7fe640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5370 0x7f73780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f738e59c640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5370 0x7f73780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f73840e5d10 con 0x7f73901087d0 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f737f7fe640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] conn(0x7f73780bee10 0x7f73780c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 --> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7384012e50 con 0x7f73780bee10 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f73840e6160 con 0x7f73901087d0 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.972+0000 7f738e59c640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5370 0x7f73780b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7380009430 tx=0x7f7380009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.973+0000 7f738ed9d640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] conn(0x7f73780bee10 0x7f73780c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.973+0000 7f738ed9d640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] conn(0x7f73780bee10 0x7f73780c12b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.974+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== osd.10 v2:172.21.15.154:6824/2294019881 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7384012e50 con 0x7f73780bee10 2024-09-10T23:22:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.988+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 --> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7390063d60 con 0x7f73780bee10 2024-09-10T23:22:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.989+0000 7f737f7fe640 1 -- 172.21.15.2:0/1432028076 <== osd.10 v2:172.21.15.154:6824/2294019881 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7390063d60 con 0x7f73780bee10 2024-09-10T23:22:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.989+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] conn(0x7f73780bee10 msgr2=0x7f73780c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.989+0000 7f7394e2d640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] conn(0x7f73780bee10 0x7f73780c12b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5370 msgr2=0x7f73780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5370 0x7f73780b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7380009430 tx=0x7f7380009360 comp rx=0 tx=0).stop 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73901087d0 msgr2=0x7f7390199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 --2- 172.21.15.2:0/1432028076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73901087d0 0x7f7390199840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f738400d950 tx=0x7f738400de10 comp rx=0 tx=0).stop 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f738ed9d640 1 -- 172.21.15.2:0/1432028076 reap_dead start 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 shutdown_connections 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 >> 172.21.15.2:0/1432028076 conn(0x7f73900fe830 msgr2=0x7f7390100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 shutdown_connections 2024-09-10T23:22:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.990+0000 7f7394e2d640 1 -- 172.21.15.2:0/1432028076 wait complete. 2024-09-10T23:22:59.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 -- 172.21.15.2:0/2365728849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c410d120 msgr2=0x7f68c410f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:59.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 --2- 172.21.15.2:0/2365728849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c410d120 0x7f68c410f590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009ca0 tx=0x7f68bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 -- 172.21.15.2:0/2365728849 shutdown_connections 2024-09-10T23:22:59.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 --2- 172.21.15.2:0/2365728849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c410d120 0x7f68c410f590 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 --2- 172.21.15.2:0/2365728849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c4104570 0x7f68c410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 --2- 172.21.15.2:0/2365728849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68c4103b70 0x7f68c4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 -- 172.21.15.2:0/2365728849 >> 172.21.15.2:0/2365728849 conn(0x7f68c40fd700 msgr2=0x7f68c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 -- 172.21.15.2:0/2365728849 shutdown_connections 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.385+0000 7f68cb284640 1 -- 172.21.15.2:0/2365728849 wait complete. 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 Processor -- start 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 -- start start 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68c4103b70 0x7f68c419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c4104570 0x7f68c419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c410d120 0x7f68c41a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4112de0 con 0x7f68c4104570 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4112c60 con 0x7f68c410d120 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68cb284640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4112f60 con 0x7f68c4103b70 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c4104570 0x7f68c419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:59.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c4104570 0x7f68c419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52820/0 (socket says 172.21.15.2:52820) 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 -- 172.21.15.2:0/4097214435 learned_addr learned my addr 172.21.15.2:0/4097214435 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c9020640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68c4103b70 0x7f68c419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c9821640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c410d120 0x7f68c41a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 -- 172.21.15.2:0/4097214435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68c4103b70 msgr2=0x7f68c419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68c4103b70 0x7f68c419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 -- 172.21.15.2:0/4097214435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c410d120 msgr2=0x7f68c41a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c410d120 0x7f68c41a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 -- 172.21.15.2:0/4097214435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41a14e0 con 0x7f68c4104570 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c9020640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68c4103b70 0x7f68c419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.386+0000 7f68c881f640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c4104570 0x7f68c419b970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f68b400b4a0 tx=0x7f68b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.387+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4014070 con 0x7f68c4104570 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.387+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68b4010ac0 con 0x7f68c4104570 2024-09-10T23:22:59.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.387+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4017c30 con 0x7f68c4104570 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.387+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41a17d0 con 0x7f68c4104570 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.387+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41a7e90 con 0x7f68c4104570 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.388+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68c4103450 con 0x7f68c4104570 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.389+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f68b4010610 con 0x7f68c4104570 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.390+0000 7f68ba7fc640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68b00b53f0 0x7f68b00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.390+0000 7f68c9020640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68b00b53f0 0x7f68b00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.390+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f68b40e5710 con 0x7f68c4104570 2024-09-10T23:22:59.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.390+0000 7f68ba7fc640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] conn(0x7f68b00bee90 0x7f68b00c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.390+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 --> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68b00c1a00 con 0x7f68b00bee90 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.390+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f68b40e5b60 con 0x7f68c4104570 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.391+0000 7f68c9821640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] conn(0x7f68b00bee90 0x7f68b00c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.391+0000 7f68c9020640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68b00b53f0 0x7f68b00b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f68c000abe0 tx=0x7f68c000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.391+0000 7f68c9821640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] conn(0x7f68b00bee90 0x7f68b00c1330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.392+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== osd.0 v2:172.21.15.2:6802/3071495420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68b00c1a00 con 0x7f68b00bee90 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.405+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 --> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68c406bb30 con 0x7f68b00bee90 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.405+0000 7f68ba7fc640 1 -- 172.21.15.2:0/4097214435 <== osd.0 v2:172.21.15.2:6802/3071495420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f68c406bb30 con 0x7f68b00bee90 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] conn(0x7f68b00bee90 msgr2=0x7f68b00c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] conn(0x7f68b00bee90 0x7f68b00c1330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68b00b53f0 msgr2=0x7f68b00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f68b00b53f0 0x7f68b00b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f68c000abe0 tx=0x7f68c000a5c0 comp rx=0 tx=0).stop 2024-09-10T23:22:59.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c4104570 msgr2=0x7f68c419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:59.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 --2- 172.21.15.2:0/4097214435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68c4104570 0x7f68c419b970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f68b400b4a0 tx=0x7f68b400b960 comp rx=0 tx=0).stop 2024-09-10T23:22:59.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68c9821640 1 -- 172.21.15.2:0/4097214435 reap_dead start 2024-09-10T23:22:59.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 shutdown_connections 2024-09-10T23:22:59.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 >> 172.21.15.2:0/4097214435 conn(0x7f68c40fd700 msgr2=0x7f68c410f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:59.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 shutdown_connections 2024-09-10T23:22:59.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:58.406+0000 7f68cb284640 1 -- 172.21.15.2:0/4097214435 wait complete. 2024-09-10T23:22:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:22:59 smithi154 ceph-mon[35136]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 143 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:59.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:22:59 smithi002 ceph-mon[31150]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 143 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:22:59.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:22:59 smithi177 ceph-mon[35760]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 143 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:23:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 -- 172.21.15.2:0/722261901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc108020 msgr2=0x7f9ccc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 --2- 172.21.15.2:0/722261901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc108020 0x7f9ccc10e820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009ca0 tx=0x7f9cc402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 -- 172.21.15.2:0/722261901 shutdown_connections 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 --2- 172.21.15.2:0/722261901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc108020 0x7f9ccc10e820 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 --2- 172.21.15.2:0/722261901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ccc1076a0 0x7f9ccc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 --2- 172.21.15.2:0/722261901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ccc101c90 0x7f9ccc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 -- 172.21.15.2:0/722261901 >> 172.21.15.2:0/722261901 conn(0x7f9ccc0fd700 msgr2=0x7f9ccc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 -- 172.21.15.2:0/722261901 shutdown_connections 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.182+0000 7f9cd468b640 1 -- 172.21.15.2:0/722261901 wait complete. 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 Processor -- start 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 -- start start 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ccc101c90 0x7f9ccc1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc1076a0 0x7f9ccc199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ccc108020 0x7f9ccc19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc111ce0 con 0x7f9ccc1076a0 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc111b60 con 0x7f9ccc101c90 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd468b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc111e60 con 0x7f9ccc108020 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc1076a0 0x7f9ccc199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc1076a0 0x7f9ccc199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52862/0 (socket says 172.21.15.2:52862) 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 -- 172.21.15.2:0/1891224988 learned_addr learned my addr 172.21.15.2:0/1891224988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd2427640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ccc101c90 0x7f9ccc1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd2c28640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ccc108020 0x7f9ccc19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 -- 172.21.15.2:0/1891224988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ccc108020 msgr2=0x7f9ccc19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ccc108020 0x7f9ccc19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 -- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ccc101c90 msgr2=0x7f9ccc1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ccc101c90 0x7f9ccc1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.183+0000 7f9cd1c26640 1 -- 172.21.15.2:0/1891224988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc19f380 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.184+0000 7f9cd1c26640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc1076a0 0x7f9ccc199810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c890 tx=0x7f9cbc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.184+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc004220 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.184+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cbc0043c0 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.184+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc19f670 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.184+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc004a00 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.184+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc1a5f00 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.185+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ccc063860 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.187+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9cbc0079b0 con 0x7f9ccc1076a0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.187+0000 7f9cc37fe640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9cb80b53f0 0x7f9cb80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cd2427640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9cb80b53f0 0x7f9cb80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9cbc0e5ef0 con 0x7f9ccc1076a0 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cc37fe640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] conn(0x7f9cb80bee90 0x7f9cb80c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 --> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cb80c1a00 con 0x7f9cb80bee90 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9cbc0e6340 con 0x7f9ccc1076a0 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cd2427640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9cb80b53f0 0x7f9cb80b78b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009890 tx=0x7f9cc8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.188+0000 7f9cd2c28640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] conn(0x7f9cb80bee90 0x7f9cb80c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.189+0000 7f9cd2c28640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] conn(0x7f9cb80bee90 0x7f9cb80c1330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.189+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== osd.1 v2:172.21.15.154:6800/773951399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cb80c1a00 con 0x7f9cb80bee90 2024-09-10T23:23:00.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.203+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 --> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ccc063c60 con 0x7f9cb80bee90 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.203+0000 7f9cc37fe640 1 -- 172.21.15.2:0/1891224988 <== osd.1 v2:172.21.15.154:6800/773951399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ccc063c60 con 0x7f9cb80bee90 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] conn(0x7f9cb80bee90 msgr2=0x7f9cb80c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] conn(0x7f9cb80bee90 0x7f9cb80c1330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9cb80b53f0 msgr2=0x7f9cb80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9cb80b53f0 0x7f9cb80b78b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009890 tx=0x7f9cc8008040 comp rx=0 tx=0).stop 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc1076a0 msgr2=0x7f9ccc199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 --2- 172.21.15.2:0/1891224988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ccc1076a0 0x7f9ccc199810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c890 tx=0x7f9cbc00cd50 comp rx=0 tx=0).stop 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd2c28640 1 -- 172.21.15.2:0/1891224988 reap_dead start 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 shutdown_connections 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 >> 172.21.15.2:0/1891224988 conn(0x7f9ccc0fd700 msgr2=0x7f9ccc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 shutdown_connections 2024-09-10T23:23:00.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.204+0000 7f9cd468b640 1 -- 172.21.15.2:0/1891224988 wait complete. 2024-09-10T23:23:00.875 INFO:teuthology.orchestra.run.smithi002.stdout:34359738446 2024-09-10T23:23:00.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T23:23:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1802409692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8102dc0 msgr2=0x7fbef81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1802409692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8102dc0 0x7fbef81031a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009900 tx=0x7fbef402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1802409692 shutdown_connections 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1802409692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef8109150 0x7fbef810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1802409692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbef81087d0 0x7fbef8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1802409692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8102dc0 0x7fbef81031a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1802409692 >> 172.21.15.2:0/1802409692 conn(0x7fbef80fe830 msgr2=0x7fbef8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1802409692 shutdown_connections 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.154+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1802409692 wait complete. 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 Processor -- start 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 -- start start 2024-09-10T23:23:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef8102dc0 0x7fbef81991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbef81087d0 0x7fbef81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8109150 0x7fbef819ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8112dd0 con 0x7fbef8109150 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8112c50 con 0x7fbef8102dc0 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbeff7a1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8112f50 con 0x7fbef81087d0 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.155+0000 7fbefdd3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8109150 0x7fbef819ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8109150 0x7fbef819ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37996/0 (socket says 172.21.15.2:37996) 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 -- 172.21.15.2:0/1539811867 learned_addr learned my addr 172.21.15.2:0/1539811867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefd53d640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef8102dc0 0x7fbef81991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefcd3c640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbef81087d0 0x7fbef81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 -- 172.21.15.2:0/1539811867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbef81087d0 msgr2=0x7fbef81996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbef81087d0 0x7fbef81996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 -- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef8102dc0 msgr2=0x7fbef81991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef8102dc0 0x7fbef81991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 -- 172.21.15.2:0/1539811867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef819f250 con 0x7fbef8109150 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbefdd3e640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8109150 0x7fbef819ea80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbef000cce0 tx=0x7fbef000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef000f450 con 0x7fbef8109150 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef819f540 con 0x7fbef8109150 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef000faa0 con 0x7fbef8109150 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0018b70 con 0x7fbef8109150 2024-09-10T23:23:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.156+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81a5c00 con 0x7fbef8109150 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.157+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbef81060e0 con 0x7fbef8109150 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.159+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fbef000f5f0 con 0x7fbef8109150 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbeee7fc640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbee40b5370 0x7fbee40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbefd53d640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbee40b5370 0x7fbee40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbef00e6750 con 0x7fbef8109150 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbeee7fc640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] conn(0x7fbee40bee10 0x7fbee40c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 --> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbef001ae50 con 0x7fbee40bee10 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fbef00e6ba0 con 0x7fbef8109150 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbefd53d640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbee40b5370 0x7fbee40b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbef4031440 tx=0x7fbef4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.160+0000 7fbefcd3c640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] conn(0x7fbee40bee10 0x7fbee40c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.161+0000 7fbefcd3c640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] conn(0x7fbee40bee10 0x7fbee40c12b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.162+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== osd.7 v2:172.21.15.154:6816/2645883120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbef001ae50 con 0x7fbee40bee10 2024-09-10T23:23:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.175+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 --> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbef8104070 con 0x7fbee40bee10 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeee7fc640 1 -- 172.21.15.2:0/1539811867 <== osd.7 v2:172.21.15.154:6816/2645883120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbef8104070 con 0x7fbee40bee10 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] conn(0x7fbee40bee10 msgr2=0x7fbee40c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] conn(0x7fbee40bee10 0x7fbee40c12b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbee40b5370 msgr2=0x7fbee40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbee40b5370 0x7fbee40b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbef4031440 tx=0x7fbef4005e80 comp rx=0 tx=0).stop 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8109150 msgr2=0x7fbef819ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 --2- 172.21.15.2:0/1539811867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8109150 0x7fbef819ea80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbef000cce0 tx=0x7fbef000a620 comp rx=0 tx=0).stop 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbefdd3e640 1 -- 172.21.15.2:0/1539811867 reap_dead start 2024-09-10T23:23:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 shutdown_connections 2024-09-10T23:23:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 >> 172.21.15.2:0/1539811867 conn(0x7fbef80fe830 msgr2=0x7fbef8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 shutdown_connections 2024-09-10T23:23:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:01.176+0000 7fbeff7a1640 1 -- 172.21.15.2:0/1539811867 wait complete. 2024-09-10T23:23:01.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:01 smithi154 ceph-mon[35136]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.0 KiB/s wr, 11 op/s; 117 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:23:01.904 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:01 smithi002 ceph-mon[31150]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.0 KiB/s wr, 11 op/s; 117 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:23:01.935 INFO:teuthology.orchestra.run.smithi002.stdout:274877906971 2024-09-10T23:23:01.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T23:23:01.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:01 smithi177 ceph-mon[35760]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.0 KiB/s wr, 11 op/s; 117 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:23:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 -- 172.21.15.2:0/614629229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090102de0 msgr2=0x7f90901031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 --2- 172.21.15.2:0/614629229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090102de0 0x7f90901031c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9080009ca0 tx=0x7f908002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 -- 172.21.15.2:0/614629229 shutdown_connections 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 --2- 172.21.15.2:0/614629229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9090109170 0x7f909010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 --2- 172.21.15.2:0/614629229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90901087f0 0x7f9090108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 --2- 172.21.15.2:0/614629229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090102de0 0x7f90901031c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 -- 172.21.15.2:0/614629229 >> 172.21.15.2:0/614629229 conn(0x7f90900fe830 msgr2=0x7f9090100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 -- 172.21.15.2:0/614629229 shutdown_connections 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.088+0000 7f90950b0640 1 -- 172.21.15.2:0/614629229 wait complete. 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 Processor -- start 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 -- start start 2024-09-10T23:23:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9090102de0 0x7f9090199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90901087f0 0x7f90901997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090109170 0x7f909019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9090112e30 con 0x7f9090109170 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9090112cb0 con 0x7f90901087f0 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f90950b0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9090112fb0 con 0x7f9090102de0 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f908f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090109170 0x7f909019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f908f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090109170 0x7f909019eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38024/0 (socket says 172.21.15.2:38024) 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.089+0000 7f908f59e640 1 -- 172.21.15.2:0/113766478 learned_addr learned my addr 172.21.15.2:0/113766478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908ed9d640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9090102de0 0x7f9090199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908e59c640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90901087f0 0x7f90901997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908f59e640 1 -- 172.21.15.2:0/113766478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9090102de0 msgr2=0x7f9090199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908f59e640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9090102de0 0x7f9090199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908f59e640 1 -- 172.21.15.2:0/113766478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90901087f0 msgr2=0x7f90901997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908f59e640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90901087f0 0x7f90901997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908f59e640 1 -- 172.21.15.2:0/113766478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909019f330 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908e59c640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90901087f0 0x7f90901997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f908f59e640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090109170 0x7f909019eb60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f908800c970 tx=0x7f908800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088007bb0 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909019f620 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9088007d50 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90901a5ce0 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.090+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088018770 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.091+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9090100a20 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.093+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f908800f990 con 0x7f9090109170 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.094+0000 7f9077fff640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f90780b5370 0x7f90780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.094+0000 7f908ed9d640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f90780b5370 0x7f90780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.094+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f90880e61b0 con 0x7f9090109170 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.094+0000 7f9077fff640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] conn(0x7f90780bee10 0x7f90780c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.094+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 --> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9088024ea0 con 0x7f90780bee10 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.094+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f90880e6600 con 0x7f9090109170 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.095+0000 7f908e59c640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] conn(0x7f90780bee10 0x7f90780c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.095+0000 7f908ed9d640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f90780b5370 0x7f90780b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9080000f80 tx=0x7f9080005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.095+0000 7f908e59c640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] conn(0x7f90780bee10 0x7f90780c12b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.096+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== osd.6 v2:172.21.15.2:6818/2336103544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9088024ea0 con 0x7f90780bee10 2024-09-10T23:23:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.109+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 --> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9090104090 con 0x7f90780bee10 2024-09-10T23:23:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f9077fff640 1 -- 172.21.15.2:0/113766478 <== osd.6 v2:172.21.15.2:6818/2336103544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9090104090 con 0x7f90780bee10 2024-09-10T23:23:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] conn(0x7f90780bee10 msgr2=0x7f90780c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] conn(0x7f90780bee10 0x7f90780c12b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f90780b5370 msgr2=0x7f90780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f90780b5370 0x7f90780b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9080000f80 tx=0x7f9080005ef0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090109170 msgr2=0x7f909019eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 --2- 172.21.15.2:0/113766478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090109170 0x7f909019eb60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f908800c970 tx=0x7f908800ce30 comp rx=0 tx=0).stop 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f908f59e640 1 -- 172.21.15.2:0/113766478 reap_dead start 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 shutdown_connections 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.110+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 >> 172.21.15.2:0/113766478 conn(0x7f90900fe830 msgr2=0x7f9090100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.111+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 shutdown_connections 2024-09-10T23:23:02.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.111+0000 7f90950b0640 1 -- 172.21.15.2:0/113766478 wait complete. 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 -- 172.21.15.2:0/1483239943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c10d250 msgr2=0x7f2c0c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/1483239943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c10d250 0x7f2c0c10f640 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009ca0 tx=0x7f2c0402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 -- 172.21.15.2:0/1483239943 shutdown_connections 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/1483239943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c10d250 0x7f2c0c10f640 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/1483239943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c0c10a920 0x7f2c0c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/1483239943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c101810 0x7f2c0c101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 -- 172.21.15.2:0/1483239943 >> 172.21.15.2:0/1483239943 conn(0x7f2c0c076f50 msgr2=0x7f2c0c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 -- 172.21.15.2:0/1483239943 shutdown_connections 2024-09-10T23:23:02.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.414+0000 7f2c12bf8640 1 -- 172.21.15.2:0/1483239943 wait complete. 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 Processor -- start 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 -- start start 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c101810 0x7f2c0c1027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c0c10a920 0x7f2c0c102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c10d250 0x7f2c0c103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c112d90 con 0x7f2c0c101810 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c112c10 con 0x7f2c0c10d250 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c12bf8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c112f10 con 0x7f2c0c10a920 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c10994640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c101810 0x7f2c0c1027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c10994640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c101810 0x7f2c0c1027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38036/0 (socket says 172.21.15.2:38036) 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c10994640 1 -- 172.21.15.2:0/3246666884 learned_addr learned my addr 172.21.15.2:0/3246666884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:02.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.415+0000 7f2c0bfff640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c0c10a920 0x7f2c0c102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c10994640 1 -- 172.21.15.2:0/3246666884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c0c10a920 msgr2=0x7f2c0c102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c11195640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c10d250 0x7f2c0c103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c10994640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c0c10a920 0x7f2c0c102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c10994640 1 -- 172.21.15.2:0/3246666884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c10d250 msgr2=0x7f2c0c103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c10994640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c10d250 0x7f2c0c103260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c10994640 1 -- 172.21.15.2:0/3246666884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c1a7620 con 0x7f2c0c101810 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c11195640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c0c10d250 0x7f2c0c103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c10994640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c101810 0x7f2c0c1027e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000d950 tx=0x7f2c0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00017070 con 0x7f2c0c101810 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c00009c30 con 0x7f2c0c101810 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c1a7910 con 0x7f2c0c101810 2024-09-10T23:23:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000f620 con 0x7f2c0c101810 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.416+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1a7ea0 con 0x7f2c0c101810 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.417+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c0c101000 con 0x7f2c0c101810 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.419+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f2c00010460 con 0x7f2c0c101810 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.419+0000 7f2c09ffb640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bfc0b53f0 0x7f2bfc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c0bfff640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bfc0b53f0 0x7f2bfc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2c000e5d00 con 0x7f2c0c101810 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c09ffb640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] conn(0x7f2bfc0bee90 0x7f2bfc0c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 --> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bfc0c1a00 con 0x7f2bfc0bee90 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f2c000e6150 con 0x7f2c0c101810 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c11195640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] conn(0x7f2bfc0bee90 0x7f2bfc0c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c0bfff640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bfc0b53f0 0x7f2bfc0b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c1042d0 tx=0x7f2bf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.420+0000 7f2c11195640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] conn(0x7f2bfc0bee90 0x7f2bfc0c1330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.421+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== osd.3 v2:172.21.15.2:6810/2995211952 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bfc0c1a00 con 0x7f2bfc0bee90 2024-09-10T23:23:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.435+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 --> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c0c06ae10 con 0x7f2bfc0bee90 2024-09-10T23:23:02.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.435+0000 7f2c09ffb640 1 -- 172.21.15.2:0/3246666884 <== osd.3 v2:172.21.15.2:6810/2995211952 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2c0c06ae10 con 0x7f2bfc0bee90 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] conn(0x7f2bfc0bee90 msgr2=0x7f2bfc0c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] conn(0x7f2bfc0bee90 0x7f2bfc0c1330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bfc0b53f0 msgr2=0x7f2bfc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bfc0b53f0 0x7f2bfc0b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c1042d0 tx=0x7f2bf8005f90 comp rx=0 tx=0).stop 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c101810 msgr2=0x7f2c0c1027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 --2- 172.21.15.2:0/3246666884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c0c101810 0x7f2c0c1027e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000d950 tx=0x7f2c0000de10 comp rx=0 tx=0).stop 2024-09-10T23:23:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c11195640 1 -- 172.21.15.2:0/3246666884 reap_dead start 2024-09-10T23:23:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 shutdown_connections 2024-09-10T23:23:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 >> 172.21.15.2:0/3246666884 conn(0x7f2c0c076f50 msgr2=0x7f2c0c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 shutdown_connections 2024-09-10T23:23:02.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:02.436+0000 7f2c12bf8640 1 -- 172.21.15.2:0/3246666884 wait complete. 2024-09-10T23:23:03.090 INFO:teuthology.orchestra.run.smithi002.stdout:253403070496 2024-09-10T23:23:03.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T23:23:03.504 INFO:teuthology.orchestra.run.smithi002.stdout:227633266725 2024-09-10T23:23:03.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T23:23:03.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:03 smithi002 ceph-mon[31150]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 106 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T23:23:03.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:03 smithi154 ceph-mon[35136]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 106 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T23:23:03.916 INFO:teuthology.orchestra.run.smithi002.stdout:55834574920 2024-09-10T23:23:03.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T23:23:03.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:03 smithi177 ceph-mon[35760]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 106 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 -- 172.21.15.2:0/4130397934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc1087d0 msgr2=0x7f3ecc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/4130397934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc1087d0 0x7f3ecc108c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009900 tx=0x7f3ec002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 -- 172.21.15.2:0/4130397934 shutdown_connections 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/4130397934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ecc109150 0x7f3ecc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/4130397934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc1087d0 0x7f3ecc108c10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/4130397934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc102dc0 0x7f3ecc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 -- 172.21.15.2:0/4130397934 >> 172.21.15.2:0/4130397934 conn(0x7f3ecc0fe830 msgr2=0x7f3ecc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 -- 172.21.15.2:0/4130397934 shutdown_connections 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.941+0000 7f3ed26ea640 1 -- 172.21.15.2:0/4130397934 wait complete. 2024-09-10T23:23:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 Processor -- start 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 -- start start 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc102dc0 0x7f3ecc199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc1087d0 0x7f3ecc199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ecc109150 0x7f3ecc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc112dd0 con 0x7f3ecc102dc0 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc112c50 con 0x7f3ecc1087d0 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ed26ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc112f50 con 0x7f3ecc109150 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ecbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc102dc0 0x7f3ecc199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ecbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc102dc0 0x7f3ecc199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52888/0 (socket says 172.21.15.2:52888) 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.942+0000 7f3ecbfff640 1 -- 172.21.15.2:0/2546562266 learned_addr learned my addr 172.21.15.2:0/2546562266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecb7fe640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc1087d0 0x7f3ecc199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecbfff640 1 -- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ecc109150 msgr2=0x7f3ecc19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecbfff640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ecc109150 0x7f3ecc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecbfff640 1 -- 172.21.15.2:0/2546562266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc1087d0 msgr2=0x7f3ecc199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecbfff640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc1087d0 0x7f3ecc199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecbfff640 1 -- 172.21.15.2:0/2546562266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc19f2d0 con 0x7f3ecc102dc0 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ecbfff640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc102dc0 0x7f3ecc199220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c920 tx=0x7f3ebc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc007c70 con 0x7f3ecc102dc0 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc19f5c0 con 0x7f3ecc102dc0 2024-09-10T23:23:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ebc007e10 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc018820 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.943+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc1a5e50 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.944+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ecc0638e0 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.946+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f3ebc00f450 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.946+0000 7f3ec97fa640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3eb40b5370 0x7f3eb40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.946+0000 7f3ecb7fe640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3eb40b5370 0x7f3eb40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.946+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3ebc0e6340 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.947+0000 7f3ec97fa640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] conn(0x7f3eb40bee10 0x7f3eb40c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.947+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 --> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3eb40c1980 con 0x7f3eb40bee10 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.947+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f3ebc0e6790 con 0x7f3ecc102dc0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.947+0000 7f3ecb7fe640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3eb40b5370 0x7f3eb40b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0031440 tx=0x7f3ec00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:03.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.947+0000 7f3ed0c87640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] conn(0x7f3eb40bee10 0x7f3eb40c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.947+0000 7f3ed0c87640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] conn(0x7f3eb40bee10 0x7f3eb40c12b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.948+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== osd.2 v2:172.21.15.177:6800/3512583930 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3eb40c1980 con 0x7f3eb40bee10 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.962+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 --> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ecc063d60 con 0x7f3eb40bee10 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ec97fa640 1 -- 172.21.15.2:0/2546562266 <== osd.2 v2:172.21.15.177:6800/3512583930 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3ecc063d60 con 0x7f3eb40bee10 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] conn(0x7f3eb40bee10 msgr2=0x7f3eb40c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] conn(0x7f3eb40bee10 0x7f3eb40c12b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3eb40b5370 msgr2=0x7f3eb40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3eb40b5370 0x7f3eb40b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0031440 tx=0x7f3ec00095f0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc102dc0 msgr2=0x7f3ecc199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 --2- 172.21.15.2:0/2546562266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ecc102dc0 0x7f3ecc199220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c920 tx=0x7f3ebc00cde0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed0c87640 1 -- 172.21.15.2:0/2546562266 reap_dead start 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 shutdown_connections 2024-09-10T23:23:03.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 >> 172.21.15.2:0/2546562266 conn(0x7f3ecc0fe830 msgr2=0x7f3ecc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:03.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 shutdown_connections 2024-09-10T23:23:03.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:22:59.963+0000 7f3ed26ea640 1 -- 172.21.15.2:0/2546562266 wait complete. 2024-09-10T23:23:04.889 INFO:teuthology.orchestra.run.smithi002.stdout:201863462954 2024-09-10T23:23:04.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T23:23:05.329 INFO:teuthology.orchestra.run.smithi002.stdout:77309411397 2024-09-10T23:23:05.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 -- 172.21.15.2:0/3875436656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9428109170 msgr2=0x7f942810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 --2- 172.21.15.2:0/3875436656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9428109170 0x7f942810f970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9420009ca0 tx=0x7f942002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 -- 172.21.15.2:0/3875436656 shutdown_connections 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 --2- 172.21.15.2:0/3875436656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9428109170 0x7f942810f970 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 --2- 172.21.15.2:0/3875436656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94281087f0 0x7f9428108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 --2- 172.21.15.2:0/3875436656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9428102de0 0x7f94281031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 -- 172.21.15.2:0/3875436656 >> 172.21.15.2:0/3875436656 conn(0x7f94280fe830 msgr2=0x7f9428100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 -- 172.21.15.2:0/3875436656 shutdown_connections 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.487+0000 7f942f45e640 1 -- 172.21.15.2:0/3875436656 wait complete. 2024-09-10T23:23:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 Processor -- start 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 -- start start 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9428102de0 0x7f94280754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94281087f0 0x7f94280759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9428109170 0x7f9428075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9428112df0 con 0x7f94281087f0 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9428112c70 con 0x7f9428102de0 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942f45e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9428112f70 con 0x7f9428109170 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94281087f0 0x7f94280759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94281087f0 0x7f94280759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38054/0 (socket says 172.21.15.2:38054) 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 -- 172.21.15.2:0/3322734731 learned_addr learned my addr 172.21.15.2:0/3322734731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942d1fa640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9428102de0 0x7f94280754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942d9fb640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9428109170 0x7f9428075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 -- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9428109170 msgr2=0x7f9428075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9428109170 0x7f9428075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 -- 172.21.15.2:0/3322734731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9428102de0 msgr2=0x7f94280754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9428102de0 0x7f94280754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 -- 172.21.15.2:0/3322734731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94281a7600 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942d9fb640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9428109170 0x7f9428075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.488+0000 7f942c9f9640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94281087f0 0x7f94280759e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f941800c920 tx=0x7f941800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.489+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418007bb0 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.489+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94281a78f0 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.489+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9418007d50 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.489+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418018730 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.489+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94281a7e80 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.490+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94280ffa00 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.492+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f941800f450 con 0x7f94281087f0 2024-09-10T23:23:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.492+0000 7f941e7fc640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94140b5370 0x7f94140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.492+0000 7f942d1fa640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94140b5370 0x7f94140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f94180e6290 con 0x7f94281087f0 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f941e7fc640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] conn(0x7f94140bee10 0x7f94140c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 --> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9418011ec0 con 0x7f94140bee10 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f94180e66e0 con 0x7f94281087f0 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f942d1fa640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94140b5370 0x7f94140b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f942400abe0 tx=0x7f942400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f942d9fb640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] conn(0x7f94140bee10 0x7f94140c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.493+0000 7f942d9fb640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] conn(0x7f94140bee10 0x7f94140c12b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:05.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.494+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== osd.5 v2:172.21.15.177:6808/1630560150 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9418011ec0 con 0x7f94140bee10 2024-09-10T23:23:05.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.509+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 --> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9428104090 con 0x7f94140bee10 2024-09-10T23:23:05.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.509+0000 7f941e7fc640 1 -- 172.21.15.2:0/3322734731 <== osd.5 v2:172.21.15.177:6808/1630560150 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9428104090 con 0x7f94140bee10 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] conn(0x7f94140bee10 msgr2=0x7f94140c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] conn(0x7f94140bee10 0x7f94140c12b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94140b5370 msgr2=0x7f94140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94140b5370 0x7f94140b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f942400abe0 tx=0x7f942400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94281087f0 msgr2=0x7f94280759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 --2- 172.21.15.2:0/3322734731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94281087f0 0x7f94280759e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f941800c920 tx=0x7f941800cd20 comp rx=0 tx=0).stop 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942d9fb640 1 -- 172.21.15.2:0/3322734731 reap_dead start 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 shutdown_connections 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 >> 172.21.15.2:0/3322734731 conn(0x7f94280fe830 msgr2=0x7f94280fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 shutdown_connections 2024-09-10T23:23:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:05.510+0000 7f942f45e640 1 -- 172.21.15.2:0/3322734731 wait complete. 2024-09-10T23:23:05.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:05 smithi002 ceph-mon[31150]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:23:05.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:05 smithi154 ceph-mon[35136]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:23:05.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:05 smithi177 ceph-mon[35760]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:23:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.443 INFO:teuthology.orchestra.run.smithi002.stdout:180388626479 2024-09-10T23:23:06.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T23:23:06.855 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.864 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.893 INFO:teuthology.orchestra.run.smithi002.stdout:154618822710 2024-09-10T23:23:06.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T23:23:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.928 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.929 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.930 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:07.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:07 smithi002 ceph-mon[31150]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-10T23:23:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:07 smithi154 ceph-mon[35136]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-10T23:23:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:07 smithi177 ceph-mon[35760]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 -- 172.21.15.2:0/3797071902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a0108020 msgr2=0x7f15a010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3797071902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a0108020 0x7f15a010e820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1598009ca0 tx=0x7f159802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 -- 172.21.15.2:0/3797071902 shutdown_connections 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3797071902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a0108020 0x7f15a010e820 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3797071902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a01076a0 0x7f15a0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3797071902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a0101c90 0x7f15a0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 -- 172.21.15.2:0/3797071902 >> 172.21.15.2:0/3797071902 conn(0x7f15a00fd700 msgr2=0x7f15a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 -- 172.21.15.2:0/3797071902 shutdown_connections 2024-09-10T23:23:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.002+0000 7f15a7a34640 1 -- 172.21.15.2:0/3797071902 wait complete. 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 Processor -- start 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 -- start start 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a0101c90 0x7f15a019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 0x7f15a019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a0108020 0x7f15a01a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0111ce0 con 0x7f15a01076a0 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0111b60 con 0x7f15a0101c90 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a7a34640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0111e60 con 0x7f15a0108020 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a4fcf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 0x7f15a019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a4fcf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 0x7f15a019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38082/0 (socket says 172.21.15.2:38082) 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a4fcf640 1 -- 172.21.15.2:0/3204909719 learned_addr learned my addr 172.21.15.2:0/3204909719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a57d0640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a0101c90 0x7f15a019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.003+0000 7f15a5fd1640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a0108020 0x7f15a01a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a4fcf640 1 -- 172.21.15.2:0/3204909719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a0108020 msgr2=0x7f15a01a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a4fcf640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a0108020 0x7f15a01a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a4fcf640 1 -- 172.21.15.2:0/3204909719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a0101c90 msgr2=0x7f15a019b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a4fcf640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a0101c90 0x7f15a019b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a4fcf640 1 -- 172.21.15.2:0/3204909719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a01a14f0 con 0x7f15a01076a0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a4fcf640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 0x7f15a019b980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f159000d950 tx=0x7f159000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590017030 con 0x7f15a01076a0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a01a17e0 con 0x7f15a01076a0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1590004020 con 0x7f15a01076a0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900047a0 con 0x7f15a01076a0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.004+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a01a7ea0 con 0x7f15a01076a0 2024-09-10T23:23:08.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.005+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a0102070 con 0x7f15a01076a0 2024-09-10T23:23:08.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.006+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f1590009a30 con 0x7f15a01076a0 2024-09-10T23:23:08.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.007+0000 7f15967fc640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f158c0b5370 0x7f158c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.007+0000 7f15a57d0640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f158c0b5370 0x7f158c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.007+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f15900e5e70 con 0x7f15a01076a0 2024-09-10T23:23:08.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.008+0000 7f15a57d0640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f158c0b5370 0x7f158c0b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f159c0058c0 tx=0x7f159c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:08.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.010+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f15900acb80 con 0x7f15a01076a0 2024-09-10T23:23:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.199+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f15a01a8200 con 0x7f15a01076a0 2024-09-10T23:23:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.200+0000 7f15967fc640 1 -- 172.21.15.2:0/3204909719 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f15900ac480 con 0x7f15a01076a0 2024-09-10T23:23:08.201 INFO:teuthology.orchestra.run.smithi002.stdout:133143986235 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f158c0b5370 msgr2=0x7f158c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f158c0b5370 0x7f158c0b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f159c0058c0 tx=0x7f159c00a250 comp rx=0 tx=0).stop 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 msgr2=0x7f15a019b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 0x7f15a019b980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f159000d950 tx=0x7f159000de10 comp rx=0 tx=0).stop 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 shutdown_connections 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f158c0b5370 0x7f158c0b7830 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a0108020 0x7f15a01a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15a01076a0 0x7f15a019b980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 --2- 172.21.15.2:0/3204909719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a0101c90 0x7f15a019b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.203+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 >> 172.21.15.2:0/3204909719 conn(0x7f15a00fd700 msgr2=0x7f15a006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.204+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 shutdown_connections 2024-09-10T23:23:08.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.204+0000 7f15a7a34640 1 -- 172.21.15.2:0/3204909719 wait complete. 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 -- 172.21.15.2:0/3824454436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b981087d0 msgr2=0x7f9b98108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/3824454436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b981087d0 0x7f9b98108c10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009900 tx=0x7f9b9402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 -- 172.21.15.2:0/3824454436 shutdown_connections 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/3824454436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b98109150 0x7f9b9810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/3824454436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b981087d0 0x7f9b98108c10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/3824454436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b98102dc0 0x7f9b981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 -- 172.21.15.2:0/3824454436 >> 172.21.15.2:0/3824454436 conn(0x7f9b980fe830 msgr2=0x7f9b98100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 -- 172.21.15.2:0/3824454436 shutdown_connections 2024-09-10T23:23:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.269+0000 7f9b9fda8640 1 -- 172.21.15.2:0/3824454436 wait complete. 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 Processor -- start 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 -- start start 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 0x7f9b98199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b981087d0 0x7f9b98199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b98109150 0x7f9b9819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98112e60 con 0x7f9b98102dc0 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98112ce0 con 0x7f9b98109150 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9fda8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98112fe0 con 0x7f9b981087d0 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9db44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 0x7f9b98199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9db44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 0x7f9b98199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38088/0 (socket says 172.21.15.2:38088) 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9db44640 1 -- 172.21.15.2:0/2326216336 learned_addr learned my addr 172.21.15.2:0/2326216336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.270+0000 7f9b9e345640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b98109150 0x7f9b9819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9d343640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b981087d0 0x7f9b98199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9db44640 1 -- 172.21.15.2:0/2326216336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b981087d0 msgr2=0x7f9b98199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9db44640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b981087d0 0x7f9b98199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9db44640 1 -- 172.21.15.2:0/2326216336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b98109150 msgr2=0x7f9b9819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9db44640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b98109150 0x7f9b9819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9db44640 1 -- 172.21.15.2:0/2326216336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9819f3c0 con 0x7f9b98102dc0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9db44640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 0x7f9b98199310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00d950 tx=0x7f9b8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c017070 con 0x7f9b98102dc0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b8c009c30 con 0x7f9b98102dc0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9819f6b0 con 0x7f9b98102dc0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00f620 con 0x7f9b98102dc0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.271+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b981a5f40 con 0x7f9b98102dc0 2024-09-10T23:23:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.272+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b981031a0 con 0x7f9b98102dc0 2024-09-10T23:23:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.274+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9b8c005030 con 0x7f9b98102dc0 2024-09-10T23:23:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.275+0000 7f9b8affd640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9b840b53f0 0x7f9b840b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.275+0000 7f9b9d343640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9b840b53f0 0x7f9b840b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.275+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9b8c0e58f0 con 0x7f9b98102dc0 2024-09-10T23:23:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.275+0000 7f9b9d343640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9b840b53f0 0x7f9b840b78b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402a930 tx=0x7f9b94005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.278+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9b8c0ac6e0 con 0x7f9b98102dc0 2024-09-10T23:23:08.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.466+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f9b9810a9a0 con 0x7f9b98102dc0 2024-09-10T23:23:08.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.467+0000 7f9b8affd640 1 -- 172.21.15.2:0/2326216336 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9b8c009de0 con 0x7f9b98102dc0 2024-09-10T23:23:08.468 INFO:teuthology.orchestra.run.smithi002.stdout:253403070498 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9b840b53f0 msgr2=0x7f9b840b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9b840b53f0 0x7f9b840b78b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402a930 tx=0x7f9b94005fd0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 msgr2=0x7f9b98199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 0x7f9b98199310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00d950 tx=0x7f9b8c00de10 comp rx=0 tx=0).stop 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 shutdown_connections 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9b840b53f0 0x7f9b840b78b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b98109150 0x7f9b9819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b981087d0 0x7f9b98199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 --2- 172.21.15.2:0/2326216336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b98102dc0 0x7f9b98199310 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:08.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 >> 172.21.15.2:0/2326216336 conn(0x7f9b980fe830 msgr2=0x7f9b98105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:08.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 shutdown_connections 2024-09-10T23:23:08.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:08.469+0000 7f9b9fda8640 1 -- 172.21.15.2:0/2326216336 wait complete. 2024-09-10T23:23:08.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:08 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3204909719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:23:08.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:08 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2326216336' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:23:08.865 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:08 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3204909719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:23:08.865 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:08 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2326216336' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:23:08.919 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:08 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3204909719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:23:08.919 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:08 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2326216336' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:23:09.562 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070496 got 253403070498 for osd.9 2024-09-10T23:23:09.563 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:09.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:09 smithi002 ceph-mon[31150]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:09.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:09 smithi154 ceph-mon[35136]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:09.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986233 got 133143986235 for osd.4 2024-09-10T23:23:09.893 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:09 smithi177 ceph-mon[35760]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:10.306 INFO:teuthology.orchestra.run.smithi002.stdout:107374182463 2024-09-10T23:23:10.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T23:23:10.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 -- 172.21.15.2:0/3066122752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770108020 msgr2=0x7f977010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 --2- 172.21.15.2:0/3066122752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770108020 0x7f977010e820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9768009ca0 tx=0x7f976802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 -- 172.21.15.2:0/3066122752 shutdown_connections 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 --2- 172.21.15.2:0/3066122752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770108020 0x7f977010e820 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 --2- 172.21.15.2:0/3066122752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97701076a0 0x7f9770107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 --2- 172.21.15.2:0/3066122752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9770101c90 0x7f9770102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 -- 172.21.15.2:0/3066122752 >> 172.21.15.2:0/3066122752 conn(0x7f97700fd700 msgr2=0x7f97700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 -- 172.21.15.2:0/3066122752 shutdown_connections 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.490+0000 7f9774b81640 1 -- 172.21.15.2:0/3066122752 wait complete. 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 Processor -- start 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 -- start start 2024-09-10T23:23:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 0x7f97701980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97701076a0 0x7f97701985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9770108020 0x7f977019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9770111ce0 con 0x7f9770101c90 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9770111b60 con 0x7f9770108020 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f9774b81640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9770111e60 con 0x7f97701076a0 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f976e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 0x7f97701980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f976e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 0x7f97701980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38100/0 (socket says 172.21.15.2:38100) 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.491+0000 7f976e59c640 1 -- 172.21.15.2:0/2768531719 learned_addr learned my addr 172.21.15.2:0/2768531719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976ed9d640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9770108020 0x7f977019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f9767fff640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97701076a0 0x7f97701985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976e59c640 1 -- 172.21.15.2:0/2768531719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97701076a0 msgr2=0x7f97701985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976e59c640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97701076a0 0x7f97701985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976e59c640 1 -- 172.21.15.2:0/2768531719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9770108020 msgr2=0x7f977019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976e59c640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9770108020 0x7f977019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976e59c640 1 -- 172.21.15.2:0/2768531719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977019e160 con 0x7f9770101c90 2024-09-10T23:23:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976ed9d640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9770108020 0x7f977019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f976e59c640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 0x7f97701980b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9760009970 tx=0x7f9760009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976000d020 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977019e450 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f976000d1c0 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976000cc50 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.492+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977006aab0 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.493+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9770102070 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.495+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9760007860 con 0x7f9770101c90 2024-09-10T23:23:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.496+0000 7f97677fe640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f975c0b5370 0x7f975c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.496+0000 7f9767fff640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f975c0b5370 0x7f975c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.496+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f97600e76a0 con 0x7f9770101c90 2024-09-10T23:23:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.497+0000 7f9767fff640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f975c0b5370 0x7f975c0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9758005e10 tx=0x7f9758005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.499+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f97600ae410 con 0x7f9770101c90 2024-09-10T23:23:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.690+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f977006ae30 con 0x7f9770101c90 2024-09-10T23:23:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.691+0000 7f97677fe640 1 -- 172.21.15.2:0/2768531719 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f97600add10 con 0x7f9770101c90 2024-09-10T23:23:10.692 INFO:teuthology.orchestra.run.smithi002.stdout:201863462956 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f975c0b5370 msgr2=0x7f975c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f975c0b5370 0x7f975c0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9758005e10 tx=0x7f9758005da0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 msgr2=0x7f97701980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 0x7f97701980b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9760009970 tx=0x7f9760009e30 comp rx=0 tx=0).stop 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 shutdown_connections 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f975c0b5370 0x7f975c0b7830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9770108020 0x7f977019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97701076a0 0x7f97701985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 --2- 172.21.15.2:0/2768531719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9770101c90 0x7f97701980b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 >> 172.21.15.2:0/2768531719 conn(0x7f97700fd700 msgr2=0x7f97700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 shutdown_connections 2024-09-10T23:23:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.693+0000 7f9774b81640 1 -- 172.21.15.2:0/2768531719 wait complete. 2024-09-10T23:23:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 -- 172.21.15.2:0/3107774604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 msgr2=0x7f987c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 --2- 172.21.15.2:0/3107774604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1031a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f986c009900 tx=0x7f986c02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 -- 172.21.15.2:0/3107774604 shutdown_connections 2024-09-10T23:23:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 --2- 172.21.15.2:0/3107774604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c109150 0x7f987c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 --2- 172.21.15.2:0/3107774604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f987c1087d0 0x7f987c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 --2- 172.21.15.2:0/3107774604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1031a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 -- 172.21.15.2:0/3107774604 >> 172.21.15.2:0/3107774604 conn(0x7f987c0fe830 msgr2=0x7f987c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 -- 172.21.15.2:0/3107774604 shutdown_connections 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.783+0000 7f98811c3640 1 -- 172.21.15.2:0/3107774604 wait complete. 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 Processor -- start 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 -- start start 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f987c1087d0 0x7f987c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c109150 0x7f987c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f987c112e60 con 0x7f987c102dc0 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f987c112ce0 con 0x7f987c109150 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f98811c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f987c112fe0 con 0x7f987c1087d0 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.784+0000 7f987ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38122/0 (socket says 172.21.15.2:38122) 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 -- 172.21.15.2:0/3314442419 learned_addr learned my addr 172.21.15.2:0/3314442419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987259c640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f987c1087d0 0x7f987c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987b59e640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c109150 0x7f987c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 -- 172.21.15.2:0/3314442419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f987c1087d0 msgr2=0x7f987c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f987c1087d0 0x7f987c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 -- 172.21.15.2:0/3314442419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c109150 msgr2=0x7f987c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c109150 0x7f987c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 -- 172.21.15.2:0/3314442419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c19f380 con 0x7f987c102dc0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f987ad9d640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1992d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f986c005ab0 tx=0x7f986c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c03f070 con 0x7f987c102dc0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c19f610 con 0x7f987c102dc0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986c031d60 con 0x7f987c102dc0 2024-09-10T23:23:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c035030 con 0x7f987c102dc0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.785+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c1a5d30 con 0x7f987c102dc0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.786+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c1031a0 con 0x7f987c102dc0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.788+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f986c03b580 con 0x7f987c102dc0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.789+0000 7f9878d99640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98680b5370 0x7f98680b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.789+0000 7f987259c640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98680b5370 0x7f98680b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.789+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f986c106eb0 con 0x7f987c102dc0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.789+0000 7f987259c640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98680b5370 0x7f98680b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f987c101e20 tx=0x7f986400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.792+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f986c0cd570 con 0x7f987c102dc0 2024-09-10T23:23:10.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.985+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f987c10af30 con 0x7f987c102dc0 2024-09-10T23:23:10.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.986+0000 7f9878d99640 1 -- 172.21.15.2:0/3314442419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f986c0d1fa0 con 0x7f987c102dc0 2024-09-10T23:23:10.986 INFO:teuthology.orchestra.run.smithi002.stdout:227633266728 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98680b5370 msgr2=0x7f98680b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98680b5370 0x7f98680b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f987c101e20 tx=0x7f986400b390 comp rx=0 tx=0).stop 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 msgr2=0x7f987c1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1992d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f986c005ab0 tx=0x7f986c003cd0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 shutdown_connections 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98680b5370 0x7f98680b7830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c109150 0x7f987c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f987c1087d0 0x7f987c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 --2- 172.21.15.2:0/3314442419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f987c102dc0 0x7f987c1992d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 >> 172.21.15.2:0/3314442419 conn(0x7f987c0fe830 msgr2=0x7f987c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:10.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 shutdown_connections 2024-09-10T23:23:10.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.988+0000 7f98811c3640 1 -- 172.21.15.2:0/3314442419 wait complete. 2024-09-10T23:23:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.993+0000 7fdca4d88640 1 -- 172.21.15.2:0/2826954032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 msgr2=0x7fdca01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.993+0000 7fdca4d88640 1 --2- 172.21.15.2:0/2826954032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 0x7fdca01031c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009900 tx=0x7fdc9002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 -- 172.21.15.2:0/2826954032 shutdown_connections 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 --2- 172.21.15.2:0/2826954032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0109170 0x7fdca010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 --2- 172.21.15.2:0/2826954032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca01087f0 0x7fdca0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 --2- 172.21.15.2:0/2826954032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 0x7fdca01031c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 -- 172.21.15.2:0/2826954032 >> 172.21.15.2:0/2826954032 conn(0x7fdca00fe830 msgr2=0x7fdca0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 -- 172.21.15.2:0/2826954032 shutdown_connections 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 -- 172.21.15.2:0/2826954032 wait complete. 2024-09-10T23:23:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 Processor -- start 2024-09-10T23:23:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.994+0000 7fdca4d88640 1 -- start start 2024-09-10T23:23:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdca4d88640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 0x7fdca0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdca4d88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca01087f0 0x7fdca0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdca4d88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca0109170 0x7fdca019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdca4d88640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0112e80 con 0x7fdca0102de0 2024-09-10T23:23:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdca4d88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0112d00 con 0x7fdca0109170 2024-09-10T23:23:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdca4d88640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0113000 con 0x7fdca01087f0 2024-09-10T23:23:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 0x7fdca0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 0x7fdca0199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38142/0 (socket says 172.21.15.2:38142) 2024-09-10T23:23:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9e59c640 1 -- 172.21.15.2:0/1816402754 learned_addr learned my addr 172.21.15.2:0/1816402754 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9dd9b640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca01087f0 0x7fdca0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9ed9d640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca0109170 0x7fdca019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9dd9b640 1 -- 172.21.15.2:0/1816402754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca0109170 msgr2=0x7fdca019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9dd9b640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca0109170 0x7fdca019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9dd9b640 1 -- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 msgr2=0x7fdca0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9dd9b640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca0102de0 0x7fdca0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.995+0000 7fdc9dd9b640 1 -- 172.21.15.2:0/1816402754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca019f3e0 con 0x7fdca01087f0 2024-09-10T23:23:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.996+0000 7fdc9dd9b640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca01087f0 0x7fdca0199870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400e9f0 tx=0x7fdc9400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.996+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400ccc0 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.996+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca019f6d0 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.996+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc940108e0 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.996+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94018880 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.996+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca01a5f60 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.997+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdca0100a60 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.999+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fdc94029050 con 0x7fdca01087f0 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:10.999+0000 7fdc8f7fe640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc880b5370 0x7fdc880b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc9e59c640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc880b5370 0x7fdc880b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdc940e65f0 con 0x7fdca01087f0 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc8f7fe640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] conn(0x7fdc880bee10 0x7fdc880c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 --> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc94027e50 con 0x7fdc880bee10 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdc940e69a0 con 0x7fdca01087f0 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc9e59c640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc880b5370 0x7fdc880b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdc900096c0 tx=0x7fdc90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.000+0000 7fdc9ed9d640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] conn(0x7fdc880bee10 0x7fdc880c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.001+0000 7fdc9ed9d640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] conn(0x7fdc880bee10 0x7fdc880c12b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.001+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== osd.11 v2:172.21.15.177:6824/3355252458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc94027e50 con 0x7fdc880bee10 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.016+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 --> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdca0104090 con 0x7fdc880bee10 2024-09-10T23:23:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.016+0000 7fdc8f7fe640 1 -- 172.21.15.2:0/1816402754 <== osd.11 v2:172.21.15.177:6824/3355252458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdca0104090 con 0x7fdc880bee10 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] conn(0x7fdc880bee10 msgr2=0x7fdc880c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] conn(0x7fdc880bee10 0x7fdc880c12b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc880b5370 msgr2=0x7fdc880b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc880b5370 0x7fdc880b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdc900096c0 tx=0x7fdc90005a20 comp rx=0 tx=0).stop 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca01087f0 msgr2=0x7fdca0199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 --2- 172.21.15.2:0/1816402754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca01087f0 0x7fdca0199870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400e9f0 tx=0x7fdc9400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdc9ed9d640 1 -- 172.21.15.2:0/1816402754 reap_dead start 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 shutdown_connections 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 >> 172.21.15.2:0/1816402754 conn(0x7fdca00fe830 msgr2=0x7fdca0100040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 shutdown_connections 2024-09-10T23:23:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:11.017+0000 7fdca4d88640 1 -- 172.21.15.2:0/1816402754 wait complete. 2024-09-10T23:23:11.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:11 smithi154 ceph-mon[35136]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T23:23:11.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2768531719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:23:11.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3314442419' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:23:11.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:11 smithi002 ceph-mon[31150]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T23:23:11.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2768531719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:23:11.901 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3314442419' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:23:11.935 INFO:teuthology.orchestra.run.smithi002.stdout:296352743448 2024-09-10T23:23:11.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T23:23:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:11 smithi177 ceph-mon[35760]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T23:23:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2768531719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:23:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3314442419' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:23:12.626 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462954 got 201863462956 for osd.7 2024-09-10T23:23:12.626 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:13.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 -- 172.21.15.2:0/1794363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4101870 msgr2=0x7f8fb4101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/1794363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4101870 0x7f8fb4101c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 -- 172.21.15.2:0/1794363991 shutdown_connections 2024-09-10T23:23:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/1794363991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb410f420 0x7f8fb4111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/1794363991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4102190 0x7f8fb410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/1794363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4101870 0x7f8fb4101c50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 -- 172.21.15.2:0/1794363991 >> 172.21.15.2:0/1794363991 conn(0x7f8fb40fd700 msgr2=0x7f8fb40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 -- 172.21.15.2:0/1794363991 shutdown_connections 2024-09-10T23:23:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.017+0000 7f8fb94d2640 1 -- 172.21.15.2:0/1794363991 wait complete. 2024-09-10T23:23:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 Processor -- start 2024-09-10T23:23:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 -- start start 2024-09-10T23:23:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4101870 0x7f8fb419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 0x7f8fb419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb410f420 0x7f8fb41a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4115080 con 0x7f8fb4102190 2024-09-10T23:23:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4114f00 con 0x7f8fb4101870 2024-09-10T23:23:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb94d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4115200 con 0x7f8fb410f420 2024-09-10T23:23:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 0x7f8fb419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 0x7f8fb419bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49622/0 (socket says 172.21.15.2:49622) 2024-09-10T23:23:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb27fc640 1 -- 172.21.15.2:0/570121363 learned_addr learned my addr 172.21.15.2:0/570121363 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.018+0000 7f8fb2ffd640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4101870 0x7f8fb419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb37fe640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb410f420 0x7f8fb41a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb27fc640 1 -- 172.21.15.2:0/570121363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb410f420 msgr2=0x7f8fb41a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb27fc640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb410f420 0x7f8fb41a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb27fc640 1 -- 172.21.15.2:0/570121363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4101870 msgr2=0x7f8fb419b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb27fc640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4101870 0x7f8fb419b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb27fc640 1 -- 172.21.15.2:0/570121363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41a16e0 con 0x7f8fb4102190 2024-09-10T23:23:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb2ffd640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4101870 0x7f8fb419b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb27fc640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 0x7f8fb419bb70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800b4a0 tx=0x7f8fa800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8014070 con 0x7f8fb4102190 2024-09-10T23:23:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fa8010ac0 con 0x7f8fb4102190 2024-09-10T23:23:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb41a19d0 con 0x7f8fb4102190 2024-09-10T23:23:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8017c30 con 0x7f8fb4102190 2024-09-10T23:23:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.019+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41a8110 con 0x7f8fb4102190 2024-09-10T23:23:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.020+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb4101cd0 con 0x7f8fb4102190 2024-09-10T23:23:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.022+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f8fa8010610 con 0x7f8fb4102190 2024-09-10T23:23:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.022+0000 7f8f9bfff640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f9c0b5370 0x7f8f9c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.022+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8fa80e56f0 con 0x7f8fb4102190 2024-09-10T23:23:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.022+0000 7f8fb2ffd640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f9c0b5370 0x7f8f9c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.023+0000 7f8fb2ffd640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f9c0b5370 0x7f8f9c0b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4031440 tx=0x7f8fa40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.026+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8fa80ac460 con 0x7f8fb4102190 2024-09-10T23:23:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.236+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f8fb419c760 con 0x7f8fb4102190 2024-09-10T23:23:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.237+0000 7f8f9bfff640 1 -- 172.21.15.2:0/570121363 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8fa80abd60 con 0x7f8fb4102190 2024-09-10T23:23:13.251 INFO:teuthology.orchestra.run.smithi002.stdout:274877906974 2024-09-10T23:23:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f9c0b5370 msgr2=0x7f8f9c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f9c0b5370 0x7f8f9c0b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4031440 tx=0x7f8fa40095f0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 msgr2=0x7f8fb419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 0x7f8fb419bb70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800b4a0 tx=0x7f8fa800b960 comp rx=0 tx=0).stop 2024-09-10T23:23:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 shutdown_connections 2024-09-10T23:23:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f9c0b5370 0x7f8f9c0b7830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fb410f420 0x7f8fb41a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fb4102190 0x7f8fb419bb70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 --2- 172.21.15.2:0/570121363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb4101870 0x7f8fb419b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 >> 172.21.15.2:0/570121363 conn(0x7f8fb40fd700 msgr2=0x7f8fb40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 shutdown_connections 2024-09-10T23:23:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:13.239+0000 7f8fb94d2640 1 -- 172.21.15.2:0/570121363 wait complete. 2024-09-10T23:23:13.500 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266725 got 227633266728 for osd.8 2024-09-10T23:23:13.500 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:13.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:13 smithi002 ceph-mon[31150]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-10T23:23:13.811 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:13 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/570121363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:23:13.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:13 smithi177 ceph-mon[35760]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-10T23:23:13.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:13 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/570121363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:23:14.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:13 smithi154 ceph-mon[35136]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-10T23:23:14.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:13 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/570121363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:23:14.155 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906971 got 274877906974 for osd.10 2024-09-10T23:23:14.155 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 -- 172.21.15.2:0/3770344415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330109150 msgr2=0x7f633010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 --2- 172.21.15.2:0/3770344415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330109150 0x7f633010f950 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6328009ca0 tx=0x7f632802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 -- 172.21.15.2:0/3770344415 shutdown_connections 2024-09-10T23:23:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 --2- 172.21.15.2:0/3770344415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330109150 0x7f633010f950 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 --2- 172.21.15.2:0/3770344415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63301087d0 0x7f6330108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 --2- 172.21.15.2:0/3770344415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330102dc0 0x7f63301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 -- 172.21.15.2:0/3770344415 >> 172.21.15.2:0/3770344415 conn(0x7f63300fe830 msgr2=0x7f6330100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 -- 172.21.15.2:0/3770344415 shutdown_connections 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.488+0000 7f6335a23640 1 -- 172.21.15.2:0/3770344415 wait complete. 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 Processor -- start 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 -- start start 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 0x7f633019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63301087d0 0x7f633019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330109150 0x7f63301a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6330112e10 con 0x7f6330102dc0 2024-09-10T23:23:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6330112c90 con 0x7f63301087d0 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f6335a23640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6330112f90 con 0x7f6330109150 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 0x7f633019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 0x7f633019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49644/0 (socket says 172.21.15.2:49644) 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632effd640 1 -- 172.21.15.2:0/2465824996 learned_addr learned my addr 172.21.15.2:0/2465824996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632e7fc640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63301087d0 0x7f633019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632f7fe640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330109150 0x7f63301a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632effd640 1 -- 172.21.15.2:0/2465824996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330109150 msgr2=0x7f63301a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.489+0000 7f632effd640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330109150 0x7f63301a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f632effd640 1 -- 172.21.15.2:0/2465824996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63301087d0 msgr2=0x7f633019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f632effd640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63301087d0 0x7f633019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f632effd640 1 -- 172.21.15.2:0/2465824996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63301a1590 con 0x7f6330102dc0 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f632f7fe640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330109150 0x7f63301a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f632effd640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 0x7f633019b4e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f632000e9f0 tx=0x7f632000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632000cd80 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63301a1880 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63200054d0 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320010690 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.490+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63301a7f40 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.491+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63301031a0 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.492+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f6320004e50 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.494+0000 7f6334a21640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63180b5370 0x7f63180b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.494+0000 7f632e7fc640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63180b5370 0x7f63180b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.494+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63200e63a0 con 0x7f6330102dc0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.494+0000 7f632e7fc640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63180b5370 0x7f63180b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6330102050 tx=0x7f632400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.497+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6320056220 con 0x7f6330102dc0 2024-09-10T23:23:14.547 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.705+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f633010edb0 con 0x7f6330102dc0 2024-09-10T23:23:14.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:14 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.705+0000 7f6334a21640 1 -- 172.21.15.2:0/2465824996 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63200ad110 con 0x7f6330102dc0 2024-09-10T23:23:14.707 INFO:teuthology.orchestra.run.smithi002.stdout:55834574923 2024-09-10T23:23:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63180b5370 msgr2=0x7f63180b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63180b5370 0x7f63180b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6330102050 tx=0x7f632400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 msgr2=0x7f633019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 0x7f633019b4e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f632000e9f0 tx=0x7f632000edf0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 shutdown_connections 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63180b5370 0x7f63180b7830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6330109150 0x7f63301a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63301087d0 0x7f633019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 --2- 172.21.15.2:0/2465824996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6330102dc0 0x7f633019b4e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.707+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 >> 172.21.15.2:0/2465824996 conn(0x7f63300fe830 msgr2=0x7f6330104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.708+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 shutdown_connections 2024-09-10T23:23:14.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:14.708+0000 7f6335a23640 1 -- 172.21.15.2:0/2465824996 wait complete. 2024-09-10T23:23:14.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:14 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:14.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:14 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:15.529 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574923 for osd.1 2024-09-10T23:23:15.530 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:15.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:15 smithi002 ceph-mon[31150]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T23:23:15.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:15 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2465824996' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:23:15.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:15 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:15 smithi177 ceph-mon[35760]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T23:23:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:15 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2465824996' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:23:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:15 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:15 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:15 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:15 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:16.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:15 smithi154 ceph-mon[35136]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T23:23:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:15 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2465824996' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:23:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:15 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:15 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:15 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:16.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:15 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 -- 172.21.15.2:0/2690191230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c108060 msgr2=0x7f2b0c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 --2- 172.21.15.2:0/2690191230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c108060 0x7f2b0c10e860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009ca0 tx=0x7f2b0402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 -- 172.21.15.2:0/2690191230 shutdown_connections 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 --2- 172.21.15.2:0/2690191230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c108060 0x7f2b0c10e860 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 --2- 172.21.15.2:0/2690191230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c1076e0 0x7f2b0c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 --2- 172.21.15.2:0/2690191230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 -- 172.21.15.2:0/2690191230 >> 172.21.15.2:0/2690191230 conn(0x7f2b0c0fd700 msgr2=0x7f2b0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 -- 172.21.15.2:0/2690191230 shutdown_connections 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.194+0000 7f2b11794640 1 -- 172.21.15.2:0/2690191230 wait complete. 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 Processor -- start 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 -- start start 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c1076e0 0x7f2b0c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b0c108060 0x7f2b0c1a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c111ce0 con 0x7f2b0c101cd0 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c111b60 con 0x7f2b0c1076e0 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b11794640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c111e60 con 0x7f2b0c108060 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c19b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49670/0 (socket says 172.21.15.2:49670) 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b0affd640 1 -- 172.21.15.2:0/1715290096 learned_addr learned my addr 172.21.15.2:0/1715290096 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.195+0000 7f2b0b7fe640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b0c108060 0x7f2b0c1a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b03fff640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c1076e0 0x7f2b0c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b0affd640 1 -- 172.21.15.2:0/1715290096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b0c108060 msgr2=0x7f2b0c1a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b0affd640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b0c108060 0x7f2b0c1a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b0affd640 1 -- 172.21.15.2:0/1715290096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c1076e0 msgr2=0x7f2b0c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b0affd640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c1076e0 0x7f2b0c19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b0affd640 1 -- 172.21.15.2:0/1715290096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c1a14b0 con 0x7f2b0c101cd0 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b0affd640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c19b400 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d950 tx=0x7f2afc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc017030 con 0x7f2b0c101cd0 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c1a17a0 con 0x7f2b0c101cd0 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2afc004020 con 0x7f2b0c101cd0 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0047a0 con 0x7f2b0c101cd0 2024-09-10T23:23:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.196+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c1a8030 con 0x7f2b0c101cd0 2024-09-10T23:23:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.197+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c102f80 con 0x7f2b0c101cd0 2024-09-10T23:23:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.199+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f2afc009a30 con 0x7f2b0c101cd0 2024-09-10T23:23:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.199+0000 7f2b08ff9640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2af80b5370 0x7f2af80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.199+0000 7f2b03fff640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2af80b5370 0x7f2af80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.199+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2afc0e5e90 con 0x7f2b0c101cd0 2024-09-10T23:23:16.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.200+0000 7f2b03fff640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2af80b5370 0x7f2af80b7830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2af4005fd0 tx=0x7f2af4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:16.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.202+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2afc0acc00 con 0x7f2b0c101cd0 2024-09-10T23:23:16.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.393+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2b0c1a8310 con 0x7f2b0c101cd0 2024-09-10T23:23:16.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.396+0000 7f2b08ff9640 1 -- 172.21.15.2:0/1715290096 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2afc0ac500 con 0x7f2b0c101cd0 2024-09-10T23:23:16.397 INFO:teuthology.orchestra.run.smithi002.stdout:180388626482 2024-09-10T23:23:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.398+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2af80b5370 msgr2=0x7f2af80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.398+0000 7f2b11794640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2af80b5370 0x7f2af80b7830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2af4005fd0 tx=0x7f2af4005850 comp rx=0 tx=0).stop 2024-09-10T23:23:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.398+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 msgr2=0x7f2b0c19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.398+0000 7f2b11794640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c19b400 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d950 tx=0x7f2afc00de10 comp rx=0 tx=0).stop 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 shutdown_connections 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2af80b5370 0x7f2af80b7830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b0c108060 0x7f2b0c1a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c1076e0 0x7f2b0c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 --2- 172.21.15.2:0/1715290096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b0c101cd0 0x7f2b0c19b400 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 >> 172.21.15.2:0/1715290096 conn(0x7f2b0c0fd700 msgr2=0x7f2b0c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 shutdown_connections 2024-09-10T23:23:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.399+0000 7f2b11794640 1 -- 172.21.15.2:0/1715290096 wait complete. 2024-09-10T23:23:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/3930533321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 msgr2=0x7f2f54103f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/3930533321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f54103f30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009900 tx=0x7f2f5002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/3930533321 shutdown_connections 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/3930533321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f5410d100 0x7f2f5410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/3930533321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f54104550 0x7f2f5410cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/3930533321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f54103f30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/3930533321 >> 172.21.15.2:0/3930533321 conn(0x7f2f540fd700 msgr2=0x7f2f540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/3930533321 shutdown_connections 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.387+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/3930533321 wait complete. 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 Processor -- start 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 -- start start 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f541991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f54104550 0x7f2f54199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f5410d100 0x7f2f5419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f54112d60 con 0x7f2f54103b50 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f54112be0 con 0x7f2f54104550 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5c2b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f54112ee0 con 0x7f2f5410d100 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5a053640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f541991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5a053640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f541991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49700/0 (socket says 172.21.15.2:49700) 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5a053640 1 -- 172.21.15.2:0/2412229103 learned_addr learned my addr 172.21.15.2:0/2412229103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f59852640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f54104550 0x7f2f54199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.388+0000 7f2f5a854640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f5410d100 0x7f2f5419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5a053640 1 -- 172.21.15.2:0/2412229103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f5410d100 msgr2=0x7f2f5419eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5a053640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f5410d100 0x7f2f5419eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5a053640 1 -- 172.21.15.2:0/2412229103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f54104550 msgr2=0x7f2f54199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5a053640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f54104550 0x7f2f54199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5a053640 1 -- 172.21.15.2:0/2412229103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5419f280 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5a053640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f541991d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2f50005940 tx=0x7f2f500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5003f030 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f50003cb0 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50035070 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5419f510 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.389+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f541a5c30 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.390+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f54103f30 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.392+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f2f50003800 con 0x7f2f54103b50 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.393+0000 7f2f4b7fe640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f400b53f0 0x7f2f400b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.393+0000 7f2f59852640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f400b53f0 0x7f2f400b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.393+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f50106a60 con 0x7f2f54103b50 2024-09-10T23:23:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.394+0000 7f2f59852640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f400b53f0 0x7f2f400b78b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f5410e870 tx=0x7f2f4400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.397+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2f500cd770 con 0x7f2f54103b50 2024-09-10T23:23:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.587+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2f5419a300 con 0x7f2f54103b50 2024-09-10T23:23:16.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:16 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1715290096' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:23:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.587+0000 7f2f4b7fe640 1 -- 172.21.15.2:0/2412229103 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f5419a300 con 0x7f2f54103b50 2024-09-10T23:23:16.588 INFO:teuthology.orchestra.run.smithi002.stdout:34359738450 2024-09-10T23:23:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.589+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f400b53f0 msgr2=0x7f2f400b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.589+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f400b53f0 0x7f2f400b78b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f5410e870 tx=0x7f2f4400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.589+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 msgr2=0x7f2f541991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.589+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f541991d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2f50005940 tx=0x7f2f500042f0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 shutdown_connections 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f400b53f0 0x7f2f400b78b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f5410d100 0x7f2f5419eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f54104550 0x7f2f54199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 --2- 172.21.15.2:0/2412229103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f54103b50 0x7f2f541991d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 >> 172.21.15.2:0/2412229103 conn(0x7f2f540fd700 msgr2=0x7f2f540fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 shutdown_connections 2024-09-10T23:23:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:16.590+0000 7f2f5c2b7640 1 -- 172.21.15.2:0/2412229103 wait complete. 2024-09-10T23:23:16.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:16 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1715290096' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:23:17.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:16 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1715290096' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:23:17.265 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626482 for osd.6 2024-09-10T23:23:17.266 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:17.683 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738450 for osd.0 2024-09-10T23:23:17.683 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:17.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:17 smithi002 ceph-mon[31150]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:17.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:17 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2412229103' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:23:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 -- 172.21.15.2:0/2687763366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f527410d140 msgr2=0x7f527410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 --2- 172.21.15.2:0/2687763366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f527410d140 0x7f527410f5a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f526c009ca0 tx=0x7f526c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 -- 172.21.15.2:0/2687763366 shutdown_connections 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 --2- 172.21.15.2:0/2687763366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f527410d140 0x7f527410f5a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 --2- 172.21.15.2:0/2687763366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5274104600 0x7f527410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 --2- 172.21.15.2:0/2687763366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103ce0 0x7f52741040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.857+0000 7f527aaf6640 1 -- 172.21.15.2:0/2687763366 >> 172.21.15.2:0/2687763366 conn(0x7f52740fd700 msgr2=0x7f52740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.858+0000 7f527aaf6640 1 -- 172.21.15.2:0/2687763366 shutdown_connections 2024-09-10T23:23:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.858+0000 7f527aaf6640 1 -- 172.21.15.2:0/2687763366 wait complete. 2024-09-10T23:23:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.859+0000 7f527aaf6640 1 Processor -- start 2024-09-10T23:23:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.859+0000 7f527aaf6640 1 -- start start 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f527aaf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5274103ce0 0x7f527419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f527aaf6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 0x7f527419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f527aaf6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f527410d140 0x7f52741a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f527aaf6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5274112db0 con 0x7f5274103ce0 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f527aaf6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5274112c30 con 0x7f5274104600 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f527aaf6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5274112f30 con 0x7f527410d140 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f5278892640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5274103ce0 0x7f527419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f5273fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 0x7f527419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f5273fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 0x7f527419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:47546/0 (socket says 172.21.15.2:47546) 2024-09-10T23:23:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f5273fff640 1 -- 172.21.15.2:0/3472062477 learned_addr learned my addr 172.21.15.2:0/3472062477 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.860+0000 7f5279093640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f527410d140 0x7f52741a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5273fff640 1 -- 172.21.15.2:0/3472062477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f527410d140 msgr2=0x7f52741a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5273fff640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f527410d140 0x7f52741a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5273fff640 1 -- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5274103ce0 msgr2=0x7f527419b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5273fff640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5274103ce0 0x7f527419b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5273fff640 1 -- 172.21.15.2:0/3472062477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52741a1510 con 0x7f5274104600 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5273fff640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 0x7f527419b9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f526800c970 tx=0x7f526800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268007bb0 con 0x7f5274104600 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.861+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5268007d50 con 0x7f5274104600 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.862+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526800f870 con 0x7f5274104600 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.862+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52741a1800 con 0x7f5274104600 2024-09-10T23:23:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.862+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52741a7ec0 con 0x7f5274104600 2024-09-10T23:23:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.863+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52741040c0 con 0x7f5274104600 2024-09-10T23:23:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.866+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f526800fa10 con 0x7f5274104600 2024-09-10T23:23:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.867+0000 7f5271ffb640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f525c0b54c0 0x7f525c0b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.867+0000 7f5278892640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f525c0b54c0 0x7f525c0b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.867+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52680e5df0 con 0x7f5274104600 2024-09-10T23:23:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.868+0000 7f5278892640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f525c0b54c0 0x7f525c0b7980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5264005d00 tx=0x7f526400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:17.873 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:17.873 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:17.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:17.871+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f52680acbf0 con 0x7f5274104600 2024-09-10T23:23:17.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:17 smithi177 ceph-mon[35760]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:17.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:17 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2412229103' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:23:18.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:17 smithi154 ceph-mon[35136]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:18.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:17 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2412229103' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:23:18.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.077+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f52741a82b0 con 0x7f5274104600 2024-09-10T23:23:18.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.077+0000 7f5271ffb640 1 -- 172.21.15.2:0/3472062477 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52680ac4f0 con 0x7f5274104600 2024-09-10T23:23:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:77309411400 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f525c0b54c0 msgr2=0x7f525c0b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f525c0b54c0 0x7f525c0b7980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5264005d00 tx=0x7f526400b410 comp rx=0 tx=0).stop 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 msgr2=0x7f527419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 0x7f527419b9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f526800c970 tx=0x7f526800ce30 comp rx=0 tx=0).stop 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 shutdown_connections 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f525c0b54c0 0x7f525c0b7980 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f527410d140 0x7f52741a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274104600 0x7f527419b9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 --2- 172.21.15.2:0/3472062477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5274103ce0 0x7f527419b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 >> 172.21.15.2:0/3472062477 conn(0x7f52740fd700 msgr2=0x7f527410f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:18.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 shutdown_connections 2024-09-10T23:23:18.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.080+0000 7f527aaf6640 1 -- 172.21.15.2:0/3472062477 wait complete. 2024-09-10T23:23:18.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.495+0000 7fafb499f640 1 -- 172.21.15.2:0/1270730463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb01076a0 msgr2=0x7fafb0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 --2- 172.21.15.2:0/1270730463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb01076a0 0x7fafb0107ae0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf98009900 tx=0x7faf9802a410 comp rx=0 tx=0).stop 2024-09-10T23:23:18.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 -- 172.21.15.2:0/1270730463 shutdown_connections 2024-09-10T23:23:18.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 --2- 172.21.15.2:0/1270730463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb0108020 0x7fafb010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 --2- 172.21.15.2:0/1270730463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb01076a0 0x7fafb0107ae0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 --2- 172.21.15.2:0/1270730463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0101c90 0x7fafb0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 -- 172.21.15.2:0/1270730463 >> 172.21.15.2:0/1270730463 conn(0x7fafb00fd700 msgr2=0x7fafb00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:18.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 -- 172.21.15.2:0/1270730463 shutdown_connections 2024-09-10T23:23:18.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 -- 172.21.15.2:0/1270730463 wait complete. 2024-09-10T23:23:18.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 Processor -- start 2024-09-10T23:23:18.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.496+0000 7fafb499f640 1 -- start start 2024-09-10T23:23:18.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 0x7fafb01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:18.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb01076a0 0x7fafb0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:18.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0108020 0x7fafb019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:18.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fafb0111c70 con 0x7fafb0101c90 2024-09-10T23:23:18.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fafb0111af0 con 0x7fafb01076a0 2024-09-10T23:23:18.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafb0111df0 con 0x7fafb0108020 2024-09-10T23:23:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 0x7fafb01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 0x7fafb01992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49734/0 (socket says 172.21.15.2:49734) 2024-09-10T23:23:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 -- 172.21.15.2:0/1302449283 learned_addr learned my addr 172.21.15.2:0/1302449283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafaed9d640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0108020 0x7fafb019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafa7fff640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb01076a0 0x7fafb0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 -- 172.21.15.2:0/1302449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0108020 msgr2=0x7fafb019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0108020 0x7fafb019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 -- 172.21.15.2:0/1302449283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb01076a0 msgr2=0x7fafb0199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb01076a0 0x7fafb0199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 -- 172.21.15.2:0/1302449283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb019f380 con 0x7fafb0101c90 2024-09-10T23:23:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafaed9d640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0108020 0x7fafb019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafa7fff640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb01076a0 0x7fafb0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafae59c640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 0x7fafb01992d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fafa000d950 tx=0x7fafa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0017070 con 0x7fafb0101c90 2024-09-10T23:23:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb019f670 con 0x7fafb0101c90 2024-09-10T23:23:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafa0009c30 con 0x7fafb0101c90 2024-09-10T23:23:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa000f620 con 0x7fafb0101c90 2024-09-10T23:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.497+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb01a5d30 con 0x7fafb0101c90 2024-09-10T23:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.498+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb0102070 con 0x7fafb0101c90 2024-09-10T23:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.501+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fafa0010460 con 0x7fafb0101c90 2024-09-10T23:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.502+0000 7fafa77fe640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf9c0b5370 0x7faf9c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.502+0000 7fafa7fff640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf9c0b5370 0x7faf9c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.502+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fafa00e5aa0 con 0x7fafb0101c90 2024-09-10T23:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.502+0000 7fafa7fff640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf9c0b5370 0x7faf9c0b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf98031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.505+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fafa00ac7b0 con 0x7fafb0101c90 2024-09-10T23:23:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.695+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fafb01a60b0 con 0x7fafb0101c90 2024-09-10T23:23:18.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:18 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3472062477' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:23:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.696+0000 7fafa77fe640 1 -- 172.21.15.2:0/1302449283 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fafa0009de0 con 0x7fafb0101c90 2024-09-10T23:23:18.697 INFO:teuthology.orchestra.run.smithi002.stdout:107374182466 2024-09-10T23:23:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf9c0b5370 msgr2=0x7faf9c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf9c0b5370 0x7faf9c0b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf98031400 comp rx=0 tx=0).stop 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 msgr2=0x7fafb01992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 0x7fafb01992d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fafa000d950 tx=0x7fafa000de10 comp rx=0 tx=0).stop 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 shutdown_connections 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faf9c0b5370 0x7faf9c0b7830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0108020 0x7fafb019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb01076a0 0x7fafb0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 --2- 172.21.15.2:0/1302449283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafb0101c90 0x7fafb01992d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 >> 172.21.15.2:0/1302449283 conn(0x7fafb00fd700 msgr2=0x7fafb0100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 shutdown_connections 2024-09-10T23:23:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:18.698+0000 7fafb499f640 1 -- 172.21.15.2:0/1302449283 wait complete. 2024-09-10T23:23:18.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:18 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3472062477' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:23:18.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:18 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3472062477' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:23:19.469 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182463 got 107374182466 for osd.3 2024-09-10T23:23:19.469 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:19.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:19 smithi002 ceph-mon[31150]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:19.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:19 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1302449283' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:23:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:19 smithi177 ceph-mon[35760]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:19 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1302449283' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:23:20.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:19 smithi154 ceph-mon[35136]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:20.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:19 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1302449283' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:23:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 -- 172.21.15.2:0/2293421956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 msgr2=0x7f94e810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 --2- 172.21.15.2:0/2293421956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e810e860 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009cc0 tx=0x7f94e002cad0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 -- 172.21.15.2:0/2293421956 shutdown_connections 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 --2- 172.21.15.2:0/2293421956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e810e860 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 --2- 172.21.15.2:0/2293421956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e81076e0 0x7f94e8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 --2- 172.21.15.2:0/2293421956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e8101cd0 0x7f94e81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 -- 172.21.15.2:0/2293421956 >> 172.21.15.2:0/2293421956 conn(0x7f94e80fd700 msgr2=0x7f94e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 -- 172.21.15.2:0/2293421956 shutdown_connections 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 -- 172.21.15.2:0/2293421956 wait complete. 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.022+0000 7f94ee04b640 1 Processor -- start 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 -- start start 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8101cd0 0x7f94e8196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e81076e0 0x7f94e81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8110c20 con 0x7f94e8108060 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8110aa0 con 0x7f94e81076e0 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94ee04b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8110da0 con 0x7f94e8101cd0 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49742/0 (socket says 172.21.15.2:49742) 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 -- 172.21.15.2:0/3132988351 learned_addr learned my addr 172.21.15.2:0/3132988351 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e77fe640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8101cd0 0x7f94e8196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e6ffd640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e81076e0 0x7f94e81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 -- 172.21.15.2:0/3132988351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8101cd0 msgr2=0x7f94e8196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8101cd0 0x7f94e8196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 -- 172.21.15.2:0/3132988351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e81076e0 msgr2=0x7f94e81974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e81076e0 0x7f94e81974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 -- 172.21.15.2:0/3132988351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e819d060 con 0x7f94e8108060 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e6ffd640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e81076e0 0x7f94e81974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.023+0000 7f94e7fff640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e819c890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94e002d0c0 tx=0x7f94e0038b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.024+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0046070 con 0x7f94e8108060 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.024+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0004700 con 0x7f94e8108060 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.024+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e819d2f0 con 0x7f94e8108060 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.024+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e002edf0 con 0x7f94e8108060 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.024+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81a3a10 con 0x7f94e8108060 2024-09-10T23:23:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.025+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e81020b0 con 0x7f94e8108060 2024-09-10T23:23:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.027+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f94e002e040 con 0x7f94e8108060 2024-09-10T23:23:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.027+0000 7f94e4ff9640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b53f0 0x7f94d00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.027+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f94e0108150 con 0x7f94e8108060 2024-09-10T23:23:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.027+0000 7f94e77fe640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b53f0 0x7f94d00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.028+0000 7f94e77fe640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b53f0 0x7f94d00b78b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94d8005d00 tx=0x7f94d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.030+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f94e0034030 con 0x7f94e8108060 2024-09-10T23:23:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.222+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f94e81a3c40 con 0x7f94e8108060 2024-09-10T23:23:20.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.223+0000 7f94e4ff9640 1 -- 172.21.15.2:0/3132988351 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f94e00ceec0 con 0x7f94e8108060 2024-09-10T23:23:20.225 INFO:teuthology.orchestra.run.smithi002.stdout:154618822713 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b53f0 msgr2=0x7f94d00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b53f0 0x7f94d00b78b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94d8005d00 tx=0x7f94d800b410 comp rx=0 tx=0).stop 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 msgr2=0x7f94e819c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e819c890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94e002d0c0 tx=0x7f94e0038b50 comp rx=0 tx=0).stop 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 shutdown_connections 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b53f0 0x7f94d00b78b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8108060 0x7f94e819c890 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e81076e0 0x7f94e81974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 --2- 172.21.15.2:0/3132988351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8101cd0 0x7f94e8196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 >> 172.21.15.2:0/3132988351 conn(0x7f94e80fd700 msgr2=0x7f94e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:20.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 shutdown_connections 2024-09-10T23:23:20.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.225+0000 7f94ee04b640 1 -- 172.21.15.2:0/3132988351 wait complete. 2024-09-10T23:23:20.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 -- 172.21.15.2:0/1649958018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40201076b0 msgr2=0x7f4020107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 --2- 172.21.15.2:0/1649958018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40201076b0 0x7f4020107af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4014009900 tx=0x7f401402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:20.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 -- 172.21.15.2:0/1649958018 shutdown_connections 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 --2- 172.21.15.2:0/1649958018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4020108030 0x7f402010e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 --2- 172.21.15.2:0/1649958018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40201076b0 0x7f4020107af0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 --2- 172.21.15.2:0/1649958018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020101ca0 0x7f4020102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 -- 172.21.15.2:0/1649958018 >> 172.21.15.2:0/1649958018 conn(0x7f40200fd6f0 msgr2=0x7f40200ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 -- 172.21.15.2:0/1649958018 shutdown_connections 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.251+0000 7f4024b38640 1 -- 172.21.15.2:0/1649958018 wait complete. 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 Processor -- start 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 -- start start 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 0x7f4020199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40201076b0 0x7f40201997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020108030 0x7f402019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4020111cf0 con 0x7f4020101ca0 2024-09-10T23:23:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f401e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 0x7f4020199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f401e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 0x7f4020199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49772/0 (socket says 172.21.15.2:49772) 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f401e59c640 1 -- 172.21.15.2:0/3242552523 learned_addr learned my addr 172.21.15.2:0/3242552523 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4020111b70 con 0x7f40201076b0 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4020111e70 con 0x7f4020108030 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.252+0000 7f401ed9d640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020108030 0x7f402019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401dd9b640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40201076b0 0x7f40201997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401e59c640 1 -- 172.21.15.2:0/3242552523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020108030 msgr2=0x7f402019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401e59c640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020108030 0x7f402019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401e59c640 1 -- 172.21.15.2:0/3242552523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40201076b0 msgr2=0x7f40201997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401e59c640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40201076b0 0x7f40201997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401e59c640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402019f320 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401ed9d640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020108030 0x7f402019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401dd9b640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40201076b0 0x7f40201997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f401e59c640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 0x7f4020199270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f401800cde0 tx=0x7f401800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018004b20 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.253+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402019f610 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.254+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4018004cc0 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.254+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40201a5ea0 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.254+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800f850 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.255+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4020102080 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.256+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f401800f9f0 con 0x7f4020101ca0 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.257+0000 7f400f7fe640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40080b53f0 0x7f40080b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:20.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.257+0000 7f401dd9b640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40080b53f0 0x7f40080b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:20.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.257+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f40180e62d0 con 0x7f4020101ca0 2024-09-10T23:23:20.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.258+0000 7f401dd9b640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40080b53f0 0x7f40080b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4014031440 tx=0x7f40140095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:20.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.260+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4018014030 con 0x7f4020101ca0 2024-09-10T23:23:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.452+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f402010a890 con 0x7f4020101ca0 2024-09-10T23:23:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.452+0000 7f400f7fe640 1 -- 172.21.15.2:0/3242552523 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f40180ad060 con 0x7f4020101ca0 2024-09-10T23:23:20.454 INFO:teuthology.orchestra.run.smithi002.stdout:296352743449 2024-09-10T23:23:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40080b53f0 msgr2=0x7f40080b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40080b53f0 0x7f40080b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4014031440 tx=0x7f40140095f0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 msgr2=0x7f4020199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 0x7f4020199270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f401800cde0 tx=0x7f401800a620 comp rx=0 tx=0).stop 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 shutdown_connections 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40080b53f0 0x7f40080b78b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4020108030 0x7f402019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40201076b0 0x7f40201997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 --2- 172.21.15.2:0/3242552523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4020101ca0 0x7f4020199270 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 >> 172.21.15.2:0/3242552523 conn(0x7f40200fd6f0 msgr2=0x7f402006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 shutdown_connections 2024-09-10T23:23:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:20.455+0000 7f4024b38640 1 -- 172.21.15.2:0/3242552523 wait complete. 2024-09-10T23:23:20.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3132988351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:23:20.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:20 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3242552523' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:23:20.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:20 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3132988351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:23:20.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:20 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3242552523' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:23:21.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:20 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3132988351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:23:21.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:20 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3242552523' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:23:21.228 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411400 for osd.2 2024-09-10T23:23:21.229 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:21.639 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822710 got 154618822713 for osd.5 2024-09-10T23:23:21.639 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:21.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:21 smithi002 ceph-mon[31150]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:21 smithi177 ceph-mon[35760]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:22.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:21 smithi154 ceph-mon[35136]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:22.707 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743448 got 296352743449 for osd.11 2024-09-10T23:23:22.708 DEBUG:teuthology.parallel:result is None 2024-09-10T23:23:22.708 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:23:22.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:23:22.998 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:23.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 -- 172.21.15.2:0/3271193829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 msgr2=0x7f812c10e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 --2- 172.21.15.2:0/3271193829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c10e870 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8124009ca0 tx=0x7f812402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 -- 172.21.15.2:0/3271193829 shutdown_connections 2024-09-10T23:23:23.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 --2- 172.21.15.2:0/3271193829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c10e870 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 --2- 172.21.15.2:0/3271193829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c107780 0x7f812c107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 --2- 172.21.15.2:0/3271193829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f812c102920 0x7f812c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 -- 172.21.15.2:0/3271193829 >> 172.21.15.2:0/3271193829 conn(0x7f812c076f50 msgr2=0x7f812c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 -- 172.21.15.2:0/3271193829 shutdown_connections 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 -- 172.21.15.2:0/3271193829 wait complete. 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 Processor -- start 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.499+0000 7f8132360640 1 -- start start 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c102920 0x7f812c198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f812c107780 0x7f812c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f812c111ca0 con 0x7f812c108120 2024-09-10T23:23:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f812c111b20 con 0x7f812c102920 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f812c111e20 con 0x7f812c107780 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c19d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45364/0 (socket says 172.21.15.2:45364) 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 -- 172.21.15.2:0/2365513674 learned_addr learned my addr 172.21.15.2:0/2365513674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f812b7fe640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f812c107780 0x7f812c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f812bfff640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c102920 0x7f812c198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 -- 172.21.15.2:0/2365513674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f812c107780 msgr2=0x7f812c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f812c107780 0x7f812c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 -- 172.21.15.2:0/2365513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c102920 msgr2=0x7f812c198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c102920 0x7f812c198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 -- 172.21.15.2:0/2365513674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c19e1c0 con 0x7f812c108120 2024-09-10T23:23:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81308fd640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c19d9f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f81240098d0 tx=0x7f81240317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124003b70 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8124003d10 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c19e450 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.500+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812403e9e0 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.501+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c1015b0 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.501+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c102d00 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.503+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f812403eba0 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.504+0000 7f81297fa640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81140b5370 0x7f81140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.504+0000 7f812bfff640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81140b5370 0x7f81140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.504+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f81241093d0 con 0x7f812c108120 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.504+0000 7f812bfff640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81140b5370 0x7f81140b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f811c005fd0 tx=0x7f811c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.506+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f81240d0140 con 0x7f812c108120 2024-09-10T23:23:23.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.708+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f812c102060 con 0x7f81140b5370 2024-09-10T23:23:23.710 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:23 smithi002 ceph-mon[31150]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:23.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.716+0000 7f81297fa640 1 -- 172.21.15.2:0/2365513674 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258920 (secure 0 0 0) 0x7f812c102060 con 0x7f81140b5370 2024-09-10T23:23:23.721 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:23.722 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:23:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81140b5370 msgr2=0x7f81140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81140b5370 0x7f81140b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f811c005fd0 tx=0x7f811c005850 comp rx=0 tx=0).stop 2024-09-10T23:23:23.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 msgr2=0x7f812c19d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c19d9f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f81240098d0 tx=0x7f81240317b0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 shutdown_connections 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81140b5370 0x7f81140b7830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c108120 0x7f812c19d9f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f812c107780 0x7f812c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 --2- 172.21.15.2:0/2365513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c102920 0x7f812c198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 >> 172.21.15.2:0/2365513674 conn(0x7f812c076f50 msgr2=0x7f812c100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 shutdown_connections 2024-09-10T23:23:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:23.721+0000 7f8132360640 1 -- 172.21.15.2:0/2365513674 wait complete. 2024-09-10T23:23:23.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:23 smithi177 ceph-mon[35760]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:23 smithi154 ceph-mon[35136]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-10T23:23:22.231868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658976,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":632,"num_read_kb":418,"num_write":372,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952987,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376320,"kb_used_data":10368,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565504,"statfs":{"total":1151940427776,"available":1151555076096,"internally_reserved":0,"allocated":10616832,"data_stored":6790812,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485539+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:22:51.485539+0000","last_peered":"2024-09-10T23:22:51.485539+0000","last_clean":"2024-09-10T23:22:51.485539+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:22:51.485539+0000","last_undegraded":"2024-09-10T23:22:51.485539+0000","last_fullsized":"2024-09-10T23:22:51.485539+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487847+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:22:51.487847+0000","last_peered":"2024-09-10T23:22:51.487847+0000","last_clean":"2024-09-10T23:22:51.487847+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:22:51.487847+0000","last_undegraded":"2024-09-10T23:22:51.487847+0000","last_fullsized":"2024-09-10T23:22:51.487847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487802+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:22:51.487802+0000","last_peered":"2024-09-10T23:22:51.487802+0000","last_clean":"2024-09-10T23:22:51.487802+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:22:51.487802+0000","last_undegraded":"2024-09-10T23:22:51.487802+0000","last_fullsized":"2024-09-10T23:22:51.487802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484418+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:22:51.484418+0000","last_peered":"2024-09-10T23:22:51.484418+0000","last_clean":"2024-09-10T23:22:51.484418+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:22:51.484418+0000","last_undegraded":"2024-09-10T23:22:51.484418+0000","last_fullsized":"2024-09-10T23:22:51.484418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486135+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:22:51.486135+0000","last_peered":"2024-09-10T23:22:51.486135+0000","last_clean":"2024-09-10T23:22:51.486135+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:22:51.486135+0000","last_undegraded":"2024-09-10T23:22:51.486135+0000","last_fullsized":"2024-09-10T23:22:51.486135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544641+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:22:51.544641+0000","last_peered":"2024-09-10T23:22:51.544641+0000","last_clean":"2024-09-10T23:22:51.544641+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:22:51.544641+0000","last_undegraded":"2024-09-10T23:22:51.544641+0000","last_fullsized":"2024-09-10T23:22:51.544641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491499+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:22:51.491499+0000","last_peered":"2024-09-10T23:22:51.491499+0000","last_clean":"2024-09-10T23:22:51.491499+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:22:51.491499+0000","last_undegraded":"2024-09-10T23:22:51.491499+0000","last_fullsized":"2024-09-10T23:22:51.491499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544254+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:22:51.544254+0000","last_peered":"2024-09-10T23:22:51.544254+0000","last_clean":"2024-09-10T23:22:51.544254+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:22:51.544254+0000","last_undegraded":"2024-09-10T23:22:51.544254+0000","last_fullsized":"2024-09-10T23:22:51.544254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486368+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:22:51.486368+0000","last_peered":"2024-09-10T23:22:51.486368+0000","last_clean":"2024-09-10T23:22:51.486368+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:22:51.486368+0000","last_undegraded":"2024-09-10T23:22:51.486368+0000","last_fullsized":"2024-09-10T23:22:51.486368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.545013+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:22:51.545013+0000","last_peered":"2024-09-10T23:22:51.545013+0000","last_clean":"2024-09-10T23:22:51.545013+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:22:51.545013+0000","last_undegraded":"2024-09-10T23:22:51.545013+0000","last_fullsized":"2024-09-10T23:22:51.545013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491800+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:22:51.491800+0000","last_peered":"2024-09-10T23:22:51.491800+0000","last_clean":"2024-09-10T23:22:51.491800+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:22:51.491800+0000","last_undegraded":"2024-09-10T23:22:51.491800+0000","last_fullsized":"2024-09-10T23:22:51.491800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484533+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:22:51.484533+0000","last_peered":"2024-09-10T23:22:51.484533+0000","last_clean":"2024-09-10T23:22:51.484533+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:22:51.484533+0000","last_undegraded":"2024-09-10T23:22:51.484533+0000","last_fullsized":"2024-09-10T23:22:51.484533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485754+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:22:51.485754+0000","last_peered":"2024-09-10T23:22:51.485754+0000","last_clean":"2024-09-10T23:22:51.485754+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:22:51.485754+0000","last_undegraded":"2024-09-10T23:22:51.485754+0000","last_fullsized":"2024-09-10T23:22:51.485754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487652+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:22:51.487652+0000","last_peered":"2024-09-10T23:22:51.487652+0000","last_clean":"2024-09-10T23:22:51.487652+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:22:51.487652+0000","last_undegraded":"2024-09-10T23:22:51.487652+0000","last_fullsized":"2024-09-10T23:22:51.487652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487437+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:22:51.487437+0000","last_peered":"2024-09-10T23:22:51.487437+0000","last_clean":"2024-09-10T23:22:51.487437+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:22:51.487437+0000","last_undegraded":"2024-09-10T23:22:51.487437+0000","last_fullsized":"2024-09-10T23:22:51.487437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485740+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:22:51.485740+0000","last_peered":"2024-09-10T23:22:51.485740+0000","last_clean":"2024-09-10T23:22:51.485740+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:22:51.485740+0000","last_undegraded":"2024-09-10T23:22:51.485740+0000","last_fullsized":"2024-09-10T23:22:51.485740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485763+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:22:51.485763+0000","last_peered":"2024-09-10T23:22:51.485763+0000","last_clean":"2024-09-10T23:22:51.485763+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:22:51.485763+0000","last_undegraded":"2024-09-10T23:22:51.485763+0000","last_fullsized":"2024-09-10T23:22:51.485763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482929+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:22:51.482929+0000","last_peered":"2024-09-10T23:22:51.482929+0000","last_clean":"2024-09-10T23:22:51.482929+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:22:51.482929+0000","last_undegraded":"2024-09-10T23:22:51.482929+0000","last_fullsized":"2024-09-10T23:22:51.482929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492928+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:22:51.492928+0000","last_peered":"2024-09-10T23:22:51.492928+0000","last_clean":"2024-09-10T23:22:51.492928+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:22:51.492928+0000","last_undegraded":"2024-09-10T23:22:51.492928+0000","last_fullsized":"2024-09-10T23:22:51.492928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492994+0000","last_change":"2024-09-10T23:22:51.492807+0000","last_active":"2024-09-10T23:22:51.492994+0000","last_peered":"2024-09-10T23:22:51.492994+0000","last_clean":"2024-09-10T23:22:51.492994+0000","last_became_active":"2024-09-10T23:22:51.492343+0000","last_became_peered":"2024-09-10T23:22:51.492343+0000","last_unstale":"2024-09-10T23:22:51.492994+0000","last_undegraded":"2024-09-10T23:22:51.492994+0000","last_fullsized":"2024-09-10T23:22:51.492994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:59.573883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485762+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:22:51.485762+0000","last_peered":"2024-09-10T23:22:51.485762+0000","last_clean":"2024-09-10T23:22:51.485762+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:22:51.485762+0000","last_undegraded":"2024-09-10T23:22:51.485762+0000","last_fullsized":"2024-09-10T23:22:51.485762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486303+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:22:51.486303+0000","last_peered":"2024-09-10T23:22:51.486303+0000","last_clean":"2024-09-10T23:22:51.486303+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:22:51.486303+0000","last_undegraded":"2024-09-10T23:22:51.486303+0000","last_fullsized":"2024-09-10T23:22:51.486303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544315+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:22:51.544315+0000","last_peered":"2024-09-10T23:22:51.544315+0000","last_clean":"2024-09-10T23:22:51.544315+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:22:51.544315+0000","last_undegraded":"2024-09-10T23:22:51.544315+0000","last_fullsized":"2024-09-10T23:22:51.544315+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487995+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:22:51.487995+0000","last_peered":"2024-09-10T23:22:51.487995+0000","last_clean":"2024-09-10T23:22:51.487995+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:22:51.487995+0000","last_undegraded":"2024-09-10T23:22:51.487995+0000","last_fullsized":"2024-09-10T23:22:51.487995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544699+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:22:51.544699+0000","last_peered":"2024-09-10T23:22:51.544699+0000","last_clean":"2024-09-10T23:22:51.544699+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:22:51.544699+0000","last_undegraded":"2024-09-10T23:22:51.544699+0000","last_fullsized":"2024-09-10T23:22:51.544699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491699+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:22:51.491699+0000","last_peered":"2024-09-10T23:22:51.491699+0000","last_clean":"2024-09-10T23:22:51.491699+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:22:51.491699+0000","last_undegraded":"2024-09-10T23:22:51.491699+0000","last_fullsized":"2024-09-10T23:22:51.491699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485892+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:22:51.485892+0000","last_peered":"2024-09-10T23:22:51.485892+0000","last_clean":"2024-09-10T23:22:51.485892+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:22:51.485892+0000","last_undegraded":"2024-09-10T23:22:51.485892+0000","last_fullsized":"2024-09-10T23:22:51.485892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488773+0000","last_change":"2024-09-10T23:22:51.488675+0000","last_active":"2024-09-10T23:22:51.488773+0000","last_peered":"2024-09-10T23:22:51.488773+0000","last_clean":"2024-09-10T23:22:51.488773+0000","last_became_active":"2024-09-10T23:22:51.488291+0000","last_became_peered":"2024-09-10T23:22:51.488291+0000","last_unstale":"2024-09-10T23:22:51.488773+0000","last_undegraded":"2024-09-10T23:22:51.488773+0000","last_fullsized":"2024-09-10T23:22:51.488773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487646+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:22:51.487646+0000","last_peered":"2024-09-10T23:22:51.487646+0000","last_clean":"2024-09-10T23:22:51.487646+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:22:51.487646+0000","last_undegraded":"2024-09-10T23:22:51.487646+0000","last_fullsized":"2024-09-10T23:22:51.487646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492028+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:22:51.492028+0000","last_peered":"2024-09-10T23:22:51.492028+0000","last_clean":"2024-09-10T23:22:51.492028+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:22:51.492028+0000","last_undegraded":"2024-09-10T23:22:51.492028+0000","last_fullsized":"2024-09-10T23:22:51.492028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492224+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:22:51.492224+0000","last_peered":"2024-09-10T23:22:51.492224+0000","last_clean":"2024-09-10T23:22:51.492224+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:22:51.492224+0000","last_undegraded":"2024-09-10T23:22:51.492224+0000","last_fullsized":"2024-09-10T23:22:51.492224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484678+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:22:51.484678+0000","last_peered":"2024-09-10T23:22:51.484678+0000","last_clean":"2024-09-10T23:22:51.484678+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:22:51.484678+0000","last_undegraded":"2024-09-10T23:22:51.484678+0000","last_fullsized":"2024-09-10T23:22:51.484678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486929+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:22:51.486929+0000","last_peered":"2024-09-10T23:22:51.486929+0000","last_clean":"2024-09-10T23:22:51.486929+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:22:51.486929+0000","last_undegraded":"2024-09-10T23:22:51.486929+0000","last_fullsized":"2024-09-10T23:22:51.486929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.531422+0000","last_change":"2024-09-10T23:22:51.506742+0000","last_active":"2024-09-10T23:23:20.531422+0000","last_peered":"2024-09-10T23:23:20.531422+0000","last_clean":"2024-09-10T23:23:20.531422+0000","last_became_active":"2024-09-10T23:22:51.493588+0000","last_became_peered":"2024-09-10T23:22:51.493588+0000","last_unstale":"2024-09-10T23:23:20.531422+0000","last_undegraded":"2024-09-10T23:23:20.531422+0000","last_fullsized":"2024-09-10T23:23:20.531422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:42.641981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488448+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:22:51.488448+0000","last_peered":"2024-09-10T23:22:51.488448+0000","last_clean":"2024-09-10T23:22:51.488448+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:22:51.488448+0000","last_undegraded":"2024-09-10T23:22:51.488448+0000","last_fullsized":"2024-09-10T23:22:51.488448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544310+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:22:51.544310+0000","last_peered":"2024-09-10T23:22:51.544310+0000","last_clean":"2024-09-10T23:22:51.544310+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:22:51.544310+0000","last_undegraded":"2024-09-10T23:22:51.544310+0000","last_fullsized":"2024-09-10T23:22:51.544310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488201+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:51.488201+0000","last_peered":"2024-09-10T23:22:51.488201+0000","last_clean":"2024-09-10T23:22:51.488201+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:51.488201+0000","last_undegraded":"2024-09-10T23:22:51.488201+0000","last_fullsized":"2024-09-10T23:22:51.488201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482756+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:22:51.482756+0000","last_peered":"2024-09-10T23:22:51.482756+0000","last_clean":"2024-09-10T23:22:51.482756+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:22:51.482756+0000","last_undegraded":"2024-09-10T23:22:51.482756+0000","last_fullsized":"2024-09-10T23:22:51.482756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":133,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.513955+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:23:20.513955+0000","last_peered":"2024-09-10T23:23:20.513955+0000","last_clean":"2024-09-10T23:23:20.513955+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:23:20.513955+0000","last_undegraded":"2024-09-10T23:23:20.513955+0000","last_fullsized":"2024-09-10T23:23:20.513955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486586+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:22:51.486586+0000","last_peered":"2024-09-10T23:22:51.486586+0000","last_clean":"2024-09-10T23:22:51.486586+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:22:51.486586+0000","last_undegraded":"2024-09-10T23:22:51.486586+0000","last_fullsized":"2024-09-10T23:22:51.486586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492077+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:51.492077+0000","last_peered":"2024-09-10T23:22:51.492077+0000","last_clean":"2024-09-10T23:22:51.492077+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:51.492077+0000","last_undegraded":"2024-09-10T23:22:51.492077+0000","last_fullsized":"2024-09-10T23:22:51.492077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487987+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:22:51.487987+0000","last_peered":"2024-09-10T23:22:51.487987+0000","last_clean":"2024-09-10T23:22:51.487987+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:22:51.487987+0000","last_undegraded":"2024-09-10T23:22:51.487987+0000","last_fullsized":"2024-09-10T23:22:51.487987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488638+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:51.488638+0000","last_peered":"2024-09-10T23:22:51.488638+0000","last_clean":"2024-09-10T23:22:51.488638+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:51.488638+0000","last_undegraded":"2024-09-10T23:22:51.488638+0000","last_fullsized":"2024-09-10T23:22:51.488638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.490274+0000","last_change":"2024-09-10T23:22:51.490154+0000","last_active":"2024-09-10T23:22:51.490274+0000","last_peered":"2024-09-10T23:22:51.490274+0000","last_clean":"2024-09-10T23:22:51.490274+0000","last_became_active":"2024-09-10T23:22:51.489716+0000","last_became_peered":"2024-09-10T23:22:51.489716+0000","last_unstale":"2024-09-10T23:22:51.490274+0000","last_undegraded":"2024-09-10T23:22:51.490274+0000","last_fullsized":"2024-09-10T23:22:51.490274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.280542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.531147+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:23:20.531147+0000","last_peered":"2024-09-10T23:23:20.531147+0000","last_clean":"2024-09-10T23:23:20.531147+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:23:20.531147+0000","last_undegraded":"2024-09-10T23:23:20.531147+0000","last_fullsized":"2024-09-10T23:23:20.531147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61170,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":117,"num_write":34,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487558+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:22:51.487558+0000","last_peered":"2024-09-10T23:22:51.487558+0000","last_clean":"2024-09-10T23:22:51.487558+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:22:51.487558+0000","last_undegraded":"2024-09-10T23:22:51.487558+0000","last_fullsized":"2024-09-10T23:22:51.487558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491721+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:51.491721+0000","last_peered":"2024-09-10T23:22:51.491721+0000","last_clean":"2024-09-10T23:22:51.491721+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:51.491721+0000","last_undegraded":"2024-09-10T23:22:51.491721+0000","last_fullsized":"2024-09-10T23:22:51.491721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485601+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:22:51.485601+0000","last_peered":"2024-09-10T23:22:51.485601+0000","last_clean":"2024-09-10T23:22:51.485601+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:22:51.485601+0000","last_undegraded":"2024-09-10T23:22:51.485601+0000","last_fullsized":"2024-09-10T23:22:51.485601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488112+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:51.488112+0000","last_peered":"2024-09-10T23:22:51.488112+0000","last_clean":"2024-09-10T23:22:51.488112+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:51.488112+0000","last_undegraded":"2024-09-10T23:22:51.488112+0000","last_fullsized":"2024-09-10T23:22:51.488112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492211+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:22:51.492211+0000","last_peered":"2024-09-10T23:22:51.492211+0000","last_clean":"2024-09-10T23:22:51.492211+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:22:51.492211+0000","last_undegraded":"2024-09-10T23:22:51.492211+0000","last_fullsized":"2024-09-10T23:22:51.492211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":84,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.514056+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:23:20.514056+0000","last_peered":"2024-09-10T23:23:20.514056+0000","last_clean":"2024-09-10T23:23:20.514056+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:23:20.514056+0000","last_undegraded":"2024-09-10T23:23:20.514056+0000","last_fullsized":"2024-09-10T23:23:20.514056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491477+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:22:51.491477+0000","last_peered":"2024-09-10T23:22:51.491477+0000","last_clean":"2024-09-10T23:22:51.491477+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:22:51.491477+0000","last_undegraded":"2024-09-10T23:22:51.491477+0000","last_fullsized":"2024-09-10T23:22:51.491477+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486630+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:51.486630+0000","last_peered":"2024-09-10T23:22:51.486630+0000","last_clean":"2024-09-10T23:22:51.486630+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:51.486630+0000","last_undegraded":"2024-09-10T23:22:51.486630+0000","last_fullsized":"2024-09-10T23:22:51.486630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487967+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:22:51.487967+0000","last_peered":"2024-09-10T23:22:51.487967+0000","last_clean":"2024-09-10T23:22:51.487967+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:22:51.487967+0000","last_undegraded":"2024-09-10T23:22:51.487967+0000","last_fullsized":"2024-09-10T23:22:51.487967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.510546+0000","last_change":"2024-09-10T23:22:51.510092+0000","last_active":"2024-09-10T23:22:51.510546+0000","last_peered":"2024-09-10T23:22:51.510546+0000","last_clean":"2024-09-10T23:22:51.510546+0000","last_became_active":"2024-09-10T23:22:51.489887+0000","last_became_peered":"2024-09-10T23:22:51.489887+0000","last_unstale":"2024-09-10T23:22:51.510546+0000","last_undegraded":"2024-09-10T23:22:51.510546+0000","last_fullsized":"2024-09-10T23:22:51.510546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:14.757355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484993+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:22:51.484993+0000","last_peered":"2024-09-10T23:22:51.484993+0000","last_clean":"2024-09-10T23:22:51.484993+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:22:51.484993+0000","last_undegraded":"2024-09-10T23:22:51.484993+0000","last_fullsized":"2024-09-10T23:22:51.484993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486119+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:51.486119+0000","last_peered":"2024-09-10T23:22:51.486119+0000","last_clean":"2024-09-10T23:22:51.486119+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:51.486119+0000","last_undegraded":"2024-09-10T23:22:51.486119+0000","last_fullsized":"2024-09-10T23:22:51.486119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492006+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:22:51.492006+0000","last_peered":"2024-09-10T23:22:51.492006+0000","last_clean":"2024-09-10T23:22:51.492006+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:22:51.492006+0000","last_undegraded":"2024-09-10T23:22:51.492006+0000","last_fullsized":"2024-09-10T23:22:51.492006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488710+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:51.488710+0000","last_peered":"2024-09-10T23:22:51.488710+0000","last_clean":"2024-09-10T23:22:51.488710+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:51.488710+0000","last_undegraded":"2024-09-10T23:22:51.488710+0000","last_fullsized":"2024-09-10T23:22:51.488710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491850+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:22:51.491850+0000","last_peered":"2024-09-10T23:22:51.491850+0000","last_clean":"2024-09-10T23:22:51.491850+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:22:51.491850+0000","last_undegraded":"2024-09-10T23:22:51.491850+0000","last_fullsized":"2024-09-10T23:22:51.491850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":83,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:17.510635+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:23:17.510635+0000","last_peered":"2024-09-10T23:23:17.510635+0000","last_clean":"2024-09-10T23:23:17.510635+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:23:17.510635+0000","last_undegraded":"2024-09-10T23:23:17.510635+0000","last_fullsized":"2024-09-10T23:23:17.510635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491920+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:22:51.491920+0000","last_peered":"2024-09-10T23:22:51.491920+0000","last_clean":"2024-09-10T23:22:51.491920+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:22:51.491920+0000","last_undegraded":"2024-09-10T23:22:51.491920+0000","last_fullsized":"2024-09-10T23:22:51.491920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491733+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:51.491733+0000","last_peered":"2024-09-10T23:22:51.491733+0000","last_clean":"2024-09-10T23:22:51.491733+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:51.491733+0000","last_undegraded":"2024-09-10T23:22:51.491733+0000","last_fullsized":"2024-09-10T23:22:51.491733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484149+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:51.484149+0000","last_peered":"2024-09-10T23:22:51.484149+0000","last_clean":"2024-09-10T23:22:51.484149+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:51.484149+0000","last_undegraded":"2024-09-10T23:22:51.484149+0000","last_fullsized":"2024-09-10T23:22:51.484149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.489587+0000","last_change":"2024-09-10T23:22:51.489197+0000","last_active":"2024-09-10T23:22:51.489587+0000","last_peered":"2024-09-10T23:22:51.489587+0000","last_clean":"2024-09-10T23:22:51.489587+0000","last_became_active":"2024-09-10T23:22:51.488701+0000","last_became_peered":"2024-09-10T23:22:51.488701+0000","last_unstale":"2024-09-10T23:22:51.489587+0000","last_undegraded":"2024-09-10T23:22:51.489587+0000","last_fullsized":"2024-09-10T23:22:51.489587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:47.899980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491615+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:51.491615+0000","last_peered":"2024-09-10T23:22:51.491615+0000","last_clean":"2024-09-10T23:22:51.491615+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:51.491615+0000","last_undegraded":"2024-09-10T23:22:51.491615+0000","last_fullsized":"2024-09-10T23:22:51.491615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":79,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:16.507890+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:23:16.507890+0000","last_peered":"2024-09-10T23:23:16.507890+0000","last_clean":"2024-09-10T23:23:16.507890+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:23:16.507890+0000","last_undegraded":"2024-09-10T23:23:16.507890+0000","last_fullsized":"2024-09-10T23:23:16.507890+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488167+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:22:51.488167+0000","last_peered":"2024-09-10T23:22:51.488167+0000","last_clean":"2024-09-10T23:22:51.488167+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:22:51.488167+0000","last_undegraded":"2024-09-10T23:22:51.488167+0000","last_fullsized":"2024-09-10T23:22:51.488167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":79,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:16.508346+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:23:16.508346+0000","last_peered":"2024-09-10T23:23:16.508346+0000","last_clean":"2024-09-10T23:23:16.508346+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:23:16.508346+0000","last_undegraded":"2024-09-10T23:23:16.508346+0000","last_fullsized":"2024-09-10T23:23:16.508346+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544742+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:22:51.544742+0000","last_peered":"2024-09-10T23:22:51.544742+0000","last_clean":"2024-09-10T23:22:51.544742+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:22:51.544742+0000","last_undegraded":"2024-09-10T23:22:51.544742+0000","last_fullsized":"2024-09-10T23:22:51.544742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482986+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:51.482986+0000","last_peered":"2024-09-10T23:22:51.482986+0000","last_clean":"2024-09-10T23:22:51.482986+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:51.482986+0000","last_undegraded":"2024-09-10T23:22:51.482986+0000","last_fullsized":"2024-09-10T23:22:51.482986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544759+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:22:51.544759+0000","last_peered":"2024-09-10T23:22:51.544759+0000","last_clean":"2024-09-10T23:22:51.544759+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:22:51.544759+0000","last_undegraded":"2024-09-10T23:22:51.544759+0000","last_fullsized":"2024-09-10T23:22:51.544759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.498531+0000","last_change":"2024-09-10T23:22:51.498021+0000","last_active":"2024-09-10T23:22:51.498531+0000","last_peered":"2024-09-10T23:22:51.498531+0000","last_clean":"2024-09-10T23:22:51.498531+0000","last_became_active":"2024-09-10T23:22:51.488787+0000","last_became_peered":"2024-09-10T23:22:51.488787+0000","last_unstale":"2024-09-10T23:22:51.498531+0000","last_undegraded":"2024-09-10T23:22:51.498531+0000","last_fullsized":"2024-09-10T23:22:51.498531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:46.855288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486021+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:22:51.486021+0000","last_peered":"2024-09-10T23:22:51.486021+0000","last_clean":"2024-09-10T23:22:51.486021+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:22:51.486021+0000","last_undegraded":"2024-09-10T23:22:51.486021+0000","last_fullsized":"2024-09-10T23:22:51.486021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.483072+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:51.483072+0000","last_peered":"2024-09-10T23:22:51.483072+0000","last_clean":"2024-09-10T23:22:51.483072+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:51.483072+0000","last_undegraded":"2024-09-10T23:22:51.483072+0000","last_fullsized":"2024-09-10T23:22:51.483072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484358+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:51.484358+0000","last_peered":"2024-09-10T23:22:51.484358+0000","last_clean":"2024-09-10T23:22:51.484358+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:51.484358+0000","last_undegraded":"2024-09-10T23:22:51.484358+0000","last_fullsized":"2024-09-10T23:22:51.484358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487873+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:22:51.487873+0000","last_peered":"2024-09-10T23:22:51.487873+0000","last_clean":"2024-09-10T23:22:51.487873+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:22:51.487873+0000","last_undegraded":"2024-09-10T23:22:51.487873+0000","last_fullsized":"2024-09-10T23:22:51.487873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485900+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:51.485900+0000","last_peered":"2024-09-10T23:22:51.485900+0000","last_clean":"2024-09-10T23:22:51.485900+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:51.485900+0000","last_undegraded":"2024-09-10T23:22:51.485900+0000","last_fullsized":"2024-09-10T23:22:51.485900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486157+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:22:51.486157+0000","last_peered":"2024-09-10T23:22:51.486157+0000","last_clean":"2024-09-10T23:22:51.486157+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:22:51.486157+0000","last_undegraded":"2024-09-10T23:22:51.486157+0000","last_fullsized":"2024-09-10T23:22:51.486157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544426+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:51.544426+0000","last_peered":"2024-09-10T23:22:51.544426+0000","last_clean":"2024-09-10T23:22:51.544426+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:51.544426+0000","last_undegraded":"2024-09-10T23:22:51.544426+0000","last_fullsized":"2024-09-10T23:22:51.544426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484688+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:22:51.484688+0000","last_peered":"2024-09-10T23:22:51.484688+0000","last_clean":"2024-09-10T23:22:51.484688+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:22:51.484688+0000","last_undegraded":"2024-09-10T23:22:51.484688+0000","last_fullsized":"2024-09-10T23:22:51.484688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492153+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:51.492153+0000","last_peered":"2024-09-10T23:22:51.492153+0000","last_clean":"2024-09-10T23:22:51.492153+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:51.492153+0000","last_undegraded":"2024-09-10T23:22:51.492153+0000","last_fullsized":"2024-09-10T23:22:51.492153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544544+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:22:51.544544+0000","last_peered":"2024-09-10T23:22:51.544544+0000","last_clean":"2024-09-10T23:22:51.544544+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:22:51.544544+0000","last_undegraded":"2024-09-10T23:22:51.544544+0000","last_fullsized":"2024-09-10T23:22:51.544544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486273+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:51.486273+0000","last_peered":"2024-09-10T23:22:51.486273+0000","last_clean":"2024-09-10T23:22:51.486273+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:51.486273+0000","last_undegraded":"2024-09-10T23:22:51.486273+0000","last_fullsized":"2024-09-10T23:22:51.486273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491647+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:22:51.491647+0000","last_peered":"2024-09-10T23:22:51.491647+0000","last_clean":"2024-09-10T23:22:51.491647+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:22:51.491647+0000","last_undegraded":"2024-09-10T23:22:51.491647+0000","last_fullsized":"2024-09-10T23:22:51.491647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488536+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:22:51.488536+0000","last_peered":"2024-09-10T23:22:51.488536+0000","last_clean":"2024-09-10T23:22:51.488536+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:22:51.488536+0000","last_undegraded":"2024-09-10T23:22:51.488536+0000","last_fullsized":"2024-09-10T23:22:51.488536+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487411+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:51.487411+0000","last_peered":"2024-09-10T23:22:51.487411+0000","last_clean":"2024-09-10T23:22:51.487411+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:51.487411+0000","last_undegraded":"2024-09-10T23:22:51.487411+0000","last_fullsized":"2024-09-10T23:22:51.487411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485833+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:22:51.485833+0000","last_peered":"2024-09-10T23:22:51.485833+0000","last_clean":"2024-09-10T23:22:51.485833+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:22:51.485833+0000","last_undegraded":"2024-09-10T23:22:51.485833+0000","last_fullsized":"2024-09-10T23:22:51.485833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":59,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.504887+0000","last_change":"2024-09-10T23:22:51.504814+0000","last_active":"2024-09-10T23:22:51.504887+0000","last_peered":"2024-09-10T23:22:51.504887+0000","last_clean":"2024-09-10T23:22:51.504887+0000","last_became_active":"2024-09-10T23:22:51.493572+0000","last_became_peered":"2024-09-10T23:22:51.493572+0000","last_unstale":"2024-09-10T23:22:51.504887+0000","last_undegraded":"2024-09-10T23:22:51.504887+0000","last_fullsized":"2024-09-10T23:22:51.504887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:02.758621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487949+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:22:51.487949+0000","last_peered":"2024-09-10T23:22:51.487949+0000","last_clean":"2024-09-10T23:22:51.487949+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:22:51.487949+0000","last_undegraded":"2024-09-10T23:22:51.487949+0000","last_fullsized":"2024-09-10T23:22:51.487949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544736+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:51.544736+0000","last_peered":"2024-09-10T23:22:51.544736+0000","last_clean":"2024-09-10T23:22:51.544736+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:51.544736+0000","last_undegraded":"2024-09-10T23:22:51.544736+0000","last_fullsized":"2024-09-10T23:22:51.544736+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544542+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:22:51.544542+0000","last_peered":"2024-09-10T23:22:51.544542+0000","last_clean":"2024-09-10T23:22:51.544542+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:22:51.544542+0000","last_undegraded":"2024-09-10T23:22:51.544542+0000","last_fullsized":"2024-09-10T23:22:51.544542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":88,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:17.509203+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:23:17.509203+0000","last_peered":"2024-09-10T23:23:17.509203+0000","last_clean":"2024-09-10T23:23:17.509203+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:23:17.509203+0000","last_undegraded":"2024-09-10T23:23:17.509203+0000","last_fullsized":"2024-09-10T23:23:17.509203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68374,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":556,"num_read_kb":354,"num_write":247,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1147,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":205122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":402874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":1054548,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":402279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":402523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":995175,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":401996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":994853,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":851968,"data_stored":402870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36192,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708960,"statfs":{"total":95995035648,"available":95957975040,"internally_reserved":0,"allocated":860160,"data_stored":401821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":464068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":464079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":864256,"data_stored":403726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:23:24.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:23:24.731 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:24.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:24.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:24.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:24 smithi002 ceph-mon[31150]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:23:24.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:24.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:24.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:24.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:24.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:24.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:24 smithi177 ceph-mon[35760]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:23:24.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:24.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:24.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:25.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:25.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:25.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:24 smithi154 ceph-mon[35136]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:23:25.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:25.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:25.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:23:25.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 -- 172.21.15.2:0/3534346870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 msgr2=0x7f1dc810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:25.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 --2- 172.21.15.2:0/3534346870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc810e860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009ca0 tx=0x7f1dc002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 -- 172.21.15.2:0/3534346870 shutdown_connections 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 --2- 172.21.15.2:0/3534346870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc810e860 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 --2- 172.21.15.2:0/3534346870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc81076e0 0x7f1dc8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 --2- 172.21.15.2:0/3534346870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc8101cd0 0x7f1dc81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 -- 172.21.15.2:0/3534346870 >> 172.21.15.2:0/3534346870 conn(0x7f1dc80fd700 msgr2=0x7f1dc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 -- 172.21.15.2:0/3534346870 shutdown_connections 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.224+0000 7f1dce084640 1 -- 172.21.15.2:0/3534346870 wait complete. 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 Processor -- start 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 -- start start 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc8101cd0 0x7f1dc819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc81076e0 0x7f1dc819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8111ce0 con 0x7f1dc8108060 2024-09-10T23:23:25.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8111b60 con 0x7f1dc81076e0 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dce084640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8111e60 con 0x7f1dc8101cd0 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45382/0 (socket says 172.21.15.2:45382) 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dc7fff640 1 -- 172.21.15.2:0/2504223548 learned_addr learned my addr 172.21.15.2:0/2504223548 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dc77fe640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc8101cd0 0x7f1dc819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.225+0000 7f1dc6ffd640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc81076e0 0x7f1dc819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc7fff640 1 -- 172.21.15.2:0/2504223548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc8101cd0 msgr2=0x7f1dc819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc7fff640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc8101cd0 0x7f1dc819a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc7fff640 1 -- 172.21.15.2:0/2504223548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc81076e0 msgr2=0x7f1dc819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc7fff640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc81076e0 0x7f1dc819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc7fff640 1 -- 172.21.15.2:0/2504223548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc81a54a0 con 0x7f1dc8108060 2024-09-10T23:23:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc7fff640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc819ab60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0005cc0 tx=0x7f1dc002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0003bf0 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc0003d90 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc002fbc0 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc81a5730 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.226+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc81a5cc0 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.227+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc81020b0 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.228+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f1dc0004610 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.230+0000 7f1dc4ff9640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1db00b53f0 0x7f1db00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.230+0000 7f1dc77fe640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1db00b53f0 0x7f1db00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.230+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1dc01073a0 con 0x7f1dc8108060 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.230+0000 7f1dc77fe640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1db00b53f0 0x7f1db00b78b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005d00 tx=0x7f1db800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:25.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.233+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1dc00ce110 con 0x7f1dc8108060 2024-09-10T23:23:25.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.415+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1dc8063590 con 0x7f1db00b53f0 2024-09-10T23:23:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.419+0000 7f1dc4ff9640 1 -- 172.21.15.2:0/2504223548 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258918 (secure 0 0 0) 0x7f1dc8063590 con 0x7f1db00b53f0 2024-09-10T23:23:25.423 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:25.424 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:23:25.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1db00b53f0 msgr2=0x7f1db00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:25.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1db00b53f0 0x7f1db00b78b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005d00 tx=0x7f1db800b410 comp rx=0 tx=0).stop 2024-09-10T23:23:25.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 msgr2=0x7f1dc819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:25.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc819ab60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0005cc0 tx=0x7f1dc002f380 comp rx=0 tx=0).stop 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 shutdown_connections 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1db00b53f0 0x7f1db00b78b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dc8108060 0x7f1dc819ab60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc81076e0 0x7f1dc819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 --2- 172.21.15.2:0/2504223548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc8101cd0 0x7f1dc819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 >> 172.21.15.2:0/2504223548 conn(0x7f1dc80fd700 msgr2=0x7f1dc80fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 shutdown_connections 2024-09-10T23:23:25.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:25.422+0000 7f1dce084640 1 -- 172.21.15.2:0/2504223548 wait complete. 2024-09-10T23:23:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:25 smithi002 ceph-mon[31150]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:25.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:25 smithi177 ceph-mon[35760]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:25 smithi154 ceph-mon[35136]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:26.135 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-10T23:23:24.232346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658976,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":647,"num_read_kb":423,"num_write":372,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952987,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376320,"kb_used_data":10368,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565504,"statfs":{"total":1151940427776,"available":1151555076096,"internally_reserved":0,"allocated":10616832,"data_stored":6790812,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002874"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485539+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:22:51.485539+0000","last_peered":"2024-09-10T23:22:51.485539+0000","last_clean":"2024-09-10T23:22:51.485539+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:22:51.485539+0000","last_undegraded":"2024-09-10T23:22:51.485539+0000","last_fullsized":"2024-09-10T23:22:51.485539+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487847+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:22:51.487847+0000","last_peered":"2024-09-10T23:22:51.487847+0000","last_clean":"2024-09-10T23:22:51.487847+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:22:51.487847+0000","last_undegraded":"2024-09-10T23:22:51.487847+0000","last_fullsized":"2024-09-10T23:22:51.487847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487802+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:22:51.487802+0000","last_peered":"2024-09-10T23:22:51.487802+0000","last_clean":"2024-09-10T23:22:51.487802+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:22:51.487802+0000","last_undegraded":"2024-09-10T23:22:51.487802+0000","last_fullsized":"2024-09-10T23:22:51.487802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484418+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:22:51.484418+0000","last_peered":"2024-09-10T23:22:51.484418+0000","last_clean":"2024-09-10T23:22:51.484418+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:22:51.484418+0000","last_undegraded":"2024-09-10T23:22:51.484418+0000","last_fullsized":"2024-09-10T23:22:51.484418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486135+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:22:51.486135+0000","last_peered":"2024-09-10T23:22:51.486135+0000","last_clean":"2024-09-10T23:22:51.486135+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:22:51.486135+0000","last_undegraded":"2024-09-10T23:22:51.486135+0000","last_fullsized":"2024-09-10T23:22:51.486135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544641+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:22:51.544641+0000","last_peered":"2024-09-10T23:22:51.544641+0000","last_clean":"2024-09-10T23:22:51.544641+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:22:51.544641+0000","last_undegraded":"2024-09-10T23:22:51.544641+0000","last_fullsized":"2024-09-10T23:22:51.544641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491499+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:22:51.491499+0000","last_peered":"2024-09-10T23:22:51.491499+0000","last_clean":"2024-09-10T23:22:51.491499+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:22:51.491499+0000","last_undegraded":"2024-09-10T23:22:51.491499+0000","last_fullsized":"2024-09-10T23:22:51.491499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544254+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:22:51.544254+0000","last_peered":"2024-09-10T23:22:51.544254+0000","last_clean":"2024-09-10T23:22:51.544254+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:22:51.544254+0000","last_undegraded":"2024-09-10T23:22:51.544254+0000","last_fullsized":"2024-09-10T23:22:51.544254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486368+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:22:51.486368+0000","last_peered":"2024-09-10T23:22:51.486368+0000","last_clean":"2024-09-10T23:22:51.486368+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:22:51.486368+0000","last_undegraded":"2024-09-10T23:22:51.486368+0000","last_fullsized":"2024-09-10T23:22:51.486368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.545013+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:22:51.545013+0000","last_peered":"2024-09-10T23:22:51.545013+0000","last_clean":"2024-09-10T23:22:51.545013+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:22:51.545013+0000","last_undegraded":"2024-09-10T23:22:51.545013+0000","last_fullsized":"2024-09-10T23:22:51.545013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491800+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:22:51.491800+0000","last_peered":"2024-09-10T23:22:51.491800+0000","last_clean":"2024-09-10T23:22:51.491800+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:22:51.491800+0000","last_undegraded":"2024-09-10T23:22:51.491800+0000","last_fullsized":"2024-09-10T23:22:51.491800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484533+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:22:51.484533+0000","last_peered":"2024-09-10T23:22:51.484533+0000","last_clean":"2024-09-10T23:22:51.484533+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:22:51.484533+0000","last_undegraded":"2024-09-10T23:22:51.484533+0000","last_fullsized":"2024-09-10T23:22:51.484533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485754+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:22:51.485754+0000","last_peered":"2024-09-10T23:22:51.485754+0000","last_clean":"2024-09-10T23:22:51.485754+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:22:51.485754+0000","last_undegraded":"2024-09-10T23:22:51.485754+0000","last_fullsized":"2024-09-10T23:22:51.485754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487652+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:22:51.487652+0000","last_peered":"2024-09-10T23:22:51.487652+0000","last_clean":"2024-09-10T23:22:51.487652+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:22:51.487652+0000","last_undegraded":"2024-09-10T23:22:51.487652+0000","last_fullsized":"2024-09-10T23:22:51.487652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487437+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:22:51.487437+0000","last_peered":"2024-09-10T23:22:51.487437+0000","last_clean":"2024-09-10T23:22:51.487437+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:22:51.487437+0000","last_undegraded":"2024-09-10T23:22:51.487437+0000","last_fullsized":"2024-09-10T23:22:51.487437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485740+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:22:51.485740+0000","last_peered":"2024-09-10T23:22:51.485740+0000","last_clean":"2024-09-10T23:22:51.485740+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:22:51.485740+0000","last_undegraded":"2024-09-10T23:22:51.485740+0000","last_fullsized":"2024-09-10T23:22:51.485740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485763+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:22:51.485763+0000","last_peered":"2024-09-10T23:22:51.485763+0000","last_clean":"2024-09-10T23:22:51.485763+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:22:51.485763+0000","last_undegraded":"2024-09-10T23:22:51.485763+0000","last_fullsized":"2024-09-10T23:22:51.485763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482929+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:22:51.482929+0000","last_peered":"2024-09-10T23:22:51.482929+0000","last_clean":"2024-09-10T23:22:51.482929+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:22:51.482929+0000","last_undegraded":"2024-09-10T23:22:51.482929+0000","last_fullsized":"2024-09-10T23:22:51.482929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492928+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:22:51.492928+0000","last_peered":"2024-09-10T23:22:51.492928+0000","last_clean":"2024-09-10T23:22:51.492928+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:22:51.492928+0000","last_undegraded":"2024-09-10T23:22:51.492928+0000","last_fullsized":"2024-09-10T23:22:51.492928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492994+0000","last_change":"2024-09-10T23:22:51.492807+0000","last_active":"2024-09-10T23:22:51.492994+0000","last_peered":"2024-09-10T23:22:51.492994+0000","last_clean":"2024-09-10T23:22:51.492994+0000","last_became_active":"2024-09-10T23:22:51.492343+0000","last_became_peered":"2024-09-10T23:22:51.492343+0000","last_unstale":"2024-09-10T23:22:51.492994+0000","last_undegraded":"2024-09-10T23:22:51.492994+0000","last_fullsized":"2024-09-10T23:22:51.492994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:59.573883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485762+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:22:51.485762+0000","last_peered":"2024-09-10T23:22:51.485762+0000","last_clean":"2024-09-10T23:22:51.485762+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:22:51.485762+0000","last_undegraded":"2024-09-10T23:22:51.485762+0000","last_fullsized":"2024-09-10T23:22:51.485762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486303+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:22:51.486303+0000","last_peered":"2024-09-10T23:22:51.486303+0000","last_clean":"2024-09-10T23:22:51.486303+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:22:51.486303+0000","last_undegraded":"2024-09-10T23:22:51.486303+0000","last_fullsized":"2024-09-10T23:22:51.486303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544315+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:22:51.544315+0000","last_peered":"2024-09-10T23:22:51.544315+0000","last_clean":"2024-09-10T23:22:51.544315+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:22:51.544315+0000","last_undegraded":"2024-09-10T23:22:51.544315+0000","last_fullsized":"2024-09-10T23:22:51.544315+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487995+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:22:51.487995+0000","last_peered":"2024-09-10T23:22:51.487995+0000","last_clean":"2024-09-10T23:22:51.487995+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:22:51.487995+0000","last_undegraded":"2024-09-10T23:22:51.487995+0000","last_fullsized":"2024-09-10T23:22:51.487995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544699+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:22:51.544699+0000","last_peered":"2024-09-10T23:22:51.544699+0000","last_clean":"2024-09-10T23:22:51.544699+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:22:51.544699+0000","last_undegraded":"2024-09-10T23:22:51.544699+0000","last_fullsized":"2024-09-10T23:22:51.544699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491699+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:22:51.491699+0000","last_peered":"2024-09-10T23:22:51.491699+0000","last_clean":"2024-09-10T23:22:51.491699+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:22:51.491699+0000","last_undegraded":"2024-09-10T23:22:51.491699+0000","last_fullsized":"2024-09-10T23:22:51.491699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485892+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:22:51.485892+0000","last_peered":"2024-09-10T23:22:51.485892+0000","last_clean":"2024-09-10T23:22:51.485892+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:22:51.485892+0000","last_undegraded":"2024-09-10T23:22:51.485892+0000","last_fullsized":"2024-09-10T23:22:51.485892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488773+0000","last_change":"2024-09-10T23:22:51.488675+0000","last_active":"2024-09-10T23:22:51.488773+0000","last_peered":"2024-09-10T23:22:51.488773+0000","last_clean":"2024-09-10T23:22:51.488773+0000","last_became_active":"2024-09-10T23:22:51.488291+0000","last_became_peered":"2024-09-10T23:22:51.488291+0000","last_unstale":"2024-09-10T23:22:51.488773+0000","last_undegraded":"2024-09-10T23:22:51.488773+0000","last_fullsized":"2024-09-10T23:22:51.488773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487646+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:22:51.487646+0000","last_peered":"2024-09-10T23:22:51.487646+0000","last_clean":"2024-09-10T23:22:51.487646+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:22:51.487646+0000","last_undegraded":"2024-09-10T23:22:51.487646+0000","last_fullsized":"2024-09-10T23:22:51.487646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492028+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:22:51.492028+0000","last_peered":"2024-09-10T23:22:51.492028+0000","last_clean":"2024-09-10T23:22:51.492028+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:22:51.492028+0000","last_undegraded":"2024-09-10T23:22:51.492028+0000","last_fullsized":"2024-09-10T23:22:51.492028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492224+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:22:51.492224+0000","last_peered":"2024-09-10T23:22:51.492224+0000","last_clean":"2024-09-10T23:22:51.492224+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:22:51.492224+0000","last_undegraded":"2024-09-10T23:22:51.492224+0000","last_fullsized":"2024-09-10T23:22:51.492224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484678+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:22:51.484678+0000","last_peered":"2024-09-10T23:22:51.484678+0000","last_clean":"2024-09-10T23:22:51.484678+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:22:51.484678+0000","last_undegraded":"2024-09-10T23:22:51.484678+0000","last_fullsized":"2024-09-10T23:22:51.484678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486929+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:22:51.486929+0000","last_peered":"2024-09-10T23:22:51.486929+0000","last_clean":"2024-09-10T23:22:51.486929+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:22:51.486929+0000","last_undegraded":"2024-09-10T23:22:51.486929+0000","last_fullsized":"2024-09-10T23:22:51.486929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.531422+0000","last_change":"2024-09-10T23:22:51.506742+0000","last_active":"2024-09-10T23:23:20.531422+0000","last_peered":"2024-09-10T23:23:20.531422+0000","last_clean":"2024-09-10T23:23:20.531422+0000","last_became_active":"2024-09-10T23:22:51.493588+0000","last_became_peered":"2024-09-10T23:22:51.493588+0000","last_unstale":"2024-09-10T23:23:20.531422+0000","last_undegraded":"2024-09-10T23:23:20.531422+0000","last_fullsized":"2024-09-10T23:23:20.531422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:42.641981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488448+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:22:51.488448+0000","last_peered":"2024-09-10T23:22:51.488448+0000","last_clean":"2024-09-10T23:22:51.488448+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:22:51.488448+0000","last_undegraded":"2024-09-10T23:22:51.488448+0000","last_fullsized":"2024-09-10T23:22:51.488448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544310+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:22:51.544310+0000","last_peered":"2024-09-10T23:22:51.544310+0000","last_clean":"2024-09-10T23:22:51.544310+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:22:51.544310+0000","last_undegraded":"2024-09-10T23:22:51.544310+0000","last_fullsized":"2024-09-10T23:22:51.544310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488201+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:51.488201+0000","last_peered":"2024-09-10T23:22:51.488201+0000","last_clean":"2024-09-10T23:22:51.488201+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:51.488201+0000","last_undegraded":"2024-09-10T23:22:51.488201+0000","last_fullsized":"2024-09-10T23:22:51.488201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482756+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:22:51.482756+0000","last_peered":"2024-09-10T23:22:51.482756+0000","last_clean":"2024-09-10T23:22:51.482756+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:22:51.482756+0000","last_undegraded":"2024-09-10T23:22:51.482756+0000","last_fullsized":"2024-09-10T23:22:51.482756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":133,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.513955+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:23:20.513955+0000","last_peered":"2024-09-10T23:23:20.513955+0000","last_clean":"2024-09-10T23:23:20.513955+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:23:20.513955+0000","last_undegraded":"2024-09-10T23:23:20.513955+0000","last_fullsized":"2024-09-10T23:23:20.513955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486586+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:22:51.486586+0000","last_peered":"2024-09-10T23:22:51.486586+0000","last_clean":"2024-09-10T23:22:51.486586+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:22:51.486586+0000","last_undegraded":"2024-09-10T23:22:51.486586+0000","last_fullsized":"2024-09-10T23:22:51.486586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492077+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:51.492077+0000","last_peered":"2024-09-10T23:22:51.492077+0000","last_clean":"2024-09-10T23:22:51.492077+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:51.492077+0000","last_undegraded":"2024-09-10T23:22:51.492077+0000","last_fullsized":"2024-09-10T23:22:51.492077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487987+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:22:51.487987+0000","last_peered":"2024-09-10T23:22:51.487987+0000","last_clean":"2024-09-10T23:22:51.487987+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:22:51.487987+0000","last_undegraded":"2024-09-10T23:22:51.487987+0000","last_fullsized":"2024-09-10T23:22:51.487987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488638+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:51.488638+0000","last_peered":"2024-09-10T23:22:51.488638+0000","last_clean":"2024-09-10T23:22:51.488638+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:51.488638+0000","last_undegraded":"2024-09-10T23:22:51.488638+0000","last_fullsized":"2024-09-10T23:22:51.488638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.490274+0000","last_change":"2024-09-10T23:22:51.490154+0000","last_active":"2024-09-10T23:22:51.490274+0000","last_peered":"2024-09-10T23:22:51.490274+0000","last_clean":"2024-09-10T23:22:51.490274+0000","last_became_active":"2024-09-10T23:22:51.489716+0000","last_became_peered":"2024-09-10T23:22:51.489716+0000","last_unstale":"2024-09-10T23:22:51.490274+0000","last_undegraded":"2024-09-10T23:22:51.490274+0000","last_fullsized":"2024-09-10T23:22:51.490274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.280542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.531147+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:23:20.531147+0000","last_peered":"2024-09-10T23:23:20.531147+0000","last_clean":"2024-09-10T23:23:20.531147+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:23:20.531147+0000","last_undegraded":"2024-09-10T23:23:20.531147+0000","last_fullsized":"2024-09-10T23:23:20.531147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61170,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":117,"num_write":34,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487558+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:22:51.487558+0000","last_peered":"2024-09-10T23:22:51.487558+0000","last_clean":"2024-09-10T23:22:51.487558+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:22:51.487558+0000","last_undegraded":"2024-09-10T23:22:51.487558+0000","last_fullsized":"2024-09-10T23:22:51.487558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491721+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:51.491721+0000","last_peered":"2024-09-10T23:22:51.491721+0000","last_clean":"2024-09-10T23:22:51.491721+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:51.491721+0000","last_undegraded":"2024-09-10T23:22:51.491721+0000","last_fullsized":"2024-09-10T23:22:51.491721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485601+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:22:51.485601+0000","last_peered":"2024-09-10T23:22:51.485601+0000","last_clean":"2024-09-10T23:22:51.485601+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:22:51.485601+0000","last_undegraded":"2024-09-10T23:22:51.485601+0000","last_fullsized":"2024-09-10T23:22:51.485601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488112+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:51.488112+0000","last_peered":"2024-09-10T23:22:51.488112+0000","last_clean":"2024-09-10T23:22:51.488112+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:51.488112+0000","last_undegraded":"2024-09-10T23:22:51.488112+0000","last_fullsized":"2024-09-10T23:22:51.488112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492211+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:22:51.492211+0000","last_peered":"2024-09-10T23:22:51.492211+0000","last_clean":"2024-09-10T23:22:51.492211+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:22:51.492211+0000","last_undegraded":"2024-09-10T23:22:51.492211+0000","last_fullsized":"2024-09-10T23:22:51.492211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":84,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:20.514056+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:23:20.514056+0000","last_peered":"2024-09-10T23:23:20.514056+0000","last_clean":"2024-09-10T23:23:20.514056+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:23:20.514056+0000","last_undegraded":"2024-09-10T23:23:20.514056+0000","last_fullsized":"2024-09-10T23:23:20.514056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491477+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:22:51.491477+0000","last_peered":"2024-09-10T23:22:51.491477+0000","last_clean":"2024-09-10T23:22:51.491477+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:22:51.491477+0000","last_undegraded":"2024-09-10T23:22:51.491477+0000","last_fullsized":"2024-09-10T23:22:51.491477+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486630+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:51.486630+0000","last_peered":"2024-09-10T23:22:51.486630+0000","last_clean":"2024-09-10T23:22:51.486630+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:51.486630+0000","last_undegraded":"2024-09-10T23:22:51.486630+0000","last_fullsized":"2024-09-10T23:22:51.486630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487967+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:22:51.487967+0000","last_peered":"2024-09-10T23:22:51.487967+0000","last_clean":"2024-09-10T23:22:51.487967+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:22:51.487967+0000","last_undegraded":"2024-09-10T23:22:51.487967+0000","last_fullsized":"2024-09-10T23:22:51.487967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.510546+0000","last_change":"2024-09-10T23:22:51.510092+0000","last_active":"2024-09-10T23:22:51.510546+0000","last_peered":"2024-09-10T23:22:51.510546+0000","last_clean":"2024-09-10T23:22:51.510546+0000","last_became_active":"2024-09-10T23:22:51.489887+0000","last_became_peered":"2024-09-10T23:22:51.489887+0000","last_unstale":"2024-09-10T23:22:51.510546+0000","last_undegraded":"2024-09-10T23:22:51.510546+0000","last_fullsized":"2024-09-10T23:22:51.510546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:14.757355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484993+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:22:51.484993+0000","last_peered":"2024-09-10T23:22:51.484993+0000","last_clean":"2024-09-10T23:22:51.484993+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:22:51.484993+0000","last_undegraded":"2024-09-10T23:22:51.484993+0000","last_fullsized":"2024-09-10T23:22:51.484993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486119+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:51.486119+0000","last_peered":"2024-09-10T23:22:51.486119+0000","last_clean":"2024-09-10T23:22:51.486119+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:51.486119+0000","last_undegraded":"2024-09-10T23:22:51.486119+0000","last_fullsized":"2024-09-10T23:22:51.486119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492006+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:22:51.492006+0000","last_peered":"2024-09-10T23:22:51.492006+0000","last_clean":"2024-09-10T23:22:51.492006+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:22:51.492006+0000","last_undegraded":"2024-09-10T23:22:51.492006+0000","last_fullsized":"2024-09-10T23:22:51.492006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488710+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:51.488710+0000","last_peered":"2024-09-10T23:22:51.488710+0000","last_clean":"2024-09-10T23:22:51.488710+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:51.488710+0000","last_undegraded":"2024-09-10T23:22:51.488710+0000","last_fullsized":"2024-09-10T23:22:51.488710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491850+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:22:51.491850+0000","last_peered":"2024-09-10T23:22:51.491850+0000","last_clean":"2024-09-10T23:22:51.491850+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:22:51.491850+0000","last_undegraded":"2024-09-10T23:22:51.491850+0000","last_fullsized":"2024-09-10T23:22:51.491850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":88,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:22.517163+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:23:22.517163+0000","last_peered":"2024-09-10T23:23:22.517163+0000","last_clean":"2024-09-10T23:23:22.517163+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:23:22.517163+0000","last_undegraded":"2024-09-10T23:23:22.517163+0000","last_fullsized":"2024-09-10T23:23:22.517163+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491920+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:22:51.491920+0000","last_peered":"2024-09-10T23:22:51.491920+0000","last_clean":"2024-09-10T23:22:51.491920+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:22:51.491920+0000","last_undegraded":"2024-09-10T23:22:51.491920+0000","last_fullsized":"2024-09-10T23:22:51.491920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491733+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:51.491733+0000","last_peered":"2024-09-10T23:22:51.491733+0000","last_clean":"2024-09-10T23:22:51.491733+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:51.491733+0000","last_undegraded":"2024-09-10T23:22:51.491733+0000","last_fullsized":"2024-09-10T23:22:51.491733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484149+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:51.484149+0000","last_peered":"2024-09-10T23:22:51.484149+0000","last_clean":"2024-09-10T23:22:51.484149+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:51.484149+0000","last_undegraded":"2024-09-10T23:22:51.484149+0000","last_fullsized":"2024-09-10T23:22:51.484149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.489587+0000","last_change":"2024-09-10T23:22:51.489197+0000","last_active":"2024-09-10T23:22:51.489587+0000","last_peered":"2024-09-10T23:22:51.489587+0000","last_clean":"2024-09-10T23:22:51.489587+0000","last_became_active":"2024-09-10T23:22:51.488701+0000","last_became_peered":"2024-09-10T23:22:51.488701+0000","last_unstale":"2024-09-10T23:22:51.489587+0000","last_undegraded":"2024-09-10T23:22:51.489587+0000","last_fullsized":"2024-09-10T23:22:51.489587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:47.899980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491615+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:51.491615+0000","last_peered":"2024-09-10T23:22:51.491615+0000","last_clean":"2024-09-10T23:22:51.491615+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:51.491615+0000","last_undegraded":"2024-09-10T23:22:51.491615+0000","last_fullsized":"2024-09-10T23:22:51.491615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":84,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:21.514765+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:23:21.514765+0000","last_peered":"2024-09-10T23:23:21.514765+0000","last_clean":"2024-09-10T23:23:21.514765+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:23:21.514765+0000","last_undegraded":"2024-09-10T23:23:21.514765+0000","last_fullsized":"2024-09-10T23:23:21.514765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488167+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:22:51.488167+0000","last_peered":"2024-09-10T23:22:51.488167+0000","last_clean":"2024-09-10T23:22:51.488167+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:22:51.488167+0000","last_undegraded":"2024-09-10T23:22:51.488167+0000","last_fullsized":"2024-09-10T23:22:51.488167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":84,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:21.515142+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:23:21.515142+0000","last_peered":"2024-09-10T23:23:21.515142+0000","last_clean":"2024-09-10T23:23:21.515142+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:23:21.515142+0000","last_undegraded":"2024-09-10T23:23:21.515142+0000","last_fullsized":"2024-09-10T23:23:21.515142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544742+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:22:51.544742+0000","last_peered":"2024-09-10T23:22:51.544742+0000","last_clean":"2024-09-10T23:22:51.544742+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:22:51.544742+0000","last_undegraded":"2024-09-10T23:22:51.544742+0000","last_fullsized":"2024-09-10T23:22:51.544742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482986+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:51.482986+0000","last_peered":"2024-09-10T23:22:51.482986+0000","last_clean":"2024-09-10T23:22:51.482986+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:51.482986+0000","last_undegraded":"2024-09-10T23:22:51.482986+0000","last_fullsized":"2024-09-10T23:22:51.482986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544759+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:22:51.544759+0000","last_peered":"2024-09-10T23:22:51.544759+0000","last_clean":"2024-09-10T23:22:51.544759+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:22:51.544759+0000","last_undegraded":"2024-09-10T23:22:51.544759+0000","last_fullsized":"2024-09-10T23:22:51.544759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.498531+0000","last_change":"2024-09-10T23:22:51.498021+0000","last_active":"2024-09-10T23:22:51.498531+0000","last_peered":"2024-09-10T23:22:51.498531+0000","last_clean":"2024-09-10T23:22:51.498531+0000","last_became_active":"2024-09-10T23:22:51.488787+0000","last_became_peered":"2024-09-10T23:22:51.488787+0000","last_unstale":"2024-09-10T23:22:51.498531+0000","last_undegraded":"2024-09-10T23:22:51.498531+0000","last_fullsized":"2024-09-10T23:22:51.498531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:46.855288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486021+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:22:51.486021+0000","last_peered":"2024-09-10T23:22:51.486021+0000","last_clean":"2024-09-10T23:22:51.486021+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:22:51.486021+0000","last_undegraded":"2024-09-10T23:22:51.486021+0000","last_fullsized":"2024-09-10T23:22:51.486021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.483072+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:51.483072+0000","last_peered":"2024-09-10T23:22:51.483072+0000","last_clean":"2024-09-10T23:22:51.483072+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:51.483072+0000","last_undegraded":"2024-09-10T23:22:51.483072+0000","last_fullsized":"2024-09-10T23:22:51.483072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484358+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:51.484358+0000","last_peered":"2024-09-10T23:22:51.484358+0000","last_clean":"2024-09-10T23:22:51.484358+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:51.484358+0000","last_undegraded":"2024-09-10T23:22:51.484358+0000","last_fullsized":"2024-09-10T23:22:51.484358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487873+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:22:51.487873+0000","last_peered":"2024-09-10T23:22:51.487873+0000","last_clean":"2024-09-10T23:22:51.487873+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:22:51.487873+0000","last_undegraded":"2024-09-10T23:22:51.487873+0000","last_fullsized":"2024-09-10T23:22:51.487873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485900+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:51.485900+0000","last_peered":"2024-09-10T23:22:51.485900+0000","last_clean":"2024-09-10T23:22:51.485900+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:51.485900+0000","last_undegraded":"2024-09-10T23:22:51.485900+0000","last_fullsized":"2024-09-10T23:22:51.485900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486157+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:22:51.486157+0000","last_peered":"2024-09-10T23:22:51.486157+0000","last_clean":"2024-09-10T23:22:51.486157+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:22:51.486157+0000","last_undegraded":"2024-09-10T23:22:51.486157+0000","last_fullsized":"2024-09-10T23:22:51.486157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544426+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:51.544426+0000","last_peered":"2024-09-10T23:22:51.544426+0000","last_clean":"2024-09-10T23:22:51.544426+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:51.544426+0000","last_undegraded":"2024-09-10T23:22:51.544426+0000","last_fullsized":"2024-09-10T23:22:51.544426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484688+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:22:51.484688+0000","last_peered":"2024-09-10T23:22:51.484688+0000","last_clean":"2024-09-10T23:22:51.484688+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:22:51.484688+0000","last_undegraded":"2024-09-10T23:22:51.484688+0000","last_fullsized":"2024-09-10T23:22:51.484688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492153+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:51.492153+0000","last_peered":"2024-09-10T23:22:51.492153+0000","last_clean":"2024-09-10T23:22:51.492153+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:51.492153+0000","last_undegraded":"2024-09-10T23:22:51.492153+0000","last_fullsized":"2024-09-10T23:22:51.492153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544544+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:22:51.544544+0000","last_peered":"2024-09-10T23:22:51.544544+0000","last_clean":"2024-09-10T23:22:51.544544+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:22:51.544544+0000","last_undegraded":"2024-09-10T23:22:51.544544+0000","last_fullsized":"2024-09-10T23:22:51.544544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486273+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:51.486273+0000","last_peered":"2024-09-10T23:22:51.486273+0000","last_clean":"2024-09-10T23:22:51.486273+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:51.486273+0000","last_undegraded":"2024-09-10T23:22:51.486273+0000","last_fullsized":"2024-09-10T23:22:51.486273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491647+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:22:51.491647+0000","last_peered":"2024-09-10T23:22:51.491647+0000","last_clean":"2024-09-10T23:22:51.491647+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:22:51.491647+0000","last_undegraded":"2024-09-10T23:22:51.491647+0000","last_fullsized":"2024-09-10T23:22:51.491647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488536+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:22:51.488536+0000","last_peered":"2024-09-10T23:22:51.488536+0000","last_clean":"2024-09-10T23:22:51.488536+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:22:51.488536+0000","last_undegraded":"2024-09-10T23:22:51.488536+0000","last_fullsized":"2024-09-10T23:22:51.488536+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487411+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:51.487411+0000","last_peered":"2024-09-10T23:22:51.487411+0000","last_clean":"2024-09-10T23:22:51.487411+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:51.487411+0000","last_undegraded":"2024-09-10T23:22:51.487411+0000","last_fullsized":"2024-09-10T23:22:51.487411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485833+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:22:51.485833+0000","last_peered":"2024-09-10T23:22:51.485833+0000","last_clean":"2024-09-10T23:22:51.485833+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:22:51.485833+0000","last_undegraded":"2024-09-10T23:22:51.485833+0000","last_fullsized":"2024-09-10T23:22:51.485833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":59,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.504887+0000","last_change":"2024-09-10T23:22:51.504814+0000","last_active":"2024-09-10T23:22:51.504887+0000","last_peered":"2024-09-10T23:22:51.504887+0000","last_clean":"2024-09-10T23:22:51.504887+0000","last_became_active":"2024-09-10T23:22:51.493572+0000","last_became_peered":"2024-09-10T23:22:51.493572+0000","last_unstale":"2024-09-10T23:22:51.504887+0000","last_undegraded":"2024-09-10T23:22:51.504887+0000","last_fullsized":"2024-09-10T23:22:51.504887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:02.758621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487949+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:22:51.487949+0000","last_peered":"2024-09-10T23:22:51.487949+0000","last_clean":"2024-09-10T23:22:51.487949+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:22:51.487949+0000","last_undegraded":"2024-09-10T23:22:51.487949+0000","last_fullsized":"2024-09-10T23:22:51.487949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544736+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:51.544736+0000","last_peered":"2024-09-10T23:22:51.544736+0000","last_clean":"2024-09-10T23:22:51.544736+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:51.544736+0000","last_undegraded":"2024-09-10T23:22:51.544736+0000","last_fullsized":"2024-09-10T23:22:51.544736+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544542+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:22:51.544542+0000","last_peered":"2024-09-10T23:22:51.544542+0000","last_clean":"2024-09-10T23:22:51.544542+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:22:51.544542+0000","last_undegraded":"2024-09-10T23:22:51.544542+0000","last_fullsized":"2024-09-10T23:22:51.544542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":88,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:17.509203+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:23:17.509203+0000","last_peered":"2024-09-10T23:23:17.509203+0000","last_clean":"2024-09-10T23:23:17.509203+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:23:17.509203+0000","last_undegraded":"2024-09-10T23:23:17.509203+0000","last_fullsized":"2024-09-10T23:23:17.509203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68374,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":571,"num_read_kb":359,"num_write":247,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1147,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":205122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":402874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":1054548,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":402279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":402523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":995175,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":401996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":994853,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":851968,"data_stored":402870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36192,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708960,"statfs":{"total":95995035648,"available":95957975040,"internally_reserved":0,"allocated":860160,"data_stored":401821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":464068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":464079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":864256,"data_stored":403726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:23:26.140 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:23:26.140 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:23:26.140 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:23:26.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T23:23:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:26.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:26 smithi002 ceph-mon[31150]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:23:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 -- 172.21.15.2:0/1797124672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd16410d140 msgr2=0x7fd16410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1797124672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd16410d140 0x7fd16410f5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009900 tx=0x7fd15c02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 -- 172.21.15.2:0/1797124672 shutdown_connections 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1797124672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd16410d140 0x7fd16410f5a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1797124672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd164104600 0x7fd16410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1797124672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd164103ce0 0x7fd1641040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 -- 172.21.15.2:0/1797124672 >> 172.21.15.2:0/1797124672 conn(0x7fd1640fd700 msgr2=0x7fd1640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 -- 172.21.15.2:0/1797124672 shutdown_connections 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.905+0000 7fd168ebc640 1 -- 172.21.15.2:0/1797124672 wait complete. 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 Processor -- start 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 -- start start 2024-09-10T23:23:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 0x7fd164101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd164104600 0x7fd164101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd16410d140 0x7fd164102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd164112db0 con 0x7fd164103ce0 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd164112c30 con 0x7fd16410d140 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd168ebc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd164112f30 con 0x7fd164104600 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 0x7fd164101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 0x7fd164101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45410/0 (socket says 172.21.15.2:45410) 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 -- 172.21.15.2:0/1848374940 learned_addr learned my addr 172.21.15.2:0/1848374940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd161d9b640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd164104600 0x7fd164101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 -- 172.21.15.2:0/1848374940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd164104600 msgr2=0x7fd164101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd164104600 0x7fd164101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:26.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd162d9d640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd16410d140 0x7fd164102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 -- 172.21.15.2:0/1848374940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd16410d140 msgr2=0x7fd164102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd16410d140 0x7fd164102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.906+0000 7fd16259c640 1 -- 172.21.15.2:0/1848374940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1641a75e0 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.907+0000 7fd16259c640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 0x7fd164101990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd15400cce0 tx=0x7fd15400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.907+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400f650 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.907+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd15400fca0 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.907+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1641a78d0 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.907+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154018b40 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.907+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641a7e60 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.908+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1641040c0 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.910+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fd15400f7f0 con 0x7fd164103ce0 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.911+0000 7fd15b7fe640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd1500b53f0 0x7fd1500b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.911+0000 7fd161d9b640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd1500b53f0 0x7fd1500b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.912+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd1540e6500 con 0x7fd164103ce0 2024-09-10T23:23:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.912+0000 7fd161d9b640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd1500b53f0 0x7fd1500b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd164103480 tx=0x7fd14c00b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:26.914+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd154014030 con 0x7fd164103ce0 2024-09-10T23:23:26.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:26 smithi177 ceph-mon[35760]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:23:27.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:26 smithi154 ceph-mon[35136]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:23:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.137+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd164102c90 con 0x7fd164103ce0 2024-09-10T23:23:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.138+0000 7fd15b7fe640 1 -- 172.21.15.2:0/1848374940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd1540ad320 con 0x7fd164103ce0 2024-09-10T23:23:27.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:27.140 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:23:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd1500b53f0 msgr2=0x7fd1500b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd1500b53f0 0x7fd1500b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd164103480 tx=0x7fd14c00b5d0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 msgr2=0x7fd164101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 0x7fd164101990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd15400cce0 tx=0x7fd15400a620 comp rx=0 tx=0).stop 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 shutdown_connections 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd1500b53f0 0x7fd1500b78b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd16410d140 0x7fd164102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd164104600 0x7fd164101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 --2- 172.21.15.2:0/1848374940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd164103ce0 0x7fd164101990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 >> 172.21.15.2:0/1848374940 conn(0x7fd1640fd700 msgr2=0x7fd16410f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 shutdown_connections 2024-09-10T23:23:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:27.141+0000 7fd168ebc640 1 -- 172.21.15.2:0/1848374940 wait complete. 2024-09-10T23:23:27.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:27 smithi002 ceph-mon[31150]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:27.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:27 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1848374940' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:23:27.839 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:23:27.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:27 smithi177 ceph-mon[35760]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:27 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1848374940' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:23:28.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:27 smithi154 ceph-mon[35136]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:27 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1848374940' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:23:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 -- 172.21.15.2:0/1864401858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98102dc0 msgr2=0x7f9a981031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 --2- 172.21.15.2:0/1864401858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98102dc0 0x7f9a981031a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009900 tx=0x7f9a8802a410 comp rx=0 tx=0).stop 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 -- 172.21.15.2:0/1864401858 shutdown_connections 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 --2- 172.21.15.2:0/1864401858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a98109150 0x7f9a9810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 --2- 172.21.15.2:0/1864401858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a981087d0 0x7f9a98108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 --2- 172.21.15.2:0/1864401858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98102dc0 0x7f9a981031a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 -- 172.21.15.2:0/1864401858 >> 172.21.15.2:0/1864401858 conn(0x7f9a980fe830 msgr2=0x7f9a98100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 -- 172.21.15.2:0/1864401858 shutdown_connections 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.624+0000 7f9a9c889640 1 -- 172.21.15.2:0/1864401858 wait complete. 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 Processor -- start 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 -- start start 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a98102dc0 0x7f9a98199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 0x7f9a98199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a98109150 0x7f9a9819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98112e50 con 0x7f9a981087d0 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98112cd0 con 0x7f9a98102dc0 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a9c889640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98112fd0 con 0x7f9a98109150 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a95d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 0x7f9a98199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a95d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 0x7f9a98199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45430/0 (socket says 172.21.15.2:45430) 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.625+0000 7f9a95d9b640 1 -- 172.21.15.2:0/2847287007 learned_addr learned my addr 172.21.15.2:0/2847287007 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a96d9d640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a98109150 0x7f9a9819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a9659c640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a98102dc0 0x7f9a98199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a95d9b640 1 -- 172.21.15.2:0/2847287007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a98109150 msgr2=0x7f9a9819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a95d9b640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a98109150 0x7f9a9819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a95d9b640 1 -- 172.21.15.2:0/2847287007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a98102dc0 msgr2=0x7f9a98199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a95d9b640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a98102dc0 0x7f9a98199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a95d9b640 1 -- 172.21.15.2:0/2847287007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9819f4f0 con 0x7f9a981087d0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a95d9b640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 0x7f9a98199980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00b4a0 tx=0x7f9a8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c014070 con 0x7f9a981087d0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a8c010ac0 con 0x7f9a981087d0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9819f7e0 con 0x7f9a981087d0 2024-09-10T23:23:28.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c017c30 con 0x7f9a981087d0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.626+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a981a5ea0 con 0x7f9a981087d0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.627+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a98103220 con 0x7f9a981087d0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.629+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9a8c010610 con 0x7f9a981087d0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.629+0000 7f9a877fe640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a800b5370 0x7f9a800b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.630+0000 7f9a9659c640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a800b5370 0x7f9a800b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.630+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9a8c0e56d0 con 0x7f9a981087d0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.630+0000 7f9a9659c640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a800b5370 0x7f9a800b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a88031440 tx=0x7f9a880095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:28.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.632+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a8c0ac440 con 0x7f9a981087d0 2024-09-10T23:23:28.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.858+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a9819a570 con 0x7f9a981087d0 2024-09-10T23:23:28.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.858+0000 7f9a877fe640 1 -- 172.21.15.2:0/2847287007 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11964 (secure 0 0 0) 0x7f9a9819a570 con 0x7f9a981087d0 2024-09-10T23:23:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:28.860 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-10T23:22:28:431609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:22:28.431589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24568,24563,24547,24541,24536]},"id":1}]} 2024-09-10T23:23:28.860 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:23:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a800b5370 msgr2=0x7f9a800b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a800b5370 0x7f9a800b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a88031440 tx=0x7f9a880095f0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 msgr2=0x7f9a98199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 0x7f9a98199980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00b4a0 tx=0x7f9a8c00b960 comp rx=0 tx=0).stop 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 shutdown_connections 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a800b5370 0x7f9a800b7830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a98109150 0x7f9a9819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a981087d0 0x7f9a98199980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 --2- 172.21.15.2:0/2847287007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a98102dc0 0x7f9a98199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 >> 172.21.15.2:0/2847287007 conn(0x7f9a980fe830 msgr2=0x7f9a98100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 shutdown_connections 2024-09-10T23:23:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:28.861+0000 7f9a9c889640 1 -- 172.21.15.2:0/2847287007 wait complete. 2024-09-10T23:23:29.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:29.951 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:29 smithi002 ceph-mon[31150]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:29.951 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:29 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2847287007' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:29.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:29 smithi177 ceph-mon[35760]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:29.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:29 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2847287007' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:30.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:29 smithi154 ceph-mon[35136]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:30.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:29 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2847287007' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:30.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 -- 172.21.15.2:0/364540642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd344103ce0 msgr2=0x7fd3441040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 --2- 172.21.15.2:0/364540642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd344103ce0 0x7fd3441040c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd334009900 tx=0x7fd33402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 -- 172.21.15.2:0/364540642 shutdown_connections 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 --2- 172.21.15.2:0/364540642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd34410d140 0x7fd34410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 --2- 172.21.15.2:0/364540642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344104600 0x7fd34410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 --2- 172.21.15.2:0/364540642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd344103ce0 0x7fd3441040c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 -- 172.21.15.2:0/364540642 >> 172.21.15.2:0/364540642 conn(0x7fd3440fd700 msgr2=0x7fd3440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 -- 172.21.15.2:0/364540642 shutdown_connections 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.333+0000 7fd34a188640 1 -- 172.21.15.2:0/364540642 wait complete. 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 Processor -- start 2024-09-10T23:23:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 -- start start 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd344103ce0 0x7fd3441993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344104600 0x7fd344199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 0x7fd34419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd344112db0 con 0x7fd34410d140 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd344112c30 con 0x7fd344104600 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd34a188640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd344112f30 con 0x7fd344103ce0 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd343fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 0x7fd34419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd343fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 0x7fd34419ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45436/0 (socket says 172.21.15.2:45436) 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd343fff640 1 -- 172.21.15.2:0/3116313088 learned_addr learned my addr 172.21.15.2:0/3116313088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd3437fe640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd344103ce0 0x7fd3441993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.334+0000 7fd342ffd640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344104600 0x7fd344199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd343fff640 1 -- 172.21.15.2:0/3116313088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd344103ce0 msgr2=0x7fd3441993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd343fff640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd344103ce0 0x7fd3441993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd343fff640 1 -- 172.21.15.2:0/3116313088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344104600 msgr2=0x7fd344199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd343fff640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344104600 0x7fd344199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd343fff640 1 -- 172.21.15.2:0/3116313088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34419f490 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd343fff640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 0x7fd34419ecc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00cad0 tx=0x7fd33c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00ae20 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33c005020 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00f6b0 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34419f780 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.335+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3441a5e40 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.336+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3441040c0 con 0x7fd34410d140 2024-09-10T23:23:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.338+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fd33c0054f0 con 0x7fd34410d140 2024-09-10T23:23:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.338+0000 7fd340ff9640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd32c0b53f0 0x7fd32c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.339+0000 7fd3437fe640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd32c0b53f0 0x7fd32c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.339+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd33c0e5fe0 con 0x7fd34410d140 2024-09-10T23:23:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.339+0000 7fd3437fe640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd32c0b53f0 0x7fd32c0b78b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd334031440 tx=0x7fd334005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.341+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd33c014030 con 0x7fd34410d140 2024-09-10T23:23:30.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.566+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3441081b0 con 0x7fd34410d140 2024-09-10T23:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.567+0000 7fd340ff9640 1 -- 172.21.15.2:0/3116313088 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11964 (secure 0 0 0) 0x7fd33c0ace70 con 0x7fd34410d140 2024-09-10T23:23:30.568 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:30.568 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-10T23:22:28:431609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:22:28.431589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24568,24563,24547,24541,24536]},"id":1}]} 2024-09-10T23:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd32c0b53f0 msgr2=0x7fd32c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd32c0b53f0 0x7fd32c0b78b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd334031440 tx=0x7fd334005e80 comp rx=0 tx=0).stop 2024-09-10T23:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 msgr2=0x7fd34419ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 0x7fd34419ecc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00cad0 tx=0x7fd33c00cf90 comp rx=0 tx=0).stop 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 shutdown_connections 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd32c0b53f0 0x7fd32c0b78b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd34410d140 0x7fd34419ecc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344104600 0x7fd344199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 --2- 172.21.15.2:0/3116313088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd344103ce0 0x7fd3441993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.570+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 >> 172.21.15.2:0/3116313088 conn(0x7fd3440fd700 msgr2=0x7fd3440fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.571+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 shutdown_connections 2024-09-10T23:23:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:30.571+0000 7fd34a188640 1 -- 172.21.15.2:0/3116313088 wait complete. 2024-09-10T23:23:30.890 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:30 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3116313088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:30.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:30 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3116313088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:31.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:30 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3116313088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:31.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:23:31.497 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:31.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:31 smithi002 ceph-mon[31150]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:31.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:31 smithi177 ceph-mon[35760]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 -- 172.21.15.2:0/2674775182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898102dc0 msgr2=0x7f98981031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 --2- 172.21.15.2:0/2674775182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898102dc0 0x7f98981031a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9894009900 tx=0x7f989402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 -- 172.21.15.2:0/2674775182 shutdown_connections 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 --2- 172.21.15.2:0/2674775182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9898109150 0x7f989810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 --2- 172.21.15.2:0/2674775182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98981087d0 0x7f9898108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 --2- 172.21.15.2:0/2674775182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898102dc0 0x7f98981031a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 -- 172.21.15.2:0/2674775182 >> 172.21.15.2:0/2674775182 conn(0x7f98980fe830 msgr2=0x7f9898100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 -- 172.21.15.2:0/2674775182 shutdown_connections 2024-09-10T23:23:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.984+0000 7f989fb32640 1 -- 172.21.15.2:0/2674775182 wait complete. 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 Processor -- start 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 -- start start 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9898102dc0 0x7f98981993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98981087d0 0x7f9898199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 0x7f989819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9898112ea0 con 0x7f9898109150 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9898112d20 con 0x7f9898102dc0 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989fb32640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9898113020 con 0x7f98981087d0 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989e0cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 0x7f989819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989e0cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 0x7f989819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32978/0 (socket says 172.21.15.2:32978) 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989e0cf640 1 -- 172.21.15.2:0/4043132106 learned_addr learned my addr 172.21.15.2:0/4043132106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989d8ce640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9898102dc0 0x7f98981993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:32.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989d0cd640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98981087d0 0x7f9898199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989e0cf640 1 -- 172.21.15.2:0/4043132106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98981087d0 msgr2=0x7f9898199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.985+0000 7f989e0cf640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98981087d0 0x7f9898199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989e0cf640 1 -- 172.21.15.2:0/4043132106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9898102dc0 msgr2=0x7f98981993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989e0cf640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9898102dc0 0x7f98981993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989e0cf640 1 -- 172.21.15.2:0/4043132106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989819f4a0 con 0x7f9898109150 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989d0cd640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98981087d0 0x7f9898199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989d8ce640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9898102dc0 0x7f98981993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989e0cf640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 0x7f989819ecd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f989000b970 tx=0x7f989000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890019070 con 0x7f9898109150 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9890014440 con 0x7f9898109150 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900075d0 con 0x7f9898109150 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989819f790 con 0x7f9898109150 2024-09-10T23:23:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.986+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98981a5ed0 con 0x7f9898109150 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.987+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9898103220 con 0x7f9898109150 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.988+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f989000cb40 con 0x7f9898109150 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.989+0000 7f988effd640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98840b5370 0x7f98840b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.989+0000 7f989d8ce640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98840b5370 0x7f98840b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.989+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f98900e5a10 con 0x7f9898109150 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.990+0000 7f989d8ce640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98840b5370 0x7f98840b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9894000c00 tx=0x7f9894031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:31.992+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98900ac780 con 0x7f9898109150 2024-09-10T23:23:32.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:31 smithi154 ceph-mon[35136]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:32.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.179+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f989819a520 con 0x7f9898109150 2024-09-10T23:23:32.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.181+0000 7f988effd640 1 -- 172.21.15.2:0/4043132106 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7f989819a520 con 0x7f9898109150 2024-09-10T23:23:32.182 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:32.182 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98840b5370 msgr2=0x7f98840b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98840b5370 0x7f98840b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9894000c00 tx=0x7f9894031400 comp rx=0 tx=0).stop 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 msgr2=0x7f989819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 0x7f989819ecd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f989000b970 tx=0x7f989000be30 comp rx=0 tx=0).stop 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 shutdown_connections 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98840b5370 0x7f98840b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9898109150 0x7f989819ecd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98981087d0 0x7f9898199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 --2- 172.21.15.2:0/4043132106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9898102dc0 0x7f98981993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 >> 172.21.15.2:0/4043132106 conn(0x7f98980fe830 msgr2=0x7f9898100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 shutdown_connections 2024-09-10T23:23:32.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:32.184+0000 7f989fb32640 1 -- 172.21.15.2:0/4043132106 wait complete. 2024-09-10T23:23:32.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:32 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4043132106' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:23:32.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:32.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:32 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4043132106' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:23:33.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:32 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4043132106' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:23:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 -- 172.21.15.2:0/2540085632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180109150 msgr2=0x7f518010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 --2- 172.21.15.2:0/2540085632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180109150 0x7f518010f950 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5178009ca0 tx=0x7f517802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 -- 172.21.15.2:0/2540085632 shutdown_connections 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 --2- 172.21.15.2:0/2540085632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180109150 0x7f518010f950 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 --2- 172.21.15.2:0/2540085632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51801087d0 0x7f5180108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 --2- 172.21.15.2:0/2540085632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5180102dc0 0x7f51801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 -- 172.21.15.2:0/2540085632 >> 172.21.15.2:0/2540085632 conn(0x7f51800fe830 msgr2=0x7f5180100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 -- 172.21.15.2:0/2540085632 shutdown_connections 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.676+0000 7f518641c640 1 -- 172.21.15.2:0/2540085632 wait complete. 2024-09-10T23:23:33.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.677+0000 7f518641c640 1 Processor -- start 2024-09-10T23:23:33.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.677+0000 7f518641c640 1 -- start start 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.677+0000 7f518641c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 0x7f51800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.677+0000 7f517ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 0x7f51800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 0x7f51800754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32994/0 (socket says 172.21.15.2:32994) 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 -- 172.21.15.2:0/3626769171 learned_addr learned my addr 172.21.15.2:0/3626769171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51801087d0 0x7f51800759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5180109150 0x7f5180075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:33.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5180112e10 con 0x7f5180102dc0 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5180112c90 con 0x7f5180109150 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5180112f90 con 0x7f51801087d0 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f5177fff640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51801087d0 0x7f51800759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f51849b9640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5180109150 0x7f5180075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 -- 172.21.15.2:0/3626769171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51801087d0 msgr2=0x7f51800759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51801087d0 0x7f51800759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 -- 172.21.15.2:0/3626769171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5180109150 msgr2=0x7f5180075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5180109150 0x7f5180075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51801a7540 con 0x7f5180102dc0 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f51849b9640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5180109150 0x7f5180075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.678+0000 7f517ffff640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 0x7f51800754a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f517000c920 tx=0x7f517000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:33.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.679+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170007bb0 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.679+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5170007d50 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.679+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51801a7830 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.679+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170018730 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.679+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51801a7dc0 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.680+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51801031a0 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.681+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f517000f450 con 0x7f5180102dc0 2024-09-10T23:23:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.682+0000 7f517dffb640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f516c0b53f0 0x7f516c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:33.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.682+0000 7f5177fff640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f516c0b53f0 0x7f516c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:33.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.682+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f51700e6150 con 0x7f5180102dc0 2024-09-10T23:23:33.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.682+0000 7f5177fff640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f516c0b53f0 0x7f516c0b78b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5180076f90 tx=0x7f516800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:33.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.685+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5170014030 con 0x7f5180102dc0 2024-09-10T23:23:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.909+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51800767a0 con 0x7f5180102dc0 2024-09-10T23:23:33.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:33 smithi002 ceph-mon[31150]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:33.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.909+0000 7f517dffb640 1 -- 172.21.15.2:0/3626769171 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11964 (secure 0 0 0) 0x7f51700acf70 con 0x7f5180102dc0 2024-09-10T23:23:33.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:33.911 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-10T23:22:28:431609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:22:28.431589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24568,24563,24547,24541,24536]},"id":1}]} 2024-09-10T23:23:33.911 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f516c0b53f0 msgr2=0x7f516c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f516c0b53f0 0x7f516c0b78b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5180076f90 tx=0x7f516800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 msgr2=0x7f51800754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 0x7f51800754a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f517000c920 tx=0x7f517000cd20 comp rx=0 tx=0).stop 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 shutdown_connections 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f516c0b53f0 0x7f516c0b78b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5180109150 0x7f5180075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51801087d0 0x7f51800759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 --2- 172.21.15.2:0/3626769171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5180102dc0 0x7f51800754a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 >> 172.21.15.2:0/3626769171 conn(0x7f51800fe830 msgr2=0x7f5180101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 shutdown_connections 2024-09-10T23:23:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:33.912+0000 7f518641c640 1 -- 172.21.15.2:0/3626769171 wait complete. 2024-09-10T23:23:33.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:33 smithi177 ceph-mon[35760]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:34.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:33 smithi154 ceph-mon[35136]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:34.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:22:17.001408+0000', 'modified': '2024-09-10T23:22:28.431589+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24568, 'mds_1': 24563, 'mds_2': 24547, 'mds_3': 24541, 'mds_4': 24536}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14712': {'gid': 14712, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.2:6839/1174009300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6838', 'nonce': 1174009300}, {'type': 'v1', 'addr': '172.21.15.2:6839', 'nonce': 1174009300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14718': {'gid': 14718, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.2:6841/2991165185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6840', 'nonce': 2991165185}, {'type': 'v1', 'addr': '172.21.15.2:6841', 'nonce': 2991165185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/940548947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 940548947}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 940548947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/157862185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 157862185}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 157862185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6833/4014999302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6832', 'nonce': 4014999302}, {'type': 'v1', 'addr': '172.21.15.177:6833', 'nonce': 4014999302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24536': {'gid': 24536, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6837/4148932474', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 4148932474}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 4148932474}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24541': {'gid': 24541, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.177:6835/2192031560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 2192031560}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 2192031560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24547': {'gid': 24547, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.177:6837/4092191728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 4092191728}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 4092191728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.154:6839/3482947796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3482947796}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3482947796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.177:6839/2078594456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 2078594456}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 2078594456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24568, 'qdb_cluster': [24568, 24563, 24547, 24541, 24536]} 2024-09-10T23:23:34.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T23:23:34.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:23:34.825 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:34.947 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:34 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3626769171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:34.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:34 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3626769171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:35.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:34 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3626769171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:35.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.276+0000 7f5424255640 1 -- 172.21.15.2:0/3946504581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075540 msgr2=0x7f541c075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.276+0000 7f5424255640 1 --2- 172.21.15.2:0/3946504581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075540 0x7f541c075920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5418009900 tx=0x7f541802a410 comp rx=0 tx=0).stop 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 -- 172.21.15.2:0/3946504581 shutdown_connections 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 --2- 172.21.15.2:0/3946504581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c113b20 0x7f541c115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 --2- 172.21.15.2:0/3946504581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541c075e60 0x7f541c1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 --2- 172.21.15.2:0/3946504581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075540 0x7f541c075920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 -- 172.21.15.2:0/3946504581 >> 172.21.15.2:0/3946504581 conn(0x7f541c0fe830 msgr2=0x7f541c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 -- 172.21.15.2:0/3946504581 shutdown_connections 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 -- 172.21.15.2:0/3946504581 wait complete. 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 Processor -- start 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.277+0000 7f5424255640 1 -- start start 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c075540 0x7f541c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 0x7f541c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541c113b20 0x7f541c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f541c1193c0 con 0x7f541c075e60 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f541c119240 con 0x7f541c075540 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f541c119540 con 0x7f541c113b20 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 0x7f541c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 0x7f541c19fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33010/0 (socket says 172.21.15.2:33010) 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 -- 172.21.15.2:0/437793834 learned_addr learned my addr 172.21.15.2:0/437793834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54227f2640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541c113b20 0x7f541c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5421ff1640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c075540 0x7f541c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 -- 172.21.15.2:0/437793834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541c113b20 msgr2=0x7f541c1a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541c113b20 0x7f541c1a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 -- 172.21.15.2:0/437793834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c075540 msgr2=0x7f541c19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c075540 0x7f541c19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 -- 172.21.15.2:0/437793834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c1a59e0 con 0x7f541c075e60 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5421ff1640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c075540 0x7f541c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f54217f0640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 0x7f541c19fe70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f540c00d770 tx=0x7f540c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5412ffd640 1 -- 172.21.15.2:0/437793834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c017070 con 0x7f541c075e60 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541c1a5cd0 con 0x7f541c075e60 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5412ffd640 1 -- 172.21.15.2:0/437793834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f540c0054d0 con 0x7f541c075e60 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.278+0000 7f5412ffd640 1 -- 172.21.15.2:0/437793834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c004c30 con 0x7f541c075e60 2024-09-10T23:23:35.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.279+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541c1ac390 con 0x7f541c075e60 2024-09-10T23:23:35.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.281+0000 7f5412ffd640 1 -- 172.21.15.2:0/437793834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f540c004e10 con 0x7f541c075e60 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.281+0000 7f542662a740 1 Processor -- start 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.281+0000 7f542662a740 1 -- start start 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f542662a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2e6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f542662a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f542662a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2f25e0 0x559a6b2f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f542662a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a6b25dc10 con 0x559a6b2e5d30 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f542662a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a6b24d040 con 0x559a6b2f25e0 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f542662a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a6b250e50 con 0x559a6b2e6650 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33020/0 (socket says 172.21.15.2:33020) 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 -- 172.21.15.2:0/4006378292 learned_addr learned my addr 172.21.15.2:0/4006378292 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f5421ff1640 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f5412ffd640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54080b5370 0x7f54080b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54217f0640 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2f25e0 0x559a6b2f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 -- 172.21.15.2:0/4006378292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 msgr2=0x559a6b2f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 -- 172.21.15.2:0/4006378292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2f25e0 msgr2=0x559a6b2f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2f25e0 0x559a6b2f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 -- 172.21.15.2:0/4006378292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6afab540 con 0x559a6b2e5d30 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54080b5370 0x7f54080b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f5412ffd640 1 -- 172.21.15.2:0/437793834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f540c0e5850 con 0x7f541c075e60 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.282+0000 7f54227f2640 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2e6110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f541400f3f0 tx=0x7f541400f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfeac9c89f5bef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f5407fff640 1 -- 172.21.15.2:0/4006378292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414024430 con 0x559a6b2e5d30 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f5407fff640 1 -- 172.21.15.2:0/4006378292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5414019820 con 0x559a6b2e5d30 2024-09-10T23:23:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f5407fff640 1 -- 172.21.15.2:0/4006378292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400c5a0 con 0x559a6b2e5d30 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f54227f2640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54080b5370 0x7f54080b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5414020000 tx=0x7f541401c030 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 -- 172.21.15.2:0/4006378292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 msgr2=0x559a6b2e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2e6110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f541400f3f0 tx=0x7f541400f8b0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 -- 172.21.15.2:0/4006378292 shutdown_connections 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2f25e0 0x559a6b2f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 --2- 172.21.15.2:0/4006378292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2e6110 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.283+0000 7f542662a740 1 -- 172.21.15.2:0/4006378292 >> 172.21.15.2:0/4006378292 conn(0x559a6b2e3b60 msgr2=0x559a6b2e4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.284+0000 7f542662a740 1 -- 172.21.15.2:0/4006378292 shutdown_connections 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.284+0000 7f542662a740 1 -- 172.21.15.2:0/4006378292 wait complete. 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.284+0000 7f542662a740 1 -- start start 2024-09-10T23:23:35.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.284+0000 7f542662a740 1 Processor -- start 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2ef500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b2efa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2f25e0 0x559a6b2eff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a6b0ae5f0 con 0x559a6b2e5d30 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a6b1e8010 con 0x559a6b2e6650 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a6b2f5290 con 0x559a6b2f25e0 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2ef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33022/0 (socket says 172.21.15.2:33022) 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 -- 172.21.15.2:0/2713814122 learned_addr learned my addr 172.21.15.2:0/2713814122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 10 client.0 _ll_register_callbacks cb 0x559a6b247340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f54217f0640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b2efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f54227f2640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2f25e0 0x559a6b2eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 -- 172.21.15.2:0/2713814122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2f25e0 msgr2=0x559a6b2eff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2f25e0 0x559a6b2eff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 -- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 msgr2=0x559a6b2efa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b2efa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 -- 172.21.15.2:0/2713814122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a6b215a00 con 0x559a6b2e5d30 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f5421ff1640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2ef500 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f541802a930 tx=0x7f54180318a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12acd8be58e07760 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f54057fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f54057fa640 1 -- 172.21.15.2:0/2713814122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418035040 con 0x559a6b2e5d30 2024-09-10T23:23:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f54057fa640 1 -- 172.21.15.2:0/2713814122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5418031d10 con 0x559a6b2e5d30 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.285+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5414019820 con 0x559a6b2e5d30 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f54057fa640 1 -- 172.21.15.2:0/2713814122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5418004100 con 0x559a6b2e5d30 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 10 client.15081 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a6b300d80 con 0x559a6b2e5d30 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f54057fa640 1 -- 172.21.15.2:0/2713814122 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5414019820 con 0x559a6b2e5d30 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f54057fa640 1 -- 172.21.15.2:0/2713814122 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5418004730 con 0x559a6b2e5d30 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 10 client.15081 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 10 client.15081 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 20 client.15081 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b3033b0 0x559a6b304820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 4 client.15081 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a6b25fb60 con 0x559a6b3033b0 2024-09-10T23:23:35.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.286+0000 7f54217f0640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b3033b0 0x559a6b304820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.287+0000 7f54217f0640 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b3033b0 0x559a6b304820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b78c290dc7920ce server_cookie=5f32d8190948ec1f in_seq=0 out_seq=0 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.287+0000 7f54057fa640 10 client.15081 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f54057fa640 1 -- 172.21.15.2:0/2713814122 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a6b25fb60 con 0x559a6b3033b0 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f54057fa640 10 client.15081 handle_command_reply: tid=0 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 client.15081 shutdown 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 msgr2=0x559a6b2ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2ef500 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f541802a930 tx=0x7f54180318a0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 shutdown_connections 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b3033b0 0x559a6b304820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2f25e0 0x559a6b2eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b2efa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f54057fa640 0 client.15081 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:23:35.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 --2- 172.21.15.2:0/2713814122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2e5d30 0x559a6b2ef500 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 >> 172.21.15.2:0/2713814122 conn(0x559a6b2e3b60 msgr2=0x559a6b2e96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 shutdown_connections 2024-09-10T23:23:35.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 1 -- 172.21.15.2:0/2713814122 wait complete. 2024-09-10T23:23:35.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.288+0000 7f542662a740 20 client.15081 trim_cache size 0 max 16384 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.306+0000 7f542662a740 1 Processor -- start 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.306+0000 7f542662a740 1 -- start start 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.306+0000 7f542662a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e5d30 0x559a6b2e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.306+0000 7f542662a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.306+0000 7f542662a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b2edd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f542662a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a6b302b60 con 0x559a6b2f25e0 2024-09-10T23:23:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f542662a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a6b303230 con 0x559a6b2e5d30 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f542662a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a6b303900 con 0x559a6b2e6650 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b2edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b2edd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33024/0 (socket says 172.21.15.2:33024) 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 -- 172.21.15.2:0/3692775669 learned_addr learned my addr 172.21.15.2:0/3692775669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f5421ff1640 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e5d30 0x559a6b2e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54217f0640 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 -- 172.21.15.2:0/3692775669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 msgr2=0x559a6b2f02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 -- 172.21.15.2:0/3692775669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e5d30 msgr2=0x559a6b2e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e5d30 0x559a6b2e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 -- 172.21.15.2:0/3692775669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6b2e45e0 con 0x559a6b2f25e0 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54217f0640 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54227f2640 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b2edd80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f541400fdb0 tx=0x7f5414012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e05ec48f5b4eef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54077fe640 1 -- 172.21.15.2:0/3692775669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400a7f0 con 0x559a6b2f25e0 2024-09-10T23:23:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54077fe640 1 -- 172.21.15.2:0/3692775669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54140121d0 con 0x559a6b2f25e0 2024-09-10T23:23:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.307+0000 7f54077fe640 1 -- 172.21.15.2:0/3692775669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414024a90 con 0x559a6b2f25e0 2024-09-10T23:23:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 -- 172.21.15.2:0/3692775669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 msgr2=0x559a6b2edd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b2edd80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f541400fdb0 tx=0x7f5414012000 comp rx=0 tx=0).stop 2024-09-10T23:23:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 -- 172.21.15.2:0/3692775669 shutdown_connections 2024-09-10T23:23:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b2edd80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e6650 0x559a6b2f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 --2- 172.21.15.2:0/3692775669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e5d30 0x559a6b2e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 -- 172.21.15.2:0/3692775669 >> 172.21.15.2:0/3692775669 conn(0x559a6b2e3b60 msgr2=0x559a6b2ea780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 -- 172.21.15.2:0/3692775669 shutdown_connections 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 -- 172.21.15.2:0/3692775669 wait complete. 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.308+0000 7f542662a740 1 -- start start 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 Processor -- start 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e5d30 0x559a6b307340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b3078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b30c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a6b3046a0 con 0x559a6b2f25e0 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a6b303fd0 con 0x559a6b2e6650 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a6b304d70 con 0x559a6b2e5d30 2024-09-10T23:23:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f542662a740 10 client.0 _ll_register_callbacks cb 0x7f5418031530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b30c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b30c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33028/0 (socket says 172.21.15.2:33028) 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 -- 172.21.15.2:0/3415035580 learned_addr learned my addr 172.21.15.2:0/3415035580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f5421ff1640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e5d30 0x559a6b307340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54217f0640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b3078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 -- 172.21.15.2:0/3415035580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e5d30 msgr2=0x559a6b307340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e5d30 0x559a6b307340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 -- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 msgr2=0x559a6b3078c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b3078c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54227f2640 1 -- 172.21.15.2:0/3415035580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a6b2e4a50 con 0x559a6b2f25e0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.309+0000 7f54217f0640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b3078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54227f2640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b30c960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54140128c0 tx=0x7f541400ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707ae1bf650f0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54057fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54057fa640 1 -- 172.21.15.2:0/3415035580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414004c10 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54140121d0 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54057fa640 1 -- 172.21.15.2:0/3415035580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f541402c040 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54057fa640 1 -- 172.21.15.2:0/3415035580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5414004db0 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 10 client.15087 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a6b370510 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54057fa640 1 -- 172.21.15.2:0/3415035580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54140121d0 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f54057fa640 1 -- 172.21.15.2:0/3415035580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5414023070 con 0x559a6b2f25e0 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 20 client.15087 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b374b40 0x559a6b373850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 4 client.15087 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:23:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.310+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "status"}) -- 0x559a6b25b610 con 0x559a6b374b40 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.311+0000 7f5421ff1640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b374b40 0x559a6b373850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.311+0000 7f5421ff1640 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b374b40 0x559a6b373850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=94c97cc79d1a8c54 server_cookie=6ee2e6a0299c443c in_seq=0 out_seq=0 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.311+0000 7f54057fa640 10 client.15087 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.311+0000 7f54057fa640 1 -- 172.21.15.2:0/3415035580 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559a6b25b610 con 0x559a6b374b40 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.311+0000 7f54057fa640 10 client.15087 handle_command_reply: tid=0 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.311+0000 7f542662a740 1 client.15087 shutdown 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 msgr2=0x559a6b30c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b30c960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54140128c0 tx=0x7f541400ab10 comp rx=0 tx=0).stop 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 shutdown_connections 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a6b374b40 0x559a6b373850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a6b2f25e0 0x559a6b30c960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a6b2e6650 0x559a6b3078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 --2- 172.21.15.2:0/3415035580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a6b2e5d30 0x559a6b307340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f54057fa640 0 client.15087 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 >> 172.21.15.2:0/3415035580 conn(0x559a6b2e3b60 msgr2=0x559a6b2edcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 shutdown_connections 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 1 -- 172.21.15.2:0/3415035580 wait complete. 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f542662a740 20 client.15087 trim_cache size 0 max 16384 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 4, 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24536, 2024-09-10T23:23:35.318 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 67.890852737000003, 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 99.691607003000001 2024-09-10T23:23:35.319 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54080b5370 msgr2=0x7f54080b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f5424255640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54080b5370 0x7f54080b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5414020000 tx=0x7f541401c030 comp rx=0 tx=0).stop 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 msgr2=0x7f541c19fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.312+0000 7f5424255640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 0x7f541c19fe70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f540c00d770 tx=0x7f540c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 shutdown_connections 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54080b5370 0x7f54080b7830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541c113b20 0x7f541c1a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f541c075e60 0x7f541c19fe70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 --2- 172.21.15.2:0/437793834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f541c075540 0x7f541c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 >> 172.21.15.2:0/437793834 conn(0x7f541c0fe830 msgr2=0x7f541c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 shutdown_connections 2024-09-10T23:23:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:35.313+0000 7f5424255640 1 -- 172.21.15.2:0/437793834 wait complete. 2024-09-10T23:23:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:35 smithi177 ceph-mon[35760]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:35.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:35 smithi002 ceph-mon[31150]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:35 smithi154 ceph-mon[35136]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:36.031 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T23:23:36.289 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 -- 172.21.15.2:0/2816310607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 msgr2=0x7f3ebc103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/2816310607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc103f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009900 tx=0x7f3eac02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 -- 172.21.15.2:0/2816310607 shutdown_connections 2024-09-10T23:23:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/2816310607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ebc10d120 0x7f3ebc10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/2816310607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc104570 0x7f3ebc10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/2816310607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc103f50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 -- 172.21.15.2:0/2816310607 >> 172.21.15.2:0/2816310607 conn(0x7f3ebc0fd700 msgr2=0x7f3ebc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 -- 172.21.15.2:0/2816310607 shutdown_connections 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.797+0000 7f3ec27c1640 1 -- 172.21.15.2:0/2816310607 wait complete. 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 Processor -- start 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 -- start start 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc104570 0x7f3ebc199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ebc10d120 0x7f3ebc19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc112da0 con 0x7f3ebc103b70 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc112c20 con 0x7f3ebc10d120 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ec27c1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc112f20 con 0x7f3ebc104570 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33032/0 (socket says 172.21.15.2:33032) 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 -- 172.21.15.2:0/626777592 learned_addr learned my addr 172.21.15.2:0/626777592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc104570 0x7f3ebc199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 -- 172.21.15.2:0/626777592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc104570 msgr2=0x7f3ebc199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc104570 0x7f3ebc199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 -- 172.21.15.2:0/626777592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ebc10d120 msgr2=0x7f3ebc19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ebc10d120 0x7f3ebc19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.798+0000 7f3ebbfff640 1 -- 172.21.15.2:0/626777592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc19f2a0 con 0x7f3ebc103b70 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.799+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc1991f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3eac006010 tx=0x7f3eac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.799+0000 7f3eb9ffb640 1 -- 172.21.15.2:0/626777592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac03f030 con 0x7f3ebc103b70 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.799+0000 7f3eb9ffb640 1 -- 172.21.15.2:0/626777592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eac003800 con 0x7f3ebc103b70 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.799+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ebc19f530 con 0x7f3ebc103b70 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.799+0000 7f3eb9ffb640 1 -- 172.21.15.2:0/626777592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac035070 con 0x7f3ebc103b70 2024-09-10T23:23:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.799+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ebc1a5c50 con 0x7f3ebc103b70 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3eb9ffb640 1 -- 172.21.15.2:0/626777592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f3eac031b10 con 0x7f3ebc103b70 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 Processor -- start 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 -- start start 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683ef4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683f029d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564683e6bc10 con 0x564683ef3d30 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564683e5b040 con 0x564683ef4650 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564683e5ee50 con 0x564683f005e0 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683ef4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683ef4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33048/0 (socket says 172.21.15.2:33048) 2024-09-10T23:23:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2872420846 learned_addr learned my addr 172.21.15.2:0/2872420846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2872420846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 msgr2=0x564683f029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683f029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683f029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2872420846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 msgr2=0x564683f000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2872420846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564683bb9540 con 0x564683ef3d30 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.802+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683ef4110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4007d20 tx=0x7f3eb400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d859973ce24d5d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3eb27fc640 1 -- 172.21.15.2:0/2872420846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4014070 con 0x564683ef3d30 2024-09-10T23:23:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3eb27fc640 1 -- 172.21.15.2:0/2872420846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb400fb00 con 0x564683ef3d30 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3eb27fc640 1 -- 172.21.15.2:0/2872420846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400eb90 con 0x564683ef3d30 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3eb9ffb640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ea80b53f0 0x7f3ea80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3eb9ffb640 1 -- 172.21.15.2:0/626777592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3eac1066c0 con 0x7f3ebc103b70 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.803+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ea80b53f0 0x7f3ea80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2872420846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 msgr2=0x564683ef4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683ef4110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4007d20 tx=0x7f3eb400c6a0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2872420846 shutdown_connections 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683f029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2872420846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683ef4110 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ebbfff640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ea80b53f0 0x7f3ea80b78b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x564683ef6eb0 tx=0x7f3eac0044e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2872420846 >> 172.21.15.2:0/2872420846 conn(0x564683ef1b60 msgr2=0x564683ef2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2872420846 shutdown_connections 2024-09-10T23:23:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2872420846 wait complete. 2024-09-10T23:23:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 -- start start 2024-09-10T23:23:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.804+0000 7f3ec4b96740 1 Processor -- start 2024-09-10T23:23:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683efd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683efdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683efe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564683cbc5f0 con 0x564683ef3d30 2024-09-10T23:23:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564683df6010 con 0x564683ef4650 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564683f03290 con 0x564683f005e0 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec4b96740 10 client.0 _ll_register_callbacks cb 0x564683e55340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683efd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683efd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33054/0 (socket says 172.21.15.2:33054) 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2669505591 learned_addr learned my addr 172.21.15.2:0/2669505591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683efe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683efdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 msgr2=0x564683efe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683efe050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2669505591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 msgr2=0x564683efdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683efdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2669505591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564683e23a00 con 0x564683ef3d30 2024-09-10T23:23:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683efdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683efd5d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4007310 tx=0x7f3eb400e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b78ea2010d6ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.805+0000 7f3e9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2669505591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4014070 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2669505591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3eb400f650 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eb400fb00 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2669505591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3eb4022040 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 10 client.15099 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564683f0ee10 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2669505591 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb400fb00 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2669505591 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3eb4004310 con 0x564683ef3d30 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 10 client.15099 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 10 client.15099 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 20 client.15099 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f11120 0x564683f12590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 4 client.15099 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.806+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564683e6db60 con 0x564683f11120 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.807+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f11120 0x564683f12590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.807+0000 7f3e9b7fe640 10 client.15099 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:23:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.807+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f11120 0x564683f12590 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5b256897fd576807 server_cookie=6e05cb92c4da88f2 in_seq=0 out_seq=0 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2669505591 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564683e6db60 con 0x564683f11120 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3e9b7fe640 10 client.15099 handle_command_reply: tid=0 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 client.15099 shutdown 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 msgr2=0x564683efd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683efd5d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4007310 tx=0x7f3eb400e810 comp rx=0 tx=0).stop 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 shutdown_connections 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f11120 0x564683f12590 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683efe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683efdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3e9b7fe640 0 client.15099 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2669505591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683efd5d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.808+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 >> 172.21.15.2:0/2669505591 conn(0x564683ef1b60 msgr2=0x564683ef7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.809+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 shutdown_connections 2024-09-10T23:23:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.809+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2669505591 wait complete. 2024-09-10T23:23:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.809+0000 7f3ec4b96740 20 client.15099 trim_cache size 0 max 16384 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 Processor -- start 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 -- start start 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683ef4650 0x564683eecc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683f005e0 0x564683efbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564683f108d0 con 0x564683ef3d30 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564683f10fa0 con 0x564683f005e0 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564683f11670 con 0x564683ef4650 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f117f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33066/0 (socket says 172.21.15.2:33066) 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.827+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/357719902 learned_addr learned my addr 172.21.15.2:0/357719902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/357719902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683ef4650 msgr2=0x564683eecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683ef4650 0x564683eecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/357719902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683f005e0 msgr2=0x564683efbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683f005e0 0x564683efbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/357719902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564683ef25e0 con 0x564683ef3d30 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f117f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4010fd0 tx=0x7f3eb40079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8adfa87a9a3cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3eb1ffb640 1 -- 172.21.15.2:0/357719902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4014040 con 0x564683ef3d30 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3eb1ffb640 1 -- 172.21.15.2:0/357719902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb400cba0 con 0x564683ef3d30 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.828+0000 7f3eb1ffb640 1 -- 172.21.15.2:0/357719902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400ebe0 con 0x564683ef3d30 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 -- 172.21.15.2:0/357719902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 msgr2=0x564683f117f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f117f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4010fd0 tx=0x7f3eb40079e0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 -- 172.21.15.2:0/357719902 shutdown_connections 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683f005e0 0x564683efbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683ef4650 0x564683eecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/357719902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f117f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 -- 172.21.15.2:0/357719902 >> 172.21.15.2:0/357719902 conn(0x564683ef1b60 msgr2=0x564683ef8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 -- 172.21.15.2:0/357719902 shutdown_connections 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 -- 172.21.15.2:0/357719902 wait complete. 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 -- start start 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.829+0000 7f3ec4b96740 1 Processor -- start 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f1aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683ef04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564683f12410 con 0x564683ef3d30 2024-09-10T23:23:36.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564683f11d40 con 0x564683ef4650 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564683f12ae0 con 0x564683f005e0 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 10 client.0 _ll_register_callbacks cb 0x7f3eb4007b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f1aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f1aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33076/0 (socket says 172.21.15.2:33076) 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2636704481 learned_addr learned my addr 172.21.15.2:0/2636704481 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683ef04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 msgr2=0x564683ef04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683ef04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2636704481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 msgr2=0x564683f1b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f1b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 -- 172.21.15.2:0/2636704481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564683ef0ce0 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f1b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec0d5e640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f1aad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4007bf0 tx=0x7f3eb40078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fd2bb7b490e311 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3e9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2636704481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4041060 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2636704481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3eb40041e0 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.830+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eb400cba0 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2636704481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3eb4014040 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 10 client.15105 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564683f7e500 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2636704481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb400cba0 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2636704481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3eb40197e0 con 0x564683ef3d30 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 10 client.15105 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T23:23:36.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 20 client.15105 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f82ec0 0x564683f81bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 4 client.15105 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "status"}) -- 0x564683e69610 con 0x564683f82ec0 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.831+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f82ec0 0x564683f81bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3e9b7fe640 10 client.15105 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3eb3fff640 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f82ec0 0x564683f81bd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aff1fb892fac9244 server_cookie=e256e6d1e53fa75c in_seq=0 out_seq=0 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3e9b7fe640 1 -- 172.21.15.2:0/2636704481 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564683e69610 con 0x564683f82ec0 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3e9b7fe640 10 client.15105 handle_command_reply: tid=0 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 client.15105 shutdown 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 msgr2=0x564683f1aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f1aad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4007bf0 tx=0x7f3eb40078b0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 shutdown_connections 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564683f82ec0 0x564683f81bd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564683f005e0 0x564683ef04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564683ef4650 0x564683f1b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 --2- 172.21.15.2:0/2636704481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564683ef3d30 0x564683f1aad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 >> 172.21.15.2:0/2636704481 conn(0x564683ef1b60 msgr2=0x564683efbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3e9b7fe640 0 client.15105 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 shutdown_connections 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 1 -- 172.21.15.2:0/2636704481 wait complete. 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.832+0000 7f3ec4b96740 20 client.15105 trim_cache size 0 max 16384 2024-09-10T23:23:36.840 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 3, 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24541, 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 70.419319169000005, 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 106.734935755 2024-09-10T23:23:36.841 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ea80b53f0 msgr2=0x7f3ea80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ea80b53f0 0x7f3ea80b78b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x564683ef6eb0 tx=0x7f3eac0044e0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 msgr2=0x7f3ebc1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc1991f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3eac006010 tx=0x7f3eac0042f0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 shutdown_connections 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ea80b53f0 0x7f3ea80b78b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ebc10d120 0x7f3ebc19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc104570 0x7f3ebc199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 --2- 172.21.15.2:0/626777592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc103b70 0x7f3ebc1991f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 >> 172.21.15.2:0/626777592 conn(0x7f3ebc0fd700 msgr2=0x7f3ebc0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 shutdown_connections 2024-09-10T23:23:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:36.833+0000 7f3ec27c1640 1 -- 172.21.15.2:0/626777592 wait complete. 2024-09-10T23:23:37.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T23:23:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:37.917 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:37 smithi002 ceph-mon[31150]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:37.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:37 smithi177 ceph-mon[35760]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:37 smithi154 ceph-mon[35136]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 -- 172.21.15.2:0/3287193166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294102dc0 msgr2=0x7f82941031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 --2- 172.21.15.2:0/3287193166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294102dc0 0x7f82941031a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8284009900 tx=0x7f828402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 -- 172.21.15.2:0/3287193166 shutdown_connections 2024-09-10T23:23:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 --2- 172.21.15.2:0/3287193166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294109150 0x7f829410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 --2- 172.21.15.2:0/3287193166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941087d0 0x7f8294108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 --2- 172.21.15.2:0/3287193166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294102dc0 0x7f82941031a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 -- 172.21.15.2:0/3287193166 >> 172.21.15.2:0/3287193166 conn(0x7f82940fe830 msgr2=0x7f8294100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 -- 172.21.15.2:0/3287193166 shutdown_connections 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.312+0000 7f8298d94640 1 -- 172.21.15.2:0/3287193166 wait complete. 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 Processor -- start 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 -- start start 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294102dc0 0x7f8294199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941087d0 0x7f8294199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 0x7f829419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8294112e10 con 0x7f8294109150 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8294112c90 con 0x7f82941087d0 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.313+0000 7f8298d94640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8294112f90 con 0x7f8294102dc0 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 0x7f829419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 0x7f829419ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33090/0 (socket says 172.21.15.2:33090) 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 -- 172.21.15.2:0/1348285351 learned_addr learned my addr 172.21.15.2:0/1348285351 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f829259c640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294102dc0 0x7f8294199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8291d9b640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941087d0 0x7f8294199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 -- 172.21.15.2:0/1348285351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294102dc0 msgr2=0x7f8294199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294102dc0 0x7f8294199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 -- 172.21.15.2:0/1348285351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941087d0 msgr2=0x7f8294199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941087d0 0x7f8294199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 -- 172.21.15.2:0/1348285351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829419f3f0 con 0x7f8294109150 2024-09-10T23:23:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8292d9d640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 0x7f829419ec20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f828c00cad0 tx=0x7f828c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f82837fe640 1 -- 172.21.15.2:0/1348285351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c00ae20 con 0x7f8294109150 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f82837fe640 1 -- 172.21.15.2:0/1348285351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f828c005020 con 0x7f8294109150 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829419f6e0 con 0x7f8294109150 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f82837fe640 1 -- 172.21.15.2:0/1348285351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c00f6b0 con 0x7f8294109150 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.314+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941a5da0 con 0x7f8294109150 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f82837fe640 1 -- 172.21.15.2:0/1348285351 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f828c0054f0 con 0x7f8294109150 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 Processor -- start 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 -- start start 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f44d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f4590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f45b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56258f3c4c10 con 0x56258f4595e0 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56258f3b4040 con 0x56258f44cd30 2024-09-10T23:23:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.317+0000 7f829b169740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56258f3b7e50 con 0x56258f44d650 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f45b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f45b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33098/0 (socket says 172.21.15.2:33098) 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 -- 172.21.15.2:0/1431413795 learned_addr learned my addr 172.21.15.2:0/1431413795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f44d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f829259c640 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f4590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f82837fe640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b5370 0x7f827c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 -- 172.21.15.2:0/1431413795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 msgr2=0x56258f4590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f4590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 -- 172.21.15.2:0/1431413795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 msgr2=0x56258f44d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f44d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 -- 172.21.15.2:0/1431413795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258f112540 con 0x56258f4595e0 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8292d9d640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b5370 0x7f827c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8291d9b640 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f45b9d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f82880125f0 tx=0x7f828800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661be2904900de9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f82837fe640 1 -- 172.21.15.2:0/1348285351 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f828c0e5c60 con 0x7f8294109150 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8280ff9640 1 -- 172.21.15.2:0/1431413795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82880106b0 con 0x56258f4595e0 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8280ff9640 1 -- 172.21.15.2:0/1431413795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8288010d00 con 0x56258f4595e0 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.318+0000 7f8280ff9640 1 -- 172.21.15.2:0/1431413795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828801dc40 con 0x56258f4595e0 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 -- 172.21.15.2:0/1431413795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 msgr2=0x56258f45b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f45b9d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f82880125f0 tx=0x7f828800b870 comp rx=0 tx=0).stop 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f8292d9d640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b5370 0x7f827c0b7830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f828c0a88f0 tx=0x7f828c0cf040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 -- 172.21.15.2:0/1431413795 shutdown_connections 2024-09-10T23:23:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f45b9d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f4590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 --2- 172.21.15.2:0/1431413795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f44d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 -- 172.21.15.2:0/1431413795 >> 172.21.15.2:0/1431413795 conn(0x56258f44ab60 msgr2=0x56258f44bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 -- 172.21.15.2:0/1431413795 shutdown_connections 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.319+0000 7f829b169740 1 -- 172.21.15.2:0/1431413795 wait complete. 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 -- start start 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 Processor -- start 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f456620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f456b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f4570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56258f2155f0 con 0x56258f44d650 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56258f34f010 con 0x56258f4595e0 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56258f45c290 con 0x56258f44cd30 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829b169740 10 client.0 _ll_register_callbacks cb 0x56258f3ae340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f456b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f456b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33108/0 (socket says 172.21.15.2:33108) 2024-09-10T23:23:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 -- 172.21.15.2:0/2024048560 learned_addr learned my addr 172.21.15.2:0/2024048560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f8291d9b640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f456620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f8291d9b640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f4570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 -- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 msgr2=0x56258f456620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f456620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 -- 172.21.15.2:0/2024048560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 msgr2=0x56258f4570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f4570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f829259c640 1 -- 172.21.15.2:0/2024048560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56258f37ca00 con 0x56258f44d650 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.320+0000 7f8291d9b640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f4570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829259c640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f456b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f828402a930 tx=0x7f82840316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5ee5a4e0f294ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f8279ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f8279ffb640 1 -- 172.21.15.2:0/2024048560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284035040 con 0x56258f44d650 2024-09-10T23:23:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f8279ffb640 1 -- 172.21.15.2:0/2024048560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8284004040 con 0x56258f44d650 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8288010d00 con 0x56258f44d650 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f8279ffb640 1 -- 172.21.15.2:0/2024048560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8284032e10 con 0x56258f44d650 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 10 client.15117 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56258f467ed0 con 0x56258f44d650 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f8279ffb640 1 -- 172.21.15.2:0/2024048560 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8288010d00 con 0x56258f44d650 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f8279ffb640 1 -- 172.21.15.2:0/2024048560 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8284004870 con 0x56258f44d650 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 10 client.15117 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 20 client.15117 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.321+0000 7f829b169740 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f46a530 0x56258f46b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.322+0000 7f829b169740 4 client.15117 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.322+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56258f3c6b60 con 0x56258f46a530 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.322+0000 7f8291d9b640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f46a530 0x56258f46b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.322+0000 7f8291d9b640 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f46a530 0x56258f46b9a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=308454d8bdac0525 server_cookie=d2fea375cb440b07 in_seq=0 out_seq=0 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.322+0000 7f8279ffb640 10 client.15117 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f8279ffb640 1 -- 172.21.15.2:0/2024048560 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56258f3c6b60 con 0x56258f46a530 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f8279ffb640 10 client.15117 handle_command_reply: tid=0 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 client.15117 shutdown 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 msgr2=0x56258f456b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f456b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f828402a930 tx=0x7f82840316d0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 shutdown_connections 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f46a530 0x56258f46b9a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f4570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f456b60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 --2- 172.21.15.2:0/2024048560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f456620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f8279ffb640 0 client.15117 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:23:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 >> 172.21.15.2:0/2024048560 conn(0x56258f44ab60 msgr2=0x56258f4506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 shutdown_connections 2024-09-10T23:23:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 1 -- 172.21.15.2:0/2024048560 wait complete. 2024-09-10T23:23:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.323+0000 7f829b169740 20 client.15117 trim_cache size 0 max 16384 2024-09-10T23:23:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 Processor -- start 2024-09-10T23:23:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 -- start start 2024-09-10T23:23:38.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f44c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f450da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f453830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56258f469ce0 con 0x56258f44d650 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56258f46a3b0 con 0x56258f4595e0 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829b169740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56258f46aa80 con 0x56258f44cd30 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f450da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f450da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33124/0 (socket says 172.21.15.2:33124) 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 -- 172.21.15.2:0/11885247 learned_addr learned my addr 172.21.15.2:0/11885247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f8291d9b640 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f453830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f8291d9b640 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f44c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 -- 172.21.15.2:0/11885247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 msgr2=0x56258f44c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f44c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 -- 172.21.15.2:0/11885247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 msgr2=0x56258f453830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f453830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.342+0000 7f829259c640 1 -- 172.21.15.2:0/11885247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258f44b5e0 con 0x56258f44d650 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829259c640 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f450da0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8284031440 tx=0x7f828402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e976eca8d77e63d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f827bfff640 1 -- 172.21.15.2:0/11885247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284035030 con 0x56258f44d650 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f827bfff640 1 -- 172.21.15.2:0/11885247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8284004950 con 0x56258f44d650 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f827bfff640 1 -- 172.21.15.2:0/11885247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284005310 con 0x56258f44d650 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 -- 172.21.15.2:0/11885247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 msgr2=0x56258f450da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f450da0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8284031440 tx=0x7f828402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 -- 172.21.15.2:0/11885247 shutdown_connections 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f4595e0 0x56258f453830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f44d650 0x56258f450da0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 --2- 172.21.15.2:0/11885247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44cd30 0x56258f44c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.343+0000 7f829b169740 1 -- 172.21.15.2:0/11885247 >> 172.21.15.2:0/11885247 conn(0x56258f44ab60 msgr2=0x56258f464d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 -- 172.21.15.2:0/11885247 shutdown_connections 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 -- 172.21.15.2:0/11885247 wait complete. 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 -- start start 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 Processor -- start 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f474160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f46e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f46eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56258f46b820 con 0x56258f4595e0 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56258f46b150 con 0x56258f44cd30 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56258f46bef0 con 0x56258f44d650 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829b169740 10 client.0 _ll_register_callbacks cb 0x7f8284005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f46eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f46eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33138/0 (socket says 172.21.15.2:33138) 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f8291d9b640 1 -- 172.21.15.2:0/810872453 learned_addr learned my addr 172.21.15.2:0/810872453 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f8291d9b640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f474160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.344+0000 7f829259c640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f46e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8291d9b640 1 -- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 msgr2=0x56258f46e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8291d9b640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f46e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8291d9b640 1 -- 172.21.15.2:0/810872453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 msgr2=0x56258f474160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8291d9b640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f474160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8291d9b640 1 -- 172.21.15.2:0/810872453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56258f46f120 con 0x56258f4595e0 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8291d9b640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f46eb60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f828800b620 tx=0x7f8288020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c70ed3ea2337cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8279ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8279ffb640 1 -- 172.21.15.2:0/810872453 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828801db60 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8279ffb640 1 -- 172.21.15.2:0/810872453 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f828801dd00 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8284004950 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8279ffb640 1 -- 172.21.15.2:0/810872453 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8288005040 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f829b169740 10 client.15123 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56258f4d7c20 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8279ffb640 1 -- 172.21.15.2:0/810872453 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8284004950 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.345+0000 7f8279ffb640 1 -- 172.21.15.2:0/810872453 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f828801c070 con 0x56258f4595e0 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829b169740 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829b169740 10 client.15123 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829b169740 20 client.15123 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829b169740 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f4dc470 0x56258f4db180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829b169740 4 client.15123 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:23:38.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "status"}) -- 0x56258f3c2610 con 0x56258f4dc470 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829259c640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f4dc470 0x56258f4db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f829259c640 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f4dc470 0x56258f4db180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d9dbc4866f33f24 server_cookie=c09f6d99432f55f in_seq=0 out_seq=0 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f8279ffb640 10 client.15123 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.346+0000 7f8279ffb640 1 -- 172.21.15.2:0/810872453 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56258f3c2610 con 0x56258f4dc470 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8279ffb640 10 client.15123 handle_command_reply: tid=0 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 client.15123 shutdown 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 msgr2=0x56258f46eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f46eb60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f828800b620 tx=0x7f8288020040 comp rx=0 tx=0).stop 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 shutdown_connections 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56258f4dc470 0x56258f4db180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56258f4595e0 0x56258f46eb60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56258f44d650 0x56258f46e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8279ffb640 0 client.15123 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 --2- 172.21.15.2:0/810872453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56258f44cd30 0x56258f474160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 >> 172.21.15.2:0/810872453 conn(0x56258f44ab60 msgr2=0x56258f4563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 shutdown_connections 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 1 -- 172.21.15.2:0/810872453 wait complete. 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f829b169740 20 client.15123 trim_cache size 0 max 16384 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24547, 2024-09-10T23:23:38.361 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 72.941944008999997, 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 105.509048327 2024-09-10T23:23:38.362 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b5370 msgr2=0x7f827c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b5370 0x7f827c0b7830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f828c0a88f0 tx=0x7f828c0cf040 comp rx=0 tx=0).stop 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 msgr2=0x7f829419ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 0x7f829419ec20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f828c00cad0 tx=0x7f828c00cf90 comp rx=0 tx=0).stop 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 shutdown_connections 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b5370 0x7f827c0b7830 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294109150 0x7f829419ec20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941087d0 0x7f8294199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 --2- 172.21.15.2:0/1348285351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294102dc0 0x7f8294199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.347+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 >> 172.21.15.2:0/1348285351 conn(0x7f82940fe830 msgr2=0x7f8294100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.348+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 shutdown_connections 2024-09-10T23:23:38.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:38.348+0000 7f8298d94640 1 -- 172.21.15.2:0/1348285351 wait complete. 2024-09-10T23:23:39.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:23:39.319 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:39.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:39 smithi002 ceph-mon[31150]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.837+0000 7f647494b640 1 -- 172.21.15.2:0/1967839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470102dc0 msgr2=0x7f64701031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.837+0000 7f647494b640 1 --2- 172.21.15.2:0/1967839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470102dc0 0x7f64701031a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6460009900 tx=0x7f646002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.837+0000 7f647494b640 1 -- 172.21.15.2:0/1967839249 shutdown_connections 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.837+0000 7f647494b640 1 --2- 172.21.15.2:0/1967839249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6470109150 0x7f647010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.837+0000 7f647494b640 1 --2- 172.21.15.2:0/1967839249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64701087d0 0x7f6470108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.837+0000 7f647494b640 1 --2- 172.21.15.2:0/1967839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470102dc0 0x7f64701031a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.838+0000 7f647494b640 1 -- 172.21.15.2:0/1967839249 >> 172.21.15.2:0/1967839249 conn(0x7f64700fe830 msgr2=0x7f6470100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.838+0000 7f647494b640 1 -- 172.21.15.2:0/1967839249 shutdown_connections 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.838+0000 7f647494b640 1 -- 172.21.15.2:0/1967839249 wait complete. 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.838+0000 7f647494b640 1 Processor -- start 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.838+0000 7f647494b640 1 -- start start 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6470102dc0 0x7f6470199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64701087d0 0x7f6470199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 0x7f647019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6470112dd0 con 0x7f6470109150 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6470112c50 con 0x7f64701087d0 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6470112f50 con 0x7f6470102dc0 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 0x7f647019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 0x7f647019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33164/0 (socket says 172.21.15.2:33164) 2024-09-10T23:23:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 -- 172.21.15.2:0/3398141562 learned_addr learned my addr 172.21.15.2:0/3398141562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646e59c640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6470102dc0 0x7f6470199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646dd9b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64701087d0 0x7f6470199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 -- 172.21.15.2:0/3398141562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6470102dc0 msgr2=0x7f6470199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6470102dc0 0x7f6470199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 -- 172.21.15.2:0/3398141562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64701087d0 msgr2=0x7f6470199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64701087d0 0x7f6470199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 -- 172.21.15.2:0/3398141562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647019f2d0 con 0x7f6470109150 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f646ed9d640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 0x7f647019eb00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f646800eaa0 tx=0x7f646800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f645f7fe640 1 -- 172.21.15.2:0/3398141562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6468004d20 con 0x7f6470109150 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f645f7fe640 1 -- 172.21.15.2:0/3398141562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6468005020 con 0x7f6470109150 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647019f5c0 con 0x7f6470109150 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.839+0000 7f645f7fe640 1 -- 172.21.15.2:0/3398141562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64680116b0 con 0x7f6470109150 2024-09-10T23:23:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.840+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64701a5c80 con 0x7f6470109150 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.842+0000 7f6476d20740 1 Processor -- start 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.842+0000 7f645f7fe640 1 -- 172.21.15.2:0/3398141562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f646800f040 con 0x7f6470109150 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.842+0000 7f6476d20740 1 -- start start 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f6476d20740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd332d30 0x5647bd333110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f6476d20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd3434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f6476d20740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 0x5647bd345de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f6476d20740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647bd2aac10 con 0x5647bd3439f0 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f6476d20740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bd29a040 con 0x5647bd332d30 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f6476d20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5647bd29de50 con 0x5647bd333650 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 0x5647bd345de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 0x5647bd345de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33166/0 (socket says 172.21.15.2:33166) 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646dd9b640 1 -- 172.21.15.2:0/1959655840 learned_addr learned my addr 172.21.15.2:0/1959655840 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd3434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd332d30 0x5647bd333110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f645f7fe640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64580b53f0 0x7f64580b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 -- 172.21.15.2:0/1959655840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd332d30 msgr2=0x5647bd333110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd332d30 0x5647bd333110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 -- 172.21.15.2:0/1959655840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 msgr2=0x5647bd345de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 0x5647bd345de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 -- 172.21.15.2:0/1959655840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bcff8540 con 0x5647bd333650 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 0x5647bd345de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646ed9d640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64580b53f0 0x7f64580b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f646e59c640 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd3434b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6460009230 tx=0x7f6460032e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc217faec630ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.843+0000 7f645f7fe640 1 -- 172.21.15.2:0/3398141562 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f64680e5b60 con 0x7f6470109150 2024-09-10T23:23:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f645cff9640 1 -- 172.21.15.2:0/1959655840 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460035040 con 0x5647bd333650 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f645cff9640 1 -- 172.21.15.2:0/1959655840 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64600316a0 con 0x5647bd333650 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f645cff9640 1 -- 172.21.15.2:0/1959655840 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460004750 con 0x5647bd333650 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 -- 172.21.15.2:0/1959655840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 msgr2=0x5647bd3434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f646ed9d640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64580b53f0 0x7f64580b78b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64680a87a0 tx=0x7f64680cf040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd3434b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6460009230 tx=0x7f6460032e60 comp rx=0 tx=0).stop 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 -- 172.21.15.2:0/1959655840 shutdown_connections 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd3439f0 0x5647bd345de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd3434b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 --2- 172.21.15.2:0/1959655840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd332d30 0x5647bd333110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 -- 172.21.15.2:0/1959655840 >> 172.21.15.2:0/1959655840 conn(0x5647bd330b60 msgr2=0x5647bd331d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.844+0000 7f6476d20740 1 -- 172.21.15.2:0/1959655840 shutdown_connections 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 -- 172.21.15.2:0/1959655840 wait complete. 2024-09-10T23:23:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 -- start start 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 Processor -- start 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd340ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd341430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647bd0fb5f0 con 0x5647bd332d30 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bd235010 con 0x5647bd3439f0 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5647bd346640 con 0x5647bd333650 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f6476d20740 10 client.0 _ll_register_callbacks cb 0x5647bd294340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f646dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f646dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33174/0 (socket says 172.21.15.2:33174) 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f646dd9b640 1 -- 172.21.15.2:0/2778191906 learned_addr learned my addr 172.21.15.2:0/2778191906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.845+0000 7f646e59c640 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd340ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f646dd9b640 1 -- 172.21.15.2:0/2778191906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 msgr2=0x5647bd340ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f646dd9b640 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd340ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f646dd9b640 1 -- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 msgr2=0x5647bd341430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f646dd9b640 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd341430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f646dd9b640 1 -- 172.21.15.2:0/2778191906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bd262a00 con 0x5647bd332d30 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f646dd9b640 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3409b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6464011f20 tx=0x7f646400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe46689587ec515 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6455ffb640 1 -- 172.21.15.2:0/2778191906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464005220 con 0x5647bd332d30 2024-09-10T23:23:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6455ffb640 1 -- 172.21.15.2:0/2778191906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f64640053c0 con 0x5647bd332d30 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64600316a0 con 0x5647bd332d30 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6455ffb640 1 -- 172.21.15.2:0/2778191906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6464027050 con 0x5647bd332d30 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6476d20740 10 client.15135 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5647bd352200 con 0x5647bd332d30 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.846+0000 7f6455ffb640 1 -- 172.21.15.2:0/2778191906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64600316a0 con 0x5647bd332d30 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6455ffb640 1 -- 172.21.15.2:0/2778191906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f646400e6e0 con 0x5647bd332d30 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6476d20740 10 client.15135 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6476d20740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6476d20740 20 client.15135 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6476d20740 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3547f0 0x5647bd355c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6476d20740 4 client.15135 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647bd2acb60 con 0x5647bd3547f0 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f646e59c640 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3547f0 0x5647bd355c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f6455ffb640 10 client.15135 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.847+0000 7f646e59c640 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3547f0 0x5647bd355c60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e59f778afa5894c server_cookie=4998816ed0524787 in_seq=0 out_seq=0 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6455ffb640 1 -- 172.21.15.2:0/2778191906 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5647bd2acb60 con 0x5647bd3547f0 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6455ffb640 10 client.15135 handle_command_reply: tid=0 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 client.15135 shutdown 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 msgr2=0x5647bd3409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3409b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6464011f20 tx=0x7f646400f7f0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 shutdown_connections 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd341430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd340ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.848+0000 7f6476d20740 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3547f0 0x5647bd355c60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.849+0000 7f6476d20740 1 --2- 172.21.15.2:0/2778191906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3409b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.849+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 >> 172.21.15.2:0/2778191906 conn(0x5647bd330b60 msgr2=0x5647bd32fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.849+0000 7f6455ffb640 0 client.15135 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.849+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 shutdown_connections 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.849+0000 7f6476d20740 1 -- 172.21.15.2:0/2778191906 wait complete. 2024-09-10T23:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.849+0000 7f6476d20740 20 client.15135 trim_cache size 0 max 16384 2024-09-10T23:23:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 Processor -- start 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 -- start start 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd345ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd33e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647bd353fa0 con 0x5647bd332d30 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bd354670 con 0x5647bd3439f0 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f6476d20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5647bd354d40 con 0x5647bd333650 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3304f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33180/0 (socket says 172.21.15.2:33180) 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 -- 172.21.15.2:0/4264789784 learned_addr learned my addr 172.21.15.2:0/4264789784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646e59c640 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd345ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 -- 172.21.15.2:0/4264789784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 msgr2=0x5647bd345ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd345ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 -- 172.21.15.2:0/4264789784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 msgr2=0x5647bd33e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd33e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.867+0000 7f646dd9b640 1 -- 172.21.15.2:0/4264789784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bd33ef10 con 0x5647bd332d30 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f646dd9b640 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3304f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6464011940 tx=0x7f6464005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe6f8ba4a0e799 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6457fff640 1 -- 172.21.15.2:0/4264789784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646402f020 con 0x5647bd332d30 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6457fff640 1 -- 172.21.15.2:0/4264789784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f646401c070 con 0x5647bd332d30 2024-09-10T23:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6457fff640 1 -- 172.21.15.2:0/4264789784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64640112a0 con 0x5647bd332d30 2024-09-10T23:23:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 -- 172.21.15.2:0/4264789784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 msgr2=0x5647bd3304f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3304f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6464011940 tx=0x7f6464005e40 comp rx=0 tx=0).stop 2024-09-10T23:23:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 -- 172.21.15.2:0/4264789784 shutdown_connections 2024-09-10T23:23:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd33e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd333650 0x5647bd345ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 --2- 172.21.15.2:0/4264789784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd332d30 0x5647bd3304f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.868+0000 7f6476d20740 1 -- 172.21.15.2:0/4264789784 >> 172.21.15.2:0/4264789784 conn(0x5647bd330b60 msgr2=0x5647bd353670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 -- 172.21.15.2:0/4264789784 shutdown_connections 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 -- 172.21.15.2:0/4264789784 wait complete. 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 -- start start 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 Processor -- start 2024-09-10T23:23:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd332d30 0x5647bd335540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 0x5647bd35deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd35e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647bd355ae0 con 0x5647bd333650 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bd355410 con 0x5647bd3439f0 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5647bd3561b0 con 0x5647bd332d30 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f6476d20740 10 client.0 _ll_register_callbacks cb 0x7f6464011ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f646e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 0x5647bd35deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f646e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 0x5647bd35deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33194/0 (socket says 172.21.15.2:33194) 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f646e59c640 1 -- 172.21.15.2:0/1168593837 learned_addr learned my addr 172.21.15.2:0/1168593837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.869+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd332d30 0x5647bd335540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd35e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646e59c640 1 -- 172.21.15.2:0/1168593837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd332d30 msgr2=0x5647bd335540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646e59c640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd332d30 0x5647bd335540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646e59c640 1 -- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 msgr2=0x5647bd35e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646e59c640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd35e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646e59c640 1 -- 172.21.15.2:0/1168593837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bd33da60 con 0x5647bd333650 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd332d30 0x5647bd335540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f646e59c640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 0x5647bd35deb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f646002a930 tx=0x7f646002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8f4a068a508d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6455ffb640 1 -- 172.21.15.2:0/1168593837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460035040 con 0x5647bd333650 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6455ffb640 1 -- 172.21.15.2:0/1168593837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6460031840 con 0x5647bd333650 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f646401c070 con 0x5647bd333650 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6455ffb640 1 -- 172.21.15.2:0/1168593837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6460031b10 con 0x5647bd333650 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6476d20740 10 client.15141 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5647bd3c12f0 con 0x5647bd333650 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.870+0000 7f6455ffb640 1 -- 172.21.15.2:0/1168593837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f646401c070 con 0x5647bd333650 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6455ffb640 1 -- 172.21.15.2:0/1168593837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f64600052a0 con 0x5647bd333650 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6476d20740 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6476d20740 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6476d20740 20 client.15141 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6476d20740 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3c5ab0 0x5647bd3c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6476d20740 4 client.15141 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "status"}) -- 0x5647bd2a8610 con 0x5647bd3c5ab0 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3c5ab0 0x5647bd3c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f6455ffb640 10 client.15141 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.871+0000 7f646dd9b640 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3c5ab0 0x5647bd3c47c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f789bd3709c0039 server_cookie=8844cad797b1401d in_seq=0 out_seq=0 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6455ffb640 1 -- 172.21.15.2:0/1168593837 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5647bd2a8610 con 0x5647bd3c5ab0 2024-09-10T23:23:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6455ffb640 10 client.15141 handle_command_reply: tid=0 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 client.15141 shutdown 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 msgr2=0x5647bd35deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 0x5647bd35deb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f646002a930 tx=0x7f646002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 shutdown_connections 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bd3439f0 0x5647bd35e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5647bd3c5ab0 0x5647bd3c47c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647bd333650 0x5647bd35deb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 --2- 172.21.15.2:0/1168593837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647bd332d30 0x5647bd335540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 >> 172.21.15.2:0/1168593837 conn(0x5647bd330b60 msgr2=0x5647bd344b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6455ffb640 0 client.15141 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 shutdown_connections 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 1 -- 172.21.15.2:0/1168593837 wait complete. 2024-09-10T23:23:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.872+0000 7f6476d20740 20 client.15141 trim_cache size 0 max 16384 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24563, 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 75.475999619999996, 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:23:39.881 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:23:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:23:39.882 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 92.928226498000001 2024-09-10T23:23:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:23:39.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64580b53f0 msgr2=0x7f64580b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64580b53f0 0x7f64580b78b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64680a87a0 tx=0x7f64680cf040 comp rx=0 tx=0).stop 2024-09-10T23:23:39.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 msgr2=0x7f647019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 0x7f647019eb00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f646800eaa0 tx=0x7f646800eea0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 shutdown_connections 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f64580b53f0 0x7f64580b78b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6470109150 0x7f647019eb00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64701087d0 0x7f6470199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 --2- 172.21.15.2:0/3398141562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6470102dc0 0x7f6470199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 >> 172.21.15.2:0/3398141562 conn(0x7f64700fe830 msgr2=0x7f6470100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 shutdown_connections 2024-09-10T23:23:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:39.873+0000 7f647494b640 1 -- 172.21.15.2:0/3398141562 wait complete. 2024-09-10T23:23:39.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:39 smithi177 ceph-mon[35760]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:40.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:39 smithi154 ceph-mon[35136]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:40.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T23:23:40.926 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 -- 172.21.15.2:0/185170336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 msgr2=0x7f0abc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/185170336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1031a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009900 tx=0x7f0ab002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 -- 172.21.15.2:0/185170336 shutdown_connections 2024-09-10T23:23:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/185170336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0abc109150 0x7f0abc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/185170336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc1087d0 0x7f0abc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/185170336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1031a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 -- 172.21.15.2:0/185170336 >> 172.21.15.2:0/185170336 conn(0x7f0abc0fe830 msgr2=0x7f0abc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 -- 172.21.15.2:0/185170336 shutdown_connections 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.414+0000 7f0ac2fae640 1 -- 172.21.15.2:0/185170336 wait complete. 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 Processor -- start 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 -- start start 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0abc1087d0 0x7f0abc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc109150 0x7f0abc19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112e10 con 0x7f0abc102dc0 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112c90 con 0x7f0abc1087d0 2024-09-10T23:23:41.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac2fae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112f90 con 0x7f0abc109150 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59178/0 (socket says 172.21.15.2:59178) 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/1323313688 learned_addr learned my addr 172.21.15.2:0/1323313688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0abbfff640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0abc1087d0 0x7f0abc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac154b640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc109150 0x7f0abc19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/1323313688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc109150 msgr2=0x7f0abc19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc109150 0x7f0abc19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/1323313688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0abc1087d0 msgr2=0x7f0abc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.415+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0abc1087d0 0x7f0abc199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/1323313688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0abc19f3a0 con 0x7f0abc102dc0 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ac154b640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc109150 0x7f0abc19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1992f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0005940 tx=0x7f0ab00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ab9ffb640 1 -- 172.21.15.2:0/1323313688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab003f030 con 0x7f0abc102dc0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ab9ffb640 1 -- 172.21.15.2:0/1323313688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab0003cb0 con 0x7f0abc102dc0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0abc19f630 con 0x7f0abc102dc0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ab9ffb640 1 -- 172.21.15.2:0/1323313688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0035070 con 0x7f0abc102dc0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.416+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0abc1a5d50 con 0x7f0abc102dc0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ab9ffb640 1 -- 172.21.15.2:0/1323313688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f0ab003bbf0 con 0x7f0abc102dc0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 Processor -- start 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 -- start start 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41ad30 0x55d9ea41b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea42b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea392c10 con 0x55d9ea42b9f0 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea382040 con 0x55d9ea41ad30 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac5383740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea385e50 con 0x55d9ea41b650 2024-09-10T23:23:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59184/0 (socket says 172.21.15.2:59184) 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 -- 172.21.15.2:0/1106905170 learned_addr learned my addr 172.21.15.2:0/1106905170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac154b640 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41ad30 0x55d9ea41b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea42b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 -- 172.21.15.2:0/1106905170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 msgr2=0x55d9ea42b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea42b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 -- 172.21.15.2:0/1106905170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41ad30 msgr2=0x55d9ea41b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41ad30 0x55d9ea41b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0abbfff640 1 -- 172.21.15.2:0/1106905170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ea0e0540 con 0x55d9ea42b9f0 2024-09-10T23:23:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.419+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea42b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0abbfff640 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42dde0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800bcb0 tx=0x7f0aa800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f165ea26f0ef26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0ab9ffb640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0aac0b53f0 0x7f0aac0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0aa6ffd640 1 -- 172.21.15.2:0/1106905170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8015070 con 0x55d9ea42b9f0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0aa6ffd640 1 -- 172.21.15.2:0/1106905170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa801a910 con 0x55d9ea42b9f0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0aa6ffd640 1 -- 172.21.15.2:0/1106905170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011920 con 0x55d9ea42b9f0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0ac154b640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0aac0b53f0 0x7f0aac0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.420+0000 7f0ab9ffb640 1 -- 172.21.15.2:0/1323313688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0ab0106900 con 0x7f0abc102dc0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 -- 172.21.15.2:0/1106905170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 msgr2=0x55d9ea42dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac154b640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0aac0b53f0 0x7f0aac0b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400f4c0 tx=0x7f0ab4007740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42dde0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800bcb0 tx=0x7f0aa800f730 comp rx=0 tx=0).stop 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 -- 172.21.15.2:0/1106905170 shutdown_connections 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42dde0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea42b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 --2- 172.21.15.2:0/1106905170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41ad30 0x55d9ea41b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 -- 172.21.15.2:0/1106905170 >> 172.21.15.2:0/1106905170 conn(0x55d9ea418b60 msgr2=0x55d9ea419d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 -- 172.21.15.2:0/1106905170 shutdown_connections 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 -- 172.21.15.2:0/1106905170 wait complete. 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 -- start start 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 Processor -- start 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea428990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.421+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea428ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea429410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea1e35f0 con 0x55d9ea42b9f0 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac5383740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea31d010 con 0x55d9ea41b650 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac5383740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea42e6a0 con 0x55d9ea41ad30 2024-09-10T23:23:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac5383740 10 client.0 _ll_register_callbacks cb 0x55d9ea37c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea429410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea429410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59192/0 (socket says 172.21.15.2:59192) 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 -- 172.21.15.2:0/83158129 learned_addr learned my addr 172.21.15.2:0/83158129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea428990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0abbfff640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea428ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 -- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 msgr2=0x55d9ea428990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea428990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 -- 172.21.15.2:0/83158129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 msgr2=0x55d9ea428ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea428ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 -- 172.21.15.2:0/83158129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ea34aa00 con 0x55d9ea42b9f0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0a9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac154b640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea429410 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4010ee0 tx=0x7f0ab4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bdc9ea5d3016af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0a9bfff640 1 -- 172.21.15.2:0/83158129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4026680 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0a9bfff640 1 -- 172.21.15.2:0/83158129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0ab401d420 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.422+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa801a910 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0a9bfff640 1 -- 172.21.15.2:0/83158129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ab4026820 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 10 client.15153 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9ea43a2c0 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0a9bfff640 1 -- 172.21.15.2:0/83158129 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa801a910 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0a9bfff640 1 -- 172.21.15.2:0/83158129 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0ab401dc20 con 0x55d9ea42b9f0 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 10 client.15153 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 10 client.15153 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 20 client.15153 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea43c970 0x55d9ea43dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 4 client.15153 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9ea394b60 con 0x55d9ea43c970 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.423+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea43c970 0x55d9ea43dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea43c970 0x55d9ea43dde0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=298fb56b0d60dfdc server_cookie=6d5d996e82939dde in_seq=0 out_seq=0 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0a9bfff640 10 client.15153 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0a9bfff640 1 -- 172.21.15.2:0/83158129 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9ea394b60 con 0x55d9ea43c970 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0a9bfff640 10 client.15153 handle_command_reply: tid=0 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 client.15153 shutdown 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 msgr2=0x55d9ea429410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea429410 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4010ee0 tx=0x7f0ab4004b50 comp rx=0 tx=0).stop 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 shutdown_connections 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea43c970 0x55d9ea43dde0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea429410 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea428ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0a9bfff640 0 client.15153 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:23:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 --2- 172.21.15.2:0/83158129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea428990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.424+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 >> 172.21.15.2:0/83158129 conn(0x55d9ea418b60 msgr2=0x55d9ea417d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.425+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 shutdown_connections 2024-09-10T23:23:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.425+0000 7f0ac5383740 1 -- 172.21.15.2:0/83158129 wait complete. 2024-09-10T23:23:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.425+0000 7f0ac5383740 20 client.15153 trim_cache size 0 max 16384 2024-09-10T23:23:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 Processor -- start 2024-09-10T23:23:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 -- start start 2024-09-10T23:23:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea426480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea42ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea43c120 con 0x55d9ea42b9f0 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea43c7f0 con 0x55d9ea41b650 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac5383740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea43cec0 con 0x55d9ea41ad30 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59208/0 (socket says 172.21.15.2:59208) 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 -- 172.21.15.2:0/2792003450 learned_addr learned my addr 172.21.15.2:0/2792003450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0abbfff640 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea42ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea426480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 -- 172.21.15.2:0/2792003450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 msgr2=0x55d9ea426480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea426480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 -- 172.21.15.2:0/2792003450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 msgr2=0x55d9ea42ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea42ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac154b640 1 -- 172.21.15.2:0/2792003450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ea4144f0 con 0x55d9ea42b9f0 2024-09-10T23:23:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.443+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea426480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac154b640 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42cfb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4010900 tx=0x7f0ab4010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b49a2321148d618 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0aa67fc640 1 -- 172.21.15.2:0/2792003450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4026480 con 0x55d9ea42b9f0 2024-09-10T23:23:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0aa67fc640 1 -- 172.21.15.2:0/2792003450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4026620 con 0x55d9ea42b9f0 2024-09-10T23:23:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0aa67fc640 1 -- 172.21.15.2:0/2792003450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab401ce80 con 0x55d9ea42b9f0 2024-09-10T23:23:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 -- 172.21.15.2:0/2792003450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 msgr2=0x55d9ea42cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42cfb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4010900 tx=0x7f0ab4010f10 comp rx=0 tx=0).stop 2024-09-10T23:23:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 -- 172.21.15.2:0/2792003450 shutdown_connections 2024-09-10T23:23:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea42b9f0 0x55d9ea42cfb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea41b650 0x55d9ea42ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2792003450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41ad30 0x55d9ea426480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.444+0000 7f0ac5383740 1 -- 172.21.15.2:0/2792003450 >> 172.21.15.2:0/2792003450 conn(0x55d9ea418b60 msgr2=0x55d9ea43b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 -- 172.21.15.2:0/2792003450 shutdown_connections 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 -- 172.21.15.2:0/2792003450 wait complete. 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 -- start start 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 Processor -- start 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 0x55d9ea440e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea441370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea42b9f0 0x55d9ea445e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea43dc60 con 0x55d9ea41ad30 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea43d590 con 0x55d9ea42b9f0 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea43e330 con 0x55d9ea41b650 2024-09-10T23:23:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.445+0000 7f0ac5383740 10 client.0 _ll_register_callbacks cb 0x7f0ab4010b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 0x55d9ea440e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 0x55d9ea440e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59224/0 (socket says 172.21.15.2:59224) 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/2303851624 learned_addr learned my addr 172.21.15.2:0/2303851624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0abbfff640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea441370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac154b640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea42b9f0 0x55d9ea445e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 msgr2=0x55d9ea441370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea441370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/2303851624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea42b9f0 msgr2=0x55d9ea445e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea42b9f0 0x55d9ea445e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 -- 172.21.15.2:0/2303851624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ea4463c0 con 0x55d9ea41ad30 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac0d4a640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 0x55d9ea440e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0003fd0 tx=0x7f0ab002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72655dd2705193ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0a9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:23:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0a9bfff640 1 -- 172.21.15.2:0/2303851624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0108e60 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0a9bfff640 1 -- 172.21.15.2:0/2303851624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0ab00cd1d0 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab4026620 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0a9bfff640 1 -- 172.21.15.2:0/2303851624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ab0049040 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac5383740 10 client.15159 fetch_fsmap learned FSMap version 27 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.446+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9ea4a9a20 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0a9bfff640 1 -- 172.21.15.2:0/2303851624 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4026620 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0a9bfff640 1 -- 172.21.15.2:0/2303851624 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0ab00d6070 con 0x55d9ea41ad30 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0ac5383740 10 client.15159 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0ac5383740 10 client.15159 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0ac5383740 20 client.15159 populate_metadata read hostname 'smithi002' 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea4ae5b0 0x55d9ea4ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0ac5383740 4 client.15159 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:23:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "status"}) -- 0x55d9ea390610 con 0x55d9ea4ae5b0 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0abbfff640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea4ae5b0 0x55d9ea4ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0a9bfff640 10 client.15159 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.447+0000 7f0abbfff640 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea4ae5b0 0x55d9ea4ad2c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e62e35feaf00954f server_cookie=39d91f5d53d0a82a in_seq=0 out_seq=0 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0a9bfff640 1 -- 172.21.15.2:0/2303851624 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d9ea390610 con 0x55d9ea4ae5b0 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0a9bfff640 10 client.15159 handle_command_reply: tid=0 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 client.15159 shutdown 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 msgr2=0x55d9ea440e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 0x55d9ea440e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0003fd0 tx=0x7f0ab002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 shutdown_connections 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9ea4ae5b0 0x55d9ea4ad2c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9ea42b9f0 0x55d9ea445e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9ea41b650 0x55d9ea441370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 --2- 172.21.15.2:0/2303851624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9ea41ad30 0x55d9ea440e30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 >> 172.21.15.2:0/2303851624 conn(0x55d9ea418b60 msgr2=0x55d9ea42ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0a9bfff640 0 client.15159 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 shutdown_connections 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 1 -- 172.21.15.2:0/2303851624 wait complete. 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.448+0000 7f0ac5383740 20 client.15159 trim_cache size 0 max 16384 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-10T23:23:41.454 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24568, 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 84.140155421000003, 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 103.247177901 2024-09-10T23:23:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0aac0b53f0 msgr2=0x7f0aac0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0aac0b53f0 0x7f0aac0b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400f4c0 tx=0x7f0ab4007740 comp rx=0 tx=0).stop 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 msgr2=0x7f0abc1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1992f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0005940 tx=0x7f0ab00042f0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 shutdown_connections 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0aac0b53f0 0x7f0aac0b78b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0abc109150 0x7f0abc19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0abc1087d0 0x7f0abc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 --2- 172.21.15.2:0/1323313688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0abc102dc0 0x7f0abc1992f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:41.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 >> 172.21.15.2:0/1323313688 conn(0x7f0abc0fe830 msgr2=0x7f0abc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:41.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 shutdown_connections 2024-09-10T23:23:41.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:41.449+0000 7f0ac2fae640 1 -- 172.21.15.2:0/1323313688 wait complete. 2024-09-10T23:23:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:41 smithi177 ceph-mon[35760]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:41.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:41 smithi002 ceph-mon[31150]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:42.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:41 smithi154 ceph-mon[35136]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:42.157 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T23:23:42.158 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:23:42.169 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:23:42.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T23:23:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:42.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.965+0000 7fc39dedd640 1 -- 172.21.15.2:0/2770789973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398108720 msgr2=0x7fc39810abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:42.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.965+0000 7fc39dedd640 1 --2- 172.21.15.2:0/2770789973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398108720 0x7fc39810abe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc390009900 tx=0x7fc39002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 -- 172.21.15.2:0/2770789973 shutdown_connections 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 --2- 172.21.15.2:0/2770789973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398108720 0x7fc39810abe0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 --2- 172.21.15.2:0/2770789973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc398105bd0 0x7fc398107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 --2- 172.21.15.2:0/2770789973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc39806b640 0x7fc398105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 -- 172.21.15.2:0/2770789973 >> 172.21.15.2:0/2770789973 conn(0x7fc3980fd1e0 msgr2=0x7fc3980ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 -- 172.21.15.2:0/2770789973 shutdown_connections 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.966+0000 7fc39dedd640 1 -- 172.21.15.2:0/2770789973 wait complete. 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 Processor -- start 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 -- start start 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39806b640 0x7fc398198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 0x7fc398199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc398108720 0x7fc398199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc39810e650 con 0x7fc398105bd0 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc39810e4d0 con 0x7fc39806b640 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.967+0000 7fc39dedd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc39810e7d0 con 0x7fc398108720 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 0x7fc398199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 0x7fc398199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59234/0 (socket says 172.21.15.2:59234) 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 -- 172.21.15.2:0/35683563 learned_addr learned my addr 172.21.15.2:0/35683563 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc3977fe640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39806b640 0x7fc398198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc397fff640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc398108720 0x7fc398199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 -- 172.21.15.2:0/35683563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc398108720 msgr2=0x7fc398199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc398108720 0x7fc398199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 -- 172.21.15.2:0/35683563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39806b640 msgr2=0x7fc398198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39806b640 0x7fc398198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 -- 172.21.15.2:0/35683563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39819a7f0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc396ffd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 0x7fc398199310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c890 tx=0x7fc38c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c004220 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c0043c0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39819aae0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c004a00 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.968+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3981a11c0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.969+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3980fecd0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.971+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc38c0079b0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.971+0000 7fc394ff9640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc3800b5370 0x7fc3800b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.972+0000 7fc3977fe640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc3800b5370 0x7fc3800b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.972+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc38c0e5ef0 con 0x7fc398105bd0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.972+0000 7fc3977fe640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc3800b5370 0x7fc3800b7830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc388007ec0 tx=0x7fc3880075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:42.974+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc38c014030 con 0x7fc398105bd0 2024-09-10T23:23:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.178+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fc398063590 con 0x7fc3800b5370 2024-09-10T23:23:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.179+0000 7fc394ff9640 1 -- 172.21.15.2:0/35683563 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fc398063590 con 0x7fc3800b5370 2024-09-10T23:23:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-10T23:23:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-10T23:23:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-10T23:23:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc3800b5370 msgr2=0x7fc3800b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc3800b5370 0x7fc3800b7830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc388007ec0 tx=0x7fc3880075b0 comp rx=0 tx=0).stop 2024-09-10T23:23:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 msgr2=0x7fc398199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 0x7fc398199310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c890 tx=0x7fc38c00cd50 comp rx=0 tx=0).stop 2024-09-10T23:23:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 shutdown_connections 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc3800b5370 0x7fc3800b7830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc398108720 0x7fc398199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398105bd0 0x7fc398199310 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 --2- 172.21.15.2:0/35683563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc39806b640 0x7fc398198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 >> 172.21.15.2:0/35683563 conn(0x7fc3980fd1e0 msgr2=0x7fc398103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 shutdown_connections 2024-09-10T23:23:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:43.181+0000 7fc39dedd640 1 -- 172.21.15.2:0/35683563 wait complete. 2024-09-10T23:23:43.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:43 smithi002 ceph-mon[31150]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:43.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T23:23:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:43 smithi177 ceph-mon[35760]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:44.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:43 smithi154 ceph-mon[35136]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:23:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:44.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 -- 172.21.15.2:0/3359803622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec105bc0 msgr2=0x7ffbec108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 --2- 172.21.15.2:0/3359803622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec105bc0 0x7ffbec108030 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009900 tx=0x7ffbe002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 -- 172.21.15.2:0/3359803622 shutdown_connections 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 --2- 172.21.15.2:0/3359803622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbec108770 0x7ffbec10ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 --2- 172.21.15.2:0/3359803622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec105bc0 0x7ffbec108030 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 --2- 172.21.15.2:0/3359803622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbec06c0c0 0x7ffbec105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 -- 172.21.15.2:0/3359803622 >> 172.21.15.2:0/3359803622 conn(0x7ffbec0fd200 msgr2=0x7ffbec0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 -- 172.21.15.2:0/3359803622 shutdown_connections 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.615+0000 7ffbf2820640 1 -- 172.21.15.2:0/3359803622 wait complete. 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 Processor -- start 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 -- start start 2024-09-10T23:23:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbec06c0c0 0x7ffbec198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbec105bc0 0x7ffbec199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 0x7ffbec19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec10e720 con 0x7ffbec108770 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec10e5a0 con 0x7ffbec105bc0 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf2820640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec10e8a0 con 0x7ffbec06c0c0 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf0dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 0x7ffbec19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf0dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 0x7ffbec19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59256/0 (socket says 172.21.15.2:59256) 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.616+0000 7ffbf0dbd640 1 -- 172.21.15.2:0/99930285 learned_addr learned my addr 172.21.15.2:0/99930285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf0dbd640 1 -- 172.21.15.2:0/99930285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbec06c0c0 msgr2=0x7ffbec198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf0dbd640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbec06c0c0 0x7ffbec198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf0dbd640 1 -- 172.21.15.2:0/99930285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbec105bc0 msgr2=0x7ffbec199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbeb7fe640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbec105bc0 0x7ffbec199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf0dbd640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbec105bc0 0x7ffbec199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf0dbd640 1 -- 172.21.15.2:0/99930285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec19aa10 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf0dbd640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 0x7ffbec19a170 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400cad0 tx=0x7ffbe400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe400ae20 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbe4005020 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec19ad00 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe400f6b0 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.617+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec1a13e0 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.618+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec106020 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.620+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7ffbe40054f0 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.621+0000 7ffbe97fa640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffbd40b5370 0x7ffbd40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.621+0000 7ffbebfff640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffbd40b5370 0x7ffbd40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.621+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffbe40e6290 con 0x7ffbec108770 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.622+0000 7ffbebfff640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffbd40b5370 0x7ffbd40b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009710 tx=0x7ffbdc006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.624+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffbe4014030 con 0x7ffbec108770 2024-09-10T23:23:44.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.823+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ffbec063590 con 0x7ffbd40b5370 2024-09-10T23:23:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:44 smithi002 ceph-mon[31150]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:44.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.836+0000 7ffbe97fa640 1 -- 172.21.15.2:0/99930285 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7ffbec063590 con 0x7ffbd40b5370 2024-09-10T23:23:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T23:23:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (100s) 21s ago 100s 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 a4728e9d49b3 2024-09-10T23:23:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi154 running (98s) 29s ago 97s 20.6M - 19.3.0-4854-g8f219c47 589dd18248e4 d5bcc9c00799 2024-09-10T23:23:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi177 running (112s) 29s ago 111s 18.2M - 19.3.0-4854-g8f219c47 589dd18248e4 deafac7a9bac 2024-09-10T23:23:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (2m) 21s ago 2m 13.9M - 19.3.0-4854-g8f219c47 589dd18248e4 fd702a6b184a 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi154 running (117s) 29s ago 117s 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 0d901baa415d 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi177 running (115s) 29s ago 114s 19.8M - 19.3.0-4854-g8f219c47 589dd18248e4 4ae7aae5102a 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (104s) 21s ago 103s 16.5M - 19.3.0-4854-g8f219c47 589dd18248e4 cfe1aaa3419b 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi154 running (109s) 29s ago 109s 17.9M - 19.3.0-4854-g8f219c47 589dd18248e4 40f74786f163 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi177 running (107s) 29s ago 106s 26.7M - 19.3.0-4854-g8f219c47 589dd18248e4 02c5d834e51d 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (2m) 21s ago 2m 13.8M - 19.3.0-4854-g8f219c47 589dd18248e4 ad87c0dc222d 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi154 running (2m) 29s ago 2m 16.6M - 19.3.0-4854-g8f219c47 589dd18248e4 694ae7bc0149 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi177 running (2m) 29s ago 2m 18.5M - 19.3.0-4854-g8f219c47 589dd18248e4 dd1a9f1e01f8 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (9m) 21s ago 9m 523M - 19.3.0-4854-g8f219c47 589dd18248e4 407ca5abcf6e 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi154 *:8443,8765 running (7m) 29s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 348398aa5980 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi177 *:8443,8765 running (7m) 29s ago 7m 455M - 19.3.0-4854-g8f219c47 589dd18248e4 a962b256e70a 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (9m) 21s ago 9m 50.9M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45da16428b40 2024-09-10T23:23:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi154 running (8m) 29s ago 8m 40.3M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 00dca4eb2b75 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi177 running (8m) 29s ago 8m 43.5M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 0801e2e66186 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 21s ago 7m 54.9M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 bd3fb658aace 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi154 running (6m) 29s ago 6m 47.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 b2aa78075ab9 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi177 running (6m) 29s ago 6m 46.4M 4271M 19.3.0-4854-g8f219c47 589dd18248e4 ebf136e06b0f 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (5m) 21s ago 5m 54.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 6128452c1f1d 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi154 running (5m) 29s ago 5m 54.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 f2a085c72aff 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi177 running (5m) 29s ago 5m 54.6M 4271M 19.3.0-4854-g8f219c47 589dd18248e4 4a05e5cded2e 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (4m) 21s ago 4m 42.3M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 ddcb3b6006d3 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi154 running (4m) 29s ago 4m 55.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0fd1461d78d7 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi177 running (3m) 29s ago 3m 43.6M 4271M 19.3.0-4854-g8f219c47 589dd18248e4 e9b4bba151f4 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (3m) 21s ago 3m 52.3M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 275f1440ecdd 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi154 running (2m) 29s ago 2m 54.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0c1e1cc0dce9 2024-09-10T23:23:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi177 running (2m) 29s ago 2m 41.0M 4271M 19.3.0-4854-g8f219c47 589dd18248e4 0251a18c09b3 2024-09-10T23:23:44.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffbd40b5370 msgr2=0x7ffbd40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffbd40b5370 0x7ffbd40b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009710 tx=0x7ffbdc006c90 comp rx=0 tx=0).stop 2024-09-10T23:23:44.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 msgr2=0x7ffbec19a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 0x7ffbec19a170 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400cad0 tx=0x7ffbe400cf90 comp rx=0 tx=0).stop 2024-09-10T23:23:44.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 shutdown_connections 2024-09-10T23:23:44.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffbd40b5370 0x7ffbd40b7830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec108770 0x7ffbec19a170 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbec105bc0 0x7ffbec199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 --2- 172.21.15.2:0/99930285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbec06c0c0 0x7ffbec198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 >> 172.21.15.2:0/99930285 conn(0x7ffbec0fd200 msgr2=0x7ffbec103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 shutdown_connections 2024-09-10T23:23:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:44.838+0000 7ffbf2820640 1 -- 172.21.15.2:0/99930285 wait complete. 2024-09-10T23:23:44.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:44 smithi177 ceph-mon[35760]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:45.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:44 smithi154 ceph-mon[35136]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:45.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T23:23:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:45 smithi177 ceph-mon[35760]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:45.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:45 smithi177 ceph-mon[35760]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:45.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:45 smithi002 ceph-mon[31150]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:45.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:45 smithi002 ceph-mon[31150]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:45 smithi154 ceph-mon[35136]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:45 smithi154 ceph-mon[35136]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 -- 172.21.15.2:0/2772879384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 msgr2=0x7fe08810abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/2772879384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08810abf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe080009900 tx=0x7fe08002a410 comp rx=0 tx=0).stop 2024-09-10T23:23:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 -- 172.21.15.2:0/2772879384 shutdown_connections 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/2772879384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08810abf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/2772879384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe088105b80 0x7fe088107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/2772879384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe08806b6e0 0x7fe0881055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 -- 172.21.15.2:0/2772879384 >> 172.21.15.2:0/2772879384 conn(0x7fe0880fd1e0 msgr2=0x7fe0880ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 -- 172.21.15.2:0/2772879384 shutdown_connections 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.347+0000 7fe08ce6c640 1 -- 172.21.15.2:0/2772879384 wait complete. 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 Processor -- start 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 -- start start 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe08806b6e0 0x7fe088198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe088105b80 0x7fe088199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810e700 con 0x7fe088108730 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810e580 con 0x7fe08806b6e0 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08ce6c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810e880 con 0x7fe088105b80 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08819a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59274/0 (socket says 172.21.15.2:59274) 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 -- 172.21.15.2:0/3911970747 learned_addr learned my addr 172.21.15.2:0/3911970747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe08659c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe08806b6e0 0x7fe088198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe085d9b640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe088105b80 0x7fe088199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 -- 172.21.15.2:0/3911970747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe088105b80 msgr2=0x7fe088199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe088105b80 0x7fe088199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 -- 172.21.15.2:0/3911970747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe08806b6e0 msgr2=0x7fe088198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe08806b6e0 0x7fe088198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 -- 172.21.15.2:0/3911970747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08819a8f0 con 0x7fe088108730 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe085d9b640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe088105b80 0x7fe088199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.348+0000 7fe086d9d640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08819a050 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe080005940 tx=0x7fe080004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.349+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08003f030 con 0x7fe088108730 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.349+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe080003cb0 con 0x7fe088108730 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.349+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08819ab80 con 0x7fe088108730 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.349+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080035070 con 0x7fe088108730 2024-09-10T23:23:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.349+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0881a1170 con 0x7fe088108730 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.350+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0880fecd0 con 0x7fe088108730 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.352+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fe08003bca0 con 0x7fe088108730 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.353+0000 7fe0777fe640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe0700b5370 0x7fe0700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.353+0000 7fe08659c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe0700b5370 0x7fe0700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.353+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe080106da0 con 0x7fe088108730 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.353+0000 7fe08659c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe0700b5370 0x7fe0700b7830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe07800abe0 tx=0x7fe07800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.356+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe0800cdab0 con 0x7fe088108730 2024-09-10T23:23:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.554+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fe088063590 con 0x7fe0700b5370 2024-09-10T23:23:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.560+0000 7fe0777fe640 1 -- 172.21.15.2:0/3911970747 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fe088063590 con 0x7fe0700b5370 2024-09-10T23:23:46.561 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T23:23:46.561 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 31s ago 2m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-10T23:23:46.561 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 31s ago 7m smithi002=x;smithi154=y;smithi177=z;count:3 2024-09-10T23:23:46.561 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 31s ago 8m smithi002:172.21.15.2=a;smithi154:172.21.15.154=b;smithi177:172.21.15.177=c;count:3 2024-09-10T23:23:46.561 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 31s ago - 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe0700b5370 msgr2=0x7fe0700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe0700b5370 0x7fe0700b7830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe07800abe0 tx=0x7fe07800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 msgr2=0x7fe08819a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08819a050 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe080005940 tx=0x7fe080004430 comp rx=0 tx=0).stop 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 shutdown_connections 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe0700b5370 0x7fe0700b7830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088108730 0x7fe08819a050 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe088105b80 0x7fe088199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 --2- 172.21.15.2:0/3911970747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe08806b6e0 0x7fe088198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 >> 172.21.15.2:0/3911970747 conn(0x7fe0880fd1e0 msgr2=0x7fe088103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 shutdown_connections 2024-09-10T23:23:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:46.562+0000 7fe08ce6c640 1 -- 172.21.15.2:0/3911970747 wait complete. 2024-09-10T23:23:47.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T23:23:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:47.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:47 smithi002 ceph-mon[31150]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:47.902 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:47 smithi002 ceph-mon[31150]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:47.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:47 smithi177 ceph-mon[35760]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:47.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:47 smithi177 ceph-mon[35760]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 -- 172.21.15.2:0/2738105815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 msgr2=0x7f4698104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 --2- 172.21.15.2:0/2738105815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698104020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f468c009930 tx=0x7f468c02a420 comp rx=0 tx=0).stop 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 -- 172.21.15.2:0/2738105815 shutdown_connections 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 --2- 172.21.15.2:0/2738105815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4698104560 0x7f469810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 --2- 172.21.15.2:0/2738105815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698104020 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 --2- 172.21.15.2:0/2738105815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4698102a40 0x7f4698102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 -- 172.21.15.2:0/2738105815 >> 172.21.15.2:0/2738105815 conn(0x7f46980fe2f0 msgr2=0x7f4698100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 -- 172.21.15.2:0/2738105815 shutdown_connections 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.985+0000 7f469ca45640 1 -- 172.21.15.2:0/2738105815 wait complete. 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 Processor -- start 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 -- start start 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4698102a40 0x7f4698198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4698104560 0x7f469819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f469810e6a0 con 0x7f4698103ba0 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f469810e520 con 0x7f4698102a40 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469ca45640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f469810e820 con 0x7f4698104560 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f4695d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f4695d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59290/0 (socket says 172.21.15.2:59290) 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f4695d9b640 1 -- 172.21.15.2:0/2224703724 learned_addr learned my addr 172.21.15.2:0/2224703724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f469659c640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4698102a40 0x7f4698198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.986+0000 7f4696d9d640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4698104560 0x7f469819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f4695d9b640 1 -- 172.21.15.2:0/2224703724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4698104560 msgr2=0x7f469819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f4695d9b640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4698104560 0x7f469819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f4695d9b640 1 -- 172.21.15.2:0/2224703724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4698102a40 msgr2=0x7f4698198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f4695d9b640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4698102a40 0x7f4698198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f4695d9b640 1 -- 172.21.15.2:0/2224703724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469819a920 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f4695d9b640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698199440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f468c005ab0 tx=0x7f468c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03f030 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469819abb0 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f468c003cb0 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c035070 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.987+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46981a12f0 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.988+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4698102e40 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.990+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f468c03bc20 con 0x7f4698103ba0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.990+0000 7f46877fe640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f46800b5370 0x7f46800b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.990+0000 7f469659c640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f46800b5370 0x7f46800b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.990+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f468c106980 con 0x7f4698103ba0 2024-09-10T23:23:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.991+0000 7f469659c640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f46800b5370 0x7f46800b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4688005d00 tx=0x7f468800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:47.993+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f468c0cd0a0 con 0x7f4698103ba0 2024-09-10T23:23:48.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:47 smithi154 ceph-mon[35136]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T23:23:48.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:47 smithi154 ceph-mon[35136]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.184+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f4698063590 con 0x7f46800b5370 2024-09-10T23:23:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.186+0000 7f46877fe640 1 -- 172.21.15.2:0/2224703724 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f4698063590 con 0x7f46800b5370 2024-09-10T23:23:48.186 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-10T23:23:48.187 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-10T23:23:48.187 INFO:teuthology.orchestra.run.smithi002.stdout:smithi154 172.21.15.154 2024-09-10T23:23:48.187 INFO:teuthology.orchestra.run.smithi002.stdout:smithi177 172.21.15.177 2024-09-10T23:23:48.187 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f46800b5370 msgr2=0x7f46800b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f46800b5370 0x7f46800b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4688005d00 tx=0x7f468800b410 comp rx=0 tx=0).stop 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 msgr2=0x7f4698199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698199440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f468c005ab0 tx=0x7f468c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 shutdown_connections 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f46800b5370 0x7f46800b7830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4698104560 0x7f469819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4698103ba0 0x7f4698199440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 --2- 172.21.15.2:0/2224703724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4698102a40 0x7f4698198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 >> 172.21.15.2:0/2224703724 conn(0x7f46980fe2f0 msgr2=0x7f4698106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 shutdown_connections 2024-09-10T23:23:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:48.188+0000 7f469ca45640 1 -- 172.21.15.2:0/2224703724 wait complete. 2024-09-10T23:23:49.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T23:23:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:49.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 -- 172.21.15.2:0/3969285620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc102a40 msgr2=0x7f89cc102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 --2- 172.21.15.2:0/3969285620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc102a40 0x7f89cc102e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009930 tx=0x7f89c802a420 comp rx=0 tx=0).stop 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 -- 172.21.15.2:0/3969285620 shutdown_connections 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 --2- 172.21.15.2:0/3969285620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89cc104560 0x7f89cc10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 --2- 172.21.15.2:0/3969285620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89cc103ba0 0x7f89cc104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 --2- 172.21.15.2:0/3969285620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc102a40 0x7f89cc102e40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 -- 172.21.15.2:0/3969285620 >> 172.21.15.2:0/3969285620 conn(0x7f89cc0fe350 msgr2=0x7f89cc100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 -- 172.21.15.2:0/3969285620 shutdown_connections 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.789+0000 7f89d46bf640 1 -- 172.21.15.2:0/3969285620 wait complete. 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 Processor -- start 2024-09-10T23:23:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 -- start start 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89cc102a40 0x7f89cc198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 0x7f89cc1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89cc104560 0x7f89cc19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc10e6a0 con 0x7f89cc103ba0 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc10e520 con 0x7f89cc104560 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d46bf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc10e820 con 0x7f89cc102a40 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 0x7f89cc1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 0x7f89cc1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59310/0 (socket says 172.21.15.2:59310) 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 -- 172.21.15.2:0/966651955 learned_addr learned my addr 172.21.15.2:0/966651955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d245b640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89cc102a40 0x7f89cc198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d2c5c640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89cc104560 0x7f89cc19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 -- 172.21.15.2:0/966651955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89cc102a40 msgr2=0x7f89cc198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89cc102a40 0x7f89cc198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 -- 172.21.15.2:0/966651955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89cc104560 msgr2=0x7f89cc19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89cc104560 0x7f89cc19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.790+0000 7f89d1c5a640 1 -- 172.21.15.2:0/966651955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc19a8c0 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.791+0000 7f89d1c5a640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 0x7f89cc1993e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00c920 tx=0x7f89bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.791+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc007c70 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.791+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89bc007e10 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.791+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc19abb0 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.791+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc018820 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.791+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc1a1290 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.792+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc109dc0 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.793+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f89bc00f450 con 0x7f89cc103ba0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.794+0000 7f89c37fe640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f89b80b53f0 0x7f89b80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.794+0000 7f89d245b640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f89b80b53f0 0x7f89b80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:49.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.794+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f89bc0e5e10 con 0x7f89cc103ba0 2024-09-10T23:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.794+0000 7f89d245b640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f89b80b53f0 0x7f89b80b78b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009900 tx=0x7f89c8031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.798+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f89bc014030 con 0x7f89cc103ba0 2024-09-10T23:23:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:49 smithi002 ceph-mon[31150]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:49 smithi002 ceph-mon[31150]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.992+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f89cc063590 con 0x7f89b80b53f0 2024-09-10T23:23:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.994+0000 7f89c37fe640 1 -- 172.21.15.2:0/966651955 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f89cc063590 con 0x7f89b80b53f0 2024-09-10T23:23:49.995 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T23:23:49.995 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-10T23:23:49.995 INFO:teuthology.orchestra.run.smithi002.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T23:23:49.995 INFO:teuthology.orchestra.run.smithi002.stdout:smithi177 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233007S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T23:23:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f89b80b53f0 msgr2=0x7f89b80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f89b80b53f0 0x7f89b80b78b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009900 tx=0x7f89c8031430 comp rx=0 tx=0).stop 2024-09-10T23:23:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 msgr2=0x7f89cc1993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 0x7f89cc1993e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00c920 tx=0x7f89bc00cde0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 shutdown_connections 2024-09-10T23:23:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f89b80b53f0 0x7f89b80b78b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89cc104560 0x7f89cc19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89cc103ba0 0x7f89cc1993e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 --2- 172.21.15.2:0/966651955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89cc102a40 0x7f89cc198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.996+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 >> 172.21.15.2:0/966651955 conn(0x7f89cc0fe350 msgr2=0x7f89cc106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.997+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 shutdown_connections 2024-09-10T23:23:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:49.997+0000 7f89d46bf640 1 -- 172.21.15.2:0/966651955 wait complete. 2024-09-10T23:23:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:49 smithi177 ceph-mon[35760]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:49 smithi177 ceph-mon[35760]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:50.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:49 smithi154 ceph-mon[35136]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:49 smithi154 ceph-mon[35136]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:50.698 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:23:50.707 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:23:50.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T23:23:50.965 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:50.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:50 smithi002 ceph-mon[31150]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:51.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:50 smithi177 ceph-mon[35760]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:51.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:50 smithi154 ceph-mon[35136]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 -- 172.21.15.2:0/2133472622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4103ba0 msgr2=0x7f8cd4104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/2133472622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4104020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009930 tx=0x7f8cbc02a420 comp rx=0 tx=0).stop 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 -- 172.21.15.2:0/2133472622 shutdown_connections 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/2133472622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 0x7f8cd410aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/2133472622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4104020 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/2133472622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4102a40 0x7f8cd4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.459+0000 7f8cda9d2640 1 -- 172.21.15.2:0/2133472622 >> 172.21.15.2:0/2133472622 conn(0x7f8cd40fe2f0 msgr2=0x7f8cd4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 -- 172.21.15.2:0/2133472622 shutdown_connections 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 -- 172.21.15.2:0/2133472622 wait complete. 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 Processor -- start 2024-09-10T23:23:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 -- start start 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 0x7f8cd4076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 0x7f8cd4075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd410e6a0 con 0x7f8cd4102a40 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd410e520 con 0x7f8cd4103ba0 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cda9d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd410e820 con 0x7f8cd4104560 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cd3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 0x7f8cd4076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cd3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 0x7f8cd4076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39610/0 (socket says 172.21.15.2:39610) 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.460+0000 7f8cd3fff640 1 -- 172.21.15.2:0/3594407383 learned_addr learned my addr 172.21.15.2:0/3594407383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd8f6f640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 0x7f8cd4075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8ccbfff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd3fff640 1 -- 172.21.15.2:0/3594407383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 msgr2=0x7f8cd4075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd3fff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 0x7f8cd4075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd3fff640 1 -- 172.21.15.2:0/3594407383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4103ba0 msgr2=0x7f8cd4075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd3fff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd3fff640 1 -- 172.21.15.2:0/3594407383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd4076340 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8ccbfff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd8f6f640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 0x7f8cd4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd3fff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 0x7f8cd4076cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c890 tx=0x7f8cc400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4004220 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd41a2e70 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cc40043c0 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4004a00 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.461+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41a32c0 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.462+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd4109d60 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.463+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f8cc40079b0 con 0x7f8cd4102a40 2024-09-10T23:23:51.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.464+0000 7f8cd1ffb640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8cc00b5370 0x7f8cc00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.464+0000 7f8ccbfff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8cc00b5370 0x7f8cc00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.464+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8cc40e5be0 con 0x7f8cd4102a40 2024-09-10T23:23:51.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.465+0000 7f8ccbfff640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8cc00b5370 0x7f8cc00b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0096c0 tx=0x7f8cbc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:51.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.468+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8cc4014030 con 0x7f8cd4102a40 2024-09-10T23:23:51.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.692+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8cd402e850 con 0x7f8cd4102a40 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.693+0000 7f8cd1ffb640 1 -- 172.21.15.2:0/3594407383 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3122 (secure 0 0 0) 0x7f8cc40ac8f0 con 0x7f8cd4102a40 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:e27 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-10T23:22:28:431609+0000 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-10T23:23:51.694 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 27 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-10T23:22:17.001408+0000 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-10T23:22:28.431589+0000 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-10T23:23:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 5 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1,2,3,4 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24568,1=24563,2=24547,3=24541,4=24536} 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-10T23:23:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24568 members: 24568,24563,24547,24541,24536 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{0:24568} state up:active seq 6 addr [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{0:24508} state up:standby-replay seq 1 addr [v2:172.21.15.177:6832/4014999302,v1:172.21.15.177:6833/4014999302] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{1:24563} state up:active seq 6 addr [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{1:24506} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/157862185,v1:172.21.15.154:6835/157862185] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{2:24547} state up:active seq 10 addr [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{2:24488} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/940548947,v1:172.21.15.154:6833/940548947] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{3:24541} state up:active seq 11 addr [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{3:14718} state up:standby-replay seq 1 addr [v2:172.21.15.2:6840/2991165185,v1:172.21.15.2:6841/2991165185] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{4:24536} state up:active seq 9 addr [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{4:14712} state up:standby-replay seq 1 addr [v2:172.21.15.2:6838/1174009300,v1:172.21.15.2:6839/1174009300] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:51.697 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:51.698 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-10T23:23:51.698 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:51.698 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14652} state up:standby seq 1 addr [v2:172.21.15.2:6834/348830467,v1:172.21.15.2:6835/348830467] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.698 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14664} state up:standby seq 1 addr [v2:172.21.15.2:6836/366884472,v1:172.21.15.2:6837/366884472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8cc00b5370 msgr2=0x7f8cc00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8cc00b5370 0x7f8cc00b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0096c0 tx=0x7f8cbc000bc0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 msgr2=0x7f8cd4076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 0x7f8cd4076cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c890 tx=0x7f8cc400cd50 comp rx=0 tx=0).stop 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 shutdown_connections 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8cc00b5370 0x7f8cc00b7830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd4104560 0x7f8cd4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd4103ba0 0x7f8cd4075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 --2- 172.21.15.2:0/3594407383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd4102a40 0x7f8cd4076cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 >> 172.21.15.2:0/3594407383 conn(0x7f8cd40fe2f0 msgr2=0x7f8cd4106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 shutdown_connections 2024-09-10T23:23:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:51.696+0000 7f8cda9d2640 1 -- 172.21.15.2:0/3594407383 wait complete. 2024-09-10T23:23:51.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:51 smithi002 ceph-mon[31150]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:51.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:51 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3594407383' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:23:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:51 smithi177 ceph-mon[35760]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:51 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3594407383' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:23:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:51 smithi154 ceph-mon[35136]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:23:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:51 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3594407383' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:23:52.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T23:23:52.850 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 -- 172.21.15.2:0/1311738374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354103460 msgr2=0x7fa354109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 --2- 172.21.15.2:0/1311738374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354103460 0x7fa354109de0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009cd0 tx=0x7fa34c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 -- 172.21.15.2:0/1311738374 shutdown_connections 2024-09-10T23:23:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 --2- 172.21.15.2:0/1311738374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354103460 0x7fa354109de0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 --2- 172.21.15.2:0/1311738374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354102aa0 0x7fa354102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 --2- 172.21.15.2:0/1311738374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354101940 0x7fa354101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 -- 172.21.15.2:0/1311738374 >> 172.21.15.2:0/1311738374 conn(0x7fa3540fd210 msgr2=0x7fa3540ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 -- 172.21.15.2:0/1311738374 shutdown_connections 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 -- 172.21.15.2:0/1311738374 wait complete. 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 Processor -- start 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.334+0000 7fa35b082640 1 -- start start 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 0x7fa354105700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354102aa0 0x7fa354103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354103460 0x7fa3541044b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa35410d620 con 0x7fa354101940 2024-09-10T23:23:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa35410d4a0 con 0x7fa354102aa0 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa35410d7a0 con 0x7fa354103460 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 0x7fa354105700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 0x7fa354105700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39628/0 (socket says 172.21.15.2:39628) 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 -- 172.21.15.2:0/404214550 learned_addr learned my addr 172.21.15.2:0/404214550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa34bfff640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354102aa0 0x7fa354103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35961f640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354103460 0x7fa3541044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 -- 172.21.15.2:0/404214550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354103460 msgr2=0x7fa3541044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354103460 0x7fa3541044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 -- 172.21.15.2:0/404214550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354102aa0 msgr2=0x7fa354103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354102aa0 0x7fa354103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 -- 172.21.15.2:0/404214550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa354104d70 con 0x7fa354101940 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35961f640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354103460 0x7fa3541044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa34bfff640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354102aa0 0x7fa354103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa358e1e640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 0x7fa354105700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa35000b4a0 tx=0x7fa35000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350014070 con 0x7fa354101940 2024-09-10T23:23:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa350010ac0 con 0x7fa354101940 2024-09-10T23:23:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350017c30 con 0x7fa354101940 2024-09-10T23:23:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.335+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3541a2f90 con 0x7fa354101940 2024-09-10T23:23:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.336+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3541a3470 con 0x7fa354101940 2024-09-10T23:23:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.337+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3541a3700 con 0x7fa354101940 2024-09-10T23:23:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.338+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa350010610 con 0x7fa354101940 2024-09-10T23:23:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.339+0000 7fa349ffb640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa33c0b5360 0x7fa33c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.339+0000 7fa34bfff640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa33c0b5360 0x7fa33c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.339+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa3500e5500 con 0x7fa354101940 2024-09-10T23:23:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.339+0000 7fa34bfff640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa33c0b5360 0x7fa33c0b7820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa34400abe0 tx=0x7fa34400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.343+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa3500ac370 con 0x7fa354101940 2024-09-10T23:23:53.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.532+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa3541a3a60 con 0x7fa354101940 2024-09-10T23:23:53.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.533+0000 7fa349ffb640 1 -- 172.21.15.2:0/404214550 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5267 (secure 0 0 0) 0x7fa3500abc70 con 0x7fa354101940 2024-09-10T23:23:53.533 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 77 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-10T23:14:03.975095+0000 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-10T23:22:51.479951+0000 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 26 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-09-10T23:23:53.534 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-09-10T23:23:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T23:23:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T23:23:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T23:23:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-09-10T23:23:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/3071495420,v1:172.21.15.2:6803/3071495420] [v2:172.21.15.2:6804/3071495420,v1:172.21.15.2:6805/3071495420] exists,up 519e53ed-0182-44f2-bf22-cf88e408fcd1 2024-09-10T23:23:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 13 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/773951399,v1:172.21.15.154:6801/773951399] [v2:172.21.15.154:6802/773951399,v1:172.21.15.154:6803/773951399] exists,up d3a75885-bb7f-436b-999f-33d290e0c742 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 18 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6800/3512583930,v1:172.21.15.177:6801/3512583930] [v2:172.21.15.177:6802/3512583930,v1:172.21.15.177:6803/3512583930] exists,up 0cb0306d-145f-4ca5-a4aa-cb66fa3648f2 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/2995211952,v1:172.21.15.2:6811/2995211952] [v2:172.21.15.2:6812/2995211952,v1:172.21.15.2:6813/2995211952] exists,up 3d4bc460-5421-4710-9aca-415a54129b1f 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/3616268167,v1:172.21.15.154:6809/3616268167] [v2:172.21.15.154:6810/3616268167,v1:172.21.15.154:6811/3616268167] exists,up 97973d11-680e-43c6-81ee-5a2cbfc57bf5 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 36 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6808/1630560150,v1:172.21.15.177:6809/1630560150] [v2:172.21.15.177:6810/1630560150,v1:172.21.15.177:6811/1630560150] exists,up 7cf7fb9f-277c-41b2-8522-d629c87d02ac 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 42 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/2336103544,v1:172.21.15.2:6819/2336103544] [v2:172.21.15.2:6820/2336103544,v1:172.21.15.2:6821/2336103544] exists,up 843cbdb2-0356-4d03-bd97-472b65618974 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 47 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/2645883120,v1:172.21.15.154:6817/2645883120] [v2:172.21.15.154:6818/2645883120,v1:172.21.15.154:6819/2645883120] exists,up 4429311c-fcfa-4d52-b1bf-627c2d65bc97 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 53 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6816/2637144478,v1:172.21.15.177:6817/2637144478] [v2:172.21.15.177:6818/2637144478,v1:172.21.15.177:6819/2637144478] exists,up 23e4001a-571b-4bf0-a4d9-04e1a2589298 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 59 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/3955910854,v1:172.21.15.2:6827/3955910854] [v2:172.21.15.2:6828/3955910854,v1:172.21.15.2:6829/3955910854] exists,up 9ac4ba62-a52e-4008-b126-e8a29957fcf5 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 64 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/2294019881,v1:172.21.15.154:6825/2294019881] [v2:172.21.15.154:6826/2294019881,v1:172.21.15.154:6827/2294019881] exists,up 2258f977-145d-4b91-b6f7-ace80b9a09e5 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6824/3355252458,v1:172.21.15.177:6825/3355252458] [v2:172.21.15.177:6826/3355252458,v1:172.21.15.177:6827/3355252458] exists,up 8f03df9f-bd81-43d7-aae6-63e3630ab331 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.5 [8,11] 2024-09-10T23:23:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1b [2,4] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1d [2,1] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.2 [3,9,5,8] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.14 [4,6] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.24 [4,9] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.2c [4,9] 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/3734475991 expires 2024-09-11T23:14:50.129191+0000 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/3734475991 expires 2024-09-11T23:14:50.129191+0000 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3292855559 expires 2024-09-11T23:14:50.129191+0000 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3314421959 expires 2024-09-11T23:14:25.416951+0000 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2291894232 expires 2024-09-11T23:14:25.416951+0000 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/823401111 expires 2024-09-11T23:14:25.416951+0000 2024-09-10T23:23:53.537 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1827148024 expires 2024-09-11T23:14:50.129191+0000 2024-09-10T23:23:53.538 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/958693037 expires 2024-09-11T23:14:50.129191+0000 2024-09-10T23:23:53.538 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/823401111 expires 2024-09-11T23:14:25.416951+0000 2024-09-10T23:23:53.538 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/672005157 expires 2024-09-11T23:14:25.416951+0000 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa33c0b5360 msgr2=0x7fa33c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa33c0b5360 0x7fa33c0b7820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa34400abe0 tx=0x7fa34400a5c0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 msgr2=0x7fa354105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 0x7fa354105700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa35000b4a0 tx=0x7fa35000b960 comp rx=0 tx=0).stop 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 shutdown_connections 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa33c0b5360 0x7fa33c0b7820 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa354103460 0x7fa3541044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa354102aa0 0x7fa354103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 --2- 172.21.15.2:0/404214550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa354101940 0x7fa354105700 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 >> 172.21.15.2:0/404214550 conn(0x7fa3540fd210 msgr2=0x7fa3540fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:53.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 shutdown_connections 2024-09-10T23:23:53.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:53.536+0000 7fa35b082640 1 -- 172.21.15.2:0/404214550 wait complete. 2024-09-10T23:23:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:53 smithi177 ceph-mon[35760]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-10T23:23:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:53 smithi177 ceph-mon[35760]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T23:23:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:53 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/404214550' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:23:54.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:53 smithi002 ceph-mon[31150]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-10T23:23:54.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:53 smithi002 ceph-mon[31150]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T23:23:54.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:53 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/404214550' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:23:54.245 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T23:23:54.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:53 smithi154 ceph-mon[35136]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-10T23:23:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:53 smithi154 ceph-mon[35136]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T23:23:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:53 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/404214550' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:23:54.517 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/2471284211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4810d140 msgr2=0x7f9f4810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/2471284211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4810d140 0x7f9f4810f5a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009ca0 tx=0x7f9f4002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/2471284211 shutdown_connections 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/2471284211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4810d140 0x7f9f4810f5a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/2471284211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f48104600 0x7f9f4810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/2471284211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f48103ce0 0x7f9f481040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/2471284211 >> 172.21.15.2:0/2471284211 conn(0x7f9f480fd700 msgr2=0x7f9f480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/2471284211 shutdown_connections 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.975+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/2471284211 wait complete. 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 Processor -- start 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 -- start start 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f48103ce0 0x7f9f48101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 0x7f9f48101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f4810d140 0x7f9f48102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48112df0 con 0x7f9f48104600 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48112c70 con 0x7f9f48103ce0 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4eaf1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48112f70 con 0x7f9f4810d140 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 0x7f9f48101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 0x7f9f48101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39636/0 (socket says 172.21.15.2:39636) 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f47fff640 1 -- 172.21.15.2:0/3147635911 learned_addr learned my addr 172.21.15.2:0/3147635911 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4d08e640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f4810d140 0x7f9f48102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f47fff640 1 -- 172.21.15.2:0/3147635911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f4810d140 msgr2=0x7f9f48102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f47fff640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f4810d140 0x7f9f48102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f47fff640 1 -- 172.21.15.2:0/3147635911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f48103ce0 msgr2=0x7f9f48101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.976+0000 7f9f4c88d640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f48103ce0 0x7f9f48101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f47fff640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f48103ce0 0x7f9f48101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f47fff640 1 -- 172.21.15.2:0/3147635911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f481a76e0 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f4d08e640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f4810d140 0x7f9f48102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f47fff640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 0x7f9f48101ed0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c970 tx=0x7f9f3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34007bb0 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f34007d50 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f481a79d0 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400f7b0 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.977+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f481a7f60 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.978+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f481040c0 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.979+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9f34018480 con 0x7f9f48104600 2024-09-10T23:23:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.980+0000 7f9f45ffb640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f380b5360 0x7f9f380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.980+0000 7f9f4c88d640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f380b5360 0x7f9f380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.980+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9f340e5e90 con 0x7f9f48104600 2024-09-10T23:23:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.981+0000 7f9f4c88d640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f380b5360 0x7f9f380b7820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00a810 tx=0x7f9f3c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:54.984+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9f340acdf0 con 0x7f9f48104600 2024-09-10T23:23:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.206+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f48102c90 con 0x7f9f48104600 2024-09-10T23:23:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.207+0000 7f9f45ffb640 1 -- 172.21.15.2:0/3147635911 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11964 (secure 0 0 0) 0x7f9f340ac6f0 con 0x7f9f48104600 2024-09-10T23:23:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:55.208 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-10T23:22:28:431609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:22:28.431589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24568,24563,24547,24541,24536]},"id":1}]} 2024-09-10T23:23:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:23:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.209+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f380b5360 msgr2=0x7f9f380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.209+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f380b5360 0x7f9f380b7820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00a810 tx=0x7f9f3c008040 comp rx=0 tx=0).stop 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.209+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 msgr2=0x7f9f48101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.209+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 0x7f9f48101ed0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c970 tx=0x7f9f3400ce30 comp rx=0 tx=0).stop 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 shutdown_connections 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f380b5360 0x7f9f380b7820 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f4810d140 0x7f9f48102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f48104600 0x7f9f48101ed0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 --2- 172.21.15.2:0/3147635911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f48103ce0 0x7f9f48101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 >> 172.21.15.2:0/3147635911 conn(0x7f9f480fd700 msgr2=0x7f9f4810f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 shutdown_connections 2024-09-10T23:23:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:55.210+0000 7f9f4eaf1640 1 -- 172.21.15.2:0/3147635911 wait complete. 2024-09-10T23:23:55.920 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:55 smithi002 ceph-mon[31150]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:23:55.920 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:55 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3147635911' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:55.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:56.183 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:55 smithi177 ceph-mon[35760]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:23:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:55 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3147635911' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:56.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:55 smithi154 ceph-mon[35136]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:23:56.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:55 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3147635911' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 -- 172.21.15.2:0/769668594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf4103ca0 msgr2=0x7febf4104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 --2- 172.21.15.2:0/769668594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf4103ca0 0x7febf4104080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7febe4009900 tx=0x7febe402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 -- 172.21.15.2:0/769668594 shutdown_connections 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 --2- 172.21.15.2:0/769668594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf410d100 0x7febf410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 --2- 172.21.15.2:0/769668594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 0x7febf410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 --2- 172.21.15.2:0/769668594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf4103ca0 0x7febf4104080 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 -- 172.21.15.2:0/769668594 >> 172.21.15.2:0/769668594 conn(0x7febf40fd700 msgr2=0x7febf40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 -- 172.21.15.2:0/769668594 shutdown_connections 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.689+0000 7febf9ecc640 1 -- 172.21.15.2:0/769668594 wait complete. 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 Processor -- start 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 -- start start 2024-09-10T23:23:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf4103ca0 0x7febf4199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 0x7febf4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 0x7febf419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febf4112db0 con 0x7febf410d100 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febf4112c30 con 0x7febf41045c0 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf9ecc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febf4112f30 con 0x7febf4103ca0 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 0x7febf419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.690+0000 7febf3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 0x7febf419eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39658/0 (socket says 172.21.15.2:39658) 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 -- 172.21.15.2:0/803789617 learned_addr learned my addr 172.21.15.2:0/803789617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf2ffd640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 0x7febf4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 -- 172.21.15.2:0/803789617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf4103ca0 msgr2=0x7febf4199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf37fe640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf4103ca0 0x7febf4199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf4103ca0 0x7febf4199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 -- 172.21.15.2:0/803789617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 msgr2=0x7febf4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 0x7febf4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 -- 172.21.15.2:0/803789617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf419f2d0 con 0x7febf410d100 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf2ffd640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 0x7febf4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf3fff640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 0x7febf419eb00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7febec00b970 tx=0x7febec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec019070 con 0x7febf410d100 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec014440 con 0x7febf410d100 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf419f5c0 con 0x7febf410d100 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec0075d0 con 0x7febf410d100 2024-09-10T23:23:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.691+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf41a5d00 con 0x7febf410d100 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.692+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf4104080 con 0x7febf410d100 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.693+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7febec00cb40 con 0x7febf410d100 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.694+0000 7febf0ff9640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febdc0b52e0 0x7febdc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.694+0000 7febf37fe640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febdc0b52e0 0x7febdc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.694+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febec0e5450 con 0x7febf410d100 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.695+0000 7febf37fe640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febdc0b52e0 0x7febdc0b77a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7febe4006010 tx=0x7febe4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.698+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7febec0ac2c0 con 0x7febf410d100 2024-09-10T23:23:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.921+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febf41a6050 con 0x7febf410d100 2024-09-10T23:23:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.922+0000 7febf0ff9640 1 -- 172.21.15.2:0/803789617 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11964 (secure 0 0 0) 0x7febec0abbc0 con 0x7febf410d100 2024-09-10T23:23:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:56.923 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-10T23:22:28:431609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:22:28.431589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24568,24563,24547,24541,24536]},"id":1}]} 2024-09-10T23:23:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febdc0b52e0 msgr2=0x7febdc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febdc0b52e0 0x7febdc0b77a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7febe4006010 tx=0x7febe4000bc0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 msgr2=0x7febf419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 0x7febf419eb00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7febec00b970 tx=0x7febec00be30 comp rx=0 tx=0).stop 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 shutdown_connections 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febdc0b52e0 0x7febdc0b77a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf410d100 0x7febf419eb00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf41045c0 0x7febf4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 --2- 172.21.15.2:0/803789617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febf4103ca0 0x7febf4199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.924+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 >> 172.21.15.2:0/803789617 conn(0x7febf40fd700 msgr2=0x7febf410f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.925+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 shutdown_connections 2024-09-10T23:23:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:56.925+0000 7febf9ecc640 1 -- 172.21.15.2:0/803789617 wait complete. 2024-09-10T23:23:57.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:23:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:58.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:57 smithi002 ceph-mon[31150]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T23:23:58.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:57 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/803789617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:57 smithi177 ceph-mon[35760]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T23:23:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:57 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/803789617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:58.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:57 smithi154 ceph-mon[35136]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T23:23:58.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:57 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/803789617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 -- 172.21.15.2:0/1645260372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c108060 msgr2=0x7faa2c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 --2- 172.21.15.2:0/1645260372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c108060 0x7faa2c10e860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faa24009ca0 tx=0x7faa2402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 -- 172.21.15.2:0/1645260372 shutdown_connections 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 --2- 172.21.15.2:0/1645260372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c108060 0x7faa2c10e860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 --2- 172.21.15.2:0/1645260372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2c1076e0 0x7faa2c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 --2- 172.21.15.2:0/1645260372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa2c101cd0 0x7faa2c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 -- 172.21.15.2:0/1645260372 >> 172.21.15.2:0/1645260372 conn(0x7faa2c0fd700 msgr2=0x7faa2c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 -- 172.21.15.2:0/1645260372 shutdown_connections 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.327+0000 7faa3184b640 1 -- 172.21.15.2:0/1645260372 wait complete. 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 Processor -- start 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 -- start start 2024-09-10T23:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 0x7faa2c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2c1076e0 0x7faa2c10f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa2c108060 0x7faa2c10fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c112e40 con 0x7faa2c101cd0 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c112cc0 con 0x7faa2c1076e0 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa3184b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c112fc0 con 0x7faa2c108060 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 0x7faa2c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 0x7faa2c10f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39680/0 (socket says 172.21.15.2:39680) 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 -- 172.21.15.2:0/2604820921 learned_addr learned my addr 172.21.15.2:0/2604820921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa23fff640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2c1076e0 0x7faa2c10f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2b7fe640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa2c108060 0x7faa2c10fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 -- 172.21.15.2:0/2604820921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa2c108060 msgr2=0x7faa2c10fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa2c108060 0x7faa2c10fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 -- 172.21.15.2:0/2604820921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2c1076e0 msgr2=0x7faa2c10f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2c1076e0 0x7faa2c10f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.328+0000 7faa2affd640 1 -- 172.21.15.2:0/2604820921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c1a7630 con 0x7faa2c101cd0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.329+0000 7faa2affd640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 0x7faa2c10f370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00d950 tx=0x7faa1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.329+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c017070 con 0x7faa2c101cd0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.329+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa1c009c30 con 0x7faa2c101cd0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.329+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c1a7920 con 0x7faa2c101cd0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.329+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00f620 con 0x7faa2c101cd0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.329+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c1a7eb0 con 0x7faa2c101cd0 2024-09-10T23:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.330+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2c1020b0 con 0x7faa2c101cd0 2024-09-10T23:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.331+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faa1c010460 con 0x7faa2c101cd0 2024-09-10T23:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.332+0000 7faa30849640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa180b5360 0x7faa180b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.332+0000 7faa23fff640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa180b5360 0x7faa180b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.332+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa1c0e56e0 con 0x7faa2c101cd0 2024-09-10T23:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.332+0000 7faa23fff640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa180b5360 0x7faa180b7820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa2c110e60 tx=0x7faa1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.336+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faa1c009de0 con 0x7faa2c101cd0 2024-09-10T23:23:58.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.522+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa2c110670 con 0x7faa2c101cd0 2024-09-10T23:23:58.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.523+0000 7faa30849640 1 -- 172.21.15.2:0/2604820921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7faa1c0abf60 con 0x7faa2c101cd0 2024-09-10T23:23:58.524 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:23:58.525 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:23:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa180b5360 msgr2=0x7faa180b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa180b5360 0x7faa180b7820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa2c110e60 tx=0x7faa1400b390 comp rx=0 tx=0).stop 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 msgr2=0x7faa2c10f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 0x7faa2c10f370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00d950 tx=0x7faa1c00de10 comp rx=0 tx=0).stop 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 shutdown_connections 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa180b5360 0x7faa180b7820 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.525+0000 7faa3184b640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa2c108060 0x7faa2c10fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.526+0000 7faa3184b640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2c1076e0 0x7faa2c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.526+0000 7faa3184b640 1 --2- 172.21.15.2:0/2604820921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa2c101cd0 0x7faa2c10f370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.526+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 >> 172.21.15.2:0/2604820921 conn(0x7faa2c0fd700 msgr2=0x7faa2c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.526+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 shutdown_connections 2024-09-10T23:23:58.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:23:58.526+0000 7faa3184b640 1 -- 172.21.15.2:0/2604820921 wait complete. 2024-09-10T23:23:59.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:58 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2604820921' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:23:59.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:58 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2604820921' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:23:59.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:58 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2604820921' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:23:59.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:22:17.001408+0000', 'modified': '2024-09-10T23:22:28.431589+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24568, 'mds_1': 24563, 'mds_2': 24547, 'mds_3': 24541, 'mds_4': 24536}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14712': {'gid': 14712, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.2:6839/1174009300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6838', 'nonce': 1174009300}, {'type': 'v1', 'addr': '172.21.15.2:6839', 'nonce': 1174009300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14718': {'gid': 14718, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.2:6841/2991165185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6840', 'nonce': 2991165185}, {'type': 'v1', 'addr': '172.21.15.2:6841', 'nonce': 2991165185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/940548947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 940548947}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 940548947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/157862185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 157862185}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 157862185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6833/4014999302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6832', 'nonce': 4014999302}, {'type': 'v1', 'addr': '172.21.15.177:6833', 'nonce': 4014999302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24536': {'gid': 24536, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6837/4148932474', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 4148932474}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 4148932474}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24541': {'gid': 24541, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.177:6835/2192031560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 2192031560}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 2192031560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24547': {'gid': 24547, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.177:6837/4092191728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 4092191728}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 4092191728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.154:6839/3482947796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3482947796}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3482947796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.177:6839/2078594456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 2078594456}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 2078594456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24568, 'qdb_cluster': [24568, 24563, 24547, 24541, 24536]} 2024-09-10T23:23:59.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T23:23:59.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:23:59.544 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:59.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:23:59 smithi002 ceph-mon[31150]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 -- 172.21.15.2:0/1077426775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860102dc0 msgr2=0x7f48601031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 --2- 172.21.15.2:0/1077426775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860102dc0 0x7f48601031a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f485c009900 tx=0x7f485c02a410 comp rx=0 tx=0).stop 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 -- 172.21.15.2:0/1077426775 shutdown_connections 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 --2- 172.21.15.2:0/1077426775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4860109150 0x7f486010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 --2- 172.21.15.2:0/1077426775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 0x7f4860108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 --2- 172.21.15.2:0/1077426775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860102dc0 0x7f48601031a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 -- 172.21.15.2:0/1077426775 >> 172.21.15.2:0/1077426775 conn(0x7f48600fe830 msgr2=0x7f4860100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 -- 172.21.15.2:0/1077426775 shutdown_connections 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.069+0000 7f4868232640 1 -- 172.21.15.2:0/1077426775 wait complete. 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 Processor -- start 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 -- start start 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4860102dc0 0x7f4860199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 0x7f48601997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 0x7f486019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4860112e10 con 0x7f4860109150 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4860112c90 con 0x7f48601087d0 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4868232640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4860112f90 con 0x7f4860102dc0 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 0x7f486019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 0x7f486019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39712/0 (socket says 172.21.15.2:39712) 2024-09-10T23:24:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 -- 172.21.15.2:0/4052207294 learned_addr learned my addr 172.21.15.2:0/4052207294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f4865fce640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4860102dc0 0x7f4860199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48657cd640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 0x7f48601997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 -- 172.21.15.2:0/4052207294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4860102dc0 msgr2=0x7f4860199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4860102dc0 0x7f4860199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 -- 172.21.15.2:0/4052207294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 msgr2=0x7f48601997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 0x7f48601997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48667cf640 1 -- 172.21.15.2:0/4052207294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486019f310 con 0x7f4860109150 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.070+0000 7f48657cd640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 0x7f48601997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.071+0000 7f48667cf640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 0x7f486019eb40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f485800cad0 tx=0x7f485800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.071+0000 7f4852ffd640 1 -- 172.21.15.2:0/4052207294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485800ae20 con 0x7f4860109150 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.071+0000 7f4852ffd640 1 -- 172.21.15.2:0/4052207294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4858005020 con 0x7f4860109150 2024-09-10T23:24:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.071+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486019f600 con 0x7f4860109150 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.071+0000 7f4852ffd640 1 -- 172.21.15.2:0/4052207294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485800f6b0 con 0x7f4860109150 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.071+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48601a5cc0 con 0x7f4860109150 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.073+0000 7f4852ffd640 1 -- 172.21.15.2:0/4052207294 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f48580054f0 con 0x7f4860109150 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.073+0000 7f486a607740 1 Processor -- start 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 -- start start 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 0x555c5f722110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f722650 0x555c5f7324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f734de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c5f699c10 con 0x555c5f721d30 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555c5f689040 con 0x555c5f7329f0 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f486a607740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555c5f68ce50 con 0x555c5f722650 2024-09-10T23:24:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 0x555c5f722110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 0x555c5f722110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39728/0 (socket says 172.21.15.2:39728) 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 -- 172.21.15.2:0/2473411849 learned_addr learned my addr 172.21.15.2:0/2473411849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f4865fce640 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f722650 0x555c5f7324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 -- 172.21.15.2:0/2473411849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f722650 msgr2=0x555c5f7324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f722650 0x555c5f7324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 -- 172.21.15.2:0/2473411849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 msgr2=0x555c5f734de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f734de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f4852ffd640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f484c0b52e0 0x7f484c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f48657cd640 1 -- 172.21.15.2:0/2473411849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c5f3e7540 con 0x555c5f721d30 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.074+0000 7f4865fce640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f484c0b52e0 0x7f484c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.075+0000 7f4852ffd640 1 -- 172.21.15.2:0/4052207294 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f48580e5bc0 con 0x7f4860109150 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.075+0000 7f48657cd640 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 0x555c5f722110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4854008d20 tx=0x7f4854010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf593ba3f989586 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.075+0000 7f484bfff640 1 -- 172.21.15.2:0/2473411849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854016070 con 0x555c5f721d30 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.075+0000 7f484bfff640 1 -- 172.21.15.2:0/2473411849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48540056d0 con 0x555c5f721d30 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.075+0000 7f484bfff640 1 -- 172.21.15.2:0/2473411849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854011850 con 0x555c5f721d30 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 -- 172.21.15.2:0/2473411849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 msgr2=0x555c5f722110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f4865fce640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f484c0b52e0 0x7f484c0b77a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f485c031440 tx=0x7f485c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 0x555c5f722110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4854008d20 tx=0x7f4854010740 comp rx=0 tx=0).stop 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 -- 172.21.15.2:0/2473411849 shutdown_connections 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f734de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f722650 0x555c5f7324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 --2- 172.21.15.2:0/2473411849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f721d30 0x555c5f722110 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 -- 172.21.15.2:0/2473411849 >> 172.21.15.2:0/2473411849 conn(0x555c5f71fb60 msgr2=0x555c5f720d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 -- 172.21.15.2:0/2473411849 shutdown_connections 2024-09-10T23:24:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 -- 172.21.15.2:0/2473411849 wait complete. 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 -- start start 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 Processor -- start 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.076+0000 7f486a607740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f722650 0x555c5f72fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 0x555c5f7303e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c5f4ea5f0 con 0x555c5f7329f0 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555c5f624010 con 0x555c5f722650 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555c5f7356a0 con 0x555c5f721d30 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 10 client.0 _ll_register_callbacks cb 0x555c5f683340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 0x555c5f7303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 0x555c5f7303e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39736/0 (socket says 172.21.15.2:39736) 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 -- 172.21.15.2:0/1756302130 learned_addr learned my addr 172.21.15.2:0/1756302130 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48657cd640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f722650 0x555c5f72fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f4865fce640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 -- 172.21.15.2:0/1756302130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 msgr2=0x555c5f72f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 -- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f722650 msgr2=0x555c5f72fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f722650 0x555c5f72fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 -- 172.21.15.2:0/1756302130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c5f651a00 con 0x555c5f7329f0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48667cf640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 0x555c5f7303e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f48580a8960 tx=0x7f48580abf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d88fe9ac412063 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48497fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48497fa640 1 -- 172.21.15.2:0/1756302130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485801d030 con 0x555c5f7329f0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48497fa640 1 -- 172.21.15.2:0/1756302130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f48580e3d90 con 0x555c5f7329f0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48540056d0 con 0x555c5f7329f0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f48497fa640 1 -- 172.21.15.2:0/1756302130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f48580b0e70 con 0x555c5f7329f0 2024-09-10T23:24:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 10 client.15231 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.077+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555c5f741200 con 0x555c5f7329f0 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f48497fa640 1 -- 172.21.15.2:0/1756302130 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48540056d0 con 0x555c5f7329f0 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f48497fa640 1 -- 172.21.15.2:0/1756302130 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f48580a7ce0 con 0x555c5f7329f0 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f486a607740 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f486a607740 10 client.15231 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f486a607740 20 client.15231 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f486a607740 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f743790 0x555c5f744c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f486a607740 4 client.15231 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c5f69bb60 con 0x555c5f743790 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.078+0000 7f4865fce640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f743790 0x555c5f744c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.079+0000 7f4865fce640 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f743790 0x555c5f744c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=781feeee9080dfe7 server_cookie=533d78d9049d55b5 in_seq=0 out_seq=0 2024-09-10T23:24:00.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.079+0000 7f48497fa640 10 client.15231 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.079+0000 7f48497fa640 1 -- 172.21.15.2:0/1756302130 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c5f69bb60 con 0x555c5f743790 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.079+0000 7f48497fa640 10 client.15231 handle_command_reply: tid=0 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.079+0000 7f486a607740 1 client.15231 shutdown 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 msgr2=0x555c5f7303e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 0x555c5f7303e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f48580a8960 tx=0x7f48580abf60 comp rx=0 tx=0).stop 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 shutdown_connections 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f743790 0x555c5f744c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f7329f0 0x555c5f7303e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f722650 0x555c5f72fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 --2- 172.21.15.2:0/1756302130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f48497fa640 0 client.15231 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 >> 172.21.15.2:0/1756302130 conn(0x555c5f71fb60 msgr2=0x555c5f71ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 shutdown_connections 2024-09-10T23:24:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 1 -- 172.21.15.2:0/1756302130 wait complete. 2024-09-10T23:24:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.080+0000 7f486a607740 20 client.15231 trim_cache size 0 max 16384 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 Processor -- start 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 -- start start 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f71f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f733a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c5f742f40 con 0x555c5f722650 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555c5f743610 con 0x555c5f7329f0 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f486a607740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555c5f743ce0 con 0x555c5f721d30 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.098+0000 7f48657cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f71f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f71f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39750/0 (socket says 172.21.15.2:39750) 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 -- 172.21.15.2:0/546362606 learned_addr learned my addr 172.21.15.2:0/546362606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f4865fce640 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 -- 172.21.15.2:0/546362606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 msgr2=0x555c5f72d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48667cf640 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f733a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 -- 172.21.15.2:0/546362606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 msgr2=0x555c5f733a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f733a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 -- 172.21.15.2:0/546362606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c5f732510 con 0x555c5f722650 2024-09-10T23:24:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f48657cd640 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f71f4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4854008d20 tx=0x7f4854008fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a7cbcfa7ce7139 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f484b7fe640 1 -- 172.21.15.2:0/546362606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854016040 con 0x555c5f722650 2024-09-10T23:24:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f484b7fe640 1 -- 172.21.15.2:0/546362606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48540115f0 con 0x555c5f722650 2024-09-10T23:24:00.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.099+0000 7f484b7fe640 1 -- 172.21.15.2:0/546362606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854004fe0 con 0x555c5f722650 2024-09-10T23:24:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 -- 172.21.15.2:0/546362606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 msgr2=0x555c5f71f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f71f4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4854008d20 tx=0x7f4854008fa0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 -- 172.21.15.2:0/546362606 shutdown_connections 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f733a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f71f4f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 --2- 172.21.15.2:0/546362606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f72d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 -- 172.21.15.2:0/546362606 >> 172.21.15.2:0/546362606 conn(0x555c5f71fb60 msgr2=0x555c5f734a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 -- 172.21.15.2:0/546362606 shutdown_connections 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 -- 172.21.15.2:0/546362606 wait complete. 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 -- start start 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.100+0000 7f486a607740 1 Processor -- start 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f724090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f7245f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f722fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c5f744a80 con 0x555c5f722650 2024-09-10T23:24:00.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555c5f7443b0 con 0x555c5f7329f0 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555c5f745150 con 0x555c5f721d30 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f486a607740 10 client.0 _ll_register_callbacks cb 0x7f48580a8a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f7245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f7245f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39752/0 (socket says 172.21.15.2:39752) 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 -- 172.21.15.2:0/303869144 learned_addr learned my addr 172.21.15.2:0/303869144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f4865fce640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f724090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48667cf640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f722fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 -- 172.21.15.2:0/303869144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 msgr2=0x555c5f724090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f724090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 -- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 msgr2=0x555c5f722fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f722fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 -- 172.21.15.2:0/303869144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c5f723800 con 0x555c5f722650 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48667cf640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f722fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:00.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48657cd640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f7245f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4854011f50 tx=0x7f4854008e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd8b43764dfe22e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.101+0000 7f48497fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f48497fa640 1 -- 172.21.15.2:0/303869144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854034060 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f48497fa640 1 -- 172.21.15.2:0/303869144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4854012680 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48540115f0 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f48497fa640 1 -- 172.21.15.2:0/303869144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4854016070 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 10 client.15237 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555c5f74cb30 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f48497fa640 1 -- 172.21.15.2:0/303869144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48540115f0 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f48497fa640 1 -- 172.21.15.2:0/303869144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f485402fa70 con 0x555c5f722650 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 10 client.15237 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 20 client.15237 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f7b5230 0x555c5f7b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 4 client.15237 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.102+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "status"}) -- 0x555c5f697610 con 0x555c5f7b5230 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f4865fce640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f7b5230 0x555c5f7b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f48497fa640 10 client.15237 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f4865fce640 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f7b5230 0x555c5f7b3f40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a5f515b6630ba3f server_cookie=1fc122910284d4c9 in_seq=0 out_seq=0 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f48497fa640 1 -- 172.21.15.2:0/303869144 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555c5f697610 con 0x555c5f7b5230 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f48497fa640 10 client.15237 handle_command_reply: tid=0 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f486a607740 1 client.15237 shutdown 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 msgr2=0x555c5f7245f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.103+0000 7f486a607740 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f7245f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4854011f50 tx=0x7f4854008e90 comp rx=0 tx=0).stop 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 shutdown_connections 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x555c5f7b5230 0x555c5f7b3f40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c5f7329f0 0x555c5f722fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c5f722650 0x555c5f7245f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 --2- 172.21.15.2:0/303869144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c5f721d30 0x555c5f724090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f48497fa640 0 client.15237 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 >> 172.21.15.2:0/303869144 conn(0x555c5f71fb60 msgr2=0x555c5f733a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 shutdown_connections 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 1 -- 172.21.15.2:0/303869144 wait complete. 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f486a607740 20 client.15237 trim_cache size 0 max 16384 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:00.110 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 4, 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24536, 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 92.682737333999995, 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:24:00.111 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 124.483491047 2024-09-10T23:24:00.112 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:00.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f484c0b52e0 msgr2=0x7f484c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f484c0b52e0 0x7f484c0b77a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f485c031440 tx=0x7f485c005e80 comp rx=0 tx=0).stop 2024-09-10T23:24:00.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 msgr2=0x7f486019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:00.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 0x7f486019eb40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f485800cad0 tx=0x7f485800cf90 comp rx=0 tx=0).stop 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 shutdown_connections 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f484c0b52e0 0x7f484c0b77a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4860109150 0x7f486019eb40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48601087d0 0x7f48601997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 --2- 172.21.15.2:0/4052207294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4860102dc0 0x7f4860199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 >> 172.21.15.2:0/4052207294 conn(0x7f48600fe830 msgr2=0x7f4860100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.104+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 shutdown_connections 2024-09-10T23:24:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:00.105+0000 7f4868232640 1 -- 172.21.15.2:0/4052207294 wait complete. 2024-09-10T23:24:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:23:59 smithi177 ceph-mon[35760]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:24:00.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:23:59 smithi154 ceph-mon[35136]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:24:00.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T23:24:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 -- 172.21.15.2:0/969973844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 msgr2=0x7f7dc810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 --2- 172.21.15.2:0/969973844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc810f950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0009ca0 tx=0x7f7dc002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 -- 172.21.15.2:0/969973844 shutdown_connections 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 --2- 172.21.15.2:0/969973844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc810f950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 --2- 172.21.15.2:0/969973844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc81087d0 0x7f7dc8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 --2- 172.21.15.2:0/969973844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc8102dc0 0x7f7dc81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 -- 172.21.15.2:0/969973844 >> 172.21.15.2:0/969973844 conn(0x7f7dc80fe830 msgr2=0x7f7dc8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 -- 172.21.15.2:0/969973844 shutdown_connections 2024-09-10T23:24:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 -- 172.21.15.2:0/969973844 wait complete. 2024-09-10T23:24:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.763+0000 7f7dcec25640 1 Processor -- start 2024-09-10T23:24:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 -- start start 2024-09-10T23:24:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc8102dc0 0x7f7dc8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc81087d0 0x7f7dc8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8112e60 con 0x7f7dc8109150 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8112ce0 con 0x7f7dc81087d0 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcec25640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8112fe0 con 0x7f7dc8102dc0 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33650/0 (socket says 172.21.15.2:33650) 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/1250469142 learned_addr learned my addr 172.21.15.2:0/1250469142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc8102dc0 0x7f7dc8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc81087d0 0x7f7dc8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/1250469142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc8102dc0 msgr2=0x7f7dc8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc8102dc0 0x7f7dc8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/1250469142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc81087d0 msgr2=0x7f7dc8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc81087d0 0x7f7dc8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.764+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/1250469142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc819f2e0 con 0x7f7dc8109150 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.765+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc819eb10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0031a20 tx=0x7f7dc0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.765+0000 7f7dc5ffb640 1 -- 172.21.15.2:0/1250469142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0003c70 con 0x7f7dc8109150 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.765+0000 7f7dc5ffb640 1 -- 172.21.15.2:0/1250469142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dc0003e10 con 0x7f7dc8109150 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.765+0000 7f7dc5ffb640 1 -- 172.21.15.2:0/1250469142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc002fcb0 con 0x7f7dc8109150 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.765+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc819f570 con 0x7f7dc8109150 2024-09-10T23:24:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.765+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc81a5d10 con 0x7f7dc8109150 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.768+0000 7f7dd0ffa740 1 Processor -- start 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.768+0000 7f7dc5ffb640 1 -- 172.21.15.2:0/1250469142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7dc0004040 con 0x7f7dc8109150 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.768+0000 7f7dd0ffa740 1 -- start start 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 0x55a69fba0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a69fb17c10 con 0x55a69fb9fd30 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a69fb07040 con 0x55a69fba0650 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a69fb0ae50 con 0x55a69fbb09f0 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 0x55a69fba0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 0x55a69fba0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33656/0 (socket says 172.21.15.2:33656) 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 -- 172.21.15.2:0/2949296969 learned_addr learned my addr 172.21.15.2:0/2949296969 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 -- 172.21.15.2:0/2949296969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fbb09f0 msgr2=0x55a69fbb2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 -- 172.21.15.2:0/2949296969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 msgr2=0x55a69fbb04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 -- 172.21.15.2:0/2949296969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69f865540 con 0x55a69fb9fd30 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 0x55a69fba0110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009ec0 tx=0x7f7db0009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1116b51f8f7730e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dc5ffb640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7db40b52e0 0x7f7db40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dbeffd640 1 -- 172.21.15.2:0/2949296969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db001c070 con 0x55a69fb9fd30 2024-09-10T23:24:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.769+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7db40b52e0 0x7f7db40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dbeffd640 1 -- 172.21.15.2:0/2949296969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7db0010040 con 0x55a69fb9fd30 2024-09-10T23:24:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dbeffd640 1 -- 172.21.15.2:0/2949296969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db00146d0 con 0x55a69fb9fd30 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dc5ffb640 1 -- 172.21.15.2:0/1250469142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7dc0107000 con 0x7f7dc8109150 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/2949296969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 msgr2=0x55a69fba0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7db40b52e0 0x7f7db40b77a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a69fba2eb0 tx=0x7f7db800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 0x55a69fba0110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009ec0 tx=0x7f7db0009420 comp rx=0 tx=0).stop 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/2949296969 shutdown_connections 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/2949296969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fb9fd30 0x55a69fba0110 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/2949296969 >> 172.21.15.2:0/2949296969 conn(0x55a69fb9db60 msgr2=0x55a69fb9ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/2949296969 shutdown_connections 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.770+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/2949296969 wait complete. 2024-09-10T23:24:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 -- start start 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 Processor -- start 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbadf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a69f9685f0 con 0x55a69fbb09f0 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a69faa2010 con 0x55a69fba0650 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbb36a0 con 0x55a69fb9fd30 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dd0ffa740 10 client.0 _ll_register_callbacks cb 0x55a69fb01340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33662/0 (socket says 172.21.15.2:33662) 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4292539094 learned_addr learned my addr 172.21.15.2:0/4292539094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.771+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbadf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 msgr2=0x55a69fbada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4292539094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 msgr2=0x55a69fbadf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbadf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4292539094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69facfa00 con 0x55a69fbb09f0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbae490 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00c9e30 tx=0x7f7dc00cd270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455d7adfe2e730da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7da7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7da7fff640 1 -- 172.21.15.2:0/4292539094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00cdf60 con 0x55a69fbb09f0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7da7fff640 1 -- 172.21.15.2:0/4292539094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7dc00c9ad0 con 0x55a69fbb09f0 2024-09-10T23:24:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7db0010040 con 0x55a69fbb09f0 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7da7fff640 1 -- 172.21.15.2:0/4292539094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7dc00cd860 con 0x55a69fbb09f0 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dd0ffa740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a69fbbf2e0 con 0x55a69fbb09f0 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7da7fff640 1 -- 172.21.15.2:0/4292539094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7db0010040 con 0x55a69fbb09f0 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.772+0000 7f7da7fff640 1 -- 172.21.15.2:0/4292539094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7dc00cdac0 con 0x55a69fbb09f0 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dd0ffa740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dd0ffa740 10 client.15249 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dd0ffa740 20 client.15249 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fbc2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dd0ffa740 4 client.15249 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a69fb19b60 con 0x55a69fbc18d0 2024-09-10T23:24:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fbc2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fbc2d40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=efcf0be844f532d4 server_cookie=e3b357c497c4a800 in_seq=0 out_seq=0 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.773+0000 7f7da7fff640 10 client.15249 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7da7fff640 1 -- 172.21.15.2:0/4292539094 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a69fb19b60 con 0x55a69fbc18d0 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7da7fff640 10 client.15249 handle_command_reply: tid=0 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 client.15249 shutdown 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 msgr2=0x55a69fbae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbae490 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00c9e30 tx=0x7f7dc00cd270 comp rx=0 tx=0).stop 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 shutdown_connections 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fbc2d40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7da7fff640 0 client.15249 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbae490 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbadf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4292539094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 >> 172.21.15.2:0/4292539094 conn(0x55a69fb9db60 msgr2=0x55a69fb9cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 shutdown_connections 2024-09-10T23:24:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.774+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4292539094 wait complete. 2024-09-10T23:24:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.775+0000 7f7dd0ffa740 20 client.15249 trim_cache size 0 max 16384 2024-09-10T23:24:01.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 Processor -- start 2024-09-10T23:24:01.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 -- start start 2024-09-10T23:24:01.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbc1080 con 0x55a69fbb09f0 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbc1750 con 0x55a69fba0650 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbc1e20 con 0x55a69fb9fd30 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33670/0 (socket says 172.21.15.2:33670) 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/3141869135 learned_addr learned my addr 172.21.15.2:0/3141869135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/3141869135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 msgr2=0x55a69fbab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/3141869135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 msgr2=0x55a69fbb1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/3141869135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69fb994f0 con 0x55a69fbb09f0 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.793+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7dc002ae80 tx=0x7f7dc00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62530f98ed28c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dbe7fc640 1 -- 172.21.15.2:0/3141869135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00cdf60 con 0x55a69fbb09f0 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dbe7fc640 1 -- 172.21.15.2:0/3141869135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dc0036030 con 0x55a69fbb09f0 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dbe7fc640 1 -- 172.21.15.2:0/3141869135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00d6b10 con 0x55a69fbb09f0 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/3141869135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 msgr2=0x55a69fbb2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7dc002ae80 tx=0x7f7dc00095c0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/3141869135 shutdown_connections 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbb2000 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbb1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/3141869135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/3141869135 >> 172.21.15.2:0/3141869135 conn(0x55a69fb9db60 msgr2=0x55a69fbc0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/3141869135 shutdown_connections 2024-09-10T23:24:01.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/3141869135 wait complete. 2024-09-10T23:24:01.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.794+0000 7f7dd0ffa740 1 -- start start 2024-09-10T23:24:01.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 Processor -- start 2024-09-10T23:24:01.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbcb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbaab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbab230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbc2bc0 con 0x55a69fbb09f0 2024-09-10T23:24:01.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbc24f0 con 0x55a69fba0650 2024-09-10T23:24:01.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a69fbc3290 con 0x55a69fb9fd30 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dd0ffa740 10 client.0 _ll_register_callbacks cb 0x7f7dc00c9790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33686/0 (socket says 172.21.15.2:33686) 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4249959224 learned_addr learned my addr 172.21.15.2:0/4249959224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbcb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 msgr2=0x55a69fbcb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbcb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4249959224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 msgr2=0x55a69fbaab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbaab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbaab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcd1c2640 1 -- 172.21.15.2:0/4249959224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69fbc73d0 con 0x55a69fbb09f0 2024-09-10T23:24:01.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbcb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.795+0000 7f7dc7fff640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbaab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dcd1c2640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbab230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00cd560 tx=0x7f7dc002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2252b0163c3ab64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7da7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7da7fff640 1 -- 172.21.15.2:0/4249959224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00cdf60 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7da7fff640 1 -- 172.21.15.2:0/4249959224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7dc00ceb90 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dc0036030 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7da7fff640 1 -- 172.21.15.2:0/4249959224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7dc00d6d60 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 10 client.15255 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a69fbc73d0 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7da7fff640 1 -- 172.21.15.2:0/4249959224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dc0036030 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7da7fff640 1 -- 172.21.15.2:0/4249959224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7dc00ccac0 con 0x55a69fbb09f0 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 10 client.15255 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 20 client.15255 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fc314a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 4 client.15255 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.796+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "status"}) -- 0x55a69fb15610 con 0x55a69fbc18d0 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fc314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7da7fff640 10 client.15255 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7dcc9c1640 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fc314a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9eda6b84b02a91ef server_cookie=af7461efc5c4e08a in_seq=0 out_seq=0 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7da7fff640 1 -- 172.21.15.2:0/4249959224 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a69fb15610 con 0x55a69fbc18d0 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7da7fff640 10 client.15255 handle_command_reply: tid=0 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7dd0ffa740 1 client.15255 shutdown 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 msgr2=0x55a69fbab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.797+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbab230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00cd560 tx=0x7f7dc002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 shutdown_connections 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55a69fbc18d0 0x55a69fc314a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7da7fff640 0 client.15255 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a69fbb09f0 0x55a69fbab230 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a69fba0650 0x55a69fbaab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 --2- 172.21.15.2:0/4249959224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a69fb9fd30 0x55a69fbcb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 >> 172.21.15.2:0/4249959224 conn(0x55a69fb9db60 msgr2=0x55a69fbb1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 shutdown_connections 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 1 -- 172.21.15.2:0/4249959224 wait complete. 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dd0ffa740 20 client.15255 trim_cache size 0 max 16384 2024-09-10T23:24:01.806 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 3, 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24541, 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 95.385720996000003, 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 131.701336279 2024-09-10T23:24:01.807 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:01.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7db40b52e0 msgr2=0x7f7db40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7db40b52e0 0x7f7db40b77a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a69fba2eb0 tx=0x7f7db800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 msgr2=0x7f7dc819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc819eb10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0031a20 tx=0x7f7dc0031a50 comp rx=0 tx=0).stop 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 shutdown_connections 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7db40b52e0 0x7f7db40b77a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc8109150 0x7f7dc819eb10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc81087d0 0x7f7dc8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.798+0000 7f7dcec25640 1 --2- 172.21.15.2:0/1250469142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc8102dc0 0x7f7dc8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.799+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 >> 172.21.15.2:0/1250469142 conn(0x7f7dc80fe830 msgr2=0x7f7dc8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.799+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 shutdown_connections 2024-09-10T23:24:01.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:01.799+0000 7f7dcec25640 1 -- 172.21.15.2:0/1250469142 wait complete. 2024-09-10T23:24:01.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:01 smithi002 ceph-mon[31150]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:24:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:01 smithi177 ceph-mon[35760]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:24:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:01 smithi154 ceph-mon[35136]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T23:24:02.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T23:24:02.867 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 -- 172.21.15.2:0/949465550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 msgr2=0x7f72bc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 --2- 172.21.15.2:0/949465550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc10e820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009ca0 tx=0x7f72b402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 -- 172.21.15.2:0/949465550 shutdown_connections 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 --2- 172.21.15.2:0/949465550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc10e820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 --2- 172.21.15.2:0/949465550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc1076a0 0x7f72bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 --2- 172.21.15.2:0/949465550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc101c90 0x7f72bc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 -- 172.21.15.2:0/949465550 >> 172.21.15.2:0/949465550 conn(0x7f72bc0fd700 msgr2=0x7f72bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 -- 172.21.15.2:0/949465550 shutdown_connections 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 -- 172.21.15.2:0/949465550 wait complete. 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.401+0000 7f72c28ee640 1 Processor -- start 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 -- start start 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc101c90 0x7f72bc1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc1076a0 0x7f72bc199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc111ce0 con 0x7f72bc108020 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc111b60 con 0x7f72bc101c90 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c28ee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc111e60 con 0x7f72bc1076a0 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc1076a0 0x7f72bc199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc1076a0 0x7f72bc199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:36288/0 (socket says 172.21.15.2:36288) 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc19eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33704/0 (socket says 172.21.15.2:33704) 2024-09-10T23:24:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72bb7fe640 1 -- 172.21.15.2:0/1189745605 learned_addr learned my addr 172.21.15.2:0/1189745605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72bbfff640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc101c90 0x7f72bc1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 -- 172.21.15.2:0/1189745605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc1076a0 msgr2=0x7f72bc199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc1076a0 0x7f72bc199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 -- 172.21.15.2:0/1189745605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc101c90 msgr2=0x7f72bc1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc101c90 0x7f72bc1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72c0e8b640 1 -- 172.21.15.2:0/1189745605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc19f370 con 0x7f72bc108020 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.402+0000 7f72bbfff640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc101c90 0x7f72bc1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.403+0000 7f72c0e8b640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc19eba0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009ca0 tx=0x7f72b40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.403+0000 7f72b97fa640 1 -- 172.21.15.2:0/1189745605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4003cf0 con 0x7f72bc108020 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.403+0000 7f72b97fa640 1 -- 172.21.15.2:0/1189745605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b40044f0 con 0x7f72bc108020 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.403+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc19f600 con 0x7f72bc108020 2024-09-10T23:24:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.403+0000 7f72b97fa640 1 -- 172.21.15.2:0/1189745605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b402fce0 con 0x7f72bc108020 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.403+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72bc1a5da0 con 0x7f72bc108020 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.405+0000 7f72b97fa640 1 -- 172.21.15.2:0/1189745605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f72b4004040 con 0x7f72bc108020 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.405+0000 7f72c4cc3740 1 Processor -- start 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 -- start start 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc2600cd30 0x55bc2600d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 0x55bc260190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc260195e0 0x55bc2601b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc25f84c10 con 0x55bc2600d650 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc25f74040 con 0x55bc2600cd30 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc25f77e50 con 0x55bc260195e0 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 0x55bc260190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72b97fa640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f72a40b5360 0x7f72a40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 0x55bc260190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33716/0 (socket says 172.21.15.2:33716) 2024-09-10T23:24:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bbfff640 1 -- 172.21.15.2:0/2820564552 learned_addr learned my addr 172.21.15.2:0/2820564552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc260195e0 0x55bc2601b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc2600cd30 0x55bc2600d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72c0e8b640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f72a40b5360 0x7f72a40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72b97fa640 1 -- 172.21.15.2:0/1189745605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f72b4106f70 con 0x7f72bc108020 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 -- 172.21.15.2:0/2820564552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc2600cd30 msgr2=0x55bc2600d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc2600cd30 0x55bc2600d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 -- 172.21.15.2:0/2820564552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 msgr2=0x55bc260190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 0x55bc260190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bb7fe640 1 -- 172.21.15.2:0/2820564552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc25cd2540 con 0x55bc260195e0 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.406+0000 7f72bbfff640 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 0x55bc260190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc260195e0 0x55bc2601b9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72b0017770 tx=0x7f72b0009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37dad1141e3e685f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72c0e8b640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f72a40b5360 0x7f72a40b7820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f72b40cd3e0 tx=0x7f72b404e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72a27fc640 1 -- 172.21.15.2:0/2820564552 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0015760 con 0x55bc260195e0 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72a27fc640 1 -- 172.21.15.2:0/2820564552 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b001d070 con 0x55bc260195e0 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72a27fc640 1 -- 172.21.15.2:0/2820564552 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0018a80 con 0x55bc260195e0 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72c4cc3740 1 -- 172.21.15.2:0/2820564552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc260195e0 msgr2=0x55bc2601b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.407+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc260195e0 0x55bc2601b9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72b0017770 tx=0x7f72b0009520 comp rx=0 tx=0).stop 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- 172.21.15.2:0/2820564552 shutdown_connections 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc260195e0 0x55bc2601b9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600d650 0x55bc260190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/2820564552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc2600cd30 0x55bc2600d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- 172.21.15.2:0/2820564552 >> 172.21.15.2:0/2820564552 conn(0x55bc2600ab60 msgr2=0x55bc2600bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- 172.21.15.2:0/2820564552 shutdown_connections 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- 172.21.15.2:0/2820564552 wait complete. 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- start start 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 Processor -- start 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc260165e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26016b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc26017060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc25dd55f0 con 0x55bc2600cd30 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc25f0f010 con 0x55bc260195e0 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.408+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc2601c230 con 0x55bc2600d650 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72c4cc3740 10 client.0 _ll_register_callbacks cb 0x55bc25f6e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26016b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26016b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:36312/0 (socket says 172.21.15.2:36312) 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bbfff640 1 -- 172.21.15.2:0/3979268731 learned_addr learned my addr 172.21.15.2:0/3979268731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc260165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 msgr2=0x55bc26016b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26016b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3979268731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 msgr2=0x55bc26017060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc26017060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3979268731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc25f3ca00 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc260165e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55bc2600cce0 tx=0x7f72b0018640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582926240a6ad36f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f729b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.409+0000 7f729b7fe640 1 -- 172.21.15.2:0/3979268731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0027070 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f729b7fe640 1 -- 172.21.15.2:0/3979268731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f72b0015760 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b001d070 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f729b7fe640 1 -- 172.21.15.2:0/3979268731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72b0033050 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc26027e50 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f729b7fe640 1 -- 172.21.15.2:0/3979268731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b001d070 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f729b7fe640 1 -- 172.21.15.2:0/3979268731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f72b00214b0 con 0x55bc2600cd30 2024-09-10T23:24:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 10 client.15267 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 20 client.15267 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2602a070 0x55bc2602b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 4 client.15267 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc25f86b60 con 0x55bc2602a070 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.410+0000 7f72bbfff640 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2602a070 0x55bc2602b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.411+0000 7f729b7fe640 10 client.15267 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.411+0000 7f72bbfff640 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2602a070 0x55bc2602b4e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23a2405e53d75d05 server_cookie=653b766b30caac03 in_seq=0 out_seq=0 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.411+0000 7f729b7fe640 1 -- 172.21.15.2:0/3979268731 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc25f86b60 con 0x55bc2602a070 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.411+0000 7f729b7fe640 10 client.15267 handle_command_reply: tid=0 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 client.15267 shutdown 2024-09-10T23:24:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 msgr2=0x55bc260165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc260165e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55bc2600cce0 tx=0x7f72b0018640 comp rx=0 tx=0).stop 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 shutdown_connections 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2602a070 0x55bc2602b4e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc26017060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26016b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f729b7fe640 0 client.15267 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3979268731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc260165e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 >> 172.21.15.2:0/3979268731 conn(0x55bc2600ab60 msgr2=0x55bc26010700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 shutdown_connections 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3979268731 wait complete. 2024-09-10T23:24:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.412+0000 7f72c4cc3740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T23:24:03.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.430+0000 7f72c4cc3740 1 Processor -- start 2024-09-10T23:24:03.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.430+0000 7f72c4cc3740 1 -- start start 2024-09-10T23:24:03.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.430+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2600bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.430+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26010d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc260137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc26029820 con 0x55bc2600cd30 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc26029ef0 con 0x55bc260195e0 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc2602a5c0 con 0x55bc2600d650 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2600bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2600bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33744/0 (socket says 172.21.15.2:33744) 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3217340364 learned_addr learned my addr 172.21.15.2:0/3217340364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc260137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bbfff640 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26010d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3217340364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 msgr2=0x55bc26010d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26010d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3217340364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 msgr2=0x55bc260137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc260137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 -- 172.21.15.2:0/3217340364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2600b5e0 con 0x55bc2600cd30 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2600bbb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f72b0021b20 tx=0x7f72b0004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3e2a58e3a8119 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72a1ffb640 1 -- 172.21.15.2:0/3217340364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0027050 con 0x55bc2600cd30 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72a1ffb640 1 -- 172.21.15.2:0/3217340364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b003c070 con 0x55bc2600cd30 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.431+0000 7f72a1ffb640 1 -- 172.21.15.2:0/3217340364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0021420 con 0x55bc2600cd30 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3217340364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 msgr2=0x55bc2600bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2600bbb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f72b0021b20 tx=0x7f72b0004640 comp rx=0 tx=0).stop 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3217340364 shutdown_connections 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc260137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc26010d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/3217340364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2600bbb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3217340364 >> 172.21.15.2:0/3217340364 conn(0x55bc2600ab60 msgr2=0x55bc26014e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3217340364 shutdown_connections 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 -- 172.21.15.2:0/3217340364 wait complete. 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.432+0000 7f72c4cc3740 1 -- start start 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 Processor -- start 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2602e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc2602e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc26033660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc2602b360 con 0x55bc2600cd30 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc2602ac90 con 0x55bc260195e0 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc2602ba30 con 0x55bc2600d650 2024-09-10T23:24:03.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72c4cc3740 10 client.0 _ll_register_callbacks cb 0x7f72ac00c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2602e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2602e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33756/0 (socket says 172.21.15.2:33756) 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 -- 172.21.15.2:0/1184196310 learned_addr learned my addr 172.21.15.2:0/1184196310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bbfff640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc2602e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 -- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 msgr2=0x55bc2602e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc2602e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 -- 172.21.15.2:0/1184196310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 msgr2=0x55bc26033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc26033660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 -- 172.21.15.2:0/1184196310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc26033da0 con 0x55bc2600cd30 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bbfff640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc2602e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:03.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f72bb7fe640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2602e090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f72b0039040 tx=0x7f72b0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bca07422a5cf6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.433+0000 7f729b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f729b7fe640 1 -- 172.21.15.2:0/1184196310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0027040 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f729b7fe640 1 -- 172.21.15.2:0/1184196310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f72b0019cb0 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b003c070 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f729b7fe640 1 -- 172.21.15.2:0/1184196310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72b0019eb0 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 10 client.15273 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc26097480 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f729b7fe640 1 -- 172.21.15.2:0/1184196310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b003c070 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f729b7fe640 1 -- 172.21.15.2:0/1184196310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f72b0015730 con 0x55bc2600cd30 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 20 client.15273 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2609bd80 0x55bc2609aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 4 client.15273 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.434+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "status"}) -- 0x55bc25f82610 con 0x55bc2609bd80 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f72bbfff640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2609bd80 0x55bc2609aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f72bbfff640 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2609bd80 0x55bc2609aa90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=769e36e13fd3039a server_cookie=c7bd51549d5b1d4c in_seq=0 out_seq=0 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f729b7fe640 10 client.15273 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f729b7fe640 1 -- 172.21.15.2:0/1184196310 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bc25f82610 con 0x55bc2609bd80 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f729b7fe640 10 client.15273 handle_command_reply: tid=0 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f72c4cc3740 1 client.15273 shutdown 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 msgr2=0x55bc2602e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.435+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2602e090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f72b0039040 tx=0x7f72b0009850 comp rx=0 tx=0).stop 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 shutdown_connections 2024-09-10T23:24:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bc2609bd80 0x55bc2609aa90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f729b7fe640 0 client.15273 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:24:03.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc260195e0 0x55bc26033660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc2600d650 0x55bc2602e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 --2- 172.21.15.2:0/1184196310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc2600cd30 0x55bc2602e090 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 >> 172.21.15.2:0/1184196310 conn(0x55bc2600ab60 msgr2=0x55bc26015280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 shutdown_connections 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 1 -- 172.21.15.2:0/1184196310 wait complete. 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c4cc3740 20 client.15273 trim_cache size 0 max 16384 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-10T23:24:03.449 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24547, 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 98.031746444999996, 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 130.59884870400001 2024-09-10T23:24:03.450 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:03.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f72a40b5360 msgr2=0x7f72a40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f72a40b5360 0x7f72a40b7820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f72b40cd3e0 tx=0x7f72b404e000 comp rx=0 tx=0).stop 2024-09-10T23:24:03.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 msgr2=0x7f72bc19eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc19eba0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009ca0 tx=0x7f72b40319f0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 shutdown_connections 2024-09-10T23:24:03.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f72a40b5360 0x7f72a40b7820 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72bc108020 0x7f72bc19eba0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72bc1076a0 0x7f72bc199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 --2- 172.21.15.2:0/1189745605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc101c90 0x7f72bc1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.436+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 >> 172.21.15.2:0/1189745605 conn(0x7f72bc0fd700 msgr2=0x7f72bc06adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.437+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 shutdown_connections 2024-09-10T23:24:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:03.437+0000 7f72c28ee640 1 -- 172.21.15.2:0/1189745605 wait complete. 2024-09-10T23:24:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:03 smithi177 ceph-mon[35760]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T23:24:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:03 smithi002 ceph-mon[31150]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T23:24:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:03 smithi154 ceph-mon[35136]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T23:24:04.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:24:04.546 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 -- 172.21.15.2:0/1007469762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150108020 msgr2=0x7f115010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 --2- 172.21.15.2:0/1007469762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150108020 0x7f115010e820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1148009ca0 tx=0x7f114802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 -- 172.21.15.2:0/1007469762 shutdown_connections 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 --2- 172.21.15.2:0/1007469762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150108020 0x7f115010e820 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 --2- 172.21.15.2:0/1007469762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 0x7f1150107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 --2- 172.21.15.2:0/1007469762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1150101c90 0x7f1150102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 -- 172.21.15.2:0/1007469762 >> 172.21.15.2:0/1007469762 conn(0x7f11500fd700 msgr2=0x7f11500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 -- 172.21.15.2:0/1007469762 shutdown_connections 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 -- 172.21.15.2:0/1007469762 wait complete. 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.041+0000 7f1155ed0640 1 Processor -- start 2024-09-10T23:24:05.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 -- start start 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 0x7f1150199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 0x7f1150199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1150108020 0x7f115019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1150111d30 con 0x7f1150101c90 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1150111bb0 con 0x7f11501076a0 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f1155ed0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1150111eb0 con 0x7f1150108020 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 0x7f1150199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 0x7f1150199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33776/0 (socket says 172.21.15.2:33776) 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 -- 172.21.15.2:0/2780764239 learned_addr learned my addr 172.21.15.2:0/2780764239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114ffff640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1150108020 0x7f115019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114effd640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 0x7f1150199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 -- 172.21.15.2:0/2780764239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1150108020 msgr2=0x7f115019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1150108020 0x7f115019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 -- 172.21.15.2:0/2780764239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 msgr2=0x7f1150199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 0x7f1150199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114f7fe640 1 -- 172.21.15.2:0/2780764239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115019f3e0 con 0x7f1150101c90 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.042+0000 7f114effd640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 0x7f1150199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.043+0000 7f114f7fe640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 0x7f1150199330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f114000d950 tx=0x7f114000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.043+0000 7f114cff9640 1 -- 172.21.15.2:0/2780764239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140017070 con 0x7f1150101c90 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.043+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115019f6d0 con 0x7f1150101c90 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.043+0000 7f114cff9640 1 -- 172.21.15.2:0/2780764239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1140009c30 con 0x7f1150101c90 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.043+0000 7f114cff9640 1 -- 172.21.15.2:0/2780764239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114000f620 con 0x7f1150101c90 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.043+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11501a5d90 con 0x7f1150101c90 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.045+0000 7f11582a5740 1 Processor -- start 2024-09-10T23:24:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.045+0000 7f114cff9640 1 -- 172.21.15.2:0/2780764239 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1140010460 con 0x7f1150101c90 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.045+0000 7f11582a5740 1 -- start start 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f11582a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b4861110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f11582a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f11582a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f11582a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5619b47d8c10 con 0x5619b486d5e0 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f11582a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5619b47c8040 con 0x5619b4860d30 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f11582a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619b47cbe50 con 0x5619b4861650 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b4861110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b4861110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:59270/0 (socket says 172.21.15.2:59270) 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33782/0 (socket says 172.21.15.2:33782) 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 -- 172.21.15.2:0/3906842304 learned_addr learned my addr 172.21.15.2:0/3906842304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114f7fe640 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 -- 172.21.15.2:0/3906842304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 msgr2=0x5619b486d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 -- 172.21.15.2:0/3906842304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 msgr2=0x5619b486f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 -- 172.21.15.2:0/3906842304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b4526540 con 0x5619b4860d30 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114effd640 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114cff9640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114f7fe640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.046+0000 7f114ffff640 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b4861110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f114802aeb0 tx=0x7f114802f450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fba9b8f298ccec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f114cff9640 1 -- 172.21.15.2:0/2780764239 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f11400e5860 con 0x7f1150101c90 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f1135ffb640 1 -- 172.21.15.2:0/3906842304 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148031450 con 0x5619b4860d30 2024-09-10T23:24:05.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f1135ffb640 1 -- 172.21.15.2:0/3906842304 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1148036030 con 0x5619b4860d30 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f1135ffb640 1 -- 172.21.15.2:0/3906842304 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480043a0 con 0x5619b4860d30 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 -- 172.21.15.2:0/3906842304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 msgr2=0x5619b4861110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f114f7fe640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11400e36e0 tx=0x7f1140010cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b4861110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f114802aeb0 tx=0x7f114802f450 comp rx=0 tx=0).stop 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 -- 172.21.15.2:0/3906842304 shutdown_connections 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 --2- 172.21.15.2:0/3906842304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b4861110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.047+0000 7f11582a5740 1 -- 172.21.15.2:0/3906842304 >> 172.21.15.2:0/3906842304 conn(0x5619b485eb60 msgr2=0x5619b485fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 -- 172.21.15.2:0/3906842304 shutdown_connections 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 -- 172.21.15.2:0/3906842304 wait complete. 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 -- start start 2024-09-10T23:24:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 Processor -- start 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b486a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5619b46295f0 con 0x5619b486d5e0 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5619b4763010 con 0x5619b4860d30 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619b48700b0 con 0x5619b4861650 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.048+0000 7f11582a5740 10 client.0 _ll_register_callbacks cb 0x5619b47c2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33794/0 (socket says 172.21.15.2:33794) 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 -- 172.21.15.2:0/3366067687 learned_addr learned my addr 172.21.15.2:0/3366067687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114effd640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b486a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 -- 172.21.15.2:0/3366067687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 msgr2=0x5619b486ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 -- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 msgr2=0x5619b486a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b486a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 -- 172.21.15.2:0/3366067687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b4790a00 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f114ffff640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486b050 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f11480049a0 tx=0x7f1148004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8a2db3bf55b894 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f112effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f112effd640 1 -- 172.21.15.2:0/3366067687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148059060 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f112effd640 1 -- 172.21.15.2:0/3366067687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1148031450 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1148036030 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f112effd640 1 -- 172.21.15.2:0/3366067687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f11480043d0 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f11582a5740 10 client.15285 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619b487bc90 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.049+0000 7f112effd640 1 -- 172.21.15.2:0/3366067687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1148036030 con 0x5619b486d5e0 2024-09-10T23:24:05.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f112effd640 1 -- 172.21.15.2:0/3366067687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1148043070 con 0x5619b486d5e0 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f11582a5740 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f11582a5740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f11582a5740 20 client.15285 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f11582a5740 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b487deb0 0x5619b487f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f11582a5740 4 client.15285 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619b47dab60 con 0x5619b487deb0 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.050+0000 7f114effd640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b487deb0 0x5619b487f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.051+0000 7f114effd640 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b487deb0 0x5619b487f320 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=306a4598e0561e30 server_cookie=af196f522153e480 in_seq=0 out_seq=0 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.051+0000 7f112effd640 10 client.15285 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.051+0000 7f112effd640 1 -- 172.21.15.2:0/3366067687 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619b47dab60 con 0x5619b487deb0 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.051+0000 7f112effd640 10 client.15285 handle_command_reply: tid=0 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.051+0000 7f11582a5740 1 client.15285 shutdown 2024-09-10T23:24:05.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 msgr2=0x5619b486b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486b050 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f11480049a0 tx=0x7f1148004040 comp rx=0 tx=0).stop 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 shutdown_connections 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b487deb0 0x5619b487f320 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b486d5e0 0x5619b486b050 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4861650 0x5619b486ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 --2- 172.21.15.2:0/3366067687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4860d30 0x5619b486a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 >> 172.21.15.2:0/3366067687 conn(0x5619b485eb60 msgr2=0x5619b4864700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f112effd640 0 client.15285 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 shutdown_connections 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 1 -- 172.21.15.2:0/3366067687 wait complete. 2024-09-10T23:24:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.052+0000 7f11582a5740 20 client.15285 trim_cache size 0 max 16384 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 Processor -- start 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 -- start start 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4860d30 0x5619b48677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 0x5619b4867d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b486d5e0 0x5619b4878340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5619b487d660 con 0x5619b4861650 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5619b487dd30 con 0x5619b486d5e0 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f11582a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619b487e400 con 0x5619b4860d30 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f114effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 0x5619b4867d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f114effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 0x5619b4867d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33800/0 (socket says 172.21.15.2:33800) 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.070+0000 7f114effd640 1 -- 172.21.15.2:0/3409024536 learned_addr learned my addr 172.21.15.2:0/3409024536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114ffff640 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b486d5e0 0x5619b4878340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114ffff640 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4860d30 0x5619b48677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114effd640 1 -- 172.21.15.2:0/3409024536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4860d30 msgr2=0x5619b48677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114effd640 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4860d30 0x5619b48677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114effd640 1 -- 172.21.15.2:0/3409024536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b486d5e0 msgr2=0x5619b4878340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114effd640 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b486d5e0 0x5619b4878340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114effd640 1 -- 172.21.15.2:0/3409024536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b485f5e0 con 0x5619b4861650 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114ffff640 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4860d30 0x5619b48677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f114effd640 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 0x5619b4867d20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1144007b20 tx=0x7f1144008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25838176a343b988 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f11357fa640 1 -- 172.21.15.2:0/3409024536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144024020 con 0x5619b4861650 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f11357fa640 1 -- 172.21.15.2:0/3409024536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11440208e0 con 0x5619b4861650 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.071+0000 7f11357fa640 1 -- 172.21.15.2:0/3409024536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114401a760 con 0x5619b4861650 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 -- 172.21.15.2:0/3409024536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 msgr2=0x5619b4867d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 0x5619b4867d20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1144007b20 tx=0x7f1144008040 comp rx=0 tx=0).stop 2024-09-10T23:24:05.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 -- 172.21.15.2:0/3409024536 shutdown_connections 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b486d5e0 0x5619b4878340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4861650 0x5619b4867d20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 --2- 172.21.15.2:0/3409024536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b4860d30 0x5619b48677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 -- 172.21.15.2:0/3409024536 >> 172.21.15.2:0/3409024536 conn(0x5619b485eb60 msgr2=0x5619b4865820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 -- 172.21.15.2:0/3409024536 shutdown_connections 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 -- 172.21.15.2:0/3409024536 wait complete. 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 -- start start 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.072+0000 7f11582a5740 1 Processor -- start 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 0x5619b4881e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4861650 0x5619b48823e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b486d5e0 0x5619b48873a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5619b487f1a0 con 0x5619b4860d30 2024-09-10T23:24:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5619b487ead0 con 0x5619b4861650 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5619b487f870 con 0x5619b486d5e0 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 10 client.0 _ll_register_callbacks cb 0x7f11440071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 0x5619b4881e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 0x5619b4881e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33802/0 (socket says 172.21.15.2:33802) 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 -- 172.21.15.2:0/1729515680 learned_addr learned my addr 172.21.15.2:0/1729515680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114effd640 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4861650 0x5619b48823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 -- 172.21.15.2:0/1729515680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b486d5e0 msgr2=0x5619b48873a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b486d5e0 0x5619b48873a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 -- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4861650 msgr2=0x5619b48823e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4861650 0x5619b48823e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 -- 172.21.15.2:0/1729515680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b4887ae0 con 0x5619b4860d30 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f114ffff640 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 0x5619b4881e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1148009ca0 tx=0x7f11480048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854cea68e4318ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:05.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f112effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f112effd640 1 -- 172.21.15.2:0/1729515680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148063030 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f112effd640 1 -- 172.21.15.2:0/1729515680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f114802fbf0 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.073+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11440208e0 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f112effd640 1 -- 172.21.15.2:0/1729515680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1148040020 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 10 client.15291 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619b48eb1a0 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f112effd640 1 -- 172.21.15.2:0/1729515680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11440208e0 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f112effd640 1 -- 172.21.15.2:0/1729515680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1148043040 con 0x5619b4860d30 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 20 client.15291 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b48efda0 0x5619b48eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 4 client.15291 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:05.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "status"}) -- 0x5619b47d6610 con 0x5619b48efda0 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.074+0000 7f114effd640 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b48efda0 0x5619b48eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f114effd640 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b48efda0 0x5619b48eeab0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee00aeefa5bae5ff server_cookie=9e257e32e66d0181 in_seq=0 out_seq=0 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f112effd640 10 client.15291 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f112effd640 1 -- 172.21.15.2:0/1729515680 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5619b47d6610 con 0x5619b48efda0 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f112effd640 10 client.15291 handle_command_reply: tid=0 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 client.15291 shutdown 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 msgr2=0x5619b4881e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 0x5619b4881e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1148009ca0 tx=0x7f11480048d0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 shutdown_connections 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5619b486d5e0 0x5619b48873a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5619b4861650 0x5619b48823e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5619b48efda0 0x5619b48eeab0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 --2- 172.21.15.2:0/1729515680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619b4860d30 0x5619b4881e40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 >> 172.21.15.2:0/1729515680 conn(0x5619b485eb60 msgr2=0x5619b486bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f112effd640 0 client.15291 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 shutdown_connections 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 1 -- 172.21.15.2:0/1729515680 wait complete. 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.075+0000 7f11582a5740 20 client.15291 trim_cache size 0 max 16384 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24563, 2024-09-10T23:24:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 100.680272755, 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 118.132500014 2024-09-10T23:24:05.090 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 msgr2=0x7f11380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11400e36e0 tx=0x7f1140010cb0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 msgr2=0x7f1150199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 0x7f1150199330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f114000d950 tx=0x7f114000de10 comp rx=0 tx=0).stop 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 shutdown_connections 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1150108020 0x7f115019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11501076a0 0x7f1150199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 --2- 172.21.15.2:0/2780764239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150101c90 0x7f1150199330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 >> 172.21.15.2:0/2780764239 conn(0x7f11500fd700 msgr2=0x7f1150104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 shutdown_connections 2024-09-10T23:24:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:05.076+0000 7f1155ed0640 1 -- 172.21.15.2:0/2780764239 wait complete. 2024-09-10T23:24:05.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T23:24:06.143 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:05 smithi177 ceph-mon[35760]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T23:24:06.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:05 smithi002 ceph-mon[31150]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T23:24:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:05 smithi154 ceph-mon[35136]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 -- 172.21.15.2:0/2150304391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 msgr2=0x7f137810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 --2- 172.21.15.2:0/2150304391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137810f950 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1370009ca0 tx=0x7f137002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 -- 172.21.15.2:0/2150304391 shutdown_connections 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 --2- 172.21.15.2:0/2150304391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137810f950 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 --2- 172.21.15.2:0/2150304391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13781087d0 0x7f1378108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 --2- 172.21.15.2:0/2150304391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1378102dc0 0x7f13781031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 -- 172.21.15.2:0/2150304391 >> 172.21.15.2:0/2150304391 conn(0x7f13780fe830 msgr2=0x7f1378100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 -- 172.21.15.2:0/2150304391 shutdown_connections 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.692+0000 7f137f70e640 1 -- 172.21.15.2:0/2150304391 wait complete. 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 Processor -- start 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 -- start start 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1378102dc0 0x7f1378199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13781087d0 0x7f1378199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1378112ea0 con 0x7f1378109150 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1378112d20 con 0x7f13781087d0 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137f70e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1378113020 con 0x7f1378102dc0 2024-09-10T23:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137819ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33824/0 (socket says 172.21.15.2:33824) 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 -- 172.21.15.2:0/3847696990 learned_addr learned my addr 172.21.15.2:0/3847696990 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137cca9640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13781087d0 0x7f1378199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137d4aa640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1378102dc0 0x7f1378199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 -- 172.21.15.2:0/3847696990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1378102dc0 msgr2=0x7f1378199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1378102dc0 0x7f1378199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 -- 172.21.15.2:0/3847696990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13781087d0 msgr2=0x7f1378199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13781087d0 0x7f1378199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 -- 172.21.15.2:0/3847696990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137819f4e0 con 0x7f1378109150 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.693+0000 7f137dcab640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137819ed10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1370031a20 tx=0x7f1370031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.694+0000 7f136e7fc640 1 -- 172.21.15.2:0/3847696990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1370003d30 con 0x7f1378109150 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.694+0000 7f136e7fc640 1 -- 172.21.15.2:0/3847696990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13700044f0 con 0x7f1378109150 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.694+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137819f770 con 0x7f1378109150 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.694+0000 7f136e7fc640 1 -- 172.21.15.2:0/3847696990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137002fd90 con 0x7f1378109150 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.694+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13781a5e90 con 0x7f1378109150 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.696+0000 7f136e7fc640 1 -- 172.21.15.2:0/3847696990 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1370004040 con 0x7f1378109150 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.696+0000 7f1381ae3740 1 Processor -- start 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 -- start start 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d6650 0x55e49d6e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6e25e0 0x55e49d6e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e49d64dc10 con 0x55e49d6d5d30 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e49d63d040 con 0x55e49d6e25e0 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f1381ae3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e49d640e50 con 0x55e49d6d6650 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33832/0 (socket says 172.21.15.2:33832) 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 -- 172.21.15.2:0/4061602585 learned_addr learned my addr 172.21.15.2:0/4061602585 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137d4aa640 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d6650 0x55e49d6e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6e25e0 0x55e49d6e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f136e7fc640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f13640b52e0 0x7f13640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 -- 172.21.15.2:0/4061602585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d6650 msgr2=0x55e49d6e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d6650 0x55e49d6e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 -- 172.21.15.2:0/4061602585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6e25e0 msgr2=0x55e49d6e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6e25e0 0x55e49d6e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137cca9640 1 -- 172.21.15.2:0/4061602585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e49d39b540 con 0x55e49d6d5d30 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.697+0000 7f137dcab640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f13640b52e0 0x7f13640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.698+0000 7f137cca9640 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d6110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1368009f40 tx=0x7f1368009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536ebc8dc880873a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.698+0000 7f136e7fc640 1 -- 172.21.15.2:0/3847696990 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f13701072d0 con 0x7f1378109150 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.698+0000 7f13637fe640 1 -- 172.21.15.2:0/4061602585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136801c070 con 0x55e49d6d5d30 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.698+0000 7f13637fe640 1 -- 172.21.15.2:0/4061602585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1368010040 con 0x55e49d6d5d30 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.698+0000 7f13637fe640 1 -- 172.21.15.2:0/4061602585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368014680 con 0x55e49d6d5d30 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 -- 172.21.15.2:0/4061602585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 msgr2=0x55e49d6d6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f137dcab640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f13640b52e0 0x7f13640b77a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1370049000 tx=0x7f137009b0b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d6110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1368009f40 tx=0x7f1368009420 comp rx=0 tx=0).stop 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 -- 172.21.15.2:0/4061602585 shutdown_connections 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6e25e0 0x55e49d6e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d6650 0x55e49d6e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 --2- 172.21.15.2:0/4061602585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d6110 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 -- 172.21.15.2:0/4061602585 >> 172.21.15.2:0/4061602585 conn(0x55e49d6d3b60 msgr2=0x55e49d6d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 -- 172.21.15.2:0/4061602585 shutdown_connections 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 -- 172.21.15.2:0/4061602585 wait complete. 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 -- start start 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.699+0000 7f1381ae3740 1 Processor -- start 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d5d30 0x55e49d6df620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 0x55e49d6e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e49d49e5f0 con 0x55e49d6e25e0 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e49d5d8010 con 0x55e49d6d6650 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6e5290 con 0x55e49d6d5d30 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 10 client.0 _ll_register_callbacks cb 0x55e49d637340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 0x55e49d6e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 0x55e49d6e00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33834/0 (socket says 172.21.15.2:33834) 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 -- 172.21.15.2:0/1144662469 learned_addr learned my addr 172.21.15.2:0/1144662469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137d4aa640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d5d30 0x55e49d6df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 -- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d5d30 msgr2=0x55e49d6df620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d5d30 0x55e49d6df620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 -- 172.21.15.2:0/1144662469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 msgr2=0x55e49d6dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 -- 172.21.15.2:0/1144662469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e49d605a00 con 0x55e49d6e25e0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f137cca9640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 0x55e49d6e00a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1368009c20 tx=0x7f1368017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff6b361bb1ed905 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1360ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1360ff9640 1 -- 172.21.15.2:0/1144662469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136802c060 con 0x55e49d6e25e0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1360ff9640 1 -- 172.21.15.2:0/1144662469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1368014620 con 0x55e49d6e25e0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.700+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1368010040 con 0x55e49d6e25e0 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1360ff9640 1 -- 172.21.15.2:0/1144662469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f136801c070 con 0x55e49d6e25e0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 10 client.15303 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e49d6f0ed0 con 0x55e49d6e25e0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1360ff9640 1 -- 172.21.15.2:0/1144662469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1368010040 con 0x55e49d6e25e0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1360ff9640 1 -- 172.21.15.2:0/1144662469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1368014ce0 con 0x55e49d6e25e0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 20 client.15303 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6f32e0 0x55e49d6f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 4 client.15303 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.701+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e49d64fb60 con 0x55e49d6f32e0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.702+0000 7f137d4aa640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6f32e0 0x55e49d6f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.702+0000 7f137d4aa640 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6f32e0 0x55e49d6f4750 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e0f98dccbbd0006 server_cookie=15718e4c4ea49f43 in_seq=0 out_seq=0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.702+0000 7f1360ff9640 10 client.15303 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1360ff9640 1 -- 172.21.15.2:0/1144662469 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e49d64fb60 con 0x55e49d6f32e0 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1360ff9640 10 client.15303 handle_command_reply: tid=0 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 client.15303 shutdown 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 msgr2=0x55e49d6e00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 0x55e49d6e00a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1368009c20 tx=0x7f1368017eb0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 shutdown_connections 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6f32e0 0x55e49d6f4750 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6e25e0 0x55e49d6e00a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1360ff9640 0 client.15303 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1144662469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d5d30 0x55e49d6df620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 >> 172.21.15.2:0/1144662469 conn(0x55e49d6d3b60 msgr2=0x55e49d6d9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 shutdown_connections 2024-09-10T23:24:06.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 1 -- 172.21.15.2:0/1144662469 wait complete. 2024-09-10T23:24:06.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.703+0000 7f1381ae3740 20 client.15303 trim_cache size 0 max 16384 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.721+0000 7f1381ae3740 1 Processor -- start 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.721+0000 7f1381ae3740 1 -- start start 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.721+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6fce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1381ae3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6f2a90 con 0x55e49d6d5d30 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1381ae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6f3160 con 0x55e49d6d6650 2024-09-10T23:24:06.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1381ae3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6f3830 con 0x55e49d6d3b60 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33840/0 (socket says 172.21.15.2:33840) 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 -- 172.21.15.2:0/1534777800 learned_addr learned my addr 172.21.15.2:0/1534777800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137cca9640 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 -- 172.21.15.2:0/1534777800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 msgr2=0x55e49d6f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 -- 172.21.15.2:0/1534777800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 msgr2=0x55e49d6fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 -- 172.21.15.2:0/1534777800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e49d6d45e0 con 0x55e49d6d5d30 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137cca9640 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f137d4aa640 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d9ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55e49d6f4fb0 tx=0x7f1374008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a20102135bba26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1362ffd640 1 -- 172.21.15.2:0/1534777800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137400bc90 con 0x55e49d6d5d30 2024-09-10T23:24:06.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1362ffd640 1 -- 172.21.15.2:0/1534777800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1374020030 con 0x55e49d6d5d30 2024-09-10T23:24:06.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.722+0000 7f1362ffd640 1 -- 172.21.15.2:0/1534777800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374024d80 con 0x55e49d6d5d30 2024-09-10T23:24:06.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 -- 172.21.15.2:0/1534777800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 msgr2=0x55e49d6d9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d9ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55e49d6f4fb0 tx=0x7f1374008040 comp rx=0 tx=0).stop 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 -- 172.21.15.2:0/1534777800 shutdown_connections 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d6650 0x55e49d6fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d5d30 0x55e49d6d9ef0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 --2- 172.21.15.2:0/1534777800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 -- 172.21.15.2:0/1534777800 >> 172.21.15.2:0/1534777800 conn(0x55e49d6f26b0 msgr2=0x55e49d6da8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 -- 172.21.15.2:0/1534777800 shutdown_connections 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 -- 172.21.15.2:0/1534777800 wait complete. 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 -- start start 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.723+0000 7f1381ae3740 1 Processor -- start 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6fb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d5d30 0x55e49d6fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 0x55e49d75ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6f45d0 con 0x55e49d6d6650 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6f3f00 con 0x55e49d6d5d30 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e49d6f4ca0 con 0x55e49d6d3b60 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f1381ae3740 10 client.0 _ll_register_callbacks cb 0x7f136801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 0x55e49d75ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 0x55e49d75ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33854/0 (socket says 172.21.15.2:33854) 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 -- 172.21.15.2:0/3292419577 learned_addr learned my addr 172.21.15.2:0/3292419577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137d4aa640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d5d30 0x55e49d6fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 -- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 msgr2=0x55e49d6fb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6fb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 -- 172.21.15.2:0/3292419577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d5d30 msgr2=0x55e49d6fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d5d30 0x55e49d6fbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.724+0000 7f137cca9640 1 -- 172.21.15.2:0/3292419577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e49d75b310 con 0x55e49d6d6650 2024-09-10T23:24:06.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f137cca9640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 0x55e49d75ac00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f136800fba0 tx=0x7f1368001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469f81fa099fcf4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1360ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1360ff9640 1 -- 172.21.15.2:0/3292419577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036040 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1360ff9640 1 -- 172.21.15.2:0/3292419577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f13680059c0 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1374020030 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1360ff9640 1 -- 172.21.15.2:0/3292419577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f136802c040 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1381ae3740 10 client.15309 fetch_fsmap learned FSMap version 27 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e49d7648e0 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1360ff9640 1 -- 172.21.15.2:0/3292419577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1374020030 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1360ff9640 1 -- 172.21.15.2:0/3292419577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f136803d8e0 con 0x55e49d6d6650 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.725+0000 7f1381ae3740 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1381ae3740 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:24:06.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1381ae3740 20 client.15309 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1381ae3740 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6e25e0 0x55e49d7680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1381ae3740 4 client.15309 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "status"}) -- 0x55e49d64b610 con 0x55e49d6e25e0 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f137d4aa640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6e25e0 0x55e49d7680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1360ff9640 10 client.15309 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f137d4aa640 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6e25e0 0x55e49d7680e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f189043ceeecda server_cookie=e21c4b4656b64e4d in_seq=0 out_seq=0 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1360ff9640 1 -- 172.21.15.2:0/3292419577 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e49d64b610 con 0x55e49d6e25e0 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.726+0000 7f1360ff9640 10 client.15309 handle_command_reply: tid=0 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 client.15309 shutdown 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 msgr2=0x55e49d75ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 0x55e49d75ac00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f136800fba0 tx=0x7f1368001e50 comp rx=0 tx=0).stop 2024-09-10T23:24:06.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 shutdown_connections 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e49d6e25e0 0x55e49d7680e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e49d6d6650 0x55e49d75ac00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e49d6d5d30 0x55e49d6fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 --2- 172.21.15.2:0/3292419577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e49d6d3b60 0x55e49d6fb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 >> 172.21.15.2:0/3292419577 conn(0x55e49d6f26b0 msgr2=0x55e49d6dde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1360ff9640 0 client.15309 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 shutdown_connections 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 1 -- 172.21.15.2:0/3292419577 wait complete. 2024-09-10T23:24:06.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.727+0000 7f1381ae3740 20 client.15309 trim_cache size 0 max 16384 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "2f953db4-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24568, 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 109.419950582, 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 27, 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 77, 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 128.52697531699999 2024-09-10T23:24:06.737 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f13640b52e0 msgr2=0x7f13640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f13640b52e0 0x7f13640b77a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1370049000 tx=0x7f137009b0b0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 msgr2=0x7f137819ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137819ed10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1370031a20 tx=0x7f1370031a50 comp rx=0 tx=0).stop 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 shutdown_connections 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f13640b52e0 0x7f13640b77a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1378109150 0x7f137819ed10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13781087d0 0x7f1378199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 --2- 172.21.15.2:0/3847696990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1378102dc0 0x7f1378199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 >> 172.21.15.2:0/3847696990 conn(0x7f13780fe830 msgr2=0x7f1378100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 shutdown_connections 2024-09-10T23:24:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:06.728+0000 7f137f70e640 1 -- 172.21.15.2:0/3847696990 wait complete. 2024-09-10T23:24:07.514 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T23:24:07.595 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T23:24:07.595 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T23:24:07.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:07.595 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T23:24:07.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:07.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-10T23:24:07.683 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-10T23:24:07.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:24:07.685 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-10T23:24:07.685 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:24:07.686 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:07.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:24:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:08.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:07 smithi002 ceph-mon[31150]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-10T23:24:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:07 smithi177 ceph-mon[35760]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-10T23:24:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:07 smithi154 ceph-mon[35136]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-10T23:24:08.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 -- 172.21.15.2:0/3696743970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c1045c0 msgr2=0x7f335c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 --2- 172.21.15.2:0/3696743970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c1045c0 0x7f335c10cab0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3344009900 tx=0x7f334402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:08.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 -- 172.21.15.2:0/3696743970 shutdown_connections 2024-09-10T23:24:08.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 --2- 172.21.15.2:0/3696743970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f335c10d100 0x7f335c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 --2- 172.21.15.2:0/3696743970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c1045c0 0x7f335c10cab0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 --2- 172.21.15.2:0/3696743970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f335c103ca0 0x7f335c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 -- 172.21.15.2:0/3696743970 >> 172.21.15.2:0/3696743970 conn(0x7f335c0fd700 msgr2=0x7f335c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 -- 172.21.15.2:0/3696743970 shutdown_connections 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.512+0000 7f3360a47640 1 -- 172.21.15.2:0/3696743970 wait complete. 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 Processor -- start 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 -- start start 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 0x7f335c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f335c1045c0 0x7f335c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f335c10d100 0x7f335c19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f335c112db0 con 0x7f335c103ca0 2024-09-10T23:24:08.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f335c112c30 con 0x7f335c1045c0 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3360a47640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f335c112f30 con 0x7f335c10d100 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 0x7f335c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 0x7f335c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33858/0 (socket says 172.21.15.2:33858) 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 -- 172.21.15.2:0/4178835109 learned_addr learned my addr 172.21.15.2:0/4178835109 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335ad9d640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f335c10d100 0x7f335c19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f3359d9b640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f335c1045c0 0x7f335c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 -- 172.21.15.2:0/4178835109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f335c10d100 msgr2=0x7f335c19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f335c10d100 0x7f335c19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 -- 172.21.15.2:0/4178835109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f335c1045c0 msgr2=0x7f335c1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f335c1045c0 0x7f335c1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 -- 172.21.15.2:0/4178835109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c19f410 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.513+0000 7f335a59c640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 0x7f335c199360 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f334c00b4a0 tx=0x7f334c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.514+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c014070 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.514+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f334c010ac0 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.514+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c017c30 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.514+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c19f700 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.514+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c1a5e40 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.515+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c104080 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.516+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f334c010610 con 0x7f335c103ca0 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.517+0000 7f33537fe640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f33480b52e0 0x7f33480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.517+0000 7f3359d9b640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f33480b52e0 0x7f33480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.517+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f334c0e55c0 con 0x7f335c103ca0 2024-09-10T23:24:08.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.518+0000 7f3359d9b640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f33480b52e0 0x7f33480b77a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3344000c00 tx=0x7f3344031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.521+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f334c0ac430 con 0x7f335c103ca0 2024-09-10T23:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.747+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f335c02e5c0 con 0x7f335c103ca0 2024-09-10T23:24:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.748+0000 7f33537fe640 1 -- 172.21.15.2:0/4178835109 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f334c0abd30 con 0x7f335c103ca0 2024-09-10T23:24:08.750 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f33480b52e0 msgr2=0x7f33480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f33480b52e0 0x7f33480b77a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3344000c00 tx=0x7f3344031400 comp rx=0 tx=0).stop 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 msgr2=0x7f335c199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 0x7f335c199360 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f334c00b4a0 tx=0x7f334c00b960 comp rx=0 tx=0).stop 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 shutdown_connections 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f33480b52e0 0x7f33480b77a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f335c10d100 0x7f335c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f335c1045c0 0x7f335c1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 --2- 172.21.15.2:0/4178835109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c103ca0 0x7f335c199360 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 >> 172.21.15.2:0/4178835109 conn(0x7f335c0fd700 msgr2=0x7f335c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 shutdown_connections 2024-09-10T23:24:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:08.750+0000 7f3360a47640 1 -- 172.21.15.2:0/4178835109 wait complete. 2024-09-10T23:24:09.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:08 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4178835109' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:24:09.115 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:08 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4178835109' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:24:09.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:08 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4178835109' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:24:09.532 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:24:09.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:09.532 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:24:09.552 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42128sec preferred_lft 42128sec 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:09.553 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-10T23:24:09.554 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:24:09.554 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T23:24:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:09.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:09.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:09.777 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:24:09.804 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-10T23:24:09.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:09.805 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-10T23:24:09.879 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-10T23:24:09.879 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:24:09.879 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:24:09.879 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:24:09.879 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:24:09.880 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:09.880 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T23:24:09.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:24:09.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:24:09.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:24:09.880 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T23:24:09.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:10.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:09 smithi002 ceph-mon[31150]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:10.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:10.213 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T23:24:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:09 smithi177 ceph-mon[35760]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:10.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:10.230 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-10T23:24:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:09 smithi154 ceph-mon[35136]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:10.285 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:10.285 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T23:24:10.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:24:10.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T23:24:10.286 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T23:24:10.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:10.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:10.405 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T23:24:10.405 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T23:24:10.406 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T23:24:10.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:10.539 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:10.539 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T23:24:10.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-10T23:24:10.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:24:10.539 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T23:24:10.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:10.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:10.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:24:10.619 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:10.635 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:24:10.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:24:10.636 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:10.691 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T23:24:10.691 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T23:24:10.691 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/0aec2cea-1dc8-40c2-85a1-36246124ca43 2024-09-10T23:24:10.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:10.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/0aec2cea-1dc8-40c2-85a1-36246124ca43 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-10T23:24:10.793 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-10T23:24:10.793 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.154:3300,172.21.15.177:3300" 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@2f953db4-6fca-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/0aec2cea-1dc8-40c2-85a1-36246124ca43 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.2:3300/172.21.15.154:3300/172.21.15.177:3300" will pass to kernel 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:24:10.924 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:24:10.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:10.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:10.951 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:24:11.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:11.049 INFO:teuthology.orchestra.run.smithi002.stdout:client24952 2024-09-10T23:24:11.050 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:24:11.050 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:11.067 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:24:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:11.164 INFO:teuthology.orchestra.run.smithi002.stdout:client24952 2024-09-10T23:24:11.164 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:24:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:11.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:11.222 INFO:teuthology.orchestra.run.smithi002.stdout:client24952 2024-09-10T23:24:11.222 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2f953db4-6fca-11ef-bcea-c7b262605968.client24952/status') 2024-09-10T23:24:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:11.282 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.24952 (3)172.21.15.2:0/2137797673 2024-09-10T23:24:11.282 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-09-10T23:24:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-09-10T23:24:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-09-10T23:24:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:70 bytes copied, 2.5022e-05 s, 2.8 MB/s 2024-09-10T23:24:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:11.290 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:24:11.299 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:24:11.299 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:24:11.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T23:24:11.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.403+0000 7f4730f4b640 1 -- 172.21.15.2:0/679635611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 msgr2=0x7f472c1055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.403+0000 7f4730f4b640 1 --2- 172.21.15.2:0/679635611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c1055e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f471c009900 tx=0x7f471c02a410 comp rx=0 tx=0).stop 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.403+0000 7f4730f4b640 1 -- 172.21.15.2:0/679635611 shutdown_connections 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.403+0000 7f4730f4b640 1 --2- 172.21.15.2:0/679635611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 0x7f472c10ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.403+0000 7f4730f4b640 1 --2- 172.21.15.2:0/679635611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f472c105b20 0x7f472c107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.403+0000 7f4730f4b640 1 --2- 172.21.15.2:0/679635611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c1055e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 -- 172.21.15.2:0/679635611 >> 172.21.15.2:0/679635611 conn(0x7f472c0fd150 msgr2=0x7f472c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 -- 172.21.15.2:0/679635611 shutdown_connections 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 -- 172.21.15.2:0/679635611 wait complete. 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 Processor -- start 2024-09-10T23:24:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 -- start start 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.404+0000 7f4730f4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f472c105b20 0x7f472c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4730f4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 0x7f472c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4730f4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f472c10e6d0 con 0x7f472c06bf90 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4730f4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f472c10e550 con 0x7f472c1086d0 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4730f4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f472c10e850 con 0x7f472c105b20 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53410/0 (socket says 172.21.15.2:53410) 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 -- 172.21.15.2:0/577286665 learned_addr learned my addr 172.21.15.2:0/577286665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4723fff640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f472c105b20 0x7f472c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472ad9d640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 0x7f472c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 -- 172.21.15.2:0/577286665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f472c105b20 msgr2=0x7f472c199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f472c105b20 0x7f472c199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 -- 172.21.15.2:0/577286665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 msgr2=0x7f472c19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 0x7f472c19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 -- 172.21.15.2:0/577286665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c19a9f0 con 0x7f472c06bf90 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472ad9d640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 0x7f472c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f472a59c640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c198eb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f471c005940 tx=0x7f471c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c03f030 con 0x7f472c06bf90 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472c19ac80 con 0x7f472c06bf90 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f471c003cb0 con 0x7f472c06bf90 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c035070 con 0x7f472c06bf90 2024-09-10T23:24:11.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.405+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472c1a13b0 con 0x7f472c06bf90 2024-09-10T23:24:11.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.406+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472c0fec40 con 0x7f472c06bf90 2024-09-10T23:24:11.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.408+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f471c03b4f0 con 0x7f472c06bf90 2024-09-10T23:24:11.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.409+0000 7f47237fe640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47180b52e0 0x7f47180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.409+0000 7f4723fff640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47180b52e0 0x7f47180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.409+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f471c106a50 con 0x7f472c06bf90 2024-09-10T23:24:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.409+0000 7f4723fff640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47180b52e0 0x7f47180b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4714005fd0 tx=0x7f471400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.411+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f471c0cd920 con 0x7f472c06bf90 2024-09-10T23:24:11.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.635+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f472c02e5c0 con 0x7f472c06bf90 2024-09-10T23:24:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.868+0000 7f47237fe640 1 -- 172.21.15.2:0/577286665 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f471c0d60d0 con 0x7f472c06bf90 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47180b52e0 msgr2=0x7f47180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47180b52e0 0x7f47180b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4714005fd0 tx=0x7f471400b390 comp rx=0 tx=0).stop 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 msgr2=0x7f472c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c198eb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f471c005940 tx=0x7f471c004430 comp rx=0 tx=0).stop 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 shutdown_connections 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47180b52e0 0x7f47180b77a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c1086d0 0x7f472c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f472c105b20 0x7f472c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 --2- 172.21.15.2:0/577286665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c06bf90 0x7f472c198eb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 >> 172.21.15.2:0/577286665 conn(0x7f472c0fd150 msgr2=0x7f472c103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 shutdown_connections 2024-09-10T23:24:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:11.871+0000 7f4730f4b640 1 -- 172.21.15.2:0/577286665 wait complete. 2024-09-10T23:24:11.884 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T23:24:11.895 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T23:24:11.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.016+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/3669913669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 msgr2=0x7fdbb4101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.016+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/3669913669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb4101ca0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009930 tx=0x7fdba402a420 comp rx=0 tx=0).stop 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/3669913669 shutdown_connections 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/3669913669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 0x7fdbb4109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/3669913669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 0x7fdbb4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/3669913669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb4101ca0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/3669913669 >> 172.21.15.2:0/3669913669 conn(0x7fdbb40fd180 msgr2=0x7fdbb40ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/3669913669 shutdown_connections 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/3669913669 wait complete. 2024-09-10T23:24:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 Processor -- start 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.017+0000 7fdbb8c6e640 1 -- start start 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 0x7fdbb419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 0x7fdbb41a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb410d570 con 0x7fdbb41018a0 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb410d3f0 con 0x7fdbb41029f0 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb410d6f0 con 0x7fdbb41033b0 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb406acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53430/0 (socket says 172.21.15.2:53430) 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 -- 172.21.15.2:0/2954908082 learned_addr learned my addr 172.21.15.2:0/2954908082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb1d9b640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 0x7fdbb419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb2d9d640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 0x7fdbb41a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 -- 172.21.15.2:0/2954908082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 msgr2=0x7fdbb41a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 0x7fdbb41a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 -- 172.21.15.2:0/2954908082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 msgr2=0x7fdbb419dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 0x7fdbb419dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 -- 172.21.15.2:0/2954908082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb41a0a10 con 0x7fdbb41018a0 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb2d9d640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 0x7fdbb41a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb1d9b640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 0x7fdbb419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb259c640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb406acf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009a50 tx=0x7fdba40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba403f030 con 0x7fdbb41018a0 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba4003cb0 con 0x7fdbb41018a0 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.018+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb41a0c40 con 0x7fdbb41018a0 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.019+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4035070 con 0x7fdbb41018a0 2024-09-10T23:24:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.019+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb41a1130 con 0x7fdbb41018a0 2024-09-10T23:24:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.019+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb4108bb0 con 0x7fdbb41018a0 2024-09-10T23:24:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.022+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdba403bbf0 con 0x7fdbb41018a0 2024-09-10T23:24:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.022+0000 7fdba37fe640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb9c0b52e0 0x7fdb9c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.023+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdba4106da0 con 0x7fdbb41018a0 2024-09-10T23:24:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.023+0000 7fdbb1d9b640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb9c0b52e0 0x7fdb9c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.023+0000 7fdbb1d9b640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb9c0b52e0 0x7fdb9c0b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdba80058c0 tx=0x7fdba8005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.025+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdba40cdc70 con 0x7fdbb41018a0 2024-09-10T23:24:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.211+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbb402e810 con 0x7fdbb41018a0 2024-09-10T23:24:12.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.212+0000 7fdba37fe640 1 -- 172.21.15.2:0/2954908082 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7fdba40d6420 con 0x7fdbb41018a0 2024-09-10T23:24:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:12.213 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:11 smithi177 ceph-mon[35760]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/577286665' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T23:24:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb9c0b52e0 msgr2=0x7fdb9c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb9c0b52e0 0x7fdb9c0b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdba80058c0 tx=0x7fdba8005ec0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 msgr2=0x7fdbb406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb406acf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009a50 tx=0x7fdba40042f0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 shutdown_connections 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdb9c0b52e0 0x7fdb9c0b77a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbb41033b0 0x7fdbb41a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbb41029f0 0x7fdbb419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 --2- 172.21.15.2:0/2954908082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb41018a0 0x7fdbb406acf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 >> 172.21.15.2:0/2954908082 conn(0x7fdbb40fd180 msgr2=0x7fdbb4105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.214+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 shutdown_connections 2024-09-10T23:24:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.215+0000 7fdbb8c6e640 1 -- 172.21.15.2:0/2954908082 wait complete. 2024-09-10T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:11 smithi002 ceph-mon[31150]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/577286665' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T23:24:12.226 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:17:34.596978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:22:13.247903+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:22:15.004607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:24:12.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:24:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:11 smithi154 ceph-mon[35136]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/577286665' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 -- 172.21.15.2:0/1985281747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf8101890 msgr2=0x7f6bf8101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 --2- 172.21.15.2:0/1985281747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf8101890 0x7f6bf8101c90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009930 tx=0x7f6bec02a420 comp rx=0 tx=0).stop 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 -- 172.21.15.2:0/1985281747 shutdown_connections 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 --2- 172.21.15.2:0/1985281747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bf81033a0 0x7f6bf8109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 --2- 172.21.15.2:0/1985281747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf81029e0 0x7f6bf8102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 --2- 172.21.15.2:0/1985281747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf8101890 0x7f6bf8101c90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 -- 172.21.15.2:0/1985281747 >> 172.21.15.2:0/1985281747 conn(0x7f6bf80fd150 msgr2=0x7f6bf80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 -- 172.21.15.2:0/1985281747 shutdown_connections 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.333+0000 7f6bff13a640 1 -- 172.21.15.2:0/1985281747 wait complete. 2024-09-10T23:24:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 Processor -- start 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 -- start start 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf8101890 0x7f6bf8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 0x7f6bf81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bf81033a0 0x7f6bf8199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf810e630 con 0x7f6bf81029e0 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf810e4b0 con 0x7f6bf8101890 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bff13a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf810e7b0 con 0x7f6bf81033a0 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 0x7f6bf81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 0x7f6bf81993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53448/0 (socket says 172.21.15.2:53448) 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 -- 172.21.15.2:0/717792373 learned_addr learned my addr 172.21.15.2:0/717792373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bfced6640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf8101890 0x7f6bf8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bfd6d7640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bf81033a0 0x7f6bf8199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 -- 172.21.15.2:0/717792373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bf81033a0 msgr2=0x7f6bf8199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bf81033a0 0x7f6bf8199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 -- 172.21.15.2:0/717792373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf8101890 msgr2=0x7f6bf8198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf8101890 0x7f6bf8198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.334+0000 7f6bf7fff640 1 -- 172.21.15.2:0/717792373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf819a8a0 con 0x7f6bf81029e0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.335+0000 7f6bf7fff640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 0x7f6bf81993b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c920 tx=0x7f6be400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.335+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007c70 con 0x7f6bf81029e0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.335+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be4007e10 con 0x7f6bf81029e0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.335+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf819ab90 con 0x7f6bf81029e0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.335+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4018820 con 0x7f6bf81029e0 2024-09-10T23:24:12.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.335+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf81a1260 con 0x7f6bf81029e0 2024-09-10T23:24:12.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.336+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf8108c00 con 0x7f6bf81029e0 2024-09-10T23:24:12.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.337+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6be400f450 con 0x7f6bf81029e0 2024-09-10T23:24:12.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.338+0000 7f6bf5ffb640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6be80b5360 0x7f6be80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.338+0000 7f6bfced6640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6be80b5360 0x7f6be80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.338+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6be40e5c30 con 0x7f6bf81029e0 2024-09-10T23:24:12.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.339+0000 7f6bfced6640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6be80b5360 0x7f6be80b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6bec006010 tx=0x7f6bec0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.342+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6be4014030 con 0x7f6bf81029e0 2024-09-10T23:24:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.528+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6bf8063d50 con 0x7f6bf81029e0 2024-09-10T23:24:12.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.529+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/717792373 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f6be40acaa0 con 0x7f6bf81029e0 2024-09-10T23:24:12.530 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-10T23:24:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6be80b5360 msgr2=0x7f6be80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6be80b5360 0x7f6be80b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6bec006010 tx=0x7f6bec0314a0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 msgr2=0x7f6bf81993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 0x7f6bf81993b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c920 tx=0x7f6be400cde0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 shutdown_connections 2024-09-10T23:24:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6be80b5360 0x7f6be80b7820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6bf81033a0 0x7f6bf8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf81029e0 0x7f6bf81993b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 --2- 172.21.15.2:0/717792373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf8101890 0x7f6bf8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 >> 172.21.15.2:0/717792373 conn(0x7f6bf80fd150 msgr2=0x7f6bf8105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 shutdown_connections 2024-09-10T23:24:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.531+0000 7f6bff13a640 1 -- 172.21.15.2:0/717792373 wait complete. 2024-09-10T23:24:12.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:24:12.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 -- 172.21.15.2:0/293601405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06341029e0 msgr2=0x7f0634102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 --2- 172.21.15.2:0/293601405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06341029e0 0x7f0634102e60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f061c009930 tx=0x7f061c02a420 comp rx=0 tx=0).stop 2024-09-10T23:24:12.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 -- 172.21.15.2:0/293601405 shutdown_connections 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 --2- 172.21.15.2:0/293601405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06341033a0 0x7f0634109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 --2- 172.21.15.2:0/293601405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06341029e0 0x7f0634102e60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 --2- 172.21.15.2:0/293601405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0634101890 0x7f0634101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 -- 172.21.15.2:0/293601405 >> 172.21.15.2:0/293601405 conn(0x7f06340fd150 msgr2=0x7f06340ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 -- 172.21.15.2:0/293601405 shutdown_connections 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.649+0000 7f0638df3640 1 -- 172.21.15.2:0/293601405 wait complete. 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 Processor -- start 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 -- start start 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 0x7f0634198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06341029e0 0x7f0634199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06341033a0 0x7f063419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f063410d560 con 0x7f0634101890 2024-09-10T23:24:12.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f063410d3e0 con 0x7f06341033a0 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f0638df3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f063410d6e0 con 0x7f06341029e0 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f063259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 0x7f0634198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f063259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 0x7f0634198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53470/0 (socket says 172.21.15.2:53470) 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.650+0000 7f063259c640 1 -- 172.21.15.2:0/3052629851 learned_addr learned my addr 172.21.15.2:0/3052629851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f0632d9d640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06341033a0 0x7f063419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f062bfff640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06341029e0 0x7f0634199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f063259c640 1 -- 172.21.15.2:0/3052629851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06341029e0 msgr2=0x7f0634199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f063259c640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06341029e0 0x7f0634199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f063259c640 1 -- 172.21.15.2:0/3052629851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06341033a0 msgr2=0x7f063419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f063259c640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06341033a0 0x7f063419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f063259c640 1 -- 172.21.15.2:0/3052629851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063419a980 con 0x7f0634101890 2024-09-10T23:24:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f062bfff640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06341029e0 0x7f0634199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f063259c640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 0x7f0634198e40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f062400d950 tx=0x7f062400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624017070 con 0x7f0634101890 2024-09-10T23:24:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063419ac70 con 0x7f0634101890 2024-09-10T23:24:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0624009c30 con 0x7f0634101890 2024-09-10T23:24:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062400f620 con 0x7f0634101890 2024-09-10T23:24:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.651+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06341a1340 con 0x7f0634101890 2024-09-10T23:24:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.652+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06341a1570 con 0x7f0634101890 2024-09-10T23:24:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.654+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0624010460 con 0x7f0634101890 2024-09-10T23:24:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.654+0000 7f062b7fe640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f06200b52e0 0x7f06200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.655+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f06240e58b0 con 0x7f0634101890 2024-09-10T23:24:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.655+0000 7f062bfff640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f06200b52e0 0x7f06200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.655+0000 7f062bfff640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f06200b52e0 0x7f06200b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f061c0096c0 tx=0x7f061c009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.657+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f06240ac780 con 0x7f0634101890 2024-09-10T23:24:12.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.842+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06341a17e0 con 0x7f0634101890 2024-09-10T23:24:12.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.842+0000 7f062b7fe640 1 -- 172.21.15.2:0/3052629851 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f0624009de0 con 0x7f0634101890 2024-09-10T23:24:12.843 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f06200b52e0 msgr2=0x7f06200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f06200b52e0 0x7f06200b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f061c0096c0 tx=0x7f061c009650 comp rx=0 tx=0).stop 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 msgr2=0x7f0634198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 0x7f0634198e40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f062400d950 tx=0x7f062400de10 comp rx=0 tx=0).stop 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 shutdown_connections 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f06200b52e0 0x7f06200b77a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06341033a0 0x7f063419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06341029e0 0x7f0634199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 --2- 172.21.15.2:0/3052629851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0634101890 0x7f0634198e40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 >> 172.21.15.2:0/3052629851 conn(0x7f06340fd150 msgr2=0x7f06340febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 shutdown_connections 2024-09-10T23:24:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.845+0000 7f0638df3640 1 -- 172.21.15.2:0/3052629851 wait complete. 2024-09-10T23:24:12.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 -- 172.21.15.2:0/1685525923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 msgr2=0x7fd240107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 --2- 172.21.15.2:0/1685525923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd240107f40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd234009900 tx=0x7fd23402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 -- 172.21.15.2:0/1685525923 shutdown_connections 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 --2- 172.21.15.2:0/1685525923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 0x7fd24010ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 --2- 172.21.15.2:0/1685525923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd240107f40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 --2- 172.21.15.2:0/1685525923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24006af00 0x7fd2401055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 -- 172.21.15.2:0/1685525923 >> 172.21.15.2:0/1685525923 conn(0x7fd2400fd140 msgr2=0x7fd2400ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 -- 172.21.15.2:0/1685525923 shutdown_connections 2024-09-10T23:24:12.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 -- 172.21.15.2:0/1685525923 wait complete. 2024-09-10T23:24:12.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 Processor -- start 2024-09-10T23:24:12.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.964+0000 7fd246448640 1 -- start start 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd246448640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24006af00 0x7fd240198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd246448640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd2401993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd246448640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 0x7fd240199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd246448640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd24010e5d0 con 0x7fd240105b30 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd246448640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd24010e450 con 0x7fd240108680 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd246448640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd24010e750 con 0x7fd24006af00 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd2401993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd2401993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53490/0 (socket says 172.21.15.2:53490) 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 -- 172.21.15.2:0/3399174199 learned_addr learned my addr 172.21.15.2:0/3399174199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23ffff640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24006af00 0x7fd240198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd2449e5640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 0x7fd240199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 -- 172.21.15.2:0/3399174199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24006af00 msgr2=0x7fd240198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24006af00 0x7fd240198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 -- 172.21.15.2:0/3399174199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 msgr2=0x7fd240199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 0x7fd240199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 -- 172.21.15.2:0/3399174199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24019a890 con 0x7fd240105b30 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd2449e5640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 0x7fd240199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.965+0000 7fd23f7fe640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd2401993a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd234006010 tx=0x7fd234004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.966+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23403f030 con 0x7fd240105b30 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.966+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24019ab20 con 0x7fd240105b30 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.966+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd234003cb0 con 0x7fd240105b30 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.966+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234035070 con 0x7fd240105b30 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.966+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2401a1250 con 0x7fd240105b30 2024-09-10T23:24:12.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.967+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd240105f30 con 0x7fd240105b30 2024-09-10T23:24:12.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.969+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd23403bc40 con 0x7fd240105b30 2024-09-10T23:24:12.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.969+0000 7fd23d7fa640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd2280b52e0 0x7fd2280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.970+0000 7fd23ffff640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd2280b52e0 0x7fd2280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.970+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd2341069c0 con 0x7fd240105b30 2024-09-10T23:24:12.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.970+0000 7fd23ffff640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd2280b52e0 0x7fd2280b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd2300058c0 tx=0x7fd23000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:12.973+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2340cd830 con 0x7fd240105b30 2024-09-10T23:24:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.157+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd240063d50 con 0x7fd240105b30 2024-09-10T23:24:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.158+0000 7fd23d7fa640 1 -- 172.21.15.2:0/3399174199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fd234003e60 con 0x7fd240105b30 2024-09-10T23:24:13.159 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-10T23:24:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd2280b52e0 msgr2=0x7fd2280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd2280b52e0 0x7fd2280b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd2300058c0 tx=0x7fd23000a250 comp rx=0 tx=0).stop 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 msgr2=0x7fd2401993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd2401993a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd234006010 tx=0x7fd234004430 comp rx=0 tx=0).stop 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 shutdown_connections 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd2280b52e0 0x7fd2280b77a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd240108680 0x7fd240199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240105b30 0x7fd2401993a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 --2- 172.21.15.2:0/3399174199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24006af00 0x7fd240198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 >> 172.21.15.2:0/3399174199 conn(0x7fd2400fd140 msgr2=0x7fd240103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.160+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 shutdown_connections 2024-09-10T23:24:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.161+0000 7fd246448640 1 -- 172.21.15.2:0/3399174199 wait complete. 2024-09-10T23:24:13.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:12 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/577286665' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T23:24:13.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:12 smithi002 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T23:24:13.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:12 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2954908082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:13.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:12 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/717792373' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:24:13.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:12 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3052629851' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:24:13.172 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T23:24:13.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:24:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:12 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/577286665' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T23:24:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:12 smithi177 ceph-mon[35760]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T23:24:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:12 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2954908082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:12 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/717792373' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:24:13.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:12 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3052629851' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:24:13.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:12 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/577286665' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T23:24:13.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:12 smithi154 ceph-mon[35136]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T23:24:13.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:12 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2954908082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:13.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:12 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/717792373' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:24:13.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:12 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3052629851' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:24:13.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 -- 172.21.15.2:0/3772341693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce781087d0 msgr2=0x7fce78108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/3772341693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce781087d0 0x7fce78108c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fce68009900 tx=0x7fce6802a410 comp rx=0 tx=0).stop 2024-09-10T23:24:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 -- 172.21.15.2:0/3772341693 shutdown_connections 2024-09-10T23:24:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/3772341693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce78109150 0x7fce7810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/3772341693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce781087d0 0x7fce78108c10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/3772341693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce78102dc0 0x7fce781031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 -- 172.21.15.2:0/3772341693 >> 172.21.15.2:0/3772341693 conn(0x7fce780fe830 msgr2=0x7fce78100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 -- 172.21.15.2:0/3772341693 shutdown_connections 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.951+0000 7fce7ffbf640 1 -- 172.21.15.2:0/3772341693 wait complete. 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 Processor -- start 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 -- start start 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 0x7fce78199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce781087d0 0x7fce78199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce78109150 0x7fce7819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce78112e60 con 0x7fce78102dc0 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce78112ce0 con 0x7fce78109150 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7ffbf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fce78112fe0 con 0x7fce781087d0 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.952+0000 7fce7dd5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 0x7fce78199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 0x7fce78199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53510/0 (socket says 172.21.15.2:53510) 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 -- 172.21.15.2:0/219486054 learned_addr learned my addr 172.21.15.2:0/219486054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7d55a640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce781087d0 0x7fce78199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7e55c640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce78109150 0x7fce7819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 -- 172.21.15.2:0/219486054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce781087d0 msgr2=0x7fce78199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce781087d0 0x7fce78199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 -- 172.21.15.2:0/219486054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce78109150 msgr2=0x7fce7819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce78109150 0x7fce7819ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 -- 172.21.15.2:0/219486054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7819f3c0 con 0x7fce78102dc0 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7d55a640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce781087d0 0x7fce78199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7dd5b640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 0x7fce78199310 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fce7400b4a0 tx=0x7fce7400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74014070 con 0x7fce78102dc0 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce74010ac0 con 0x7fce78102dc0 2024-09-10T23:24:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74017c30 con 0x7fce78102dc0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7819f6b0 con 0x7fce78102dc0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.953+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce781a5f40 con 0x7fce78102dc0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.954+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce781031a0 con 0x7fce78102dc0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.956+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fce74010610 con 0x7fce78102dc0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.957+0000 7fce6effd640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fce640b5360 0x7fce640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.957+0000 7fce7d55a640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fce640b5360 0x7fce640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.957+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fce740e54c0 con 0x7fce78102dc0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.958+0000 7fce7d55a640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fce640b5360 0x7fce640b7820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce68005ab0 tx=0x7fce68000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:13.960+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fce740ac390 con 0x7fce78102dc0 2024-09-10T23:24:14.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.182+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce7819a440 con 0x7fce78102dc0 2024-09-10T23:24:14.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:13 smithi002 ceph-mon[31150]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:24:14.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:13 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3399174199' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:24:14.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.183+0000 7fce6effd640 1 -- 172.21.15.2:0/219486054 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fce7819a440 con 0x7fce78102dc0 2024-09-10T23:24:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:14.185 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:24:14.185 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:24:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.186+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fce640b5360 msgr2=0x7fce640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.186+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fce640b5360 0x7fce640b7820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce68005ab0 tx=0x7fce68000bc0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.186+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 msgr2=0x7fce78199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.186+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 0x7fce78199310 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fce7400b4a0 tx=0x7fce7400b960 comp rx=0 tx=0).stop 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 shutdown_connections 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fce640b5360 0x7fce640b7820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce78109150 0x7fce7819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce781087d0 0x7fce78199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 --2- 172.21.15.2:0/219486054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce78102dc0 0x7fce78199310 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 >> 172.21.15.2:0/219486054 conn(0x7fce780fe830 msgr2=0x7fce78100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 shutdown_connections 2024-09-10T23:24:14.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:14.187+0000 7fce7ffbf640 1 -- 172.21.15.2:0/219486054 wait complete. 2024-09-10T23:24:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:13 smithi177 ceph-mon[35760]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:24:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:13 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3399174199' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:24:14.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:13 smithi154 ceph-mon[35136]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:24:14.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:13 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3399174199' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:24:14.963 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T23:24:14.963 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T23:24:14.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:24:15.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 -- 172.21.15.2:0/3296082432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d01018b0 msgr2=0x7f61d0101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 --2- 172.21.15.2:0/3296082432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d01018b0 0x7f61d0101cb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009930 tx=0x7f61c002a420 comp rx=0 tx=0).stop 2024-09-10T23:24:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 -- 172.21.15.2:0/3296082432 shutdown_connections 2024-09-10T23:24:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 --2- 172.21.15.2:0/3296082432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d01033c0 0x7f61d0109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 --2- 172.21.15.2:0/3296082432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61d0102a00 0x7f61d0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 --2- 172.21.15.2:0/3296082432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d01018b0 0x7f61d0101cb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 -- 172.21.15.2:0/3296082432 >> 172.21.15.2:0/3296082432 conn(0x7f61d00fd190 msgr2=0x7f61d00ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 -- 172.21.15.2:0/3296082432 shutdown_connections 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.071+0000 7f61d4edd640 1 -- 172.21.15.2:0/3296082432 wait complete. 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 Processor -- start 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 -- start start 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61d01018b0 0x7f61d0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 0x7f61d0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d01033c0 0x7f61d019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f61d010e610 con 0x7f61d0102a00 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61d010e490 con 0x7f61d01033c0 2024-09-10T23:24:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61d4edd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61d010e790 con 0x7f61d01018b0 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 0x7f61d0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 0x7f61d0199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53532/0 (socket says 172.21.15.2:53532) 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.072+0000 7f61c7fff640 1 -- 172.21.15.2:0/1553729002 learned_addr learned my addr 172.21.15.2:0/1553729002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61ce59c640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61d01018b0 0x7f61d0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61ced9d640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d01033c0 0x7f61d019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c7fff640 1 -- 172.21.15.2:0/1553729002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61d01018b0 msgr2=0x7f61d0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c7fff640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61d01018b0 0x7f61d0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c7fff640 1 -- 172.21.15.2:0/1553729002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d01033c0 msgr2=0x7f61d019a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c7fff640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d01033c0 0x7f61d019a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c7fff640 1 -- 172.21.15.2:0/1553729002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d019a910 con 0x7f61d0102a00 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c7fff640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 0x7f61d0199420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c920 tx=0x7f61b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8007c70 con 0x7f61d0102a00 2024-09-10T23:24:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b8007e10 con 0x7f61d0102a00 2024-09-10T23:24:15.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d019ac00 con 0x7f61d0102a00 2024-09-10T23:24:15.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8018820 con 0x7f61d0102a00 2024-09-10T23:24:15.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.073+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d01a12d0 con 0x7f61d0102a00 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.074+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d0108bc0 con 0x7f61d0102a00 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.076+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f61b800f450 con 0x7f61d0102a00 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.077+0000 7f61c77fe640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f61bc0b52e0 0x7f61bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.077+0000 7f61ce59c640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f61bc0b52e0 0x7f61bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.077+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f61b80e5f50 con 0x7f61d0102a00 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.078+0000 7f61ce59c640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f61bc0b52e0 0x7f61bc0b77a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009900 tx=0x7f61c0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.080+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f61b8014030 con 0x7f61d0102a00 2024-09-10T23:24:15.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:14 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/219486054' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:15.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:14 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/219486054' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.262+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61d0063590 con 0x7f61bc0b52e0 2024-09-10T23:24:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.266+0000 7f61c77fe640 1 -- 172.21.15.2:0/1553729002 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259040 (secure 0 0 0) 0x7f61d0063590 con 0x7f61bc0b52e0 2024-09-10T23:24:15.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:24:15.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f61bc0b52e0 msgr2=0x7f61bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f61bc0b52e0 0x7f61bc0b77a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009900 tx=0x7f61c0000bc0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 msgr2=0x7f61d0199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 0x7f61d0199420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c920 tx=0x7f61b800cde0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 shutdown_connections 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f61bc0b52e0 0x7f61bc0b77a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d01033c0 0x7f61d019a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d0102a00 0x7f61d0199420 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 --2- 172.21.15.2:0/1553729002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61d01018b0 0x7f61d0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 >> 172.21.15.2:0/1553729002 conn(0x7f61d00fd190 msgr2=0x7f61d0105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 shutdown_connections 2024-09-10T23:24:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.269+0000 7f61d4edd640 1 -- 172.21.15.2:0/1553729002 wait complete. 2024-09-10T23:24:15.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:14 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/219486054' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:15.281 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-10T23:24:14.244756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659507,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":677,"num_write":381,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952987,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":814,"ondisk_log_size":814,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376256,"kb_used_data":10368,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565568,"statfs":{"total":1151940427776,"available":1151555141632,"internally_reserved":0,"allocated":10616832,"data_stored":6792713,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002941"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614723+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:23:50.614723+0000","last_peered":"2024-09-10T23:23:50.614723+0000","last_clean":"2024-09-10T23:23:50.614723+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:23:50.614723+0000","last_undegraded":"2024-09-10T23:23:50.614723+0000","last_fullsized":"2024-09-10T23:23:50.614723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615183+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:23:50.615183+0000","last_peered":"2024-09-10T23:23:50.615183+0000","last_clean":"2024-09-10T23:23:50.615183+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:23:50.615183+0000","last_undegraded":"2024-09-10T23:23:50.615183+0000","last_fullsized":"2024-09-10T23:23:50.615183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623059+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:23:50.623059+0000","last_peered":"2024-09-10T23:23:50.623059+0000","last_clean":"2024-09-10T23:23:50.623059+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:23:50.623059+0000","last_undegraded":"2024-09-10T23:23:50.623059+0000","last_fullsized":"2024-09-10T23:23:50.623059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.605552+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:23:50.605552+0000","last_peered":"2024-09-10T23:23:50.605552+0000","last_clean":"2024-09-10T23:23:50.605552+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:23:50.605552+0000","last_undegraded":"2024-09-10T23:23:50.605552+0000","last_fullsized":"2024-09-10T23:23:50.605552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.603902+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:23:50.603902+0000","last_peered":"2024-09-10T23:23:50.603902+0000","last_clean":"2024-09-10T23:23:50.603902+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:23:50.603902+0000","last_undegraded":"2024-09-10T23:23:50.603902+0000","last_fullsized":"2024-09-10T23:23:50.603902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612201+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:23:50.612201+0000","last_peered":"2024-09-10T23:23:50.612201+0000","last_clean":"2024-09-10T23:23:50.612201+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:23:50.612201+0000","last_undegraded":"2024-09-10T23:23:50.612201+0000","last_fullsized":"2024-09-10T23:23:50.612201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608056+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:23:50.608056+0000","last_peered":"2024-09-10T23:23:50.608056+0000","last_clean":"2024-09-10T23:23:50.608056+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:23:50.608056+0000","last_undegraded":"2024-09-10T23:23:50.608056+0000","last_fullsized":"2024-09-10T23:23:50.608056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608388+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:23:50.608388+0000","last_peered":"2024-09-10T23:23:50.608388+0000","last_clean":"2024-09-10T23:23:50.608388+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:23:50.608388+0000","last_undegraded":"2024-09-10T23:23:50.608388+0000","last_fullsized":"2024-09-10T23:23:50.608388+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623075+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:23:50.623075+0000","last_peered":"2024-09-10T23:23:50.623075+0000","last_clean":"2024-09-10T23:23:50.623075+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:23:50.623075+0000","last_undegraded":"2024-09-10T23:23:50.623075+0000","last_fullsized":"2024-09-10T23:23:50.623075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608978+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:23:50.608978+0000","last_peered":"2024-09-10T23:23:50.608978+0000","last_clean":"2024-09-10T23:23:50.608978+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:23:50.608978+0000","last_undegraded":"2024-09-10T23:23:50.608978+0000","last_fullsized":"2024-09-10T23:23:50.608978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617956+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:23:50.617956+0000","last_peered":"2024-09-10T23:23:50.617956+0000","last_clean":"2024-09-10T23:23:50.617956+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:23:50.617956+0000","last_undegraded":"2024-09-10T23:23:50.617956+0000","last_fullsized":"2024-09-10T23:23:50.617956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.601149+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:23:50.601149+0000","last_peered":"2024-09-10T23:23:50.601149+0000","last_clean":"2024-09-10T23:23:50.601149+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:23:50.601149+0000","last_undegraded":"2024-09-10T23:23:50.601149+0000","last_fullsized":"2024-09-10T23:23:50.601149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.597496+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:23:50.597496+0000","last_peered":"2024-09-10T23:23:50.597496+0000","last_clean":"2024-09-10T23:23:50.597496+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:23:50.597496+0000","last_undegraded":"2024-09-10T23:23:50.597496+0000","last_fullsized":"2024-09-10T23:23:50.597496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616290+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:23:50.616290+0000","last_peered":"2024-09-10T23:23:50.616290+0000","last_clean":"2024-09-10T23:23:50.616290+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:23:50.616290+0000","last_undegraded":"2024-09-10T23:23:50.616290+0000","last_fullsized":"2024-09-10T23:23:50.616290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616089+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:23:50.616089+0000","last_peered":"2024-09-10T23:23:50.616089+0000","last_clean":"2024-09-10T23:23:50.616089+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:23:50.616089+0000","last_undegraded":"2024-09-10T23:23:50.616089+0000","last_fullsized":"2024-09-10T23:23:50.616089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624294+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:23:50.624294+0000","last_peered":"2024-09-10T23:23:50.624294+0000","last_clean":"2024-09-10T23:23:50.624294+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:23:50.624294+0000","last_undegraded":"2024-09-10T23:23:50.624294+0000","last_fullsized":"2024-09-10T23:23:50.624294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614754+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:23:50.614754+0000","last_peered":"2024-09-10T23:23:50.614754+0000","last_clean":"2024-09-10T23:23:50.614754+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:23:50.614754+0000","last_undegraded":"2024-09-10T23:23:50.614754+0000","last_fullsized":"2024-09-10T23:23:50.614754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622614+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:23:50.622614+0000","last_peered":"2024-09-10T23:23:50.622614+0000","last_clean":"2024-09-10T23:23:50.622614+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:23:50.622614+0000","last_undegraded":"2024-09-10T23:23:50.622614+0000","last_fullsized":"2024-09-10T23:23:50.622614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.607920+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:23:50.607920+0000","last_peered":"2024-09-10T23:23:50.607920+0000","last_clean":"2024-09-10T23:23:50.607920+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:23:50.607920+0000","last_undegraded":"2024-09-10T23:23:50.607920+0000","last_fullsized":"2024-09-10T23:23:50.607920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610273+0000","last_change":"2024-09-10T23:22:51.492807+0000","last_active":"2024-09-10T23:23:50.610273+0000","last_peered":"2024-09-10T23:23:50.610273+0000","last_clean":"2024-09-10T23:23:50.610273+0000","last_became_active":"2024-09-10T23:22:51.492343+0000","last_became_peered":"2024-09-10T23:22:51.492343+0000","last_unstale":"2024-09-10T23:23:50.610273+0000","last_undegraded":"2024-09-10T23:23:50.610273+0000","last_fullsized":"2024-09-10T23:23:50.610273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:59.573883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614998+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:23:50.614998+0000","last_peered":"2024-09-10T23:23:50.614998+0000","last_clean":"2024-09-10T23:23:50.614998+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:23:50.614998+0000","last_undegraded":"2024-09-10T23:23:50.614998+0000","last_fullsized":"2024-09-10T23:23:50.614998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623967+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:23:50.623967+0000","last_peered":"2024-09-10T23:23:50.623967+0000","last_clean":"2024-09-10T23:23:50.623967+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:23:50.623967+0000","last_undegraded":"2024-09-10T23:23:50.623967+0000","last_fullsized":"2024-09-10T23:23:50.623967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615277+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:23:50.615277+0000","last_peered":"2024-09-10T23:23:50.615277+0000","last_clean":"2024-09-10T23:23:50.615277+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:23:50.615277+0000","last_undegraded":"2024-09-10T23:23:50.615277+0000","last_fullsized":"2024-09-10T23:23:50.615277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.609534+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:23:50.609534+0000","last_peered":"2024-09-10T23:23:50.609534+0000","last_clean":"2024-09-10T23:23:50.609534+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:23:50.609534+0000","last_undegraded":"2024-09-10T23:23:50.609534+0000","last_fullsized":"2024-09-10T23:23:50.609534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610726+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:23:50.610726+0000","last_peered":"2024-09-10T23:23:50.610726+0000","last_clean":"2024-09-10T23:23:50.610726+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:23:50.610726+0000","last_undegraded":"2024-09-10T23:23:50.610726+0000","last_fullsized":"2024-09-10T23:23:50.610726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622570+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:23:50.622570+0000","last_peered":"2024-09-10T23:23:50.622570+0000","last_clean":"2024-09-10T23:23:50.622570+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:23:50.622570+0000","last_undegraded":"2024-09-10T23:23:50.622570+0000","last_fullsized":"2024-09-10T23:23:50.622570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612488+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:23:50.612488+0000","last_peered":"2024-09-10T23:23:50.612488+0000","last_clean":"2024-09-10T23:23:50.612488+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:23:50.612488+0000","last_undegraded":"2024-09-10T23:23:50.612488+0000","last_fullsized":"2024-09-10T23:23:50.612488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614174+0000","last_change":"2024-09-10T23:22:51.488675+0000","last_active":"2024-09-10T23:23:50.614174+0000","last_peered":"2024-09-10T23:23:50.614174+0000","last_clean":"2024-09-10T23:23:50.614174+0000","last_became_active":"2024-09-10T23:22:51.488291+0000","last_became_peered":"2024-09-10T23:22:51.488291+0000","last_unstale":"2024-09-10T23:23:50.614174+0000","last_undegraded":"2024-09-10T23:23:50.614174+0000","last_fullsized":"2024-09-10T23:23:50.614174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615996+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:23:50.615996+0000","last_peered":"2024-09-10T23:23:50.615996+0000","last_clean":"2024-09-10T23:23:50.615996+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:23:50.615996+0000","last_undegraded":"2024-09-10T23:23:50.615996+0000","last_fullsized":"2024-09-10T23:23:50.615996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614632+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:23:50.614632+0000","last_peered":"2024-09-10T23:23:50.614632+0000","last_clean":"2024-09-10T23:23:50.614632+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:23:50.614632+0000","last_undegraded":"2024-09-10T23:23:50.614632+0000","last_fullsized":"2024-09-10T23:23:50.614632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615076+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:23:50.615076+0000","last_peered":"2024-09-10T23:23:50.615076+0000","last_clean":"2024-09-10T23:23:50.615076+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:23:50.615076+0000","last_undegraded":"2024-09-10T23:23:50.615076+0000","last_fullsized":"2024-09-10T23:23:50.615076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614699+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:23:50.614699+0000","last_peered":"2024-09-10T23:23:50.614699+0000","last_clean":"2024-09-10T23:23:50.614699+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:23:50.614699+0000","last_undegraded":"2024-09-10T23:23:50.614699+0000","last_fullsized":"2024-09-10T23:23:50.614699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.595682+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:23:50.595682+0000","last_peered":"2024-09-10T23:23:50.595682+0000","last_clean":"2024-09-10T23:23:50.595682+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:23:50.595682+0000","last_undegraded":"2024-09-10T23:23:50.595682+0000","last_fullsized":"2024-09-10T23:23:50.595682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":151,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.605507+0000","last_change":"2024-09-10T23:22:51.506742+0000","last_active":"2024-09-10T23:24:10.605507+0000","last_peered":"2024-09-10T23:24:10.605507+0000","last_clean":"2024-09-10T23:24:10.605507+0000","last_became_active":"2024-09-10T23:22:51.493588+0000","last_became_peered":"2024-09-10T23:22:51.493588+0000","last_unstale":"2024-09-10T23:24:10.605507+0000","last_undegraded":"2024-09-10T23:24:10.605507+0000","last_fullsized":"2024-09-10T23:24:10.605507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:42.641981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.613512+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:23:50.613512+0000","last_peered":"2024-09-10T23:23:50.613512+0000","last_clean":"2024-09-10T23:23:50.613512+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:23:50.613512+0000","last_undegraded":"2024-09-10T23:23:50.613512+0000","last_fullsized":"2024-09-10T23:23:50.613512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610161+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:23:50.610161+0000","last_peered":"2024-09-10T23:23:50.610161+0000","last_clean":"2024-09-10T23:23:50.610161+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:23:50.610161+0000","last_undegraded":"2024-09-10T23:23:50.610161+0000","last_fullsized":"2024-09-10T23:23:50.610161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488201+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:51.488201+0000","last_peered":"2024-09-10T23:22:51.488201+0000","last_clean":"2024-09-10T23:22:51.488201+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:51.488201+0000","last_undegraded":"2024-09-10T23:22:51.488201+0000","last_fullsized":"2024-09-10T23:22:51.488201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612135+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:23:50.612135+0000","last_peered":"2024-09-10T23:23:50.612135+0000","last_clean":"2024-09-10T23:23:50.612135+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:23:50.612135+0000","last_undegraded":"2024-09-10T23:23:50.612135+0000","last_fullsized":"2024-09-10T23:23:50.612135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'6","reported_seq":235,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.597678+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:24:10.597678+0000","last_peered":"2024-09-10T23:24:10.597678+0000","last_clean":"2024-09-10T23:24:10.597678+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:24:10.597678+0000","last_undegraded":"2024-09-10T23:24:10.597678+0000","last_fullsized":"2024-09-10T23:24:10.597678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624868+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:23:50.624868+0000","last_peered":"2024-09-10T23:23:50.624868+0000","last_clean":"2024-09-10T23:23:50.624868+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:23:50.624868+0000","last_undegraded":"2024-09-10T23:23:50.624868+0000","last_fullsized":"2024-09-10T23:23:50.624868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492077+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:51.492077+0000","last_peered":"2024-09-10T23:22:51.492077+0000","last_clean":"2024-09-10T23:22:51.492077+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:51.492077+0000","last_undegraded":"2024-09-10T23:22:51.492077+0000","last_fullsized":"2024-09-10T23:22:51.492077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616353+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:23:50.616353+0000","last_peered":"2024-09-10T23:23:50.616353+0000","last_clean":"2024-09-10T23:23:50.616353+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:23:50.616353+0000","last_undegraded":"2024-09-10T23:23:50.616353+0000","last_fullsized":"2024-09-10T23:23:50.616353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488638+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:51.488638+0000","last_peered":"2024-09-10T23:22:51.488638+0000","last_clean":"2024-09-10T23:22:51.488638+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:51.488638+0000","last_undegraded":"2024-09-10T23:22:51.488638+0000","last_fullsized":"2024-09-10T23:22:51.488638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624094+0000","last_change":"2024-09-10T23:22:51.490154+0000","last_active":"2024-09-10T23:23:50.624094+0000","last_peered":"2024-09-10T23:23:50.624094+0000","last_clean":"2024-09-10T23:23:50.624094+0000","last_became_active":"2024-09-10T23:22:51.489716+0000","last_became_peered":"2024-09-10T23:22:51.489716+0000","last_unstale":"2024-09-10T23:23:50.624094+0000","last_undegraded":"2024-09-10T23:23:50.624094+0000","last_fullsized":"2024-09-10T23:23:50.624094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.280542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'35","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.605170+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:24:10.605170+0000","last_peered":"2024-09-10T23:24:10.605170+0000","last_clean":"2024-09-10T23:24:10.605170+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:24:10.605170+0000","last_undegraded":"2024-09-10T23:24:10.605170+0000","last_fullsized":"2024-09-10T23:24:10.605170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61419,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":169,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611419+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:23:50.611419+0000","last_peered":"2024-09-10T23:23:50.611419+0000","last_clean":"2024-09-10T23:23:50.611419+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:23:50.611419+0000","last_undegraded":"2024-09-10T23:23:50.611419+0000","last_fullsized":"2024-09-10T23:23:50.611419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491721+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:51.491721+0000","last_peered":"2024-09-10T23:22:51.491721+0000","last_clean":"2024-09-10T23:22:51.491721+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:51.491721+0000","last_undegraded":"2024-09-10T23:22:51.491721+0000","last_fullsized":"2024-09-10T23:22:51.491721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.603550+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:23:50.603550+0000","last_peered":"2024-09-10T23:23:50.603550+0000","last_clean":"2024-09-10T23:23:50.603550+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:23:50.603550+0000","last_undegraded":"2024-09-10T23:23:50.603550+0000","last_fullsized":"2024-09-10T23:23:50.603550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488112+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:51.488112+0000","last_peered":"2024-09-10T23:22:51.488112+0000","last_clean":"2024-09-10T23:22:51.488112+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:51.488112+0000","last_undegraded":"2024-09-10T23:22:51.488112+0000","last_fullsized":"2024-09-10T23:22:51.488112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612284+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:23:50.612284+0000","last_peered":"2024-09-10T23:23:50.612284+0000","last_clean":"2024-09-10T23:23:50.612284+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:23:50.612284+0000","last_undegraded":"2024-09-10T23:23:50.612284+0000","last_fullsized":"2024-09-10T23:23:50.612284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.581668+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:24:10.581668+0000","last_peered":"2024-09-10T23:24:10.581668+0000","last_clean":"2024-09-10T23:24:10.581668+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:24:10.581668+0000","last_undegraded":"2024-09-10T23:24:10.581668+0000","last_fullsized":"2024-09-10T23:24:10.581668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608717+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:23:50.608717+0000","last_peered":"2024-09-10T23:23:50.608717+0000","last_clean":"2024-09-10T23:23:50.608717+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:23:50.608717+0000","last_undegraded":"2024-09-10T23:23:50.608717+0000","last_fullsized":"2024-09-10T23:23:50.608717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486630+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:51.486630+0000","last_peered":"2024-09-10T23:22:51.486630+0000","last_clean":"2024-09-10T23:22:51.486630+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:51.486630+0000","last_undegraded":"2024-09-10T23:22:51.486630+0000","last_fullsized":"2024-09-10T23:22:51.486630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617058+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:23:50.617058+0000","last_peered":"2024-09-10T23:23:50.617058+0000","last_clean":"2024-09-10T23:23:50.617058+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:23:50.617058+0000","last_undegraded":"2024-09-10T23:23:50.617058+0000","last_fullsized":"2024-09-10T23:23:50.617058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.510546+0000","last_change":"2024-09-10T23:22:51.510092+0000","last_active":"2024-09-10T23:22:51.510546+0000","last_peered":"2024-09-10T23:22:51.510546+0000","last_clean":"2024-09-10T23:22:51.510546+0000","last_became_active":"2024-09-10T23:22:51.489887+0000","last_became_peered":"2024-09-10T23:22:51.489887+0000","last_unstale":"2024-09-10T23:22:51.510546+0000","last_undegraded":"2024-09-10T23:22:51.510546+0000","last_fullsized":"2024-09-10T23:22:51.510546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:14.757355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612385+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:23:50.612385+0000","last_peered":"2024-09-10T23:23:50.612385+0000","last_clean":"2024-09-10T23:23:50.612385+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:23:50.612385+0000","last_undegraded":"2024-09-10T23:23:50.612385+0000","last_fullsized":"2024-09-10T23:23:50.612385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486119+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:51.486119+0000","last_peered":"2024-09-10T23:22:51.486119+0000","last_clean":"2024-09-10T23:22:51.486119+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:51.486119+0000","last_undegraded":"2024-09-10T23:22:51.486119+0000","last_fullsized":"2024-09-10T23:22:51.486119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611494+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:23:50.611494+0000","last_peered":"2024-09-10T23:23:50.611494+0000","last_clean":"2024-09-10T23:23:50.611494+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:23:50.611494+0000","last_undegraded":"2024-09-10T23:23:50.611494+0000","last_fullsized":"2024-09-10T23:23:50.611494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488710+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:51.488710+0000","last_peered":"2024-09-10T23:22:51.488710+0000","last_clean":"2024-09-10T23:22:51.488710+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:51.488710+0000","last_undegraded":"2024-09-10T23:22:51.488710+0000","last_fullsized":"2024-09-10T23:22:51.488710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.609307+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:23:50.609307+0000","last_peered":"2024-09-10T23:23:50.609307+0000","last_clean":"2024-09-10T23:23:50.609307+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:23:50.609307+0000","last_undegraded":"2024-09-10T23:23:50.609307+0000","last_fullsized":"2024-09-10T23:23:50.609307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'7","reported_seq":140,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:12.601473+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:24:12.601473+0000","last_peered":"2024-09-10T23:24:12.601473+0000","last_clean":"2024-09-10T23:24:12.601473+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:24:12.601473+0000","last_undegraded":"2024-09-10T23:24:12.601473+0000","last_fullsized":"2024-09-10T23:24:12.601473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.618080+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:23:50.618080+0000","last_peered":"2024-09-10T23:23:50.618080+0000","last_clean":"2024-09-10T23:23:50.618080+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:23:50.618080+0000","last_undegraded":"2024-09-10T23:23:50.618080+0000","last_fullsized":"2024-09-10T23:23:50.618080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491782+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:51.491782+0000","last_peered":"2024-09-10T23:22:51.491782+0000","last_clean":"2024-09-10T23:22:51.491782+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:51.491782+0000","last_undegraded":"2024-09-10T23:22:51.491782+0000","last_fullsized":"2024-09-10T23:22:51.491782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484149+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:51.484149+0000","last_peered":"2024-09-10T23:22:51.484149+0000","last_clean":"2024-09-10T23:22:51.484149+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:51.484149+0000","last_undegraded":"2024-09-10T23:22:51.484149+0000","last_fullsized":"2024-09-10T23:22:51.484149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622230+0000","last_change":"2024-09-10T23:22:51.489197+0000","last_active":"2024-09-10T23:23:50.622230+0000","last_peered":"2024-09-10T23:23:50.622230+0000","last_clean":"2024-09-10T23:23:50.622230+0000","last_became_active":"2024-09-10T23:22:51.488701+0000","last_became_peered":"2024-09-10T23:22:51.488701+0000","last_unstale":"2024-09-10T23:23:50.622230+0000","last_undegraded":"2024-09-10T23:23:50.622230+0000","last_fullsized":"2024-09-10T23:23:50.622230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:47.899980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491615+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:51.491615+0000","last_peered":"2024-09-10T23:22:51.491615+0000","last_clean":"2024-09-10T23:22:51.491615+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:51.491615+0000","last_undegraded":"2024-09-10T23:22:51.491615+0000","last_fullsized":"2024-09-10T23:22:51.491615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615068+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:23:50.615068+0000","last_peered":"2024-09-10T23:23:50.615068+0000","last_clean":"2024-09-10T23:23:50.615068+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:23:50.615068+0000","last_undegraded":"2024-09-10T23:23:50.615068+0000","last_fullsized":"2024-09-10T23:23:50.615068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:11.582380+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:24:11.582380+0000","last_peered":"2024-09-10T23:24:11.582380+0000","last_clean":"2024-09-10T23:24:11.582380+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:24:11.582380+0000","last_undegraded":"2024-09-10T23:24:11.582380+0000","last_fullsized":"2024-09-10T23:24:11.582380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615926+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:23:50.615926+0000","last_peered":"2024-09-10T23:23:50.615926+0000","last_clean":"2024-09-10T23:23:50.615926+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:23:50.615926+0000","last_undegraded":"2024-09-10T23:23:50.615926+0000","last_fullsized":"2024-09-10T23:23:50.615926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:11.582606+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:24:11.582606+0000","last_peered":"2024-09-10T23:24:11.582606+0000","last_clean":"2024-09-10T23:24:11.582606+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:24:11.582606+0000","last_undegraded":"2024-09-10T23:24:11.582606+0000","last_fullsized":"2024-09-10T23:24:11.582606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612613+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:23:50.612613+0000","last_peered":"2024-09-10T23:23:50.612613+0000","last_clean":"2024-09-10T23:23:50.612613+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:23:50.612613+0000","last_undegraded":"2024-09-10T23:23:50.612613+0000","last_fullsized":"2024-09-10T23:23:50.612613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482986+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:51.482986+0000","last_peered":"2024-09-10T23:22:51.482986+0000","last_clean":"2024-09-10T23:22:51.482986+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:51.482986+0000","last_undegraded":"2024-09-10T23:22:51.482986+0000","last_fullsized":"2024-09-10T23:22:51.482986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611442+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:23:50.611442+0000","last_peered":"2024-09-10T23:23:50.611442+0000","last_clean":"2024-09-10T23:23:50.611442+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:23:50.611442+0000","last_undegraded":"2024-09-10T23:23:50.611442+0000","last_fullsized":"2024-09-10T23:23:50.611442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.498531+0000","last_change":"2024-09-10T23:22:51.498021+0000","last_active":"2024-09-10T23:22:51.498531+0000","last_peered":"2024-09-10T23:22:51.498531+0000","last_clean":"2024-09-10T23:22:51.498531+0000","last_became_active":"2024-09-10T23:22:51.488787+0000","last_became_peered":"2024-09-10T23:22:51.488787+0000","last_unstale":"2024-09-10T23:22:51.498531+0000","last_undegraded":"2024-09-10T23:22:51.498531+0000","last_fullsized":"2024-09-10T23:22:51.498531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:46.855288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611647+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:23:50.611647+0000","last_peered":"2024-09-10T23:23:50.611647+0000","last_clean":"2024-09-10T23:23:50.611647+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:23:50.611647+0000","last_undegraded":"2024-09-10T23:23:50.611647+0000","last_fullsized":"2024-09-10T23:23:50.611647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'17","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.483124+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:51.483124+0000","last_peered":"2024-09-10T23:22:51.483124+0000","last_clean":"2024-09-10T23:22:51.483124+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:51.483124+0000","last_undegraded":"2024-09-10T23:22:51.483124+0000","last_fullsized":"2024-09-10T23:22:51.483124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610312+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:23:50.610312+0000","last_peered":"2024-09-10T23:23:50.610312+0000","last_clean":"2024-09-10T23:23:50.610312+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:23:50.610312+0000","last_undegraded":"2024-09-10T23:23:50.610312+0000","last_fullsized":"2024-09-10T23:23:50.610312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484358+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:51.484358+0000","last_peered":"2024-09-10T23:22:51.484358+0000","last_clean":"2024-09-10T23:22:51.484358+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:51.484358+0000","last_undegraded":"2024-09-10T23:22:51.484358+0000","last_fullsized":"2024-09-10T23:22:51.484358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616309+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:23:50.616309+0000","last_peered":"2024-09-10T23:23:50.616309+0000","last_clean":"2024-09-10T23:23:50.616309+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:23:50.616309+0000","last_undegraded":"2024-09-10T23:23:50.616309+0000","last_fullsized":"2024-09-10T23:23:50.616309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485900+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:51.485900+0000","last_peered":"2024-09-10T23:22:51.485900+0000","last_clean":"2024-09-10T23:22:51.485900+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:51.485900+0000","last_undegraded":"2024-09-10T23:22:51.485900+0000","last_fullsized":"2024-09-10T23:22:51.485900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.575629+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:23:50.575629+0000","last_peered":"2024-09-10T23:23:50.575629+0000","last_clean":"2024-09-10T23:23:50.575629+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:23:50.575629+0000","last_undegraded":"2024-09-10T23:23:50.575629+0000","last_fullsized":"2024-09-10T23:23:50.575629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544426+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:51.544426+0000","last_peered":"2024-09-10T23:22:51.544426+0000","last_clean":"2024-09-10T23:22:51.544426+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:51.544426+0000","last_undegraded":"2024-09-10T23:22:51.544426+0000","last_fullsized":"2024-09-10T23:22:51.544426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614271+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:23:50.614271+0000","last_peered":"2024-09-10T23:23:50.614271+0000","last_clean":"2024-09-10T23:23:50.614271+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:23:50.614271+0000","last_undegraded":"2024-09-10T23:23:50.614271+0000","last_fullsized":"2024-09-10T23:23:50.614271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492153+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:51.492153+0000","last_peered":"2024-09-10T23:22:51.492153+0000","last_clean":"2024-09-10T23:22:51.492153+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:51.492153+0000","last_undegraded":"2024-09-10T23:22:51.492153+0000","last_fullsized":"2024-09-10T23:22:51.492153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.613927+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:23:50.613927+0000","last_peered":"2024-09-10T23:23:50.613927+0000","last_clean":"2024-09-10T23:23:50.613927+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:23:50.613927+0000","last_undegraded":"2024-09-10T23:23:50.613927+0000","last_fullsized":"2024-09-10T23:23:50.613927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486273+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:51.486273+0000","last_peered":"2024-09-10T23:22:51.486273+0000","last_clean":"2024-09-10T23:22:51.486273+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:51.486273+0000","last_undegraded":"2024-09-10T23:22:51.486273+0000","last_fullsized":"2024-09-10T23:22:51.486273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617384+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:23:50.617384+0000","last_peered":"2024-09-10T23:23:50.617384+0000","last_clean":"2024-09-10T23:23:50.617384+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:23:50.617384+0000","last_undegraded":"2024-09-10T23:23:50.617384+0000","last_fullsized":"2024-09-10T23:23:50.617384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.618412+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:23:50.618412+0000","last_peered":"2024-09-10T23:23:50.618412+0000","last_clean":"2024-09-10T23:23:50.618412+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:23:50.618412+0000","last_undegraded":"2024-09-10T23:23:50.618412+0000","last_fullsized":"2024-09-10T23:23:50.618412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487411+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:51.487411+0000","last_peered":"2024-09-10T23:22:51.487411+0000","last_clean":"2024-09-10T23:22:51.487411+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:51.487411+0000","last_undegraded":"2024-09-10T23:22:51.487411+0000","last_fullsized":"2024-09-10T23:22:51.487411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624799+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:23:50.624799+0000","last_peered":"2024-09-10T23:23:50.624799+0000","last_clean":"2024-09-10T23:23:50.624799+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:23:50.624799+0000","last_undegraded":"2024-09-10T23:23:50.624799+0000","last_fullsized":"2024-09-10T23:23:50.624799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":59,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.504887+0000","last_change":"2024-09-10T23:22:51.504814+0000","last_active":"2024-09-10T23:22:51.504887+0000","last_peered":"2024-09-10T23:22:51.504887+0000","last_clean":"2024-09-10T23:22:51.504887+0000","last_became_active":"2024-09-10T23:22:51.493572+0000","last_became_peered":"2024-09-10T23:22:51.493572+0000","last_unstale":"2024-09-10T23:22:51.504887+0000","last_undegraded":"2024-09-10T23:22:51.504887+0000","last_fullsized":"2024-09-10T23:22:51.504887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:02.758621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623231+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:23:50.623231+0000","last_peered":"2024-09-10T23:23:50.623231+0000","last_clean":"2024-09-10T23:23:50.623231+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:23:50.623231+0000","last_undegraded":"2024-09-10T23:23:50.623231+0000","last_fullsized":"2024-09-10T23:23:50.623231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544790+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:51.544790+0000","last_peered":"2024-09-10T23:22:51.544790+0000","last_clean":"2024-09-10T23:22:51.544790+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:51.544790+0000","last_undegraded":"2024-09-10T23:22:51.544790+0000","last_fullsized":"2024-09-10T23:22:51.544790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.600616+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:23:50.600616+0000","last_peered":"2024-09-10T23:23:50.600616+0000","last_clean":"2024-09-10T23:23:50.600616+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:23:50.600616+0000","last_undegraded":"2024-09-10T23:23:50.600616+0000","last_fullsized":"2024-09-10T23:23:50.600616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":138,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:07.576686+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:24:07.576686+0000","last_peered":"2024-09-10T23:24:07.576686+0000","last_clean":"2024-09-10T23:24:07.576686+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:24:07.576686+0000","last_undegraded":"2024-09-10T23:24:07.576686+0000","last_fullsized":"2024-09-10T23:24:07.576686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68905,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1075,"num_read_kb":613,"num_write":256,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1147,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":212396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":403015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906986,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1054797,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":402279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":402523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":995316,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":401996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":994994,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":403011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":401821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":464766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":464328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":403867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:24:15.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 -- 172.21.15.2:0/1109894738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154101690 msgr2=0x7f2154101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 --2- 172.21.15.2:0/1109894738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154101690 0x7f2154101a90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2144009930 tx=0x7f214402a420 comp rx=0 tx=0).stop 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 -- 172.21.15.2:0/1109894738 shutdown_connections 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 --2- 172.21.15.2:0/1109894738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 --2- 172.21.15.2:0/1109894738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21541027e0 0x7f2154102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 --2- 172.21.15.2:0/1109894738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2154101690 0x7f2154101a90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.424+0000 7f2159d9f640 1 -- 172.21.15.2:0/1109894738 >> 172.21.15.2:0/1109894738 conn(0x7f21540fcf50 msgr2=0x7f21540ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 -- 172.21.15.2:0/1109894738 shutdown_connections 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 -- 172.21.15.2:0/1109894738 wait complete. 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 Processor -- start 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 -- start start 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2154101690 0x7f2154198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 0x7f21541992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d300 con 0x7f21541027e0 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d180 con 0x7f21541031a0 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.425+0000 7f2159d9f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d480 con 0x7f2154101690 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 0x7f21541992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 0x7f21541992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53550/0 (socket says 172.21.15.2:53550) 2024-09-10T23:24:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 -- 172.21.15.2:0/614594364 learned_addr learned my addr 172.21.15.2:0/614594364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 -- 172.21.15.2:0/614594364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2154101690 msgr2=0x7f2154198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2158d9d640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2154101690 0x7f2154198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f215959e640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2154101690 0x7f2154198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 -- 172.21.15.2:0/614594364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 msgr2=0x7f2154199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154199e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 -- 172.21.15.2:0/614594364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215419a720 con 0x7f21541027e0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2153fff640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 0x7f21541992a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f214800e9f0 tx=0x7f214800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214800cd80 con 0x7f21541027e0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215419aa10 con 0x7f21541027e0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21480054d0 con 0x7f21541027e0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148010690 con 0x7f21541027e0 2024-09-10T23:24:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.426+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21541a10e0 con 0x7f21541027e0 2024-09-10T23:24:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.427+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2154101a90 con 0x7f21541027e0 2024-09-10T23:24:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.429+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2148004e30 con 0x7f21541027e0 2024-09-10T23:24:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.429+0000 7f2151ffb640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f213c0b52e0 0x7f213c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.430+0000 7f2158d9d640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f213c0b52e0 0x7f213c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.430+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21480e6350 con 0x7f21541027e0 2024-09-10T23:24:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.430+0000 7f2158d9d640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f213c0b52e0 0x7f213c0b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f214402a940 tx=0x7f2144000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.432+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2148056220 con 0x7f21541027e0 2024-09-10T23:24:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.618+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f215406aa50 con 0x7f213c0b52e0 2024-09-10T23:24:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.622+0000 7f2151ffb640 1 -- 172.21.15.2:0/614594364 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259040 (secure 0 0 0) 0x7f215406aa50 con 0x7f213c0b52e0 2024-09-10T23:24:15.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:24:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f213c0b52e0 msgr2=0x7f213c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f213c0b52e0 0x7f213c0b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f214402a940 tx=0x7f2144000bc0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 msgr2=0x7f21541992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 0x7f21541992a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f214800e9f0 tx=0x7f214800edf0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 shutdown_connections 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f213c0b52e0 0x7f213c0b77a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21541027e0 0x7f21541992a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.625+0000 7f2159d9f640 1 --2- 172.21.15.2:0/614594364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2154101690 0x7f2154198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.626+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 >> 172.21.15.2:0/614594364 conn(0x7f21540fcf50 msgr2=0x7f215406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.626+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 shutdown_connections 2024-09-10T23:24:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.626+0000 7f2159d9f640 1 -- 172.21.15.2:0/614594364 wait complete. 2024-09-10T23:24:15.637 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-10T23:24:14.244756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659507,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":677,"num_write":381,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952987,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":814,"ondisk_log_size":814,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376256,"kb_used_data":10368,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565568,"statfs":{"total":1151940427776,"available":1151555141632,"internally_reserved":0,"allocated":10616832,"data_stored":6792713,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002941"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614723+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:23:50.614723+0000","last_peered":"2024-09-10T23:23:50.614723+0000","last_clean":"2024-09-10T23:23:50.614723+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:23:50.614723+0000","last_undegraded":"2024-09-10T23:23:50.614723+0000","last_fullsized":"2024-09-10T23:23:50.614723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615183+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:23:50.615183+0000","last_peered":"2024-09-10T23:23:50.615183+0000","last_clean":"2024-09-10T23:23:50.615183+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:23:50.615183+0000","last_undegraded":"2024-09-10T23:23:50.615183+0000","last_fullsized":"2024-09-10T23:23:50.615183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623059+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:23:50.623059+0000","last_peered":"2024-09-10T23:23:50.623059+0000","last_clean":"2024-09-10T23:23:50.623059+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:23:50.623059+0000","last_undegraded":"2024-09-10T23:23:50.623059+0000","last_fullsized":"2024-09-10T23:23:50.623059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.605552+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:23:50.605552+0000","last_peered":"2024-09-10T23:23:50.605552+0000","last_clean":"2024-09-10T23:23:50.605552+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:23:50.605552+0000","last_undegraded":"2024-09-10T23:23:50.605552+0000","last_fullsized":"2024-09-10T23:23:50.605552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.603902+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:23:50.603902+0000","last_peered":"2024-09-10T23:23:50.603902+0000","last_clean":"2024-09-10T23:23:50.603902+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:23:50.603902+0000","last_undegraded":"2024-09-10T23:23:50.603902+0000","last_fullsized":"2024-09-10T23:23:50.603902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612201+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:23:50.612201+0000","last_peered":"2024-09-10T23:23:50.612201+0000","last_clean":"2024-09-10T23:23:50.612201+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:23:50.612201+0000","last_undegraded":"2024-09-10T23:23:50.612201+0000","last_fullsized":"2024-09-10T23:23:50.612201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608056+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:23:50.608056+0000","last_peered":"2024-09-10T23:23:50.608056+0000","last_clean":"2024-09-10T23:23:50.608056+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:23:50.608056+0000","last_undegraded":"2024-09-10T23:23:50.608056+0000","last_fullsized":"2024-09-10T23:23:50.608056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608388+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:23:50.608388+0000","last_peered":"2024-09-10T23:23:50.608388+0000","last_clean":"2024-09-10T23:23:50.608388+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:23:50.608388+0000","last_undegraded":"2024-09-10T23:23:50.608388+0000","last_fullsized":"2024-09-10T23:23:50.608388+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623075+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:23:50.623075+0000","last_peered":"2024-09-10T23:23:50.623075+0000","last_clean":"2024-09-10T23:23:50.623075+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:23:50.623075+0000","last_undegraded":"2024-09-10T23:23:50.623075+0000","last_fullsized":"2024-09-10T23:23:50.623075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608978+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:23:50.608978+0000","last_peered":"2024-09-10T23:23:50.608978+0000","last_clean":"2024-09-10T23:23:50.608978+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:23:50.608978+0000","last_undegraded":"2024-09-10T23:23:50.608978+0000","last_fullsized":"2024-09-10T23:23:50.608978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617956+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:23:50.617956+0000","last_peered":"2024-09-10T23:23:50.617956+0000","last_clean":"2024-09-10T23:23:50.617956+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:23:50.617956+0000","last_undegraded":"2024-09-10T23:23:50.617956+0000","last_fullsized":"2024-09-10T23:23:50.617956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.601149+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:23:50.601149+0000","last_peered":"2024-09-10T23:23:50.601149+0000","last_clean":"2024-09-10T23:23:50.601149+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:23:50.601149+0000","last_undegraded":"2024-09-10T23:23:50.601149+0000","last_fullsized":"2024-09-10T23:23:50.601149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.597496+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:23:50.597496+0000","last_peered":"2024-09-10T23:23:50.597496+0000","last_clean":"2024-09-10T23:23:50.597496+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:23:50.597496+0000","last_undegraded":"2024-09-10T23:23:50.597496+0000","last_fullsized":"2024-09-10T23:23:50.597496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616290+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:23:50.616290+0000","last_peered":"2024-09-10T23:23:50.616290+0000","last_clean":"2024-09-10T23:23:50.616290+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:23:50.616290+0000","last_undegraded":"2024-09-10T23:23:50.616290+0000","last_fullsized":"2024-09-10T23:23:50.616290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616089+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:23:50.616089+0000","last_peered":"2024-09-10T23:23:50.616089+0000","last_clean":"2024-09-10T23:23:50.616089+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:23:50.616089+0000","last_undegraded":"2024-09-10T23:23:50.616089+0000","last_fullsized":"2024-09-10T23:23:50.616089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624294+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:23:50.624294+0000","last_peered":"2024-09-10T23:23:50.624294+0000","last_clean":"2024-09-10T23:23:50.624294+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:23:50.624294+0000","last_undegraded":"2024-09-10T23:23:50.624294+0000","last_fullsized":"2024-09-10T23:23:50.624294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614754+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:23:50.614754+0000","last_peered":"2024-09-10T23:23:50.614754+0000","last_clean":"2024-09-10T23:23:50.614754+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:23:50.614754+0000","last_undegraded":"2024-09-10T23:23:50.614754+0000","last_fullsized":"2024-09-10T23:23:50.614754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622614+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:23:50.622614+0000","last_peered":"2024-09-10T23:23:50.622614+0000","last_clean":"2024-09-10T23:23:50.622614+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:23:50.622614+0000","last_undegraded":"2024-09-10T23:23:50.622614+0000","last_fullsized":"2024-09-10T23:23:50.622614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.607920+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:23:50.607920+0000","last_peered":"2024-09-10T23:23:50.607920+0000","last_clean":"2024-09-10T23:23:50.607920+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:23:50.607920+0000","last_undegraded":"2024-09-10T23:23:50.607920+0000","last_fullsized":"2024-09-10T23:23:50.607920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610273+0000","last_change":"2024-09-10T23:22:51.492807+0000","last_active":"2024-09-10T23:23:50.610273+0000","last_peered":"2024-09-10T23:23:50.610273+0000","last_clean":"2024-09-10T23:23:50.610273+0000","last_became_active":"2024-09-10T23:22:51.492343+0000","last_became_peered":"2024-09-10T23:22:51.492343+0000","last_unstale":"2024-09-10T23:23:50.610273+0000","last_undegraded":"2024-09-10T23:23:50.610273+0000","last_fullsized":"2024-09-10T23:23:50.610273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:59.573883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614998+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:23:50.614998+0000","last_peered":"2024-09-10T23:23:50.614998+0000","last_clean":"2024-09-10T23:23:50.614998+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:23:50.614998+0000","last_undegraded":"2024-09-10T23:23:50.614998+0000","last_fullsized":"2024-09-10T23:23:50.614998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623967+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:23:50.623967+0000","last_peered":"2024-09-10T23:23:50.623967+0000","last_clean":"2024-09-10T23:23:50.623967+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:23:50.623967+0000","last_undegraded":"2024-09-10T23:23:50.623967+0000","last_fullsized":"2024-09-10T23:23:50.623967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615277+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:23:50.615277+0000","last_peered":"2024-09-10T23:23:50.615277+0000","last_clean":"2024-09-10T23:23:50.615277+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:23:50.615277+0000","last_undegraded":"2024-09-10T23:23:50.615277+0000","last_fullsized":"2024-09-10T23:23:50.615277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.609534+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:23:50.609534+0000","last_peered":"2024-09-10T23:23:50.609534+0000","last_clean":"2024-09-10T23:23:50.609534+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:23:50.609534+0000","last_undegraded":"2024-09-10T23:23:50.609534+0000","last_fullsized":"2024-09-10T23:23:50.609534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610726+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:23:50.610726+0000","last_peered":"2024-09-10T23:23:50.610726+0000","last_clean":"2024-09-10T23:23:50.610726+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:23:50.610726+0000","last_undegraded":"2024-09-10T23:23:50.610726+0000","last_fullsized":"2024-09-10T23:23:50.610726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622570+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:23:50.622570+0000","last_peered":"2024-09-10T23:23:50.622570+0000","last_clean":"2024-09-10T23:23:50.622570+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:23:50.622570+0000","last_undegraded":"2024-09-10T23:23:50.622570+0000","last_fullsized":"2024-09-10T23:23:50.622570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612488+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:23:50.612488+0000","last_peered":"2024-09-10T23:23:50.612488+0000","last_clean":"2024-09-10T23:23:50.612488+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:23:50.612488+0000","last_undegraded":"2024-09-10T23:23:50.612488+0000","last_fullsized":"2024-09-10T23:23:50.612488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614174+0000","last_change":"2024-09-10T23:22:51.488675+0000","last_active":"2024-09-10T23:23:50.614174+0000","last_peered":"2024-09-10T23:23:50.614174+0000","last_clean":"2024-09-10T23:23:50.614174+0000","last_became_active":"2024-09-10T23:22:51.488291+0000","last_became_peered":"2024-09-10T23:22:51.488291+0000","last_unstale":"2024-09-10T23:23:50.614174+0000","last_undegraded":"2024-09-10T23:23:50.614174+0000","last_fullsized":"2024-09-10T23:23:50.614174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615996+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:23:50.615996+0000","last_peered":"2024-09-10T23:23:50.615996+0000","last_clean":"2024-09-10T23:23:50.615996+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:23:50.615996+0000","last_undegraded":"2024-09-10T23:23:50.615996+0000","last_fullsized":"2024-09-10T23:23:50.615996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614632+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:23:50.614632+0000","last_peered":"2024-09-10T23:23:50.614632+0000","last_clean":"2024-09-10T23:23:50.614632+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:23:50.614632+0000","last_undegraded":"2024-09-10T23:23:50.614632+0000","last_fullsized":"2024-09-10T23:23:50.614632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615076+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:23:50.615076+0000","last_peered":"2024-09-10T23:23:50.615076+0000","last_clean":"2024-09-10T23:23:50.615076+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:23:50.615076+0000","last_undegraded":"2024-09-10T23:23:50.615076+0000","last_fullsized":"2024-09-10T23:23:50.615076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614699+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:23:50.614699+0000","last_peered":"2024-09-10T23:23:50.614699+0000","last_clean":"2024-09-10T23:23:50.614699+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:23:50.614699+0000","last_undegraded":"2024-09-10T23:23:50.614699+0000","last_fullsized":"2024-09-10T23:23:50.614699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.595682+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:23:50.595682+0000","last_peered":"2024-09-10T23:23:50.595682+0000","last_clean":"2024-09-10T23:23:50.595682+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:23:50.595682+0000","last_undegraded":"2024-09-10T23:23:50.595682+0000","last_fullsized":"2024-09-10T23:23:50.595682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":151,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.605507+0000","last_change":"2024-09-10T23:22:51.506742+0000","last_active":"2024-09-10T23:24:10.605507+0000","last_peered":"2024-09-10T23:24:10.605507+0000","last_clean":"2024-09-10T23:24:10.605507+0000","last_became_active":"2024-09-10T23:22:51.493588+0000","last_became_peered":"2024-09-10T23:22:51.493588+0000","last_unstale":"2024-09-10T23:24:10.605507+0000","last_undegraded":"2024-09-10T23:24:10.605507+0000","last_fullsized":"2024-09-10T23:24:10.605507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:42.641981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.613512+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:23:50.613512+0000","last_peered":"2024-09-10T23:23:50.613512+0000","last_clean":"2024-09-10T23:23:50.613512+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:23:50.613512+0000","last_undegraded":"2024-09-10T23:23:50.613512+0000","last_fullsized":"2024-09-10T23:23:50.613512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610161+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:23:50.610161+0000","last_peered":"2024-09-10T23:23:50.610161+0000","last_clean":"2024-09-10T23:23:50.610161+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:23:50.610161+0000","last_undegraded":"2024-09-10T23:23:50.610161+0000","last_fullsized":"2024-09-10T23:23:50.610161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488201+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:51.488201+0000","last_peered":"2024-09-10T23:22:51.488201+0000","last_clean":"2024-09-10T23:22:51.488201+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:51.488201+0000","last_undegraded":"2024-09-10T23:22:51.488201+0000","last_fullsized":"2024-09-10T23:22:51.488201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612135+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:23:50.612135+0000","last_peered":"2024-09-10T23:23:50.612135+0000","last_clean":"2024-09-10T23:23:50.612135+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:23:50.612135+0000","last_undegraded":"2024-09-10T23:23:50.612135+0000","last_fullsized":"2024-09-10T23:23:50.612135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'6","reported_seq":235,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.597678+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:24:10.597678+0000","last_peered":"2024-09-10T23:24:10.597678+0000","last_clean":"2024-09-10T23:24:10.597678+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:24:10.597678+0000","last_undegraded":"2024-09-10T23:24:10.597678+0000","last_fullsized":"2024-09-10T23:24:10.597678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624868+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:23:50.624868+0000","last_peered":"2024-09-10T23:23:50.624868+0000","last_clean":"2024-09-10T23:23:50.624868+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:23:50.624868+0000","last_undegraded":"2024-09-10T23:23:50.624868+0000","last_fullsized":"2024-09-10T23:23:50.624868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492077+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:51.492077+0000","last_peered":"2024-09-10T23:22:51.492077+0000","last_clean":"2024-09-10T23:22:51.492077+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:51.492077+0000","last_undegraded":"2024-09-10T23:22:51.492077+0000","last_fullsized":"2024-09-10T23:22:51.492077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616353+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:23:50.616353+0000","last_peered":"2024-09-10T23:23:50.616353+0000","last_clean":"2024-09-10T23:23:50.616353+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:23:50.616353+0000","last_undegraded":"2024-09-10T23:23:50.616353+0000","last_fullsized":"2024-09-10T23:23:50.616353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488638+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:51.488638+0000","last_peered":"2024-09-10T23:22:51.488638+0000","last_clean":"2024-09-10T23:22:51.488638+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:51.488638+0000","last_undegraded":"2024-09-10T23:22:51.488638+0000","last_fullsized":"2024-09-10T23:22:51.488638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624094+0000","last_change":"2024-09-10T23:22:51.490154+0000","last_active":"2024-09-10T23:23:50.624094+0000","last_peered":"2024-09-10T23:23:50.624094+0000","last_clean":"2024-09-10T23:23:50.624094+0000","last_became_active":"2024-09-10T23:22:51.489716+0000","last_became_peered":"2024-09-10T23:22:51.489716+0000","last_unstale":"2024-09-10T23:23:50.624094+0000","last_undegraded":"2024-09-10T23:23:50.624094+0000","last_fullsized":"2024-09-10T23:23:50.624094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.280542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'35","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.605170+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:24:10.605170+0000","last_peered":"2024-09-10T23:24:10.605170+0000","last_clean":"2024-09-10T23:24:10.605170+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:24:10.605170+0000","last_undegraded":"2024-09-10T23:24:10.605170+0000","last_fullsized":"2024-09-10T23:24:10.605170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61419,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":169,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611419+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:23:50.611419+0000","last_peered":"2024-09-10T23:23:50.611419+0000","last_clean":"2024-09-10T23:23:50.611419+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:23:50.611419+0000","last_undegraded":"2024-09-10T23:23:50.611419+0000","last_fullsized":"2024-09-10T23:23:50.611419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491721+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:51.491721+0000","last_peered":"2024-09-10T23:22:51.491721+0000","last_clean":"2024-09-10T23:22:51.491721+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:51.491721+0000","last_undegraded":"2024-09-10T23:22:51.491721+0000","last_fullsized":"2024-09-10T23:22:51.491721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.603550+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:23:50.603550+0000","last_peered":"2024-09-10T23:23:50.603550+0000","last_clean":"2024-09-10T23:23:50.603550+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:23:50.603550+0000","last_undegraded":"2024-09-10T23:23:50.603550+0000","last_fullsized":"2024-09-10T23:23:50.603550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488112+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:51.488112+0000","last_peered":"2024-09-10T23:22:51.488112+0000","last_clean":"2024-09-10T23:22:51.488112+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:51.488112+0000","last_undegraded":"2024-09-10T23:22:51.488112+0000","last_fullsized":"2024-09-10T23:22:51.488112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612284+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:23:50.612284+0000","last_peered":"2024-09-10T23:23:50.612284+0000","last_clean":"2024-09-10T23:23:50.612284+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:23:50.612284+0000","last_undegraded":"2024-09-10T23:23:50.612284+0000","last_fullsized":"2024-09-10T23:23:50.612284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.581668+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:24:10.581668+0000","last_peered":"2024-09-10T23:24:10.581668+0000","last_clean":"2024-09-10T23:24:10.581668+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:24:10.581668+0000","last_undegraded":"2024-09-10T23:24:10.581668+0000","last_fullsized":"2024-09-10T23:24:10.581668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608717+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:23:50.608717+0000","last_peered":"2024-09-10T23:23:50.608717+0000","last_clean":"2024-09-10T23:23:50.608717+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:23:50.608717+0000","last_undegraded":"2024-09-10T23:23:50.608717+0000","last_fullsized":"2024-09-10T23:23:50.608717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486630+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:51.486630+0000","last_peered":"2024-09-10T23:22:51.486630+0000","last_clean":"2024-09-10T23:22:51.486630+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:51.486630+0000","last_undegraded":"2024-09-10T23:22:51.486630+0000","last_fullsized":"2024-09-10T23:22:51.486630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617058+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:23:50.617058+0000","last_peered":"2024-09-10T23:23:50.617058+0000","last_clean":"2024-09-10T23:23:50.617058+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:23:50.617058+0000","last_undegraded":"2024-09-10T23:23:50.617058+0000","last_fullsized":"2024-09-10T23:23:50.617058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.510546+0000","last_change":"2024-09-10T23:22:51.510092+0000","last_active":"2024-09-10T23:22:51.510546+0000","last_peered":"2024-09-10T23:22:51.510546+0000","last_clean":"2024-09-10T23:22:51.510546+0000","last_became_active":"2024-09-10T23:22:51.489887+0000","last_became_peered":"2024-09-10T23:22:51.489887+0000","last_unstale":"2024-09-10T23:22:51.510546+0000","last_undegraded":"2024-09-10T23:22:51.510546+0000","last_fullsized":"2024-09-10T23:22:51.510546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:14.757355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612385+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:23:50.612385+0000","last_peered":"2024-09-10T23:23:50.612385+0000","last_clean":"2024-09-10T23:23:50.612385+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:23:50.612385+0000","last_undegraded":"2024-09-10T23:23:50.612385+0000","last_fullsized":"2024-09-10T23:23:50.612385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486119+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:51.486119+0000","last_peered":"2024-09-10T23:22:51.486119+0000","last_clean":"2024-09-10T23:22:51.486119+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:51.486119+0000","last_undegraded":"2024-09-10T23:22:51.486119+0000","last_fullsized":"2024-09-10T23:22:51.486119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611494+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:23:50.611494+0000","last_peered":"2024-09-10T23:23:50.611494+0000","last_clean":"2024-09-10T23:23:50.611494+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:23:50.611494+0000","last_undegraded":"2024-09-10T23:23:50.611494+0000","last_fullsized":"2024-09-10T23:23:50.611494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488710+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:51.488710+0000","last_peered":"2024-09-10T23:22:51.488710+0000","last_clean":"2024-09-10T23:22:51.488710+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:51.488710+0000","last_undegraded":"2024-09-10T23:22:51.488710+0000","last_fullsized":"2024-09-10T23:22:51.488710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.609307+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:23:50.609307+0000","last_peered":"2024-09-10T23:23:50.609307+0000","last_clean":"2024-09-10T23:23:50.609307+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:23:50.609307+0000","last_undegraded":"2024-09-10T23:23:50.609307+0000","last_fullsized":"2024-09-10T23:23:50.609307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'7","reported_seq":140,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:12.601473+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:24:12.601473+0000","last_peered":"2024-09-10T23:24:12.601473+0000","last_clean":"2024-09-10T23:24:12.601473+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:24:12.601473+0000","last_undegraded":"2024-09-10T23:24:12.601473+0000","last_fullsized":"2024-09-10T23:24:12.601473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.618080+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:23:50.618080+0000","last_peered":"2024-09-10T23:23:50.618080+0000","last_clean":"2024-09-10T23:23:50.618080+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:23:50.618080+0000","last_undegraded":"2024-09-10T23:23:50.618080+0000","last_fullsized":"2024-09-10T23:23:50.618080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491782+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:51.491782+0000","last_peered":"2024-09-10T23:22:51.491782+0000","last_clean":"2024-09-10T23:22:51.491782+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:51.491782+0000","last_undegraded":"2024-09-10T23:22:51.491782+0000","last_fullsized":"2024-09-10T23:22:51.491782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484149+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:51.484149+0000","last_peered":"2024-09-10T23:22:51.484149+0000","last_clean":"2024-09-10T23:22:51.484149+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:51.484149+0000","last_undegraded":"2024-09-10T23:22:51.484149+0000","last_fullsized":"2024-09-10T23:22:51.484149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622230+0000","last_change":"2024-09-10T23:22:51.489197+0000","last_active":"2024-09-10T23:23:50.622230+0000","last_peered":"2024-09-10T23:23:50.622230+0000","last_clean":"2024-09-10T23:23:50.622230+0000","last_became_active":"2024-09-10T23:22:51.488701+0000","last_became_peered":"2024-09-10T23:22:51.488701+0000","last_unstale":"2024-09-10T23:23:50.622230+0000","last_undegraded":"2024-09-10T23:23:50.622230+0000","last_fullsized":"2024-09-10T23:23:50.622230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:47.899980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491615+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:51.491615+0000","last_peered":"2024-09-10T23:22:51.491615+0000","last_clean":"2024-09-10T23:22:51.491615+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:51.491615+0000","last_undegraded":"2024-09-10T23:22:51.491615+0000","last_fullsized":"2024-09-10T23:22:51.491615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615068+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:23:50.615068+0000","last_peered":"2024-09-10T23:23:50.615068+0000","last_clean":"2024-09-10T23:23:50.615068+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:23:50.615068+0000","last_undegraded":"2024-09-10T23:23:50.615068+0000","last_fullsized":"2024-09-10T23:23:50.615068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:11.582380+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:24:11.582380+0000","last_peered":"2024-09-10T23:24:11.582380+0000","last_clean":"2024-09-10T23:24:11.582380+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:24:11.582380+0000","last_undegraded":"2024-09-10T23:24:11.582380+0000","last_fullsized":"2024-09-10T23:24:11.582380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615926+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:23:50.615926+0000","last_peered":"2024-09-10T23:23:50.615926+0000","last_clean":"2024-09-10T23:23:50.615926+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:23:50.615926+0000","last_undegraded":"2024-09-10T23:23:50.615926+0000","last_fullsized":"2024-09-10T23:23:50.615926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:11.582606+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:24:11.582606+0000","last_peered":"2024-09-10T23:24:11.582606+0000","last_clean":"2024-09-10T23:24:11.582606+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:24:11.582606+0000","last_undegraded":"2024-09-10T23:24:11.582606+0000","last_fullsized":"2024-09-10T23:24:11.582606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612613+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:23:50.612613+0000","last_peered":"2024-09-10T23:23:50.612613+0000","last_clean":"2024-09-10T23:23:50.612613+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:23:50.612613+0000","last_undegraded":"2024-09-10T23:23:50.612613+0000","last_fullsized":"2024-09-10T23:23:50.612613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482986+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:51.482986+0000","last_peered":"2024-09-10T23:22:51.482986+0000","last_clean":"2024-09-10T23:22:51.482986+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:51.482986+0000","last_undegraded":"2024-09-10T23:22:51.482986+0000","last_fullsized":"2024-09-10T23:22:51.482986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611442+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:23:50.611442+0000","last_peered":"2024-09-10T23:23:50.611442+0000","last_clean":"2024-09-10T23:23:50.611442+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:23:50.611442+0000","last_undegraded":"2024-09-10T23:23:50.611442+0000","last_fullsized":"2024-09-10T23:23:50.611442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.498531+0000","last_change":"2024-09-10T23:22:51.498021+0000","last_active":"2024-09-10T23:22:51.498531+0000","last_peered":"2024-09-10T23:22:51.498531+0000","last_clean":"2024-09-10T23:22:51.498531+0000","last_became_active":"2024-09-10T23:22:51.488787+0000","last_became_peered":"2024-09-10T23:22:51.488787+0000","last_unstale":"2024-09-10T23:22:51.498531+0000","last_undegraded":"2024-09-10T23:22:51.498531+0000","last_fullsized":"2024-09-10T23:22:51.498531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:46.855288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611647+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:23:50.611647+0000","last_peered":"2024-09-10T23:23:50.611647+0000","last_clean":"2024-09-10T23:23:50.611647+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:23:50.611647+0000","last_undegraded":"2024-09-10T23:23:50.611647+0000","last_fullsized":"2024-09-10T23:23:50.611647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'17","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.483124+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:51.483124+0000","last_peered":"2024-09-10T23:22:51.483124+0000","last_clean":"2024-09-10T23:22:51.483124+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:51.483124+0000","last_undegraded":"2024-09-10T23:22:51.483124+0000","last_fullsized":"2024-09-10T23:22:51.483124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610312+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:23:50.610312+0000","last_peered":"2024-09-10T23:23:50.610312+0000","last_clean":"2024-09-10T23:23:50.610312+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:23:50.610312+0000","last_undegraded":"2024-09-10T23:23:50.610312+0000","last_fullsized":"2024-09-10T23:23:50.610312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484358+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:51.484358+0000","last_peered":"2024-09-10T23:22:51.484358+0000","last_clean":"2024-09-10T23:22:51.484358+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:51.484358+0000","last_undegraded":"2024-09-10T23:22:51.484358+0000","last_fullsized":"2024-09-10T23:22:51.484358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616309+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:23:50.616309+0000","last_peered":"2024-09-10T23:23:50.616309+0000","last_clean":"2024-09-10T23:23:50.616309+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:23:50.616309+0000","last_undegraded":"2024-09-10T23:23:50.616309+0000","last_fullsized":"2024-09-10T23:23:50.616309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485900+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:51.485900+0000","last_peered":"2024-09-10T23:22:51.485900+0000","last_clean":"2024-09-10T23:22:51.485900+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:51.485900+0000","last_undegraded":"2024-09-10T23:22:51.485900+0000","last_fullsized":"2024-09-10T23:22:51.485900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.575629+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:23:50.575629+0000","last_peered":"2024-09-10T23:23:50.575629+0000","last_clean":"2024-09-10T23:23:50.575629+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:23:50.575629+0000","last_undegraded":"2024-09-10T23:23:50.575629+0000","last_fullsized":"2024-09-10T23:23:50.575629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544426+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:51.544426+0000","last_peered":"2024-09-10T23:22:51.544426+0000","last_clean":"2024-09-10T23:22:51.544426+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:51.544426+0000","last_undegraded":"2024-09-10T23:22:51.544426+0000","last_fullsized":"2024-09-10T23:22:51.544426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614271+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:23:50.614271+0000","last_peered":"2024-09-10T23:23:50.614271+0000","last_clean":"2024-09-10T23:23:50.614271+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:23:50.614271+0000","last_undegraded":"2024-09-10T23:23:50.614271+0000","last_fullsized":"2024-09-10T23:23:50.614271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492153+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:51.492153+0000","last_peered":"2024-09-10T23:22:51.492153+0000","last_clean":"2024-09-10T23:22:51.492153+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:51.492153+0000","last_undegraded":"2024-09-10T23:22:51.492153+0000","last_fullsized":"2024-09-10T23:22:51.492153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.613927+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:23:50.613927+0000","last_peered":"2024-09-10T23:23:50.613927+0000","last_clean":"2024-09-10T23:23:50.613927+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:23:50.613927+0000","last_undegraded":"2024-09-10T23:23:50.613927+0000","last_fullsized":"2024-09-10T23:23:50.613927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486273+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:51.486273+0000","last_peered":"2024-09-10T23:22:51.486273+0000","last_clean":"2024-09-10T23:22:51.486273+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:51.486273+0000","last_undegraded":"2024-09-10T23:22:51.486273+0000","last_fullsized":"2024-09-10T23:22:51.486273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617384+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:23:50.617384+0000","last_peered":"2024-09-10T23:23:50.617384+0000","last_clean":"2024-09-10T23:23:50.617384+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:23:50.617384+0000","last_undegraded":"2024-09-10T23:23:50.617384+0000","last_fullsized":"2024-09-10T23:23:50.617384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.618412+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:23:50.618412+0000","last_peered":"2024-09-10T23:23:50.618412+0000","last_clean":"2024-09-10T23:23:50.618412+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:23:50.618412+0000","last_undegraded":"2024-09-10T23:23:50.618412+0000","last_fullsized":"2024-09-10T23:23:50.618412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487411+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:51.487411+0000","last_peered":"2024-09-10T23:22:51.487411+0000","last_clean":"2024-09-10T23:22:51.487411+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:51.487411+0000","last_undegraded":"2024-09-10T23:22:51.487411+0000","last_fullsized":"2024-09-10T23:22:51.487411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624799+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:23:50.624799+0000","last_peered":"2024-09-10T23:23:50.624799+0000","last_clean":"2024-09-10T23:23:50.624799+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:23:50.624799+0000","last_undegraded":"2024-09-10T23:23:50.624799+0000","last_fullsized":"2024-09-10T23:23:50.624799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":59,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.504887+0000","last_change":"2024-09-10T23:22:51.504814+0000","last_active":"2024-09-10T23:22:51.504887+0000","last_peered":"2024-09-10T23:22:51.504887+0000","last_clean":"2024-09-10T23:22:51.504887+0000","last_became_active":"2024-09-10T23:22:51.493572+0000","last_became_peered":"2024-09-10T23:22:51.493572+0000","last_unstale":"2024-09-10T23:22:51.504887+0000","last_undegraded":"2024-09-10T23:22:51.504887+0000","last_fullsized":"2024-09-10T23:22:51.504887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:02.758621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623231+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:23:50.623231+0000","last_peered":"2024-09-10T23:23:50.623231+0000","last_clean":"2024-09-10T23:23:50.623231+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:23:50.623231+0000","last_undegraded":"2024-09-10T23:23:50.623231+0000","last_fullsized":"2024-09-10T23:23:50.623231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544790+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:51.544790+0000","last_peered":"2024-09-10T23:22:51.544790+0000","last_clean":"2024-09-10T23:22:51.544790+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:51.544790+0000","last_undegraded":"2024-09-10T23:22:51.544790+0000","last_fullsized":"2024-09-10T23:22:51.544790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.600616+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:23:50.600616+0000","last_peered":"2024-09-10T23:23:50.600616+0000","last_clean":"2024-09-10T23:23:50.600616+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:23:50.600616+0000","last_undegraded":"2024-09-10T23:23:50.600616+0000","last_fullsized":"2024-09-10T23:23:50.600616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":138,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:07.576686+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:24:07.576686+0000","last_peered":"2024-09-10T23:24:07.576686+0000","last_clean":"2024-09-10T23:24:07.576686+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:24:07.576686+0000","last_undegraded":"2024-09-10T23:24:07.576686+0000","last_fullsized":"2024-09-10T23:24:07.576686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68905,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1075,"num_read_kb":613,"num_write":256,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1147,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":212396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":403015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906986,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1054797,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":402279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":402523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":995316,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":401996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":994994,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":403011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":401821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":464766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":464328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":403867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:24:15.641 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T23:24:15.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 -- 172.21.15.2:0/3369710590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f81033a0 msgr2=0x7f18f8109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/3369710590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f81033a0 0x7f18f8109d20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009cd0 tx=0x7f18f002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 -- 172.21.15.2:0/3369710590 shutdown_connections 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/3369710590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f81033a0 0x7f18f8109d20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/3369710590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81029e0 0x7f18f8102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/3369710590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f8101890 0x7f18f8101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 -- 172.21.15.2:0/3369710590 >> 172.21.15.2:0/3369710590 conn(0x7f18f80fd150 msgr2=0x7f18f80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 -- 172.21.15.2:0/3369710590 shutdown_connections 2024-09-10T23:24:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.781+0000 7f18fd1a0640 1 -- 172.21.15.2:0/3369710590 wait complete. 2024-09-10T23:24:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 Processor -- start 2024-09-10T23:24:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 -- start start 2024-09-10T23:24:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 0x7f18f806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f81029e0 0x7f18f819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81033a0 0x7f18f81a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18f810d500 con 0x7f18f8101890 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18f810d380 con 0x7f18f81029e0 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18fd1a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f18f810d680 con 0x7f18f81033a0 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18f6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 0x7f18f806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18f6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 0x7f18f806bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53572/0 (socket says 172.21.15.2:53572) 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18f6d9d640 1 -- 172.21.15.2:0/34623741 learned_addr learned my addr 172.21.15.2:0/34623741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18ee59c640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f81029e0 0x7f18f819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18f759e640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81033a0 0x7f18f81a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.782+0000 7f18f6d9d640 1 -- 172.21.15.2:0/34623741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81033a0 msgr2=0x7f18f81a2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f6d9d640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81033a0 0x7f18f81a2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f6d9d640 1 -- 172.21.15.2:0/34623741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f81029e0 msgr2=0x7f18f819fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f6d9d640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f81029e0 0x7f18f819fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f6d9d640 1 -- 172.21.15.2:0/34623741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f81a2b00 con 0x7f18f8101890 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f759e640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81033a0 0x7f18f81a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18ee59c640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f81029e0 0x7f18f819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f6d9d640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 0x7f18f806bb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18e800e9f0 tx=0x7f18e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e800cd80 con 0x7f18f8101890 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18e80108e0 con 0x7f18f8101890 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f81a2df0 con 0x7f18f8101890 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8018980 con 0x7f18f8101890 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.783+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f81a3250 con 0x7f18f8101890 2024-09-10T23:24:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.784+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f8108ba0 con 0x7f18f8101890 2024-09-10T23:24:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.785+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f18e8010430 con 0x7f18f8101890 2024-09-10T23:24:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.786+0000 7f18f4d99640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f18e40b52e0 0x7f18e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.786+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f18e80e6520 con 0x7f18f8101890 2024-09-10T23:24:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.786+0000 7f18ee59c640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f18e40b52e0 0x7f18e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.787+0000 7f18ee59c640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f18e40b52e0 0x7f18e40b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009c20 tx=0x7f18e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.789+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f18e80ad3f0 con 0x7f18f8101890 2024-09-10T23:24:15.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.971+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 --> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18f8063590 con 0x7f18e40b52e0 2024-09-10T23:24:15.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.975+0000 7f18f4d99640 1 -- 172.21.15.2:0/34623741 <== mgr.14150 v2:172.21.15.2:6800/3310548901 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259040 (secure 0 0 0) 0x7f18f8063590 con 0x7f18e40b52e0 2024-09-10T23:24:15.979 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:15.980 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T23:24:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.978+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f18e40b52e0 msgr2=0x7f18e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.978+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f18e40b52e0 0x7f18e40b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009c20 tx=0x7f18e0005f90 comp rx=0 tx=0).stop 2024-09-10T23:24:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.978+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 msgr2=0x7f18f806bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 0x7f18f806bb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18e800e9f0 tx=0x7f18e800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 shutdown_connections 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f18e40b52e0 0x7f18e40b77a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18f81033a0 0x7f18f81a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18f81029e0 0x7f18f819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 --2- 172.21.15.2:0/34623741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f8101890 0x7f18f806bb50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 >> 172.21.15.2:0/34623741 conn(0x7f18f80fd150 msgr2=0x7f18f8105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 shutdown_connections 2024-09-10T23:24:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:15.979+0000 7f18fd1a0640 1 -- 172.21.15.2:0/34623741 wait complete. 2024-09-10T23:24:15.990 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-10T23:24:14.244756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659507,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":677,"num_write":381,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952987,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":814,"ondisk_log_size":814,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376256,"kb_used_data":10368,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565568,"statfs":{"total":1151940427776,"available":1151555141632,"internally_reserved":0,"allocated":10616832,"data_stored":6792713,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002941"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614723+0000","last_change":"2024-09-10T23:22:16.326264+0000","last_active":"2024-09-10T23:23:50.614723+0000","last_peered":"2024-09-10T23:23:50.614723+0000","last_clean":"2024-09-10T23:23:50.614723+0000","last_became_active":"2024-09-10T23:22:16.325932+0000","last_became_peered":"2024-09-10T23:22:16.325932+0000","last_unstale":"2024-09-10T23:23:50.614723+0000","last_undegraded":"2024-09-10T23:23:50.614723+0000","last_fullsized":"2024-09-10T23:23:50.614723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:53.755578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615183+0000","last_change":"2024-09-10T23:22:16.317800+0000","last_active":"2024-09-10T23:23:50.615183+0000","last_peered":"2024-09-10T23:23:50.615183+0000","last_clean":"2024-09-10T23:23:50.615183+0000","last_became_active":"2024-09-10T23:22:16.317498+0000","last_became_peered":"2024-09-10T23:22:16.317498+0000","last_unstale":"2024-09-10T23:23:50.615183+0000","last_undegraded":"2024-09-10T23:23:50.615183+0000","last_fullsized":"2024-09-10T23:23:50.615183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:43.253495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623059+0000","last_change":"2024-09-10T23:22:16.323503+0000","last_active":"2024-09-10T23:23:50.623059+0000","last_peered":"2024-09-10T23:23:50.623059+0000","last_clean":"2024-09-10T23:23:50.623059+0000","last_became_active":"2024-09-10T23:22:16.323200+0000","last_became_peered":"2024-09-10T23:22:16.323200+0000","last_unstale":"2024-09-10T23:23:50.623059+0000","last_undegraded":"2024-09-10T23:23:50.623059+0000","last_fullsized":"2024-09-10T23:23:50.623059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:07.583867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.605552+0000","last_change":"2024-09-10T23:22:16.333868+0000","last_active":"2024-09-10T23:23:50.605552+0000","last_peered":"2024-09-10T23:23:50.605552+0000","last_clean":"2024-09-10T23:23:50.605552+0000","last_became_active":"2024-09-10T23:22:16.333280+0000","last_became_peered":"2024-09-10T23:22:16.333280+0000","last_unstale":"2024-09-10T23:23:50.605552+0000","last_undegraded":"2024-09-10T23:23:50.605552+0000","last_fullsized":"2024-09-10T23:23:50.605552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.640943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.603902+0000","last_change":"2024-09-10T23:22:16.327362+0000","last_active":"2024-09-10T23:23:50.603902+0000","last_peered":"2024-09-10T23:23:50.603902+0000","last_clean":"2024-09-10T23:23:50.603902+0000","last_became_active":"2024-09-10T23:22:16.327014+0000","last_became_peered":"2024-09-10T23:22:16.327014+0000","last_unstale":"2024-09-10T23:23:50.603902+0000","last_undegraded":"2024-09-10T23:23:50.603902+0000","last_fullsized":"2024-09-10T23:23:50.603902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:28.187174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612201+0000","last_change":"2024-09-10T23:22:16.325820+0000","last_active":"2024-09-10T23:23:50.612201+0000","last_peered":"2024-09-10T23:23:50.612201+0000","last_clean":"2024-09-10T23:23:50.612201+0000","last_became_active":"2024-09-10T23:22:16.325476+0000","last_became_peered":"2024-09-10T23:22:16.325476+0000","last_unstale":"2024-09-10T23:23:50.612201+0000","last_undegraded":"2024-09-10T23:23:50.612201+0000","last_fullsized":"2024-09-10T23:23:50.612201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:14.948987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608056+0000","last_change":"2024-09-10T23:22:16.323461+0000","last_active":"2024-09-10T23:23:50.608056+0000","last_peered":"2024-09-10T23:23:50.608056+0000","last_clean":"2024-09-10T23:23:50.608056+0000","last_became_active":"2024-09-10T23:22:16.323124+0000","last_became_peered":"2024-09-10T23:22:16.323124+0000","last_unstale":"2024-09-10T23:23:50.608056+0000","last_undegraded":"2024-09-10T23:23:50.608056+0000","last_fullsized":"2024-09-10T23:23:50.608056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:04.999014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608388+0000","last_change":"2024-09-10T23:22:16.333496+0000","last_active":"2024-09-10T23:23:50.608388+0000","last_peered":"2024-09-10T23:23:50.608388+0000","last_clean":"2024-09-10T23:23:50.608388+0000","last_became_active":"2024-09-10T23:22:16.333165+0000","last_became_peered":"2024-09-10T23:22:16.333165+0000","last_unstale":"2024-09-10T23:23:50.608388+0000","last_undegraded":"2024-09-10T23:23:50.608388+0000","last_fullsized":"2024-09-10T23:23:50.608388+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:56.626666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623075+0000","last_change":"2024-09-10T23:22:16.327721+0000","last_active":"2024-09-10T23:23:50.623075+0000","last_peered":"2024-09-10T23:23:50.623075+0000","last_clean":"2024-09-10T23:23:50.623075+0000","last_became_active":"2024-09-10T23:22:16.327294+0000","last_became_peered":"2024-09-10T23:22:16.327294+0000","last_unstale":"2024-09-10T23:23:50.623075+0000","last_undegraded":"2024-09-10T23:23:50.623075+0000","last_fullsized":"2024-09-10T23:23:50.623075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:08.036201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608978+0000","last_change":"2024-09-10T23:22:16.329296+0000","last_active":"2024-09-10T23:23:50.608978+0000","last_peered":"2024-09-10T23:23:50.608978+0000","last_clean":"2024-09-10T23:23:50.608978+0000","last_became_active":"2024-09-10T23:22:16.327952+0000","last_became_peered":"2024-09-10T23:22:16.327952+0000","last_unstale":"2024-09-10T23:23:50.608978+0000","last_undegraded":"2024-09-10T23:23:50.608978+0000","last_fullsized":"2024-09-10T23:23:50.608978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:59.086204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617956+0000","last_change":"2024-09-10T23:22:16.330623+0000","last_active":"2024-09-10T23:23:50.617956+0000","last_peered":"2024-09-10T23:23:50.617956+0000","last_clean":"2024-09-10T23:23:50.617956+0000","last_became_active":"2024-09-10T23:22:16.329479+0000","last_became_peered":"2024-09-10T23:22:16.329479+0000","last_unstale":"2024-09-10T23:23:50.617956+0000","last_undegraded":"2024-09-10T23:23:50.617956+0000","last_fullsized":"2024-09-10T23:23:50.617956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.601149+0000","last_change":"2024-09-10T23:22:16.323995+0000","last_active":"2024-09-10T23:23:50.601149+0000","last_peered":"2024-09-10T23:23:50.601149+0000","last_clean":"2024-09-10T23:23:50.601149+0000","last_became_active":"2024-09-10T23:22:16.323616+0000","last_became_peered":"2024-09-10T23:22:16.323616+0000","last_unstale":"2024-09-10T23:23:50.601149+0000","last_undegraded":"2024-09-10T23:23:50.601149+0000","last_fullsized":"2024-09-10T23:23:50.601149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.255157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.597496+0000","last_change":"2024-09-10T23:22:16.333643+0000","last_active":"2024-09-10T23:23:50.597496+0000","last_peered":"2024-09-10T23:23:50.597496+0000","last_clean":"2024-09-10T23:23:50.597496+0000","last_became_active":"2024-09-10T23:22:16.333404+0000","last_became_peered":"2024-09-10T23:22:16.333404+0000","last_unstale":"2024-09-10T23:23:50.597496+0000","last_undegraded":"2024-09-10T23:23:50.597496+0000","last_fullsized":"2024-09-10T23:23:50.597496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:59.063275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616290+0000","last_change":"2024-09-10T23:22:16.327317+0000","last_active":"2024-09-10T23:23:50.616290+0000","last_peered":"2024-09-10T23:23:50.616290+0000","last_clean":"2024-09-10T23:23:50.616290+0000","last_became_active":"2024-09-10T23:22:16.327004+0000","last_became_peered":"2024-09-10T23:22:16.327004+0000","last_unstale":"2024-09-10T23:23:50.616290+0000","last_undegraded":"2024-09-10T23:23:50.616290+0000","last_fullsized":"2024-09-10T23:23:50.616290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:35.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616089+0000","last_change":"2024-09-10T23:22:16.325483+0000","last_active":"2024-09-10T23:23:50.616089+0000","last_peered":"2024-09-10T23:23:50.616089+0000","last_clean":"2024-09-10T23:23:50.616089+0000","last_became_active":"2024-09-10T23:22:16.325162+0000","last_became_peered":"2024-09-10T23:22:16.325162+0000","last_unstale":"2024-09-10T23:23:50.616089+0000","last_undegraded":"2024-09-10T23:23:50.616089+0000","last_fullsized":"2024-09-10T23:23:50.616089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:26.884062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624294+0000","last_change":"2024-09-10T23:22:16.332755+0000","last_active":"2024-09-10T23:23:50.624294+0000","last_peered":"2024-09-10T23:23:50.624294+0000","last_clean":"2024-09-10T23:23:50.624294+0000","last_became_active":"2024-09-10T23:22:16.332398+0000","last_became_peered":"2024-09-10T23:22:16.332398+0000","last_unstale":"2024-09-10T23:23:50.624294+0000","last_undegraded":"2024-09-10T23:23:50.624294+0000","last_fullsized":"2024-09-10T23:23:50.624294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:30.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614754+0000","last_change":"2024-09-10T23:22:16.326429+0000","last_active":"2024-09-10T23:23:50.614754+0000","last_peered":"2024-09-10T23:23:50.614754+0000","last_clean":"2024-09-10T23:23:50.614754+0000","last_became_active":"2024-09-10T23:22:16.326031+0000","last_became_peered":"2024-09-10T23:22:16.326031+0000","last_unstale":"2024-09-10T23:23:50.614754+0000","last_undegraded":"2024-09-10T23:23:50.614754+0000","last_fullsized":"2024-09-10T23:23:50.614754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:29.077496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622614+0000","last_change":"2024-09-10T23:22:16.323393+0000","last_active":"2024-09-10T23:23:50.622614+0000","last_peered":"2024-09-10T23:23:50.622614+0000","last_clean":"2024-09-10T23:23:50.622614+0000","last_became_active":"2024-09-10T23:22:16.322983+0000","last_became_peered":"2024-09-10T23:22:16.322983+0000","last_unstale":"2024-09-10T23:23:50.622614+0000","last_undegraded":"2024-09-10T23:23:50.622614+0000","last_fullsized":"2024-09-10T23:23:50.622614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:42.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.607920+0000","last_change":"2024-09-10T23:22:16.317275+0000","last_active":"2024-09-10T23:23:50.607920+0000","last_peered":"2024-09-10T23:23:50.607920+0000","last_clean":"2024-09-10T23:23:50.607920+0000","last_became_active":"2024-09-10T23:22:16.316939+0000","last_became_peered":"2024-09-10T23:22:16.316939+0000","last_unstale":"2024-09-10T23:23:50.607920+0000","last_undegraded":"2024-09-10T23:23:50.607920+0000","last_fullsized":"2024-09-10T23:23:50.607920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:46.627858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610273+0000","last_change":"2024-09-10T23:22:51.492807+0000","last_active":"2024-09-10T23:23:50.610273+0000","last_peered":"2024-09-10T23:23:50.610273+0000","last_clean":"2024-09-10T23:23:50.610273+0000","last_became_active":"2024-09-10T23:22:51.492343+0000","last_became_peered":"2024-09-10T23:22:51.492343+0000","last_unstale":"2024-09-10T23:23:50.610273+0000","last_undegraded":"2024-09-10T23:23:50.610273+0000","last_fullsized":"2024-09-10T23:23:50.610273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:59.573883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614998+0000","last_change":"2024-09-10T23:22:16.317968+0000","last_active":"2024-09-10T23:23:50.614998+0000","last_peered":"2024-09-10T23:23:50.614998+0000","last_clean":"2024-09-10T23:23:50.614998+0000","last_became_active":"2024-09-10T23:22:16.317644+0000","last_became_peered":"2024-09-10T23:22:16.317644+0000","last_unstale":"2024-09-10T23:23:50.614998+0000","last_undegraded":"2024-09-10T23:23:50.614998+0000","last_fullsized":"2024-09-10T23:23:50.614998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:49.435222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623967+0000","last_change":"2024-09-10T23:22:16.325547+0000","last_active":"2024-09-10T23:23:50.623967+0000","last_peered":"2024-09-10T23:23:50.623967+0000","last_clean":"2024-09-10T23:23:50.623967+0000","last_became_active":"2024-09-10T23:22:16.325191+0000","last_became_peered":"2024-09-10T23:22:16.325191+0000","last_unstale":"2024-09-10T23:23:50.623967+0000","last_undegraded":"2024-09-10T23:23:50.623967+0000","last_fullsized":"2024-09-10T23:23:50.623967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:29.094236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615277+0000","last_change":"2024-09-10T23:22:16.321485+0000","last_active":"2024-09-10T23:23:50.615277+0000","last_peered":"2024-09-10T23:23:50.615277+0000","last_clean":"2024-09-10T23:23:50.615277+0000","last_became_active":"2024-09-10T23:22:16.320524+0000","last_became_peered":"2024-09-10T23:22:16.320524+0000","last_unstale":"2024-09-10T23:23:50.615277+0000","last_undegraded":"2024-09-10T23:23:50.615277+0000","last_fullsized":"2024-09-10T23:23:50.615277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.972029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.609534+0000","last_change":"2024-09-10T23:22:16.329194+0000","last_active":"2024-09-10T23:23:50.609534+0000","last_peered":"2024-09-10T23:23:50.609534+0000","last_clean":"2024-09-10T23:23:50.609534+0000","last_became_active":"2024-09-10T23:22:16.328701+0000","last_became_peered":"2024-09-10T23:22:16.328701+0000","last_unstale":"2024-09-10T23:23:50.609534+0000","last_undegraded":"2024-09-10T23:23:50.609534+0000","last_fullsized":"2024-09-10T23:23:50.609534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:40.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610726+0000","last_change":"2024-09-10T23:22:16.323633+0000","last_active":"2024-09-10T23:23:50.610726+0000","last_peered":"2024-09-10T23:23:50.610726+0000","last_clean":"2024-09-10T23:23:50.610726+0000","last_became_active":"2024-09-10T23:22:16.323295+0000","last_became_peered":"2024-09-10T23:22:16.323295+0000","last_unstale":"2024-09-10T23:23:50.610726+0000","last_undegraded":"2024-09-10T23:23:50.610726+0000","last_fullsized":"2024-09-10T23:23:50.610726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:48.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622570+0000","last_change":"2024-09-10T23:22:16.324534+0000","last_active":"2024-09-10T23:23:50.622570+0000","last_peered":"2024-09-10T23:23:50.622570+0000","last_clean":"2024-09-10T23:23:50.622570+0000","last_became_active":"2024-09-10T23:22:16.324191+0000","last_became_peered":"2024-09-10T23:22:16.324191+0000","last_unstale":"2024-09-10T23:23:50.622570+0000","last_undegraded":"2024-09-10T23:23:50.622570+0000","last_fullsized":"2024-09-10T23:23:50.622570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:19.741538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612488+0000","last_change":"2024-09-10T23:22:16.331099+0000","last_active":"2024-09-10T23:23:50.612488+0000","last_peered":"2024-09-10T23:23:50.612488+0000","last_clean":"2024-09-10T23:23:50.612488+0000","last_became_active":"2024-09-10T23:22:16.330697+0000","last_became_peered":"2024-09-10T23:22:16.330697+0000","last_unstale":"2024-09-10T23:23:50.612488+0000","last_undegraded":"2024-09-10T23:23:50.612488+0000","last_fullsized":"2024-09-10T23:23:50.612488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:26.705509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614174+0000","last_change":"2024-09-10T23:22:51.488675+0000","last_active":"2024-09-10T23:23:50.614174+0000","last_peered":"2024-09-10T23:23:50.614174+0000","last_clean":"2024-09-10T23:23:50.614174+0000","last_became_active":"2024-09-10T23:22:51.488291+0000","last_became_peered":"2024-09-10T23:22:51.488291+0000","last_unstale":"2024-09-10T23:23:50.614174+0000","last_undegraded":"2024-09-10T23:23:50.614174+0000","last_fullsized":"2024-09-10T23:23:50.614174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615996+0000","last_change":"2024-09-10T23:22:16.324288+0000","last_active":"2024-09-10T23:23:50.615996+0000","last_peered":"2024-09-10T23:23:50.615996+0000","last_clean":"2024-09-10T23:23:50.615996+0000","last_became_active":"2024-09-10T23:22:16.322460+0000","last_became_peered":"2024-09-10T23:22:16.322460+0000","last_unstale":"2024-09-10T23:23:50.615996+0000","last_undegraded":"2024-09-10T23:23:50.615996+0000","last_fullsized":"2024-09-10T23:23:50.615996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:46.492116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614632+0000","last_change":"2024-09-10T23:22:16.319589+0000","last_active":"2024-09-10T23:23:50.614632+0000","last_peered":"2024-09-10T23:23:50.614632+0000","last_clean":"2024-09-10T23:23:50.614632+0000","last_became_active":"2024-09-10T23:22:16.319156+0000","last_became_peered":"2024-09-10T23:22:16.319156+0000","last_unstale":"2024-09-10T23:23:50.614632+0000","last_undegraded":"2024-09-10T23:23:50.614632+0000","last_fullsized":"2024-09-10T23:23:50.614632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:20.869921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615076+0000","last_change":"2024-09-10T23:22:16.324589+0000","last_active":"2024-09-10T23:23:50.615076+0000","last_peered":"2024-09-10T23:23:50.615076+0000","last_clean":"2024-09-10T23:23:50.615076+0000","last_became_active":"2024-09-10T23:22:16.324161+0000","last_became_peered":"2024-09-10T23:22:16.324161+0000","last_unstale":"2024-09-10T23:23:50.615076+0000","last_undegraded":"2024-09-10T23:23:50.615076+0000","last_fullsized":"2024-09-10T23:23:50.615076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:55.734701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614699+0000","last_change":"2024-09-10T23:22:16.331155+0000","last_active":"2024-09-10T23:23:50.614699+0000","last_peered":"2024-09-10T23:23:50.614699+0000","last_clean":"2024-09-10T23:23:50.614699+0000","last_became_active":"2024-09-10T23:22:16.330802+0000","last_became_peered":"2024-09-10T23:22:16.330802+0000","last_unstale":"2024-09-10T23:23:50.614699+0000","last_undegraded":"2024-09-10T23:23:50.614699+0000","last_fullsized":"2024-09-10T23:23:50.614699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:07.865298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.595682+0000","last_change":"2024-09-10T23:22:16.324168+0000","last_active":"2024-09-10T23:23:50.595682+0000","last_peered":"2024-09-10T23:23:50.595682+0000","last_clean":"2024-09-10T23:23:50.595682+0000","last_became_active":"2024-09-10T23:22:16.322052+0000","last_became_peered":"2024-09-10T23:22:16.322052+0000","last_unstale":"2024-09-10T23:23:50.595682+0000","last_undegraded":"2024-09-10T23:23:50.595682+0000","last_fullsized":"2024-09-10T23:23:50.595682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:23.335250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":151,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.605507+0000","last_change":"2024-09-10T23:22:51.506742+0000","last_active":"2024-09-10T23:24:10.605507+0000","last_peered":"2024-09-10T23:24:10.605507+0000","last_clean":"2024-09-10T23:24:10.605507+0000","last_became_active":"2024-09-10T23:22:51.493588+0000","last_became_peered":"2024-09-10T23:22:51.493588+0000","last_unstale":"2024-09-10T23:24:10.605507+0000","last_undegraded":"2024-09-10T23:24:10.605507+0000","last_fullsized":"2024-09-10T23:24:10.605507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:42.641981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.613512+0000","last_change":"2024-09-10T23:22:16.331148+0000","last_active":"2024-09-10T23:23:50.613512+0000","last_peered":"2024-09-10T23:23:50.613512+0000","last_clean":"2024-09-10T23:23:50.613512+0000","last_became_active":"2024-09-10T23:22:16.330771+0000","last_became_peered":"2024-09-10T23:22:16.330771+0000","last_unstale":"2024-09-10T23:23:50.613512+0000","last_undegraded":"2024-09-10T23:23:50.613512+0000","last_fullsized":"2024-09-10T23:23:50.613512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:02.265270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544696+0000","last_change":"2024-09-10T23:22:14.302811+0000","last_active":"2024-09-10T23:22:51.544696+0000","last_peered":"2024-09-10T23:22:51.544696+0000","last_clean":"2024-09-10T23:22:51.544696+0000","last_became_active":"2024-09-10T23:22:14.302488+0000","last_became_peered":"2024-09-10T23:22:14.302488+0000","last_unstale":"2024-09-10T23:22:51.544696+0000","last_undegraded":"2024-09-10T23:22:51.544696+0000","last_fullsized":"2024-09-10T23:22:51.544696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:21.072853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485555+0000","last_change":"2024-09-10T23:22:14.295433+0000","last_active":"2024-09-10T23:22:51.485555+0000","last_peered":"2024-09-10T23:22:51.485555+0000","last_clean":"2024-09-10T23:22:51.485555+0000","last_became_active":"2024-09-10T23:22:14.295135+0000","last_became_peered":"2024-09-10T23:22:14.295135+0000","last_unstale":"2024-09-10T23:22:51.485555+0000","last_undegraded":"2024-09-10T23:22:51.485555+0000","last_fullsized":"2024-09-10T23:22:51.485555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:26.546613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610161+0000","last_change":"2024-09-10T23:22:16.320673+0000","last_active":"2024-09-10T23:23:50.610161+0000","last_peered":"2024-09-10T23:23:50.610161+0000","last_clean":"2024-09-10T23:23:50.610161+0000","last_became_active":"2024-09-10T23:22:16.320337+0000","last_became_peered":"2024-09-10T23:22:16.320337+0000","last_unstale":"2024-09-10T23:23:50.610161+0000","last_undegraded":"2024-09-10T23:23:50.610161+0000","last_fullsized":"2024-09-10T23:23:50.610161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:27.026160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488201+0000","last_change":"2024-09-10T23:22:14.300287+0000","last_active":"2024-09-10T23:22:51.488201+0000","last_peered":"2024-09-10T23:22:51.488201+0000","last_clean":"2024-09-10T23:22:51.488201+0000","last_became_active":"2024-09-10T23:22:14.299959+0000","last_became_peered":"2024-09-10T23:22:14.299959+0000","last_unstale":"2024-09-10T23:22:51.488201+0000","last_undegraded":"2024-09-10T23:22:51.488201+0000","last_fullsized":"2024-09-10T23:22:51.488201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:27.679736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612135+0000","last_change":"2024-09-10T23:22:16.328555+0000","last_active":"2024-09-10T23:23:50.612135+0000","last_peered":"2024-09-10T23:23:50.612135+0000","last_clean":"2024-09-10T23:23:50.612135+0000","last_became_active":"2024-09-10T23:22:16.328251+0000","last_became_peered":"2024-09-10T23:22:16.328251+0000","last_unstale":"2024-09-10T23:23:50.612135+0000","last_undegraded":"2024-09-10T23:23:50.612135+0000","last_fullsized":"2024-09-10T23:23:50.612135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:24.901832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'6","reported_seq":235,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.597678+0000","last_change":"2024-09-10T23:22:14.304863+0000","last_active":"2024-09-10T23:24:10.597678+0000","last_peered":"2024-09-10T23:24:10.597678+0000","last_clean":"2024-09-10T23:24:10.597678+0000","last_became_active":"2024-09-10T23:22:14.304486+0000","last_became_peered":"2024-09-10T23:22:14.304486+0000","last_unstale":"2024-09-10T23:24:10.597678+0000","last_undegraded":"2024-09-10T23:24:10.597678+0000","last_fullsized":"2024-09-10T23:24:10.597678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:23.756772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624868+0000","last_change":"2024-09-10T23:22:16.328219+0000","last_active":"2024-09-10T23:23:50.624868+0000","last_peered":"2024-09-10T23:23:50.624868+0000","last_clean":"2024-09-10T23:23:50.624868+0000","last_became_active":"2024-09-10T23:22:16.327902+0000","last_became_peered":"2024-09-10T23:22:16.327902+0000","last_unstale":"2024-09-10T23:23:50.624868+0000","last_undegraded":"2024-09-10T23:23:50.624868+0000","last_fullsized":"2024-09-10T23:23:50.624868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.764908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492077+0000","last_change":"2024-09-10T23:22:14.302108+0000","last_active":"2024-09-10T23:22:51.492077+0000","last_peered":"2024-09-10T23:22:51.492077+0000","last_clean":"2024-09-10T23:22:51.492077+0000","last_became_active":"2024-09-10T23:22:14.301743+0000","last_became_peered":"2024-09-10T23:22:14.301743+0000","last_unstale":"2024-09-10T23:22:51.492077+0000","last_undegraded":"2024-09-10T23:22:51.492077+0000","last_fullsized":"2024-09-10T23:22:51.492077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616353+0000","last_change":"2024-09-10T23:22:16.325609+0000","last_active":"2024-09-10T23:23:50.616353+0000","last_peered":"2024-09-10T23:23:50.616353+0000","last_clean":"2024-09-10T23:23:50.616353+0000","last_became_active":"2024-09-10T23:22:16.325079+0000","last_became_peered":"2024-09-10T23:22:16.325079+0000","last_unstale":"2024-09-10T23:23:50.616353+0000","last_undegraded":"2024-09-10T23:23:50.616353+0000","last_fullsized":"2024-09-10T23:23:50.616353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.411802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488638+0000","last_change":"2024-09-10T23:22:14.417855+0000","last_active":"2024-09-10T23:22:51.488638+0000","last_peered":"2024-09-10T23:22:51.488638+0000","last_clean":"2024-09-10T23:22:51.488638+0000","last_became_active":"2024-09-10T23:22:14.417439+0000","last_became_peered":"2024-09-10T23:22:14.417439+0000","last_unstale":"2024-09-10T23:22:51.488638+0000","last_undegraded":"2024-09-10T23:22:51.488638+0000","last_fullsized":"2024-09-10T23:22:51.488638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:55.878884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624094+0000","last_change":"2024-09-10T23:22:51.490154+0000","last_active":"2024-09-10T23:23:50.624094+0000","last_peered":"2024-09-10T23:23:50.624094+0000","last_clean":"2024-09-10T23:23:50.624094+0000","last_became_active":"2024-09-10T23:22:51.489716+0000","last_became_peered":"2024-09-10T23:22:51.489716+0000","last_unstale":"2024-09-10T23:23:50.624094+0000","last_undegraded":"2024-09-10T23:23:50.624094+0000","last_fullsized":"2024-09-10T23:23:50.624094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.280542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'35","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.605170+0000","last_change":"2024-09-10T23:22:14.303550+0000","last_active":"2024-09-10T23:24:10.605170+0000","last_peered":"2024-09-10T23:24:10.605170+0000","last_clean":"2024-09-10T23:24:10.605170+0000","last_became_active":"2024-09-10T23:22:14.303197+0000","last_became_peered":"2024-09-10T23:22:14.303197+0000","last_unstale":"2024-09-10T23:24:10.605170+0000","last_undegraded":"2024-09-10T23:24:10.605170+0000","last_fullsized":"2024-09-10T23:24:10.605170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:57.968944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61419,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":169,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611419+0000","last_change":"2024-09-10T23:22:16.326273+0000","last_active":"2024-09-10T23:23:50.611419+0000","last_peered":"2024-09-10T23:23:50.611419+0000","last_clean":"2024-09-10T23:23:50.611419+0000","last_became_active":"2024-09-10T23:22:16.325522+0000","last_became_peered":"2024-09-10T23:22:16.325522+0000","last_unstale":"2024-09-10T23:23:50.611419+0000","last_undegraded":"2024-09-10T23:23:50.611419+0000","last_fullsized":"2024-09-10T23:23:50.611419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:49.923958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491721+0000","last_change":"2024-09-10T23:22:14.299820+0000","last_active":"2024-09-10T23:22:51.491721+0000","last_peered":"2024-09-10T23:22:51.491721+0000","last_clean":"2024-09-10T23:22:51.491721+0000","last_became_active":"2024-09-10T23:22:14.299412+0000","last_became_peered":"2024-09-10T23:22:14.299412+0000","last_unstale":"2024-09-10T23:22:51.491721+0000","last_undegraded":"2024-09-10T23:22:51.491721+0000","last_fullsized":"2024-09-10T23:22:51.491721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:40.322774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.603550+0000","last_change":"2024-09-10T23:22:16.317705+0000","last_active":"2024-09-10T23:23:50.603550+0000","last_peered":"2024-09-10T23:23:50.603550+0000","last_clean":"2024-09-10T23:23:50.603550+0000","last_became_active":"2024-09-10T23:22:16.317404+0000","last_became_peered":"2024-09-10T23:22:16.317404+0000","last_unstale":"2024-09-10T23:23:50.603550+0000","last_undegraded":"2024-09-10T23:23:50.603550+0000","last_fullsized":"2024-09-10T23:23:50.603550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:47.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488112+0000","last_change":"2024-09-10T23:22:14.298984+0000","last_active":"2024-09-10T23:22:51.488112+0000","last_peered":"2024-09-10T23:22:51.488112+0000","last_clean":"2024-09-10T23:22:51.488112+0000","last_became_active":"2024-09-10T23:22:14.298651+0000","last_became_peered":"2024-09-10T23:22:14.298651+0000","last_unstale":"2024-09-10T23:22:51.488112+0000","last_undegraded":"2024-09-10T23:22:51.488112+0000","last_fullsized":"2024-09-10T23:22:51.488112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:52.777476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612284+0000","last_change":"2024-09-10T23:22:16.324084+0000","last_active":"2024-09-10T23:23:50.612284+0000","last_peered":"2024-09-10T23:23:50.612284+0000","last_clean":"2024-09-10T23:23:50.612284+0000","last_became_active":"2024-09-10T23:22:16.323775+0000","last_became_peered":"2024-09-10T23:22:16.323775+0000","last_unstale":"2024-09-10T23:23:50.612284+0000","last_undegraded":"2024-09-10T23:23:50.612284+0000","last_fullsized":"2024-09-10T23:23:50.612284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:22.583698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:10.581668+0000","last_change":"2024-09-10T23:22:14.300854+0000","last_active":"2024-09-10T23:24:10.581668+0000","last_peered":"2024-09-10T23:24:10.581668+0000","last_clean":"2024-09-10T23:24:10.581668+0000","last_became_active":"2024-09-10T23:22:14.300484+0000","last_became_peered":"2024-09-10T23:22:14.300484+0000","last_unstale":"2024-09-10T23:24:10.581668+0000","last_undegraded":"2024-09-10T23:24:10.581668+0000","last_fullsized":"2024-09-10T23:24:10.581668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.608717+0000","last_change":"2024-09-10T23:22:16.329935+0000","last_active":"2024-09-10T23:23:50.608717+0000","last_peered":"2024-09-10T23:23:50.608717+0000","last_clean":"2024-09-10T23:23:50.608717+0000","last_became_active":"2024-09-10T23:22:16.329586+0000","last_became_peered":"2024-09-10T23:22:16.329586+0000","last_unstale":"2024-09-10T23:23:50.608717+0000","last_undegraded":"2024-09-10T23:23:50.608717+0000","last_fullsized":"2024-09-10T23:23:50.608717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:14.303177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486630+0000","last_change":"2024-09-10T23:22:14.416965+0000","last_active":"2024-09-10T23:22:51.486630+0000","last_peered":"2024-09-10T23:22:51.486630+0000","last_clean":"2024-09-10T23:22:51.486630+0000","last_became_active":"2024-09-10T23:22:14.416209+0000","last_became_peered":"2024-09-10T23:22:14.416209+0000","last_unstale":"2024-09-10T23:22:51.486630+0000","last_undegraded":"2024-09-10T23:22:51.486630+0000","last_fullsized":"2024-09-10T23:22:51.486630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:04.383975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617058+0000","last_change":"2024-09-10T23:22:16.333938+0000","last_active":"2024-09-10T23:23:50.617058+0000","last_peered":"2024-09-10T23:23:50.617058+0000","last_clean":"2024-09-10T23:23:50.617058+0000","last_became_active":"2024-09-10T23:22:16.333611+0000","last_became_peered":"2024-09-10T23:22:16.333611+0000","last_unstale":"2024-09-10T23:23:50.617058+0000","last_undegraded":"2024-09-10T23:23:50.617058+0000","last_fullsized":"2024-09-10T23:23:50.617058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.091196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.510546+0000","last_change":"2024-09-10T23:22:51.510092+0000","last_active":"2024-09-10T23:22:51.510546+0000","last_peered":"2024-09-10T23:22:51.510546+0000","last_clean":"2024-09-10T23:22:51.510546+0000","last_became_active":"2024-09-10T23:22:51.489887+0000","last_became_peered":"2024-09-10T23:22:51.489887+0000","last_unstale":"2024-09-10T23:22:51.510546+0000","last_undegraded":"2024-09-10T23:22:51.510546+0000","last_fullsized":"2024-09-10T23:22:51.510546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:14.757355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612385+0000","last_change":"2024-09-10T23:22:16.328425+0000","last_active":"2024-09-10T23:23:50.612385+0000","last_peered":"2024-09-10T23:23:50.612385+0000","last_clean":"2024-09-10T23:23:50.612385+0000","last_became_active":"2024-09-10T23:22:16.328098+0000","last_became_peered":"2024-09-10T23:22:16.328098+0000","last_unstale":"2024-09-10T23:23:50.612385+0000","last_undegraded":"2024-09-10T23:23:50.612385+0000","last_fullsized":"2024-09-10T23:23:50.612385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:21.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486119+0000","last_change":"2024-09-10T23:22:14.296579+0000","last_active":"2024-09-10T23:22:51.486119+0000","last_peered":"2024-09-10T23:22:51.486119+0000","last_clean":"2024-09-10T23:22:51.486119+0000","last_became_active":"2024-09-10T23:22:14.296258+0000","last_became_peered":"2024-09-10T23:22:14.296258+0000","last_unstale":"2024-09-10T23:22:51.486119+0000","last_undegraded":"2024-09-10T23:22:51.486119+0000","last_fullsized":"2024-09-10T23:22:51.486119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:31.483957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611494+0000","last_change":"2024-09-10T23:22:16.317992+0000","last_active":"2024-09-10T23:23:50.611494+0000","last_peered":"2024-09-10T23:23:50.611494+0000","last_clean":"2024-09-10T23:23:50.611494+0000","last_became_active":"2024-09-10T23:22:16.317606+0000","last_became_peered":"2024-09-10T23:22:16.317606+0000","last_unstale":"2024-09-10T23:23:50.611494+0000","last_undegraded":"2024-09-10T23:23:50.611494+0000","last_fullsized":"2024-09-10T23:23:50.611494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:45.516488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.488710+0000","last_change":"2024-09-10T23:22:14.302658+0000","last_active":"2024-09-10T23:22:51.488710+0000","last_peered":"2024-09-10T23:22:51.488710+0000","last_clean":"2024-09-10T23:22:51.488710+0000","last_became_active":"2024-09-10T23:22:14.302192+0000","last_became_peered":"2024-09-10T23:22:14.302192+0000","last_unstale":"2024-09-10T23:22:51.488710+0000","last_undegraded":"2024-09-10T23:22:51.488710+0000","last_fullsized":"2024-09-10T23:22:51.488710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:02.969019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.609307+0000","last_change":"2024-09-10T23:22:16.318665+0000","last_active":"2024-09-10T23:23:50.609307+0000","last_peered":"2024-09-10T23:23:50.609307+0000","last_clean":"2024-09-10T23:23:50.609307+0000","last_became_active":"2024-09-10T23:22:16.318318+0000","last_became_peered":"2024-09-10T23:22:16.318318+0000","last_unstale":"2024-09-10T23:23:50.609307+0000","last_undegraded":"2024-09-10T23:23:50.609307+0000","last_fullsized":"2024-09-10T23:23:50.609307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:28.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'7","reported_seq":140,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:12.601473+0000","last_change":"2024-09-10T23:22:14.415736+0000","last_active":"2024-09-10T23:24:12.601473+0000","last_peered":"2024-09-10T23:24:12.601473+0000","last_clean":"2024-09-10T23:24:12.601473+0000","last_became_active":"2024-09-10T23:22:14.415367+0000","last_became_peered":"2024-09-10T23:22:14.415367+0000","last_unstale":"2024-09-10T23:24:12.601473+0000","last_undegraded":"2024-09-10T23:24:12.601473+0000","last_fullsized":"2024-09-10T23:24:12.601473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.044084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.618080+0000","last_change":"2024-09-10T23:22:16.327819+0000","last_active":"2024-09-10T23:23:50.618080+0000","last_peered":"2024-09-10T23:23:50.618080+0000","last_clean":"2024-09-10T23:23:50.618080+0000","last_became_active":"2024-09-10T23:22:16.327468+0000","last_became_peered":"2024-09-10T23:22:16.327468+0000","last_unstale":"2024-09-10T23:23:50.618080+0000","last_undegraded":"2024-09-10T23:23:50.618080+0000","last_fullsized":"2024-09-10T23:23:50.618080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:02.324683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491782+0000","last_change":"2024-09-10T23:21:02.404057+0000","last_active":"2024-09-10T23:22:51.491782+0000","last_peered":"2024-09-10T23:22:51.491782+0000","last_clean":"2024-09-10T23:22:51.491782+0000","last_became_active":"2024-09-10T23:21:02.398551+0000","last_became_peered":"2024-09-10T23:21:02.398551+0000","last_unstale":"2024-09-10T23:22:51.491782+0000","last_undegraded":"2024-09-10T23:22:51.491782+0000","last_fullsized":"2024-09-10T23:22:51.491782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:34.673898+0000","last_clean_scrub_stamp":"2024-09-10T23:17:34.673898+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.037982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484149+0000","last_change":"2024-09-10T23:22:14.300207+0000","last_active":"2024-09-10T23:22:51.484149+0000","last_peered":"2024-09-10T23:22:51.484149+0000","last_clean":"2024-09-10T23:22:51.484149+0000","last_became_active":"2024-09-10T23:22:14.299444+0000","last_became_peered":"2024-09-10T23:22:14.299444+0000","last_unstale":"2024-09-10T23:22:51.484149+0000","last_undegraded":"2024-09-10T23:22:51.484149+0000","last_fullsized":"2024-09-10T23:22:51.484149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:05.172027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.622230+0000","last_change":"2024-09-10T23:22:51.489197+0000","last_active":"2024-09-10T23:23:50.622230+0000","last_peered":"2024-09-10T23:23:50.622230+0000","last_clean":"2024-09-10T23:23:50.622230+0000","last_became_active":"2024-09-10T23:22:51.488701+0000","last_became_peered":"2024-09-10T23:22:51.488701+0000","last_unstale":"2024-09-10T23:23:50.622230+0000","last_undegraded":"2024-09-10T23:23:50.622230+0000","last_fullsized":"2024-09-10T23:23:50.622230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:47.899980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.491615+0000","last_change":"2024-09-10T23:22:14.302122+0000","last_active":"2024-09-10T23:22:51.491615+0000","last_peered":"2024-09-10T23:22:51.491615+0000","last_clean":"2024-09-10T23:22:51.491615+0000","last_became_active":"2024-09-10T23:22:14.301788+0000","last_became_peered":"2024-09-10T23:22:14.301788+0000","last_unstale":"2024-09-10T23:22:51.491615+0000","last_undegraded":"2024-09-10T23:22:51.491615+0000","last_fullsized":"2024-09-10T23:22:51.491615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:35.504458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615068+0000","last_change":"2024-09-10T23:22:16.322754+0000","last_active":"2024-09-10T23:23:50.615068+0000","last_peered":"2024-09-10T23:23:50.615068+0000","last_clean":"2024-09-10T23:23:50.615068+0000","last_became_active":"2024-09-10T23:22:16.322437+0000","last_became_peered":"2024-09-10T23:22:16.322437+0000","last_unstale":"2024-09-10T23:23:50.615068+0000","last_undegraded":"2024-09-10T23:23:50.615068+0000","last_fullsized":"2024-09-10T23:23:50.615068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:51.741557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:11.582380+0000","last_change":"2024-09-10T23:22:14.416152+0000","last_active":"2024-09-10T23:24:11.582380+0000","last_peered":"2024-09-10T23:24:11.582380+0000","last_clean":"2024-09-10T23:24:11.582380+0000","last_became_active":"2024-09-10T23:22:14.415395+0000","last_became_peered":"2024-09-10T23:22:14.415395+0000","last_unstale":"2024-09-10T23:24:11.582380+0000","last_undegraded":"2024-09-10T23:24:11.582380+0000","last_fullsized":"2024-09-10T23:24:11.582380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:33.970483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.615926+0000","last_change":"2024-09-10T23:22:16.331874+0000","last_active":"2024-09-10T23:23:50.615926+0000","last_peered":"2024-09-10T23:23:50.615926+0000","last_clean":"2024-09-10T23:23:50.615926+0000","last_became_active":"2024-09-10T23:22:16.331550+0000","last_became_peered":"2024-09-10T23:22:16.331550+0000","last_unstale":"2024-09-10T23:23:50.615926+0000","last_undegraded":"2024-09-10T23:23:50.615926+0000","last_fullsized":"2024-09-10T23:23:50.615926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.669637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:11.582606+0000","last_change":"2024-09-10T23:22:14.300150+0000","last_active":"2024-09-10T23:24:11.582606+0000","last_peered":"2024-09-10T23:24:11.582606+0000","last_clean":"2024-09-10T23:24:11.582606+0000","last_became_active":"2024-09-10T23:22:14.299791+0000","last_became_peered":"2024-09-10T23:22:14.299791+0000","last_unstale":"2024-09-10T23:24:11.582606+0000","last_undegraded":"2024-09-10T23:24:11.582606+0000","last_fullsized":"2024-09-10T23:24:11.582606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:59.958956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.612613+0000","last_change":"2024-09-10T23:22:16.324141+0000","last_active":"2024-09-10T23:23:50.612613+0000","last_peered":"2024-09-10T23:23:50.612613+0000","last_clean":"2024-09-10T23:23:50.612613+0000","last_became_active":"2024-09-10T23:22:16.323839+0000","last_became_peered":"2024-09-10T23:22:16.323839+0000","last_unstale":"2024-09-10T23:23:50.612613+0000","last_undegraded":"2024-09-10T23:23:50.612613+0000","last_fullsized":"2024-09-10T23:23:50.612613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:51.045876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.482986+0000","last_change":"2024-09-10T23:22:14.417828+0000","last_active":"2024-09-10T23:22:51.482986+0000","last_peered":"2024-09-10T23:22:51.482986+0000","last_clean":"2024-09-10T23:22:51.482986+0000","last_became_active":"2024-09-10T23:22:14.417517+0000","last_became_peered":"2024-09-10T23:22:14.417517+0000","last_unstale":"2024-09-10T23:22:51.482986+0000","last_undegraded":"2024-09-10T23:22:51.482986+0000","last_fullsized":"2024-09-10T23:22:51.482986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:20.131909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611442+0000","last_change":"2024-09-10T23:22:16.328894+0000","last_active":"2024-09-10T23:23:50.611442+0000","last_peered":"2024-09-10T23:23:50.611442+0000","last_clean":"2024-09-10T23:23:50.611442+0000","last_became_active":"2024-09-10T23:22:16.328556+0000","last_became_peered":"2024-09-10T23:22:16.328556+0000","last_unstale":"2024-09-10T23:23:50.611442+0000","last_undegraded":"2024-09-10T23:23:50.611442+0000","last_fullsized":"2024-09-10T23:23:50.611442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:06.069547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.498531+0000","last_change":"2024-09-10T23:22:51.498021+0000","last_active":"2024-09-10T23:22:51.498531+0000","last_peered":"2024-09-10T23:22:51.498531+0000","last_clean":"2024-09-10T23:22:51.498531+0000","last_became_active":"2024-09-10T23:22:51.488787+0000","last_became_peered":"2024-09-10T23:22:51.488787+0000","last_unstale":"2024-09-10T23:22:51.498531+0000","last_undegraded":"2024-09-10T23:22:51.498531+0000","last_fullsized":"2024-09-10T23:22:51.498531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:46.855288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.611647+0000","last_change":"2024-09-10T23:22:16.317300+0000","last_active":"2024-09-10T23:23:50.611647+0000","last_peered":"2024-09-10T23:23:50.611647+0000","last_clean":"2024-09-10T23:23:50.611647+0000","last_became_active":"2024-09-10T23:22:16.316980+0000","last_became_peered":"2024-09-10T23:22:16.316980+0000","last_unstale":"2024-09-10T23:23:50.611647+0000","last_undegraded":"2024-09-10T23:23:50.611647+0000","last_fullsized":"2024-09-10T23:23:50.611647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'17","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.483124+0000","last_change":"2024-09-10T23:22:14.297276+0000","last_active":"2024-09-10T23:22:51.483124+0000","last_peered":"2024-09-10T23:22:51.483124+0000","last_clean":"2024-09-10T23:22:51.483124+0000","last_became_active":"2024-09-10T23:22:14.296936+0000","last_became_peered":"2024-09-10T23:22:14.296936+0000","last_unstale":"2024-09-10T23:22:51.483124+0000","last_undegraded":"2024-09-10T23:22:51.483124+0000","last_fullsized":"2024-09-10T23:22:51.483124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:53.264316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.610312+0000","last_change":"2024-09-10T23:22:16.318849+0000","last_active":"2024-09-10T23:23:50.610312+0000","last_peered":"2024-09-10T23:23:50.610312+0000","last_clean":"2024-09-10T23:23:50.610312+0000","last_became_active":"2024-09-10T23:22:16.318528+0000","last_became_peered":"2024-09-10T23:22:16.318528+0000","last_unstale":"2024-09-10T23:23:50.610312+0000","last_undegraded":"2024-09-10T23:23:50.610312+0000","last_fullsized":"2024-09-10T23:23:50.610312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:44.030292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.484358+0000","last_change":"2024-09-10T23:22:14.414934+0000","last_active":"2024-09-10T23:22:51.484358+0000","last_peered":"2024-09-10T23:22:51.484358+0000","last_clean":"2024-09-10T23:22:51.484358+0000","last_became_active":"2024-09-10T23:22:14.414476+0000","last_became_peered":"2024-09-10T23:22:14.414476+0000","last_unstale":"2024-09-10T23:22:51.484358+0000","last_undegraded":"2024-09-10T23:22:51.484358+0000","last_fullsized":"2024-09-10T23:22:51.484358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:44.448258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.616309+0000","last_change":"2024-09-10T23:22:16.329426+0000","last_active":"2024-09-10T23:23:50.616309+0000","last_peered":"2024-09-10T23:23:50.616309+0000","last_clean":"2024-09-10T23:23:50.616309+0000","last_became_active":"2024-09-10T23:22:16.329075+0000","last_became_peered":"2024-09-10T23:22:16.329075+0000","last_unstale":"2024-09-10T23:23:50.616309+0000","last_undegraded":"2024-09-10T23:23:50.616309+0000","last_fullsized":"2024-09-10T23:23:50.616309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:26.764597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.485900+0000","last_change":"2024-09-10T23:22:14.416252+0000","last_active":"2024-09-10T23:22:51.485900+0000","last_peered":"2024-09-10T23:22:51.485900+0000","last_clean":"2024-09-10T23:22:51.485900+0000","last_became_active":"2024-09-10T23:22:14.415903+0000","last_became_peered":"2024-09-10T23:22:14.415903+0000","last_unstale":"2024-09-10T23:22:51.485900+0000","last_undegraded":"2024-09-10T23:22:51.485900+0000","last_fullsized":"2024-09-10T23:22:51.485900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:32.574908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.575629+0000","last_change":"2024-09-10T23:22:16.322337+0000","last_active":"2024-09-10T23:23:50.575629+0000","last_peered":"2024-09-10T23:23:50.575629+0000","last_clean":"2024-09-10T23:23:50.575629+0000","last_became_active":"2024-09-10T23:22:16.320140+0000","last_became_peered":"2024-09-10T23:22:16.320140+0000","last_unstale":"2024-09-10T23:23:50.575629+0000","last_undegraded":"2024-09-10T23:23:50.575629+0000","last_fullsized":"2024-09-10T23:23:50.575629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:58.462477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544426+0000","last_change":"2024-09-10T23:22:14.299927+0000","last_active":"2024-09-10T23:22:51.544426+0000","last_peered":"2024-09-10T23:22:51.544426+0000","last_clean":"2024-09-10T23:22:51.544426+0000","last_became_active":"2024-09-10T23:22:14.299575+0000","last_became_peered":"2024-09-10T23:22:14.299575+0000","last_unstale":"2024-09-10T23:22:51.544426+0000","last_undegraded":"2024-09-10T23:22:51.544426+0000","last_fullsized":"2024-09-10T23:22:51.544426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:37.277663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.614271+0000","last_change":"2024-09-10T23:22:16.323837+0000","last_active":"2024-09-10T23:23:50.614271+0000","last_peered":"2024-09-10T23:23:50.614271+0000","last_clean":"2024-09-10T23:23:50.614271+0000","last_became_active":"2024-09-10T23:22:16.323073+0000","last_became_peered":"2024-09-10T23:22:16.323073+0000","last_unstale":"2024-09-10T23:23:50.614271+0000","last_undegraded":"2024-09-10T23:23:50.614271+0000","last_fullsized":"2024-09-10T23:23:50.614271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:37.346806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.492153+0000","last_change":"2024-09-10T23:22:14.299121+0000","last_active":"2024-09-10T23:22:51.492153+0000","last_peered":"2024-09-10T23:22:51.492153+0000","last_clean":"2024-09-10T23:22:51.492153+0000","last_became_active":"2024-09-10T23:22:14.298708+0000","last_became_peered":"2024-09-10T23:22:14.298708+0000","last_unstale":"2024-09-10T23:22:51.492153+0000","last_undegraded":"2024-09-10T23:22:51.492153+0000","last_fullsized":"2024-09-10T23:22:51.492153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:02.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.613927+0000","last_change":"2024-09-10T23:22:16.319468+0000","last_active":"2024-09-10T23:23:50.613927+0000","last_peered":"2024-09-10T23:23:50.613927+0000","last_clean":"2024-09-10T23:23:50.613927+0000","last_became_active":"2024-09-10T23:22:16.318988+0000","last_became_peered":"2024-09-10T23:22:16.318988+0000","last_unstale":"2024-09-10T23:23:50.613927+0000","last_undegraded":"2024-09-10T23:23:50.613927+0000","last_fullsized":"2024-09-10T23:23:50.613927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:34.530621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.486273+0000","last_change":"2024-09-10T23:22:14.301416+0000","last_active":"2024-09-10T23:22:51.486273+0000","last_peered":"2024-09-10T23:22:51.486273+0000","last_clean":"2024-09-10T23:22:51.486273+0000","last_became_active":"2024-09-10T23:22:14.301080+0000","last_became_peered":"2024-09-10T23:22:14.301080+0000","last_unstale":"2024-09-10T23:22:51.486273+0000","last_undegraded":"2024-09-10T23:22:51.486273+0000","last_fullsized":"2024-09-10T23:22:51.486273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:25.935561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.617384+0000","last_change":"2024-09-10T23:22:16.326556+0000","last_active":"2024-09-10T23:23:50.617384+0000","last_peered":"2024-09-10T23:23:50.617384+0000","last_clean":"2024-09-10T23:23:50.617384+0000","last_became_active":"2024-09-10T23:22:16.326241+0000","last_became_peered":"2024-09-10T23:22:16.326241+0000","last_unstale":"2024-09-10T23:23:50.617384+0000","last_undegraded":"2024-09-10T23:23:50.617384+0000","last_fullsized":"2024-09-10T23:23:50.617384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:30.457735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.618412+0000","last_change":"2024-09-10T23:22:16.329202+0000","last_active":"2024-09-10T23:23:50.618412+0000","last_peered":"2024-09-10T23:23:50.618412+0000","last_clean":"2024-09-10T23:23:50.618412+0000","last_became_active":"2024-09-10T23:22:16.328866+0000","last_became_peered":"2024-09-10T23:22:16.328866+0000","last_unstale":"2024-09-10T23:23:50.618412+0000","last_undegraded":"2024-09-10T23:23:50.618412+0000","last_fullsized":"2024-09-10T23:23:50.618412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:42.702722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.487411+0000","last_change":"2024-09-10T23:22:14.305052+0000","last_active":"2024-09-10T23:22:51.487411+0000","last_peered":"2024-09-10T23:22:51.487411+0000","last_clean":"2024-09-10T23:22:51.487411+0000","last_became_active":"2024-09-10T23:22:14.304437+0000","last_became_peered":"2024-09-10T23:22:14.304437+0000","last_unstale":"2024-09-10T23:22:51.487411+0000","last_undegraded":"2024-09-10T23:22:51.487411+0000","last_fullsized":"2024-09-10T23:22:51.487411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.729727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.624799+0000","last_change":"2024-09-10T23:22:16.329314+0000","last_active":"2024-09-10T23:23:50.624799+0000","last_peered":"2024-09-10T23:23:50.624799+0000","last_clean":"2024-09-10T23:23:50.624799+0000","last_became_active":"2024-09-10T23:22:16.328923+0000","last_became_peered":"2024-09-10T23:22:16.328923+0000","last_unstale":"2024-09-10T23:23:50.624799+0000","last_undegraded":"2024-09-10T23:23:50.624799+0000","last_fullsized":"2024-09-10T23:23:50.624799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:19.061101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":59,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.504887+0000","last_change":"2024-09-10T23:22:51.504814+0000","last_active":"2024-09-10T23:22:51.504887+0000","last_peered":"2024-09-10T23:22:51.504887+0000","last_clean":"2024-09-10T23:22:51.504887+0000","last_became_active":"2024-09-10T23:22:51.493572+0000","last_became_peered":"2024-09-10T23:22:51.493572+0000","last_unstale":"2024-09-10T23:22:51.504887+0000","last_undegraded":"2024-09-10T23:22:51.504887+0000","last_fullsized":"2024-09-10T23:22:51.504887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:02.758621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.623231+0000","last_change":"2024-09-10T23:22:16.325394+0000","last_active":"2024-09-10T23:23:50.623231+0000","last_peered":"2024-09-10T23:23:50.623231+0000","last_clean":"2024-09-10T23:23:50.623231+0000","last_became_active":"2024-09-10T23:22:16.324481+0000","last_became_peered":"2024-09-10T23:22:16.324481+0000","last_unstale":"2024-09-10T23:23:50.623231+0000","last_undegraded":"2024-09-10T23:23:50.623231+0000","last_fullsized":"2024-09-10T23:23:50.623231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:08.574263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:22:51.544790+0000","last_change":"2024-09-10T23:22:14.415682+0000","last_active":"2024-09-10T23:22:51.544790+0000","last_peered":"2024-09-10T23:22:51.544790+0000","last_clean":"2024-09-10T23:22:51.544790+0000","last_became_active":"2024-09-10T23:22:14.415257+0000","last_became_peered":"2024-09-10T23:22:14.415257+0000","last_unstale":"2024-09-10T23:22:51.544790+0000","last_undegraded":"2024-09-10T23:22:51.544790+0000","last_fullsized":"2024-09-10T23:22:51.544790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.107599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:23:50.600616+0000","last_change":"2024-09-10T23:22:16.325057+0000","last_active":"2024-09-10T23:23:50.600616+0000","last_peered":"2024-09-10T23:23:50.600616+0000","last_clean":"2024-09-10T23:23:50.600616+0000","last_became_active":"2024-09-10T23:22:16.324742+0000","last_became_peered":"2024-09-10T23:22:16.324742+0000","last_unstale":"2024-09-10T23:23:50.600616+0000","last_undegraded":"2024-09-10T23:23:50.600616+0000","last_fullsized":"2024-09-10T23:23:50.600616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:15.293516+0000","last_clean_scrub_stamp":"2024-09-10T23:22:15.293516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":138,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:24:07.576686+0000","last_change":"2024-09-10T23:22:14.298225+0000","last_active":"2024-09-10T23:24:07.576686+0000","last_peered":"2024-09-10T23:24:07.576686+0000","last_clean":"2024-09-10T23:24:07.576686+0000","last_became_active":"2024-09-10T23:22:14.297888+0000","last_became_peered":"2024-09-10T23:22:14.297888+0000","last_unstale":"2024-09-10T23:24:07.576686+0000","last_undegraded":"2024-09-10T23:24:07.576686+0000","last_fullsized":"2024-09-10T23:24:07.576686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:13.283824+0000","last_clean_scrub_stamp":"2024-09-10T23:22:13.283824+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:48.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68905,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1075,"num_read_kb":613,"num_write":256,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1147,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":212396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285495,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":403015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906986,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1054797,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":402279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":402523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":995316,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":401996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":994994,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":403011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":401821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":464766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":464328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":403867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34675,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:24:15.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:24:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:15 smithi177 ceph-mon[35760]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:16.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:15 smithi002 ceph-mon[31150]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:16.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:15 smithi154 ceph-mon[35136]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:24:16.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:16.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 -- 172.21.15.2:0/916145680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984101c90 msgr2=0x7f0984102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 --2- 172.21.15.2:0/916145680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984101c90 0x7f0984102070 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0974009900 tx=0x7f097402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 -- 172.21.15.2:0/916145680 shutdown_connections 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 --2- 172.21.15.2:0/916145680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0984108020 0x7f098410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 --2- 172.21.15.2:0/916145680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09841076a0 0x7f0984107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 --2- 172.21.15.2:0/916145680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984101c90 0x7f0984102070 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 -- 172.21.15.2:0/916145680 >> 172.21.15.2:0/916145680 conn(0x7f09840fd700 msgr2=0x7f09840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 -- 172.21.15.2:0/916145680 shutdown_connections 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.897+0000 7f098a2d7640 1 -- 172.21.15.2:0/916145680 wait complete. 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 Processor -- start 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 -- start start 2024-09-10T23:24:16.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0984101c90 0x7f0984199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09841076a0 0x7f09841998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 0x7f098419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0984111d30 con 0x7f0984108020 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0984111bb0 con 0x7f0984101c90 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f098a2d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0984111eb0 con 0x7f09841076a0 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 0x7f098419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 0x7f098419ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53578/0 (socket says 172.21.15.2:53578) 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 -- 172.21.15.2:0/4109295670 learned_addr learned my addr 172.21.15.2:0/4109295670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f097bfff640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09841076a0 0x7f09841998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0983fff640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0984101c90 0x7f0984199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 -- 172.21.15.2:0/4109295670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09841076a0 msgr2=0x7f09841998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09841076a0 0x7f09841998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 -- 172.21.15.2:0/4109295670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0984101c90 msgr2=0x7f0984199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0984101c90 0x7f0984199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.898+0000 7f0988874640 1 -- 172.21.15.2:0/4109295670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098419f420 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.899+0000 7f0988874640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 0x7f098419ec50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f097c00eaa0 tx=0x7f097c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.899+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c00cdb0 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.899+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097c005020 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.899+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098419f710 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.899+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0116d0 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.899+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09841a5dd0 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.900+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0984102070 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.901+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f097c00f040 con 0x7f0984108020 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.902+0000 7f0981ffb640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09700b5360 0x7f09700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.902+0000 7f0983fff640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09700b5360 0x7f09700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.902+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f097c0e5d00 con 0x7f0984108020 2024-09-10T23:24:16.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.903+0000 7f0983fff640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09700b5360 0x7f09700b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0974005ab0 tx=0x7f0974005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:16.905+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f097c016030 con 0x7f0984108020 2024-09-10T23:24:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.129+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f098419a4a0 con 0x7f0984108020 2024-09-10T23:24:17.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:16 smithi002 ceph-mon[31150]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:16 smithi002 ceph-mon[31150]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:16 smithi002 ceph-mon[31150]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.130+0000 7f0981ffb640 1 -- 172.21.15.2:0/4109295670 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f097c0ac5a0 con 0x7f0984108020 2024-09-10T23:24:17.131 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:17.132 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:24:17.132 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:24:17.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.132+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09700b5360 msgr2=0x7f09700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09700b5360 0x7f09700b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0974005ab0 tx=0x7f0974005a20 comp rx=0 tx=0).stop 2024-09-10T23:24:17.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 msgr2=0x7f098419ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 0x7f098419ec50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f097c00eaa0 tx=0x7f097c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 shutdown_connections 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09700b5360 0x7f09700b7820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0984108020 0x7f098419ec50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09841076a0 0x7f09841998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 --2- 172.21.15.2:0/4109295670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0984101c90 0x7f0984199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 >> 172.21.15.2:0/4109295670 conn(0x7f09840fd700 msgr2=0x7f098406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 shutdown_connections 2024-09-10T23:24:17.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:17.133+0000 7f098a2d7640 1 -- 172.21.15.2:0/4109295670 wait complete. 2024-09-10T23:24:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:16 smithi177 ceph-mon[35760]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:16 smithi177 ceph-mon[35760]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:16 smithi177 ceph-mon[35760]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:16 smithi154 ceph-mon[35136]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:16 smithi154 ceph-mon[35136]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:16 smithi154 ceph-mon[35136]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:24:17.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:24:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:17 smithi177 ceph-mon[35760]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:17 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4109295670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:17 smithi002 ceph-mon[31150]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:17 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4109295670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:18.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:17 smithi154 ceph-mon[35136]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:18.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:17 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4109295670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:18.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 -- 172.21.15.2:0/3625388709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107e80 msgr2=0x7fd5d010e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/3625388709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107e80 0x7fd5d010e680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009ca0 tx=0x7fd5c802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 -- 172.21.15.2:0/3625388709 shutdown_connections 2024-09-10T23:24:18.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/3625388709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107e80 0x7fd5d010e680 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/3625388709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d0107500 0x7fd5d0107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/3625388709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d0101af0 0x7fd5d0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 -- 172.21.15.2:0/3625388709 >> 172.21.15.2:0/3625388709 conn(0x7fd5d00fd560 msgr2=0x7fd5d00ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 -- 172.21.15.2:0/3625388709 shutdown_connections 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 -- 172.21.15.2:0/3625388709 wait complete. 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 Processor -- start 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.719+0000 7fd5d57a1640 1 -- start start 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d57a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d0101af0 0x7fd5d00fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d57a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 0x7fd5d00fdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d57a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d0107e80 0x7fd5d00fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d57a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0111b40 con 0x7fd5d0107500 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d57a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d01119c0 con 0x7fd5d0101af0 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d57a1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0111cc0 con 0x7fd5d0107e80 2024-09-10T23:24:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 0x7fd5d00fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 0x7fd5d00fdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53598/0 (socket says 172.21.15.2:53598) 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 -- 172.21.15.2:0/26947972 learned_addr learned my addr 172.21.15.2:0/26947972 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cffff640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d0101af0 0x7fd5d00fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5d4fa0640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d0107e80 0x7fd5d00fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 -- 172.21.15.2:0/26947972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d0107e80 msgr2=0x7fd5d00fe4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d0107e80 0x7fd5d00fe4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 -- 172.21.15.2:0/26947972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d0101af0 msgr2=0x7fd5d00fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d0101af0 0x7fd5d00fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 -- 172.21.15.2:0/26947972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d01a7440 con 0x7fd5d0107500 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.720+0000 7fd5cf7fe640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 0x7fd5d00fdfa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400d950 tx=0x7fd5c400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.721+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4017070 con 0x7fd5d0107500 2024-09-10T23:24:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.721+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c400de80 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.721+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d01a7730 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.721+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400f620 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.721+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d01a7d40 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.722+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d0101ed0 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.723+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd5c4005030 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.724+0000 7fd5cd7fa640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5b80b5410 0x7fd5b80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.724+0000 7fd5cffff640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5b80b5410 0x7fd5b80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.724+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd5c40e57c0 con 0x7fd5d0107500 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.724+0000 7fd5cffff640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5b80b5410 0x7fd5b80b78d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009990 tx=0x7fd5c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.727+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd5c40ac6b0 con 0x7fd5d0107500 2024-09-10T23:24:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.916+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5d002e5c0 con 0x7fd5d0107500 2024-09-10T23:24:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.918+0000 7fd5cd7fa640 1 -- 172.21.15.2:0/26947972 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7fd5c40abfb0 con 0x7fd5d0107500 2024-09-10T23:24:18.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:18.919 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5b80b5410 msgr2=0x7fd5b80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5b80b5410 0x7fd5b80b78d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009990 tx=0x7fd5c0009110 comp rx=0 tx=0).stop 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 msgr2=0x7fd5d00fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 0x7fd5d00fdfa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400d950 tx=0x7fd5c400dd50 comp rx=0 tx=0).stop 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 shutdown_connections 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5b80b5410 0x7fd5b80b78d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5d0107e80 0x7fd5d00fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5d0107500 0x7fd5d00fdfa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 --2- 172.21.15.2:0/26947972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d0101af0 0x7fd5d00fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 >> 172.21.15.2:0/26947972 conn(0x7fd5d00fd560 msgr2=0x7fd5d006b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:18.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 shutdown_connections 2024-09-10T23:24:18.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:18.920+0000 7fd5d57a1640 1 -- 172.21.15.2:0/26947972 wait complete. 2024-09-10T23:24:19.557 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T23:24:19.558 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T23:24:19.573 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:24:19.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T23:24:19.573 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T23:24:19.573 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:24:19.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:24:19.576 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T23:24:19.587 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:24:19.588 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T23:24:19.588 INFO:tasks.workunit:timeout=3h 2024-09-10T23:24:19.588 INFO:tasks.workunit:cleanup=True 2024-09-10T23:24:19.588 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T23:24:19.606 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T23:24:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:24:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T23:24:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 23:22:35.621853559 +0000 2024-09-10T23:24:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 23:22:35.621853559 +0000 2024-09-10T23:24:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 23:24:10.948765863 +0000 2024-09-10T23:24:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 23:22:35.621853559 +0000 2024-09-10T23:24:19.607 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:19.607 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T23:24:19.682 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:24:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T23:24:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:20.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:19 smithi002 ceph-mon[31150]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:20.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:19 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/26947972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:19 smithi177 ceph-mon[35760]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:19 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/26947972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:19 smithi154 ceph-mon[35136]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:19 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/26947972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 -- 172.21.15.2:0/2673795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284108020 msgr2=0x7f528410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 --2- 172.21.15.2:0/2673795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284108020 0x7f528410e820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ca0 tx=0x7f527c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 -- 172.21.15.2:0/2673795118 shutdown_connections 2024-09-10T23:24:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 --2- 172.21.15.2:0/2673795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284108020 0x7f528410e820 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 --2- 172.21.15.2:0/2673795118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52841076a0 0x7f5284107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 --2- 172.21.15.2:0/2673795118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284101c90 0x7f5284102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 -- 172.21.15.2:0/2673795118 >> 172.21.15.2:0/2673795118 conn(0x7f52840fd700 msgr2=0x7f52840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 -- 172.21.15.2:0/2673795118 shutdown_connections 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.427+0000 7f528905f640 1 -- 172.21.15.2:0/2673795118 wait complete. 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.428+0000 7f528905f640 1 Processor -- start 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.428+0000 7f528905f640 1 -- start start 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528905f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284101c90 0x7f52840fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528905f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52841076a0 0x7f52840fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528905f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284108020 0x7f52840fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528905f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5284111d30 con 0x7f5284101c90 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528905f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5284111bb0 con 0x7f5284108020 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528905f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5284111eb0 con 0x7f52841076a0 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284108020 0x7f52840fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284101c90 0x7f52840fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284108020 0x7f52840fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:39014/0 (socket says 172.21.15.2:39014) 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528359e640 1 -- 172.21.15.2:0/233401942 learned_addr learned my addr 172.21.15.2:0/233401942 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f528259c640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52841076a0 0x7f52840fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 -- 172.21.15.2:0/233401942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52841076a0 msgr2=0x7f52840fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52841076a0 0x7f52840fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 -- 172.21.15.2:0/233401942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284108020 msgr2=0x7f52840fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284108020 0x7f52840fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 -- 172.21.15.2:0/233401942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52841a7610 con 0x7f5284101c90 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.429+0000 7f5282d9d640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284101c90 0x7f52840fdc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f527400c970 tx=0x7f527400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.430+0000 7f526bfff640 1 -- 172.21.15.2:0/233401942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274007bb0 con 0x7f5284101c90 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.430+0000 7f526bfff640 1 -- 172.21.15.2:0/233401942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5274007d50 con 0x7f5284101c90 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.430+0000 7f526bfff640 1 -- 172.21.15.2:0/233401942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274018660 con 0x7f5284101c90 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.430+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52841a7900 con 0x7f5284101c90 2024-09-10T23:24:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.430+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52841a7ec0 con 0x7f5284101c90 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.432+0000 7f526bfff640 1 -- 172.21.15.2:0/233401942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f52740188c0 con 0x7f5284101c90 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.432+0000 7f528b434740 1 Processor -- start 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 -- start start 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b7fb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b7fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55818b765e60 con 0x55818b7ef800 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55818b755290 con 0x55818b7eeee0 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528b434740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55818b7590a0 con 0x55818b7fb790 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b7fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b7fb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53612/0 (socket says 172.21.15.2:53612) 2024-09-10T23:24:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f5282d9d640 1 -- 172.21.15.2:0/948276743 learned_addr learned my addr 172.21.15.2:0/948276743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528259c640 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b7fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f528359e640 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.433+0000 7f5282d9d640 1 -- 172.21.15.2:0/948276743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 msgr2=0x55818b7fdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f5282d9d640 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b7fdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f5282d9d640 1 -- 172.21.15.2:0/948276743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 msgr2=0x55818b7ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f5282d9d640 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f5282d9d640 1 -- 172.21.15.2:0/948276743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818b4b3930 con 0x55818b7ef800 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f528259c640 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b7fdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f526bfff640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f526c0b52e0 0x7f526c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f528359e640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f526c0b52e0 0x7f526c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f5282d9d640 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b7fb250 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f52740e9d50 tx=0x7f52740e9e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dba4a8f6c2db95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f526bfff640 1 -- 172.21.15.2:0/233401942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52740e5b80 con 0x7f5284101c90 2024-09-10T23:24:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f52697fa640 1 -- 172.21.15.2:0/948276743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274093030 con 0x55818b7ef800 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f52697fa640 1 -- 172.21.15.2:0/948276743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52740abe60 con 0x55818b7ef800 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.434+0000 7f52697fa640 1 -- 172.21.15.2:0/948276743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740ea040 con 0x55818b7ef800 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 -- 172.21.15.2:0/948276743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 msgr2=0x55818b7fb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528359e640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f526c0b52e0 0x7f526c0b77a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f527c005fe0 tx=0x7f527c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b7fb250 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f52740e9d50 tx=0x7f52740e9e40 comp rx=0 tx=0).stop 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 -- 172.21.15.2:0/948276743 shutdown_connections 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b7fdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b7fb250 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 --2- 172.21.15.2:0/948276743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 -- 172.21.15.2:0/948276743 >> 172.21.15.2:0/948276743 conn(0x55818b7ecd10 msgr2=0x55818b7edeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 -- 172.21.15.2:0/948276743 shutdown_connections 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 -- 172.21.15.2:0/948276743 wait complete. 2024-09-10T23:24:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.435+0000 7f528b434740 1 -- start start 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 Processor -- start 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 0x55818b7f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55818b5b6890 con 0x55818b7fb790 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55818b6efd40 con 0x55818b7eeee0 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55818b7fe3e0 con 0x55818b7ef800 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528b434740 10 client.0 _ll_register_callbacks cb 0x55818b753c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 0x55818b7f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 0x55818b7f9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53618/0 (socket says 172.21.15.2:53618) 2024-09-10T23:24:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528359e640 1 -- 172.21.15.2:0/1017297693 learned_addr learned my addr 172.21.15.2:0/1017297693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528259c640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528359e640 1 -- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 msgr2=0x55818b7f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.436+0000 7f528359e640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528359e640 1 -- 172.21.15.2:0/1017297693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 msgr2=0x55818b7f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528359e640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528359e640 1 -- 172.21.15.2:0/1017297693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818b807840 con 0x55818b7fb790 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528359e640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 0x55818b7f9220 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f527c0316a0 tx=0x7f527c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc05d9b49842fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f5266ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f5266ff5640 1 -- 172.21.15.2:0/1017297693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c004000 con 0x55818b7fb790 2024-09-10T23:24:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f5266ff5640 1 -- 172.21.15.2:0/1017297693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f527c0041a0 con 0x55818b7fb790 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52740abe60 con 0x55818b7fb790 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f5266ff5640 1 -- 172.21.15.2:0/1017297693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f527c0043a0 con 0x55818b7fb790 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528b434740 10 client.15393 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55818b80a1f0 con 0x55818b7fb790 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.437+0000 7f5266ff5640 1 -- 172.21.15.2:0/1017297693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52740abe60 con 0x55818b7fb790 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f5266ff5640 1 -- 172.21.15.2:0/1017297693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f527c051070 con 0x55818b7fb790 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f528b434740 10 client.15393 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f528b434740 10 client.15393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f528b434740 20 client.15393 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f528b434740 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b80dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f528b434740 4 client.15393 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55818b767db0 con 0x55818b80b6a0 2024-09-10T23:24:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b80dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b80dac0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50ed746f673a1057 server_cookie=ba9e88af91c81dd8 in_seq=0 out_seq=0 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.438+0000 7f5266ff5640 10 client.15393 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f5266ff5640 1 -- 172.21.15.2:0/1017297693 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55818b767db0 con 0x55818b80b6a0 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f5266ff5640 10 client.15393 handle_command_reply: tid=0 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 client.15393 shutdown 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 msgr2=0x55818b7f9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 0x55818b7f9220 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f527c0316a0 tx=0x7f527c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 shutdown_connections 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b80dac0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f5266ff5640 0 client.15393 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7fb790 0x55818b7f9220 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 --2- 172.21.15.2:0/1017297693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b7f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 >> 172.21.15.2:0/1017297693 conn(0x55818b7ecd10 msgr2=0x55818b7ebf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 shutdown_connections 2024-09-10T23:24:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.439+0000 7f528b434740 1 -- 172.21.15.2:0/1017297693 wait complete. 2024-09-10T23:24:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.440+0000 7f528b434740 20 client.15393 trim_cache size 0 max 16384 2024-09-10T23:24:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 Processor -- start 2024-09-10T23:24:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 -- start start 2024-09-10T23:24:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 0x55818b7fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7fb790 0x55818b7f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52841b0560 con 0x55818b7eeee0 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52841b20a0 con 0x55818b7fb790 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528b434740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52841b0c30 con 0x55818b7ef800 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 0x55818b7fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 0x55818b7fa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53628/0 (socket says 172.21.15.2:53628) 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f528259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:45790/0 (socket says 172.21.15.2:45790) 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.471+0000 7f5282d9d640 1 -- 172.21.15.2:0/1237634250 learned_addr learned my addr 172.21.15.2:0/1237634250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f528359e640 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7fb790 0x55818b7f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5282d9d640 1 -- 172.21.15.2:0/1237634250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 msgr2=0x55818b7f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5282d9d640 1 -- 172.21.15.2:0/1237634250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7fb790 msgr2=0x55818b7f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7fb790 0x55818b7f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5282d9d640 1 -- 172.21.15.2:0/1237634250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818b7f7700 con 0x55818b7eeee0 2024-09-10T23:24:20.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 0x55818b7fa4e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52740e3a00 tx=0x7f52740e9e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6295f7633d2b855 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5268ff9640 1 -- 172.21.15.2:0/1237634250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274093040 con 0x55818b7eeee0 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5268ff9640 1 -- 172.21.15.2:0/1237634250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52740abe60 con 0x55818b7eeee0 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.472+0000 7f5268ff9640 1 -- 172.21.15.2:0/1237634250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740abca0 con 0x55818b7eeee0 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 -- 172.21.15.2:0/1237634250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 msgr2=0x55818b7fa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 0x55818b7fa4e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52740e3a00 tx=0x7f52740e9e40 comp rx=0 tx=0).stop 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 -- 172.21.15.2:0/1237634250 shutdown_connections 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7fb790 0x55818b7f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7ef800 0x55818b7f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 --2- 172.21.15.2:0/1237634250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7eeee0 0x55818b7fa4e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 -- 172.21.15.2:0/1237634250 >> 172.21.15.2:0/1237634250 conn(0x55818b7ecd10 msgr2=0x55818b7f9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 -- 172.21.15.2:0/1237634250 shutdown_connections 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 -- 172.21.15.2:0/1237634250 wait complete. 2024-09-10T23:24:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 -- start start 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.473+0000 7f528b434740 1 Processor -- start 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b803e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b8003a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b8008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52841b19d0 con 0x55818b7ef800 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52841b1300 con 0x55818b7eeee0 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52841ae540 con 0x55818b7fb790 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528b434740 10 client.0 _ll_register_callbacks cb 0x7f527c02f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b8003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b8003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53632/0 (socket says 172.21.15.2:53632) 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 -- 172.21.15.2:0/1449132889 learned_addr learned my addr 172.21.15.2:0/1449132889 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b803e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528359e640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b8008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 -- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 msgr2=0x55818b8008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b8008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 -- 172.21.15.2:0/1449132889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 msgr2=0x55818b803e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b803e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.474+0000 7f528259c640 1 -- 172.21.15.2:0/1449132889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818b8010e0 con 0x55818b7ef800 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528259c640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b8003a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5278015a10 tx=0x7f5278015b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38c9e51bbac2d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f5266ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f5266ff5640 1 -- 172.21.15.2:0/1449132889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278023060 con 0x55818b7ef800 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f5266ff5640 1 -- 172.21.15.2:0/1449132889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f527800f040 con 0x55818b7ef800 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52740abe60 con 0x55818b7ef800 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f5266ff5640 1 -- 172.21.15.2:0/1449132889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5278014740 con 0x55818b7ef800 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 10 client.15399 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55818b879660 con 0x55818b7ef800 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f5266ff5640 1 -- 172.21.15.2:0/1449132889 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5278014d90 con 0x55818b7ef800 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f5266ff5640 1 -- 172.21.15.2:0/1449132889 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f527801ec50 con 0x55818b7ef800 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 20 client.15399 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.475+0000 7f528b434740 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b87be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.476+0000 7f528b434740 4 client.15399 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.476+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f52740abe60 con 0x55818b80b6a0 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.476+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b87be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.476+0000 7f5282d9d640 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b87be80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4213826d1599a5b server_cookie=c98dab51c1a1994a in_seq=0 out_seq=0 2024-09-10T23:24:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.476+0000 7f5266ff5640 10 client.15399 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f5266ff5640 1 -- 172.21.15.2:0/1449132889 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f52740abe60 con 0x55818b80b6a0 2024-09-10T23:24:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f5266ff5640 10 client.15399 handle_command_reply: tid=0 2024-09-10T23:24:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 client.15399 shutdown 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 msgr2=0x55818b8003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b8003a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5278015a10 tx=0x7f5278015b00 comp rx=0 tx=0).stop 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 shutdown_connections 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55818b80b6a0 0x55818b87be80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55818b7fb790 0x55818b8008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55818b7ef800 0x55818b8003a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 --2- 172.21.15.2:0/1449132889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55818b7eeee0 0x55818b803e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 >> 172.21.15.2:0/1449132889 conn(0x55818b7ecd10 msgr2=0x55818b7ebf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f5266ff5640 0 client.15399 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 shutdown_connections 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 1 -- 172.21.15.2:0/1449132889 wait complete. 2024-09-10T23:24:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.478+0000 7f528b434740 20 client.15399 trim_cache size 0 max 16384 2024-09-10T23:24:20.483 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:20.483 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:24:20.483 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "d8b58120-d4f2-47b5-930a-fbe4c2c18a91", 2024-09-10T23:24:20.483 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:24:20.483 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f526c0b52e0 msgr2=0x7f526c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f526c0b52e0 0x7f526c0b77a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f527c005fe0 tx=0x7f527c009800 comp rx=0 tx=0).stop 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284101c90 msgr2=0x7f52840fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284101c90 0x7f52840fdc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f527400c970 tx=0x7f527400cd70 comp rx=0 tx=0).stop 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 shutdown_connections 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f526c0b52e0 0x7f526c0b77a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284108020 0x7f52840fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52841076a0 0x7f52840fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 --2- 172.21.15.2:0/233401942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5284101c90 0x7f52840fdc00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 >> 172.21.15.2:0/233401942 conn(0x7f52840fd700 msgr2=0x7f5284104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 shutdown_connections 2024-09-10T23:24:20.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:20.479+0000 7f528905f640 1 -- 172.21.15.2:0/233401942 wait complete. 2024-09-10T23:24:21.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:24:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:21.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:21 smithi002 ceph-mon[31150]: pgmap v352: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:24:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:24:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:24:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 -- 172.21.15.2:0/4003903738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad041076e0 msgr2=0x7fad04107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 --2- 172.21.15.2:0/4003903738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad041076e0 0x7fad04107b20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7facec009900 tx=0x7facec02a410 comp rx=0 tx=0).stop 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 -- 172.21.15.2:0/4003903738 shutdown_connections 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 --2- 172.21.15.2:0/4003903738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 0x7fad0410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 --2- 172.21.15.2:0/4003903738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad041076e0 0x7fad04107b20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 --2- 172.21.15.2:0/4003903738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad04101cd0 0x7fad041020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 -- 172.21.15.2:0/4003903738 >> 172.21.15.2:0/4003903738 conn(0x7fad040fd720 msgr2=0x7fad040ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 -- 172.21.15.2:0/4003903738 shutdown_connections 2024-09-10T23:24:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.117+0000 7fad09c65640 1 -- 172.21.15.2:0/4003903738 wait complete. 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 Processor -- start 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 -- start start 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 0x7fad041982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad041076e0 0x7fad04198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 0x7fad0419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad04111d60 con 0x7fad04101cd0 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad04111be0 con 0x7fad04108060 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad09c65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad04111ee0 con 0x7fad041076e0 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 0x7fad041982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 0x7fad041982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57132/0 (socket says 172.21.15.2:57132) 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 -- 172.21.15.2:0/4079580602 learned_addr learned my addr 172.21.15.2:0/4079580602 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad03fff640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 0x7fad0419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7facfbfff640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad041076e0 0x7fad04198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 -- 172.21.15.2:0/4079580602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad041076e0 msgr2=0x7fad04198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad041076e0 0x7fad04198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 -- 172.21.15.2:0/4079580602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 msgr2=0x7fad0419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 0x7fad0419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad037fe640 1 -- 172.21.15.2:0/4079580602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0419e3a0 con 0x7fad04101cd0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.118+0000 7fad03fff640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 0x7fad0419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.119+0000 7fad037fe640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 0x7fad041982f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7facf400b4a0 tx=0x7facf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.119+0000 7fad017fa640 1 -- 172.21.15.2:0/4079580602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4014070 con 0x7fad04101cd0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.119+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0419e690 con 0x7fad04101cd0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.119+0000 7fad017fa640 1 -- 172.21.15.2:0/4079580602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf4010ac0 con 0x7fad04101cd0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.119+0000 7fad017fa640 1 -- 172.21.15.2:0/4079580602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4017c30 con 0x7fad04101cd0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.119+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041a4dd0 con 0x7fad04101cd0 2024-09-10T23:24:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad017fa640 1 -- 172.21.15.2:0/4079580602 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7facf4010610 con 0x7fad04101cd0 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 Processor -- start 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 -- start start 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650779480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650787620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650789f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5556506efe50 con 0x5556507790a0 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556506df280 con 0x555650787b60 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad0c03a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5556506e3090 con 0x5556507799c0 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650779480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650779480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57144/0 (socket says 172.21.15.2:57144) 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad03fff640 1 -- 172.21.15.2:0/3327657350 learned_addr learned my addr 172.21.15.2:0/3327657350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7fad037fe640 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650787620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.122+0000 7facfbfff640 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650789f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad03fff640 1 -- 172.21.15.2:0/3327657350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 msgr2=0x555650787620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad03fff640 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650787620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad03fff640 1 -- 172.21.15.2:0/3327657350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 msgr2=0x555650789f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad03fff640 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650789f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad03fff640 1 -- 172.21.15.2:0/3327657350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55565043d650 con 0x5556507790a0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad017fa640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7facf00b52e0 0x7facf00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad03fff640 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650779480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c450 tx=0x7facfc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d95fb328ce67837 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad037fe640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7facf00b52e0 0x7facf00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7facf9ffb640 1 -- 172.21.15.2:0/3327657350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007430 con 0x5556507790a0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7fad017fa640 1 -- 172.21.15.2:0/4079580602 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7facf40e5210 con 0x7fad04101cd0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7facf9ffb640 1 -- 172.21.15.2:0/3327657350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc007a80 con 0x5556507790a0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.123+0000 7facf9ffb640 1 -- 172.21.15.2:0/3327657350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc00a9f0 con 0x5556507790a0 2024-09-10T23:24:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 -- 172.21.15.2:0/3327657350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 msgr2=0x555650779480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad037fe640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7facf00b52e0 0x7facf00b77a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7facf40e3090 tx=0x7facf40e8cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650779480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c450 tx=0x7facfc00c910 comp rx=0 tx=0).stop 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 -- 172.21.15.2:0/3327657350 shutdown_connections 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650789f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650787620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 --2- 172.21.15.2:0/3327657350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650779480 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 -- 172.21.15.2:0/3327657350 >> 172.21.15.2:0/3327657350 conn(0x555650776ed0 msgr2=0x555650778070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 -- 172.21.15.2:0/3327657350 shutdown_connections 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 -- 172.21.15.2:0/3327657350 wait complete. 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 -- start start 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.124+0000 7fad0c03a740 1 Processor -- start 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650787400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650784850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650784e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555650540700 con 0x5556507790a0 2024-09-10T23:24:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55565067a110 con 0x555650787b60 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55565078a7e0 con 0x5556507799c0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad0c03a740 10 client.0 _ll_register_callbacks cb 0x555650693990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650787400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650787400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57148/0 (socket says 172.21.15.2:57148) 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 -- 172.21.15.2:0/73350718 learned_addr learned my addr 172.21.15.2:0/73350718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7facfbfff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650784850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650784e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 -- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 msgr2=0x555650784850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650784850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 -- 172.21.15.2:0/73350718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 msgr2=0x555650784e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650784e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 -- 172.21.15.2:0/73350718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556506a7c40 con 0x5556507790a0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7fad03fff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650787400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7facfc009440 tx=0x7facfc0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f709801745fbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.125+0000 7face2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7face2ffd640 1 -- 172.21.15.2:0/73350718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc027060 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7face2ffd640 1 -- 172.21.15.2:0/73350718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7facfc0076e0 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc007a80 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7face2ffd640 1 -- 172.21.15.2:0/73350718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facfc01b040 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555650796100 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7face2ffd640 1 -- 172.21.15.2:0/73350718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc007a80 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7face2ffd640 1 -- 172.21.15.2:0/73350718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facfc021030 con 0x5556507790a0 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 20 client.15411 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650797560 0x555650799950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 4 client.15411 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556506f1da0 con 0x555650797560 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.126+0000 7facfbfff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650797560 0x555650799950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.127+0000 7facfbfff640 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650797560 0x555650799950 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=282d52eace88a3cb server_cookie=4b555388f06a9479 in_seq=0 out_seq=0 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.127+0000 7face2ffd640 10 client.15411 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7face2ffd640 1 -- 172.21.15.2:0/73350718 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556506f1da0 con 0x555650797560 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7face2ffd640 10 client.15411 handle_command_reply: tid=0 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 client.15411 shutdown 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 msgr2=0x555650787400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650787400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7facfc009440 tx=0x7facfc0093d0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 shutdown_connections 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650797560 0x555650799950 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555650787b60 0x555650784e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650784850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 --2- 172.21.15.2:0/73350718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556507790a0 0x555650787400 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7face2ffd640 0 client.15411 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 >> 172.21.15.2:0/73350718 conn(0x555650776ed0 msgr2=0x55565077ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 shutdown_connections 2024-09-10T23:24:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 1 -- 172.21.15.2:0/73350718 wait complete. 2024-09-10T23:24:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.128+0000 7fad0c03a740 20 client.15411 trim_cache size 0 max 16384 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 Processor -- start 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 -- start start 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x555650793a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x55565079eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565079f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ac310 con 0x555650787b60 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ade50 con 0x5556507790a0 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad0c03a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ac9e0 con 0x5556507799c0 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565079f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565079f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57150/0 (socket says 172.21.15.2:57150) 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad03fff640 1 -- 172.21.15.2:0/2377649069 learned_addr learned my addr 172.21.15.2:0/2377649069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7facfbfff640 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x55565079eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.146+0000 7fad03fff640 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x555650793a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7fad03fff640 1 -- 172.21.15.2:0/2377649069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 msgr2=0x55565079eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7fad03fff640 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x55565079eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7fad03fff640 1 -- 172.21.15.2:0/2377649069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 msgr2=0x555650793a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7fad03fff640 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x555650793a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7fad03fff640 1 -- 172.21.15.2:0/2377649069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555650785180 con 0x555650787b60 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7fad03fff640 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565079f430 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7facfc00ce90 tx=0x7facfc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33674107b2205ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7facf97fa640 1 -- 172.21.15.2:0/2377649069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc031070 con 0x555650787b60 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7facf97fa640 1 -- 172.21.15.2:0/2377649069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc016420 con 0x555650787b60 2024-09-10T23:24:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.147+0000 7facf97fa640 1 -- 172.21.15.2:0/2377649069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc027070 con 0x555650787b60 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- 172.21.15.2:0/2377649069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 msgr2=0x55565079f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565079f430 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7facfc00ce90 tx=0x7facfc00c910 comp rx=0 tx=0).stop 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- 172.21.15.2:0/2377649069 shutdown_connections 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565079f430 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x55565079eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- 172.21.15.2:0/2377649069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x555650793a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- 172.21.15.2:0/2377649069 >> 172.21.15.2:0/2377649069 conn(0x555650776ed0 msgr2=0x5556507898f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- 172.21.15.2:0/2377649069 shutdown_connections 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- 172.21.15.2:0/2377649069 wait complete. 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- start start 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 Processor -- start 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x55565078fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650790290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565078ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ad780 con 0x555650787b60 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad041ad0b0 con 0x5556507790a0 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.148+0000 7fad0c03a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad041aa2f0 con 0x5556507799c0 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7fad0c03a740 10 client.0 _ll_register_callbacks cb 0x7facf40e8bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565078ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650790290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7fad03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565078ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57162/0 (socket says 172.21.15.2:57162) 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650790290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:36646/0 (socket says 172.21.15.2:36646) 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7fad03fff640 1 -- 172.21.15.2:0/638608936 learned_addr learned my addr 172.21.15.2:0/638608936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7fad03fff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x55565078fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 -- 172.21.15.2:0/638608936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 msgr2=0x55565078fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x55565078fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 -- 172.21.15.2:0/638608936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 msgr2=0x55565078ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565078ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 -- 172.21.15.2:0/638608936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55565078d2a0 con 0x5556507799c0 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7fad03fff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565078ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7facfbfff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650790290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7facec009230 tx=0x7facec02a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83eb38b5800597d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7face2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:24:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.149+0000 7face2ffd640 1 -- 172.21.15.2:0/638608936 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec048070 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7face2ffd640 1 -- 172.21.15.2:0/638608936 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7facec0314a0 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc016420 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7face2ffd640 1 -- 172.21.15.2:0/638608936 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facec035040 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 10 client.25027 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555650804c30 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7face2ffd640 1 -- 172.21.15.2:0/638608936 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc016420 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7face2ffd640 1 -- 172.21.15.2:0/638608936 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facec03b430 con 0x5556507799c0 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 10 client.25027 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 10 client.25027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 20 client.25027 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650805330 0x555650807750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 4 client.25027 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.150+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556506ed850 con 0x555650805330 2024-09-10T23:24:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad03fff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650805330 0x555650807750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad03fff640 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650805330 0x555650807750 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9edd42f3253a6363 server_cookie=40be4d311883ac2c in_seq=0 out_seq=0 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7face2ffd640 10 client.25027 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7face2ffd640 1 -- 172.21.15.2:0/638608936 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5556506ed850 con 0x555650805330 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7face2ffd640 10 client.25027 handle_command_reply: tid=0 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 client.25027 shutdown 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 msgr2=0x555650790290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650790290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7facec009230 tx=0x7facec02a9b0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 shutdown_connections 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555650805330 0x555650807750 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555650787b60 0x55565078ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5556507799c0 0x555650790290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7face2ffd640 0 client.25027 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 --2- 172.21.15.2:0/638608936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556507790a0 0x55565078fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 >> 172.21.15.2:0/638608936 conn(0x555650776ed0 msgr2=0x555650775700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.151+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 shutdown_connections 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad0c03a740 1 -- 172.21.15.2:0/638608936 wait complete. 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad0c03a740 20 client.25027 trim_cache size 0 max 16384 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "d8b58120-d4f2-47b5-930a-fbe4c2c18a91", 2024-09-10T23:24:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:24:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:24:22.160 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7facf00b52e0 msgr2=0x7facf00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7facf00b52e0 0x7facf00b77a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7facf40e3090 tx=0x7facf40e8cf0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 msgr2=0x7fad041982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 0x7fad041982f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7facf400b4a0 tx=0x7facf400b960 comp rx=0 tx=0).stop 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 shutdown_connections 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7facf00b52e0 0x7facf00b77a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad04108060 0x7fad0419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad041076e0 0x7fad04198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 --2- 172.21.15.2:0/4079580602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad04101cd0 0x7fad041982f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 >> 172.21.15.2:0/4079580602 conn(0x7fad040fd720 msgr2=0x7fad040ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 shutdown_connections 2024-09-10T23:24:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:22.152+0000 7fad09c65640 1 -- 172.21.15.2:0/4079580602 wait complete. 2024-09-10T23:24:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:21 smithi177 ceph-mon[35760]: pgmap v352: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:24:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:24:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:24:22.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:24:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:21 smithi154 ceph-mon[35136]: pgmap v352: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T23:24:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:24:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:24:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:24:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:24:22.892 INFO:tasks.cephfs.filesystem:scrub status for tag:d8b58120-d4f2-47b5-930a-fbe4c2c18a91 - {'path': '/', 'tag': 'd8b58120-d4f2-47b5-930a-fbe4c2c18a91', 'options': 'recursive,force'} 2024-09-10T23:24:24.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:23 smithi177 ceph-mon[35760]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T23:24:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:23 smithi002 ceph-mon[31150]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T23:24:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:23 smithi154 ceph-mon[35136]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T23:24:25.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:24 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:24:25.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:24 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:24:25.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:24 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:24:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T23:24:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:25 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T23:24:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:25 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T23:24:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:25 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:27.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:26 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:27.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:26 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:27.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:26 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:27.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:26 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:27.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:26 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:27.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:26 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:27.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:26 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:26 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:26 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:24:28.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:27 smithi177 ceph-mon[35760]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T23:24:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:27 smithi002 ceph-mon[31150]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T23:24:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:27 smithi154 ceph-mon[35136]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T23:24:30.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:29 smithi177 ceph-mon[35760]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T23:24:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:29 smithi002 ceph-mon[31150]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T23:24:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:29 smithi154 ceph-mon[35136]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T23:24:32.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:31 smithi177 ceph-mon[35760]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T23:24:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:31 smithi002 ceph-mon[31150]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T23:24:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:31 smithi154 ceph-mon[35136]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T23:24:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 -- 172.21.15.2:0/2898790863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c101860 msgr2=0x7f510c101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 --2- 172.21.15.2:0/2898790863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c101860 0x7f510c101c60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009cd0 tx=0x7f50fc02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 -- 172.21.15.2:0/2898790863 shutdown_connections 2024-09-10T23:24:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 --2- 172.21.15.2:0/2898790863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 0x7f510c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 --2- 172.21.15.2:0/2898790863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c1029b0 0x7f510c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 --2- 172.21.15.2:0/2898790863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c101860 0x7f510c101c60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 -- 172.21.15.2:0/2898790863 >> 172.21.15.2:0/2898790863 conn(0x7f510c0fd140 msgr2=0x7f510c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 -- 172.21.15.2:0/2898790863 shutdown_connections 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.714+0000 7f5113d32640 1 -- 172.21.15.2:0/2898790863 wait complete. 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 Processor -- start 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 -- start start 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c101860 0x7f510c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 0x7f510c199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 0x7f510c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f510c10d530 con 0x7f510c1029b0 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f510c10d3b0 con 0x7f510c101860 2024-09-10T23:24:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5113d32640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f510c10d6b0 con 0x7f510c103370 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51112cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 0x7f510c199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51112cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 0x7f510c199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51358/0 (socket says 172.21.15.2:51358) 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51112cd640 1 -- 172.21.15.2:0/4133131517 learned_addr learned my addr 172.21.15.2:0/4133131517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51122cf640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 0x7f510c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f5111ace640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c101860 0x7f510c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51112cd640 1 -- 172.21.15.2:0/4133131517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 msgr2=0x7f510c19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51112cd640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 0x7f510c19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.715+0000 7f51112cd640 1 -- 172.21.15.2:0/4133131517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c101860 msgr2=0x7f510c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f51112cd640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c101860 0x7f510c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f51112cd640 1 -- 172.21.15.2:0/4133131517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c19a970 con 0x7f510c1029b0 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f51122cf640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 0x7f510c19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f5111ace640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c101860 0x7f510c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f51112cd640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 0x7f510c199480 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f510000d950 tx=0x7f510000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f510affd640 1 -- 172.21.15.2:0/4133131517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100017070 con 0x7f510c1029b0 2024-09-10T23:24:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f510affd640 1 -- 172.21.15.2:0/4133131517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5100009c30 con 0x7f510c1029b0 2024-09-10T23:24:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f510affd640 1 -- 172.21.15.2:0/4133131517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510000f620 con 0x7f510c1029b0 2024-09-10T23:24:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c19ac60 con 0x7f510c1029b0 2024-09-10T23:24:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.716+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1a1330 con 0x7f510c1029b0 2024-09-10T23:24:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f510affd640 1 -- 172.21.15.2:0/4133131517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5100010460 con 0x7f510c1029b0 2024-09-10T23:24:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 Processor -- start 2024-09-10T23:24:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 -- start start 2024-09-10T23:24:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d812d860 0x55a8d812fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8132580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8135090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a8d809f6f0 con 0x55a8d8130190 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8d808eb20 con 0x55a8d812d860 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.719+0000 7f5116be0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a8d8092930 con 0x55a8d8132bd0 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8132580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51366/0 (socket says 172.21.15.2:51366) 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 -- 172.21.15.2:0/2523619343 learned_addr learned my addr 172.21.15.2:0/2523619343 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f51122cf640 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d812d860 0x55a8d812fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f51112cd640 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8135090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 -- 172.21.15.2:0/2523619343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 msgr2=0x55a8d8135090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8135090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 -- 172.21.15.2:0/2523619343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d812d860 msgr2=0x55a8d812fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d812d860 0x55a8d812fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 -- 172.21.15.2:0/2523619343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8d8054530 con 0x55a8d8130190 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f510affd640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f50f40b52e0 0x7f50f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f51122cf640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f50f40b52e0 0x7f50f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f5111ace640 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8132580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50fc005fe0 tx=0x7f50fc031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e221c308a4947ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f510affd640 1 -- 172.21.15.2:0/4133131517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f51000e5910 con 0x7f510c1029b0 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.720+0000 7f50f3fff640 1 -- 172.21.15.2:0/2523619343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc031c90 con 0x55a8d8130190 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f50f3fff640 1 -- 172.21.15.2:0/2523619343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc036040 con 0x55a8d8130190 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f50f3fff640 1 -- 172.21.15.2:0/2523619343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004830 con 0x55a8d8130190 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 -- 172.21.15.2:0/2523619343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 msgr2=0x55a8d8132580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f51122cf640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f50f40b52e0 0x7f50f40b77a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f510c199bb0 tx=0x7f5104008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8132580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50fc005fe0 tx=0x7f50fc031530 comp rx=0 tx=0).stop 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 -- 172.21.15.2:0/2523619343 shutdown_connections 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8135090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8132580 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 --2- 172.21.15.2:0/2523619343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d812d860 0x55a8d812fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.721+0000 7f5116be0740 1 -- 172.21.15.2:0/2523619343 >> 172.21.15.2:0/2523619343 conn(0x55a8d81289b0 msgr2=0x55a8d8129740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.722+0000 7f5116be0740 1 -- 172.21.15.2:0/2523619343 shutdown_connections 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.722+0000 7f5116be0740 1 -- 172.21.15.2:0/2523619343 wait complete. 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.722+0000 7f5116be0740 1 -- start start 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.722+0000 7f5116be0740 1 Processor -- start 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.722+0000 7f5116be0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d8136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.722+0000 7f5116be0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8137510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5116be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d81380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5116be0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a8d7fc6ab0 con 0x55a8d8130190 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5116be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8d8034730 con 0x55a8d8132bd0 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5116be0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a8d8135b50 con 0x55a8d812d860 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5116be0740 10 client.0 _ll_register_callbacks cb 0x55a8d80886b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8137510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51372/0 (socket says 172.21.15.2:51372) 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 -- 172.21.15.2:0/2548329858 learned_addr learned my addr 172.21.15.2:0/2548329858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5111ace640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d8136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51122cf640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d81380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 -- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 msgr2=0x55a8d8136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d8136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 -- 172.21.15.2:0/2548329858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 msgr2=0x55a8d81380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d81380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 -- 172.21.15.2:0/2548329858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8d7df0790 con 0x55a8d8130190 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f51112cd640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8137510 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5100000c00 tx=0x7f51000a85d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366a4e05a0a81934 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f50f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f50f17fa640 1 -- 172.21.15.2:0/2548329858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100020070 con 0x55a8d8130190 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f50f17fa640 1 -- 172.21.15.2:0/2548329858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f51000ab540 con 0x55a8d8130190 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.723+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50fc036040 con 0x55a8d8130190 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f50f17fa640 1 -- 172.21.15.2:0/2548329858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51000ab850 con 0x55a8d8130190 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 10 client.15429 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8d7e69620 con 0x55a8d8130190 2024-09-10T23:24:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f50f17fa640 1 -- 172.21.15.2:0/2548329858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc036040 con 0x55a8d8130190 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f50f17fa640 1 -- 172.21.15.2:0/2548329858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f51000a7a30 con 0x55a8d8130190 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 10 client.15429 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 20 client.15429 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81427f0 0x55a8d8144c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 4 client.15429 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8d80a1640 con 0x55a8d81427f0 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.724+0000 7f5111ace640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81427f0 0x55a8d8144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.725+0000 7f5111ace640 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81427f0 0x55a8d8144c30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ee5f8331c7c7abc server_cookie=7d8e559da0f662b5 in_seq=0 out_seq=0 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.725+0000 7f50f17fa640 10 client.15429 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.725+0000 7f50f17fa640 1 -- 172.21.15.2:0/2548329858 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8d80a1640 con 0x55a8d81427f0 2024-09-10T23:24:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.725+0000 7f50f17fa640 10 client.15429 handle_command_reply: tid=0 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 client.15429 shutdown 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 msgr2=0x55a8d8137510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8137510 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5100000c00 tx=0x7f51000a85d0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 shutdown_connections 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81427f0 0x55a8d8144c30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d81380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d8137510 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 --2- 172.21.15.2:0/2548329858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d8136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f50f17fa640 0 client.15429 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 >> 172.21.15.2:0/2548329858 conn(0x55a8d81289b0 msgr2=0x55a8d8127bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 shutdown_connections 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 1 -- 172.21.15.2:0/2548329858 wait complete. 2024-09-10T23:24:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.726+0000 7f5116be0740 20 client.15429 trim_cache size 0 max 16384 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 Processor -- start 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 -- start start 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 0x55a8d81360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8130190 0x55a8d813f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8136610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1a9ee0 con 0x55a8d812d860 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1aba20 con 0x55a8d8130190 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5116be0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1aa5b0 con 0x55a8d8132bd0 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 0x55a8d81360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 0x55a8d81360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51388/0 (socket says 172.21.15.2:51388) 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 -- 172.21.15.2:0/2716571233 learned_addr learned my addr 172.21.15.2:0/2716571233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f51112cd640 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8130190 0x55a8d813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f51122cf640 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 -- 172.21.15.2:0/2716571233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 msgr2=0x55a8d8136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8136610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 -- 172.21.15.2:0/2716571233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8130190 msgr2=0x55a8d813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8130190 0x55a8d813f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.741+0000 7f5111ace640 1 -- 172.21.15.2:0/2716571233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8d81328f0 con 0x55a8d812d860 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.742+0000 7f5111ace640 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 0x55a8d81360d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f50fc031780 tx=0x7f50fc02af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895b10c2cde8b828 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.742+0000 7f50f37fe640 1 -- 172.21.15.2:0/2716571233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc031c30 con 0x55a8d812d860 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.742+0000 7f50f37fe640 1 -- 172.21.15.2:0/2716571233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc036040 con 0x55a8d812d860 2024-09-10T23:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.742+0000 7f50f37fe640 1 -- 172.21.15.2:0/2716571233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004700 con 0x55a8d812d860 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- 172.21.15.2:0/2716571233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 msgr2=0x55a8d81360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 0x55a8d81360d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f50fc031780 tx=0x7f50fc02af20 comp rx=0 tx=0).stop 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- 172.21.15.2:0/2716571233 shutdown_connections 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d8132bd0 0x55a8d8136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8130190 0x55a8d813f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- 172.21.15.2:0/2716571233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d812d860 0x55a8d81360d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- 172.21.15.2:0/2716571233 >> 172.21.15.2:0/2716571233 conn(0x55a8d81289b0 msgr2=0x55a8d812ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- 172.21.15.2:0/2716571233 shutdown_connections 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- 172.21.15.2:0/2716571233 wait complete. 2024-09-10T23:24:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- start start 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 Processor -- start 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d813f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d813e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ab350 con 0x55a8d8130190 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1aac80 con 0x55a8d8132bd0 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1a7ec0 con 0x55a8d812d860 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.743+0000 7f5116be0740 10 client.0 _ll_register_callbacks cb 0x7f510000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d813deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51400/0 (socket says 172.21.15.2:51400) 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 -- 172.21.15.2:0/998719781 learned_addr learned my addr 172.21.15.2:0/998719781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51122cf640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d813e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f5111ace640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d813f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 -- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 msgr2=0x55a8d813f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d813f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 -- 172.21.15.2:0/998719781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 msgr2=0x55a8d813e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d813e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 -- 172.21.15.2:0/998719781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8d813c8e0 con 0x55a8d8130190 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f51112cd640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d813deb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5100005b60 tx=0x7f51000cdd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72333a4739a32c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f50f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f50f17fa640 1 -- 172.21.15.2:0/998719781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100020070 con 0x55a8d8130190 2024-09-10T23:24:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f50f17fa640 1 -- 172.21.15.2:0/998719781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5100010780 con 0x55a8d8130190 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50fc036040 con 0x55a8d8130190 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f50f17fa640 1 -- 172.21.15.2:0/998719781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51000a7f80 con 0x55a8d8130190 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f5116be0740 10 client.15435 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.744+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8d81b3e40 con 0x55a8d8130190 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f50f17fa640 1 -- 172.21.15.2:0/998719781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc036040 con 0x55a8d8130190 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f50f17fa640 1 -- 172.21.15.2:0/998719781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5100097140 con 0x55a8d8130190 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5116be0740 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5116be0740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5116be0740 20 client.15435 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5116be0740 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81b4790 0x55a8d81b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5116be0740 4 client.15435 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:24:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8d809d0f0 con 0x55a8d81b4790 2024-09-10T23:24:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.745+0000 7f5111ace640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81b4790 0x55a8d81b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.746+0000 7f5111ace640 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81b4790 0x55a8d81b6b80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c9a611fe488f7f server_cookie=93c8d64b7db8f775 in_seq=0 out_seq=0 2024-09-10T23:24:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.746+0000 7f50f17fa640 10 client.15435 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.756+0000 7f50f17fa640 1 -- 172.21.15.2:0/998719781 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8d809d0f0 con 0x55a8d81b4790 2024-09-10T23:24:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.756+0000 7f50f17fa640 10 client.15435 handle_command_reply: tid=0 2024-09-10T23:24:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.756+0000 7f5116be0740 1 client.15435 shutdown 2024-09-10T23:24:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.756+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 msgr2=0x55a8d813deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.756+0000 7f5116be0740 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d813deb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5100005b60 tx=0x7f51000cdd70 comp rx=0 tx=0).stop 2024-09-10T23:24:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 shutdown_connections 2024-09-10T23:24:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a8d81b4790 0x55a8d81b6b80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8d8132bd0 0x55a8d813e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8d8130190 0x55a8d813deb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 --2- 172.21.15.2:0/998719781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a8d812d860 0x55a8d813f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 >> 172.21.15.2:0/998719781 conn(0x55a8d81289b0 msgr2=0x55a8d812c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f50f17fa640 0 client.15435 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 shutdown_connections 2024-09-10T23:24:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 1 -- 172.21.15.2:0/998719781 wait complete. 2024-09-10T23:24:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5116be0740 20 client.15435 trim_cache size 0 max 16384 2024-09-10T23:24:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:24:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:24:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:24:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:24:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f50f40b52e0 msgr2=0x7f50f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f50f40b52e0 0x7f50f40b77a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f510c199bb0 tx=0x7f5104008040 comp rx=0 tx=0).stop 2024-09-10T23:24:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 msgr2=0x7f510c199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 0x7f510c199480 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f510000d950 tx=0x7f510000de10 comp rx=0 tx=0).stop 2024-09-10T23:24:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 shutdown_connections 2024-09-10T23:24:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f50f40b52e0 0x7f50f40b77a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f510c103370 0x7f510c19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510c1029b0 0x7f510c199480 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 --2- 172.21.15.2:0/4133131517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f510c101860 0x7f510c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.757+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 >> 172.21.15.2:0/4133131517 conn(0x7f510c0fd140 msgr2=0x7f510c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.758+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 shutdown_connections 2024-09-10T23:24:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:32.758+0000 7f5113d32640 1 -- 172.21.15.2:0/4133131517 wait complete. 2024-09-10T23:24:34.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:33 smithi177 ceph-mon[35760]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T23:24:34.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:33 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:24:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:33 smithi002 ceph-mon[31150]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T23:24:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:33 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:24:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:33 smithi154 ceph-mon[35136]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T23:24:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:33 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:24:36.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:35 smithi177 ceph-mon[35760]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T23:24:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:35 smithi002 ceph-mon[31150]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T23:24:36.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:35 smithi154 ceph-mon[35136]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T23:24:38.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:37 smithi177 ceph-mon[35760]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-10T23:24:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:37 smithi002 ceph-mon[31150]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-10T23:24:38.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:37 smithi154 ceph-mon[35136]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-10T23:24:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:39 smithi177 ceph-mon[35760]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:40.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:39 smithi002 ceph-mon[31150]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:40.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:39 smithi154 ceph-mon[35136]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:41 smithi177 ceph-mon[35760]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:42.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:41 smithi002 ceph-mon[31150]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:42.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:41 smithi154 ceph-mon[35136]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:43 smithi177 ceph-mon[35760]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-10T23:24:44.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:43 smithi002 ceph-mon[31150]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-10T23:24:44.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:43 smithi154 ceph-mon[35136]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-10T23:24:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 -- 172.21.15.2:0/2923994098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4101860 msgr2=0x7f9fe4101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 --2- 172.21.15.2:0/2923994098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4101860 0x7f9fe4101c60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009930 tx=0x7f9fe002a440 comp rx=0 tx=0).stop 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 -- 172.21.15.2:0/2923994098 shutdown_connections 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 --2- 172.21.15.2:0/2923994098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fe4103370 0x7f9fe4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 --2- 172.21.15.2:0/2923994098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe41029b0 0x7f9fe4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 --2- 172.21.15.2:0/2923994098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4101860 0x7f9fe4101c60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 -- 172.21.15.2:0/2923994098 >> 172.21.15.2:0/2923994098 conn(0x7f9fe40fd140 msgr2=0x7f9fe40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 -- 172.21.15.2:0/2923994098 shutdown_connections 2024-09-10T23:24:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.893+0000 7f9fec53a640 1 -- 172.21.15.2:0/2923994098 wait complete. 2024-09-10T23:24:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 Processor -- start 2024-09-10T23:24:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 -- start start 2024-09-10T23:24:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fe4101860 0x7f9fe406b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 0x7f9fe419db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe4103370 0x7f9fe41a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe410d500 con 0x7f9fe41029b0 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe410d380 con 0x7f9fe4101860 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.894+0000 7f9fec53a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe410d680 con 0x7f9fe4103370 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 0x7f9fe419db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 0x7f9fe419db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60684/0 (socket says 172.21.15.2:60684) 2024-09-10T23:24:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/486251086 learned_addr learned my addr 172.21.15.2:0/486251086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fe4101860 0x7f9fe406b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9feaad7640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe4103370 0x7f9fe41a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/486251086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe4103370 msgr2=0x7f9fe41a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe4103370 0x7f9fe41a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/486251086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fe4101860 msgr2=0x7f9fe406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fe4101860 0x7f9fe406b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/486251086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe41a09b0 con 0x7f9fe41029b0 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9feaad7640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe4103370 0x7f9fe41a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 0x7f9fe419db00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e9f0 tx=0x7f9fd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.895+0000 7f9fdb7fe640 1 -- 172.21.15.2:0/486251086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400cd80 con 0x7f9fe41029b0 2024-09-10T23:24:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.896+0000 7f9fdb7fe640 1 -- 172.21.15.2:0/486251086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fd40108e0 con 0x7f9fe41029b0 2024-09-10T23:24:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.896+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe4197930 con 0x7f9fe41029b0 2024-09-10T23:24:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.896+0000 7f9fdb7fe640 1 -- 172.21.15.2:0/486251086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4018980 con 0x7f9fe41029b0 2024-09-10T23:24:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.897+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe4197ed0 con 0x7f9fe41029b0 2024-09-10T23:24:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.900+0000 7f9fdb7fe640 1 -- 172.21.15.2:0/486251086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9fd4010430 con 0x7f9fe41029b0 2024-09-10T23:24:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.900+0000 7f9fef3e2740 1 Processor -- start 2024-09-10T23:24:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 -- start start 2024-09-10T23:24:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555d56286f0 con 0x5555d56b9190 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5555d5617b20 con 0x5555d56bbbd0 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5555d561b930 con 0x5555d56b6860 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9feaad7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9feaad7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:46630/0 (socket says 172.21.15.2:46630) 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.901+0000 7f9feaad7640 1 -- 172.21.15.2:0/215353538 learned_addr learned my addr 172.21.15.2:0/215353538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fea2d6640 1 -- 172.21.15.2:0/215353538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 msgr2=0x5555d56b8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56b8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fea2d6640 1 -- 172.21.15.2:0/215353538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 msgr2=0x5555d56be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fea2d6640 1 -- 172.21.15.2:0/215353538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d55dd530 con 0x5555d56b9190 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fdb7fe640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9fd00b5360 0x7f9fd00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bb580 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0033040 tx=0x7f9fe0005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ecefe12d3f3724 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9feaad7640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9fd00b5360 0x7f9fd00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fdb7fe640 1 -- 172.21.15.2:0/486251086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9fd40e6220 con 0x7f9fe41029b0 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.902+0000 7f9fd8bfe640 1 -- 172.21.15.2:0/215353538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe004b070 con 0x5555d56b9190 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.903+0000 7f9fd8bfe640 1 -- 172.21.15.2:0/215353538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fe00048c0 con 0x5555d56b9190 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.903+0000 7f9fd8bfe640 1 -- 172.21.15.2:0/215353538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0005210 con 0x5555d56b9190 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 -- 172.21.15.2:0/215353538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 msgr2=0x5555d56bb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9feaad7640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9fd00b5360 0x7f9fd00b7820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc012560 tx=0x7f9fdc009790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bb580 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0033040 tx=0x7f9fe0005e20 comp rx=0 tx=0).stop 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 -- 172.21.15.2:0/215353538 shutdown_connections 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bb580 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/215353538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 -- 172.21.15.2:0/215353538 >> 172.21.15.2:0/215353538 conn(0x5555d56b19b0 msgr2=0x5555d56b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 -- 172.21.15.2:0/215353538 shutdown_connections 2024-09-10T23:24:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.904+0000 7f9fef3e2740 1 -- 172.21.15.2:0/215353538 wait complete. 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 -- start start 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 Processor -- start 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56b6860 0x5555d56bff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 0x5555d56c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555d554fab0 con 0x5555d56bbbd0 2024-09-10T23:24:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5555d55bd730 con 0x5555d56b6860 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5555d56beb50 con 0x5555d56b9190 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fef3e2740 10 client.0 _ll_register_callbacks cb 0x5555d56116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9feaad7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 0x5555d56c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56b6860 0x5555d56bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fe9ad5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56b6860 0x5555d56bff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:47938/0 (socket says 172.21.15.2:47938) 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9feaad7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 0x5555d56c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60698/0 (socket says 172.21.15.2:60698) 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.905+0000 7f9fea2d6640 1 -- 172.21.15.2:0/1478120999 learned_addr learned my addr 172.21.15.2:0/1478120999 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/1478120999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56b6860 msgr2=0x5555d56bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56b6860 0x5555d56bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/1478120999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 msgr2=0x5555d56c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 0x5555d56c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fe9ad5640 1 -- 172.21.15.2:0/1478120999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d5379790 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9feaad7640 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 0x5555d56c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c0620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40e3d80 tx=0x7f9fd40a8890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b358e5ccd54d196a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fcdffb640 1 -- 172.21.15.2:0/1478120999 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40ac160 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fcdffb640 1 -- 172.21.15.2:0/1478120999 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9fd40b11b0 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.906+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe00048c0 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.907+0000 7f9fcdffb640 1 -- 172.21.15.2:0/1478120999 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9fd40ac500 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.907+0000 7f9fef3e2740 10 client.25051 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.907+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5555d53f2620 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.907+0000 7f9fcdffb640 1 -- 172.21.15.2:0/1478120999 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fd4095070 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fcdffb640 1 -- 172.21.15.2:0/1478120999 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9fd4018b20 con 0x5555d56b9190 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fef3e2740 10 client.25051 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fef3e2740 10 client.25051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fef3e2740 20 client.25051 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d56cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fef3e2740 4 client.25051 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555d562a640 con 0x5555d56cb890 2024-09-10T23:24:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.908+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d56cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.909+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d56cdc80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5d8f2cc7512376 server_cookie=375e6e6453ca12a5 in_seq=0 out_seq=0 2024-09-10T23:24:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.909+0000 7f9fcdffb640 10 client.25051 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.909+0000 7f9fcdffb640 1 -- 172.21.15.2:0/1478120999 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555d562a640 con 0x5555d56cb890 2024-09-10T23:24:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.909+0000 7f9fcdffb640 10 client.25051 handle_command_reply: tid=0 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.909+0000 7f9fef3e2740 1 client.25051 shutdown 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 msgr2=0x5555d56c0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c0620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40e3d80 tx=0x7f9fd40a8890 comp rx=0 tx=0).stop 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 shutdown_connections 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d56cdc80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fcdffb640 0 client.25051 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56bbbd0 0x5555d56c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c0620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/1478120999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56b6860 0x5555d56bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 >> 172.21.15.2:0/1478120999 conn(0x5555d56b19b0 msgr2=0x5555d56b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 shutdown_connections 2024-09-10T23:24:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 1 -- 172.21.15.2:0/1478120999 wait complete. 2024-09-10T23:24:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.910+0000 7f9fef3e2740 20 client.25051 trim_cache size 0 max 16384 2024-09-10T23:24:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 Processor -- start 2024-09-10T23:24:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 -- start start 2024-09-10T23:24:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56bf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41a7cc0 con 0x5555d56b9190 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41a9800 con 0x5555d56bbbd0 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41a8390 con 0x5555d56b6860 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fe9ad5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56bc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:46648/0 (socket says 172.21.15.2:46648) 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9fea2d6640 1 -- 172.21.15.2:0/2917484432 learned_addr learned my addr 172.21.15.2:0/2917484432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.940+0000 7f9feaad7640 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fea2d6640 1 -- 172.21.15.2:0/2917484432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 msgr2=0x5555d56bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56bf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fea2d6640 1 -- 172.21.15.2:0/2917484432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 msgr2=0x5555d56bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fea2d6640 1 -- 172.21.15.2:0/2917484432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d56cdff0 con 0x5555d56b6860 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.941+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56bc6c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0005ab0 tx=0x7f9fe0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca4db06ebbc0eb71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fcffff640 1 -- 172.21.15.2:0/2917484432 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe004b040 con 0x5555d56b6860 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fcffff640 1 -- 172.21.15.2:0/2917484432 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fe004c040 con 0x5555d56b6860 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fcffff640 1 -- 172.21.15.2:0/2917484432 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe003bb60 con 0x5555d56b6860 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fef3e2740 1 -- 172.21.15.2:0/2917484432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 msgr2=0x5555d56bc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56bc6c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0005ab0 tx=0x7f9fe0005fd0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fef3e2740 1 -- 172.21.15.2:0/2917484432 shutdown_connections 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b9190 0x5555d56bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.944+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/2917484432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b6860 0x5555d56bc6c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- 172.21.15.2:0/2917484432 >> 172.21.15.2:0/2917484432 conn(0x5555d56b19b0 msgr2=0x5555d56bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- 172.21.15.2:0/2917484432 shutdown_connections 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- 172.21.15.2:0/2917484432 wait complete. 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- start start 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 Processor -- start 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 0x5555d56c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41a9130 con 0x5555d56b6860 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41a8a60 con 0x5555d56bbbd0 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41a5ca0 con 0x5555d56b9190 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fef3e2740 10 client.0 _ll_register_callbacks cb 0x7f9fd4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.945+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 0x5555d56c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 0x5555d56c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60710/0 (socket says 172.21.15.2:60710) 2024-09-10T23:24:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 -- 172.21.15.2:0/4189990249 learned_addr learned my addr 172.21.15.2:0/4189990249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9feaad7640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 -- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 msgr2=0x5555d56c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 -- 172.21.15.2:0/4189990249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 msgr2=0x5555d56c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 -- 172.21.15.2:0/4189990249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d56bb8f0 con 0x5555d56b6860 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9feaad7640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fea2d6640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 0x5555d56c7b50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0004a70 tx=0x7f9fe003b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f5093d5c919a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.946+0000 7f9fcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fcdffb640 1 -- 172.21.15.2:0/4189990249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe004b070 con 0x5555d56b6860 2024-09-10T23:24:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fcdffb640 1 -- 172.21.15.2:0/4189990249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9fe003baf0 con 0x5555d56b6860 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe004c040 con 0x5555d56b6860 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fcdffb640 1 -- 172.21.15.2:0/4189990249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9fe003bcf0 con 0x5555d56b6860 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 10 client.15453 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5555d5740f80 con 0x5555d56b6860 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fcdffb640 1 -- 172.21.15.2:0/4189990249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fe004c040 con 0x5555d56b6860 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fcdffb640 1 -- 172.21.15.2:0/4189990249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9fe0046920 con 0x5555d56b6860 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 20 client.15453 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d57433e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 4 client.15453 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:24:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.947+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5555d56260f0 con 0x5555d56cb890 2024-09-10T23:24:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.948+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d57433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.948+0000 7f9fcdffb640 10 client.15453 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.948+0000 7f9fe9ad5640 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d57433e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8afa3d2439a17281 server_cookie=c59c8c963b34c08c in_seq=0 out_seq=0 2024-09-10T23:24:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fcdffb640 1 -- 172.21.15.2:0/4189990249 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5555d56260f0 con 0x5555d56cb890 2024-09-10T23:24:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fcdffb640 10 client.15453 handle_command_reply: tid=0 2024-09-10T23:24:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 client.15453 shutdown 2024-09-10T23:24:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 msgr2=0x5555d56c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 0x5555d56c7b50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0004a70 tx=0x7f9fe003b690 comp rx=0 tx=0).stop 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 shutdown_connections 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5555d56cb890 0x5555d57433e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5555d56bbbd0 0x5555d56c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fcdffb640 0 client.15453 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5555d56b9190 0x5555d56c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 --2- 172.21.15.2:0/4189990249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555d56b6860 0x5555d56c7b50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 >> 172.21.15.2:0/4189990249 conn(0x5555d56b19b0 msgr2=0x5555d56bef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 shutdown_connections 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.952+0000 7f9fef3e2740 1 -- 172.21.15.2:0/4189990249 wait complete. 2024-09-10T23:24:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fef3e2740 20 client.15453 trim_cache size 0 max 16384 2024-09-10T23:24:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:24:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:24:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:24:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9fd00b5360 msgr2=0x7f9fd00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9fd00b5360 0x7f9fd00b7820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc012560 tx=0x7f9fdc009790 comp rx=0 tx=0).stop 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 msgr2=0x7f9fe419db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 0x7f9fe419db00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e9f0 tx=0x7f9fd400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 shutdown_connections 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9fd00b5360 0x7f9fd00b7820 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe4103370 0x7f9fe41a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe41029b0 0x7f9fe419db00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 --2- 172.21.15.2:0/486251086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fe4101860 0x7f9fe406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 >> 172.21.15.2:0/486251086 conn(0x7f9fe40fd140 msgr2=0x7f9fe4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 shutdown_connections 2024-09-10T23:24:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:45.953+0000 7f9fec53a640 1 -- 172.21.15.2:0/486251086 wait complete. 2024-09-10T23:24:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:45 smithi177 ceph-mon[35760]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:46.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:45 smithi002 ceph-mon[31150]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:46.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:45 smithi154 ceph-mon[35136]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T23:24:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:47 smithi177 ceph-mon[35760]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-10T23:24:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:47 smithi002 ceph-mon[31150]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-10T23:24:48.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:47 smithi154 ceph-mon[35136]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-10T23:24:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:49 smithi177 ceph-mon[35760]: pgmap v366: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-10T23:24:50.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:49 smithi002 ceph-mon[31150]: pgmap v366: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-10T23:24:50.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:49 smithi154 ceph-mon[35136]: pgmap v366: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-10T23:24:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:51 smithi177 ceph-mon[35760]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T23:24:52.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:51 smithi002 ceph-mon[31150]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T23:24:52.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:51 smithi154 ceph-mon[35136]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T23:24:52.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:24:53.174 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 -- 172.21.15.2:0/867298567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30101076a0 msgr2=0x7f3010107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 --2- 172.21.15.2:0/867298567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30101076a0 0x7f3010107ae0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3004009900 tx=0x7f300402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 -- 172.21.15.2:0/867298567 shutdown_connections 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 --2- 172.21.15.2:0/867298567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3010108020 0x7f301010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 --2- 172.21.15.2:0/867298567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30101076a0 0x7f3010107ae0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 --2- 172.21.15.2:0/867298567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3010101c90 0x7f3010102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 -- 172.21.15.2:0/867298567 >> 172.21.15.2:0/867298567 conn(0x7f30100fd700 msgr2=0x7f30100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 -- 172.21.15.2:0/867298567 shutdown_connections 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.756+0000 7f301624f640 1 -- 172.21.15.2:0/867298567 wait complete. 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.757+0000 7f301624f640 1 Processor -- start 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.757+0000 7f301624f640 1 -- start start 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f301624f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 0x7f3010197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f301624f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30101076a0 0x7f30101975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f301624f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3010108020 0x7f301019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 0x7f3010197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 0x7f3010197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60636/0 (socket says 172.21.15.2:60636) 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f300f7fe640 1 -- 172.21.15.2:0/718239715 learned_addr learned my addr 172.21.15.2:0/718239715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3010110be0 con 0x7f3010101c90 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3010110a60 con 0x7f3010108020 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3010110d60 con 0x7f30101076a0 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f300effd640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30101076a0 0x7f30101975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.758+0000 7f300ffff640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3010108020 0x7f301019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300effd640 1 -- 172.21.15.2:0/718239715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3010108020 msgr2=0x7f301019c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300effd640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3010108020 0x7f301019c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300effd640 1 -- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 msgr2=0x7f3010197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300effd640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 0x7f3010197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300effd640 1 -- 172.21.15.2:0/718239715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301019d140 con 0x7f30101076a0 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300f7fe640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 0x7f3010197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300effd640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30101076a0 0x7f30101975d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3004005940 tx=0x7f30040040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300cff9640 1 -- 172.21.15.2:0/718239715 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300403f030 con 0x7f30101076a0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301019d3d0 con 0x7f30101076a0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300cff9640 1 -- 172.21.15.2:0/718239715 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30040044c0 con 0x7f30101076a0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f300cff9640 1 -- 172.21.15.2:0/718239715 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004035070 con 0x7f30101076a0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.759+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101a3af0 con 0x7f30101076a0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 Processor -- start 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 -- start start 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f300cff9640 1 -- 172.21.15.2:0/718239715 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f300403ba60 con 0x7f30101076a0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e90a0 0x556bcb4e9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4f5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4f5950 0x556bcb4f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556bcb45fe50 con 0x556bcb4e99c0 2024-09-10T23:24:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556bcb44f280 con 0x556bcb4f5950 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.762+0000 7f3018624740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556bcb453090 con 0x556bcb4e90a0 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60652/0 (socket says 172.21.15.2:60652) 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 -- 172.21.15.2:0/2134044991 learned_addr learned my addr 172.21.15.2:0/2134044991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 -- 172.21.15.2:0/2134044991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e90a0 msgr2=0x556bcb4e9480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e90a0 0x556bcb4e9480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 -- 172.21.15.2:0/2134044991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4f5950 msgr2=0x556bcb4f7d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4f5950 0x556bcb4f7d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 -- 172.21.15.2:0/2134044991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcb1ad650 con 0x556bcb4e99c0 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.763+0000 7f300f7fe640 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4f5410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f30000097c0 tx=0x7f3000009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b1140ba0740594 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f2ff5ffb640 1 -- 172.21.15.2:0/2134044991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000008a10 con 0x556bcb4e99c0 2024-09-10T23:24:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f300cff9640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2ff80b52e0 0x7f2ff80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f2ff5ffb640 1 -- 172.21.15.2:0/2134044991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f300001f070 con 0x556bcb4e99c0 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f2ff5ffb640 1 -- 172.21.15.2:0/2134044991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000193c0 con 0x556bcb4e99c0 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f300cff9640 1 -- 172.21.15.2:0/718239715 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3004106270 con 0x7f30101076a0 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f300ffff640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2ff80b52e0 0x7f2ff80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f3018624740 1 -- 172.21.15.2:0/2134044991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 msgr2=0x556bcb4f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.764+0000 7f3018624740 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4f5410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f30000097c0 tx=0x7f3000009c80 comp rx=0 tx=0).stop 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 -- 172.21.15.2:0/2134044991 shutdown_connections 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4f5950 0x556bcb4f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4f5410 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 --2- 172.21.15.2:0/2134044991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e90a0 0x556bcb4e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 -- 172.21.15.2:0/2134044991 >> 172.21.15.2:0/2134044991 conn(0x556bcb4e6ed0 msgr2=0x556bcb4e8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 -- 172.21.15.2:0/2134044991 shutdown_connections 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f300ffff640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2ff80b52e0 0x7f2ff80b77a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3008005fd0 tx=0x7f300800f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 -- 172.21.15.2:0/2134044991 wait complete. 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.765+0000 7f3018624740 1 -- start start 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 Processor -- start 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb4f5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 0x556bcb4f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4f5950 0x556bcb4f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556bcb2b0700 con 0x556bcb4f5950 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556bcb3ea110 con 0x556bcb4e90a0 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556bcb4f8620 con 0x556bcb4e99c0 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f3018624740 10 client.0 _ll_register_callbacks cb 0x556bcb403990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f300effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 0x556bcb4f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f300effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 0x556bcb4f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:47958/0 (socket says 172.21.15.2:47958) 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f300effd640 1 -- 172.21.15.2:0/3680818177 learned_addr learned my addr 172.21.15.2:0/3680818177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f300ffff640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4f5950 0x556bcb4f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f300f7fe640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb4f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.766+0000 7f300effd640 1 -- 172.21.15.2:0/3680818177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 msgr2=0x556bcb4f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f300effd640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb4f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f300effd640 1 -- 172.21.15.2:0/3680818177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4f5950 msgr2=0x556bcb4f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f300effd640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4f5950 0x556bcb4f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f300effd640 1 -- 172.21.15.2:0/3680818177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcb417c40 con 0x556bcb4e99c0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f300effd640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 0x556bcb4f2770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30040cca20 tx=0x7f30040cc4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623e4cb547447856 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f2feeffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f2feeffd640 1 -- 172.21.15.2:0/3680818177 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30040d1020 con 0x556bcb4e99c0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f300001f070 con 0x556bcb4e99c0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f2feeffd640 1 -- 172.21.15.2:0/3680818177 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3004103e30 con 0x556bcb4e99c0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f2feeffd640 1 -- 172.21.15.2:0/3680818177 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3004049040 con 0x556bcb4e99c0 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f3018624740 10 client.25066 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bcb504070 con 0x556bcb4e99c0 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.767+0000 7f2feeffd640 1 -- 172.21.15.2:0/3680818177 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f300001f070 con 0x556bcb4e99c0 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f2feeffd640 1 -- 172.21.15.2:0/3680818177 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f30040c8d00 con 0x556bcb4e99c0 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f3018624740 10 client.25066 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f3018624740 10 client.25066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f3018624740 20 client.25066 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f3018624740 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb505700 0x556bcb507af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f3018624740 4 client.25066 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bcb461da0 con 0x556bcb505700 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f300f7fe640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb505700 0x556bcb507af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f2feeffd640 10 client.25066 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.768+0000 7f300f7fe640 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb505700 0x556bcb507af0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7596097fc43cffdc server_cookie=68494d7fa7da5892 in_seq=0 out_seq=0 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.769+0000 7f2feeffd640 1 -- 172.21.15.2:0/3680818177 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bcb461da0 con 0x556bcb505700 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.769+0000 7f2feeffd640 10 client.25066 handle_command_reply: tid=0 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.769+0000 7f3018624740 1 client.25066 shutdown 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.769+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 msgr2=0x556bcb4f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.769+0000 7f3018624740 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 0x556bcb4f2770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30040cca20 tx=0x7f30040cc4a0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 shutdown_connections 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb505700 0x556bcb507af0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4f5950 0x556bcb4f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4e99c0 0x556bcb4f2770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 --2- 172.21.15.2:0/3680818177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb4f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 >> 172.21.15.2:0/3680818177 conn(0x556bcb4e6ed0 msgr2=0x556bcb4eca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f2feeffd640 0 client.25066 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 shutdown_connections 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 1 -- 172.21.15.2:0/3680818177 wait complete. 2024-09-10T23:24:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.770+0000 7f3018624740 20 client.25066 trim_cache size 0 max 16384 2024-09-10T23:24:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 Processor -- start 2024-09-10T23:24:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 -- start start 2024-09-10T23:24:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb507710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4e6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30101ac160 con 0x556bcb4e99c0 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30101adca0 con 0x556bcb4e90a0 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f3018624740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30101ac830 con 0x556bcb4f5950 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f300effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f300effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4e6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60676/0 (socket says 172.21.15.2:60676) 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.788+0000 7f300effd640 1 -- 172.21.15.2:0/610277459 learned_addr learned my addr 172.21.15.2:0/610277459 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300f7fe640 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb507710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 -- 172.21.15.2:0/610277459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 msgr2=0x556bcb507710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb507710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 -- 172.21.15.2:0/610277459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 msgr2=0x556bcb4e6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4e6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 -- 172.21.15.2:0/610277459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcb4f84b0 con 0x556bcb4f5950 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300effd640 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f300ffff640 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f6d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3008004410 tx=0x7f3008014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a92164e2fcbd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.789+0000 7f2ff57fa640 1 -- 172.21.15.2:0/610277459 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30080186c0 con 0x556bcb4f5950 2024-09-10T23:24:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f2ff57fa640 1 -- 172.21.15.2:0/610277459 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3008018d10 con 0x556bcb4f5950 2024-09-10T23:24:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f2ff57fa640 1 -- 172.21.15.2:0/610277459 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008016d40 con 0x556bcb4f5950 2024-09-10T23:24:53.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 -- 172.21.15.2:0/610277459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 msgr2=0x556bcb4f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f6d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3008004410 tx=0x7f3008014000 comp rx=0 tx=0).stop 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 -- 172.21.15.2:0/610277459 shutdown_connections 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f6d40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e99c0 0x556bcb4e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 --2- 172.21.15.2:0/610277459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e90a0 0x556bcb507710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.790+0000 7f3018624740 1 -- 172.21.15.2:0/610277459 >> 172.21.15.2:0/610277459 conn(0x556bcb4e6ed0 msgr2=0x556bcb4f0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 -- 172.21.15.2:0/610277459 shutdown_connections 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 -- 172.21.15.2:0/610277459 wait complete. 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 -- start start 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 Processor -- start 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 0x556bcb4fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e99c0 0x556bcb4fde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.791+0000 7f3018624740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f3018624740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30101ad5d0 con 0x556bcb4e90a0 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f3018624740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30101acf00 con 0x556bcb4e99c0 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f3018624740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30101aa140 con 0x556bcb4f5950 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 0x556bcb4fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f3018624740 10 client.0 _ll_register_callbacks cb 0x7f300403b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 0x556bcb4fd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60678/0 (socket says 172.21.15.2:60678) 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 -- 172.21.15.2:0/3274591602 learned_addr learned my addr 172.21.15.2:0/3274591602 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300effd640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e99c0 0x556bcb4fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300ffff640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 -- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 msgr2=0x556bcb4f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 -- 172.21.15.2:0/3274591602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e99c0 msgr2=0x556bcb4fde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e99c0 0x556bcb4fde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.792+0000 7f300f7fe640 1 -- 172.21.15.2:0/3274591602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcb4f8e90 con 0x556bcb4e90a0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f300f7fe640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 0x556bcb4fd8f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3000009cc0 tx=0x7f300001a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc32746cb85816a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f2feeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f2feeffd640 1 -- 172.21.15.2:0/3274591602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000005240 con 0x556bcb4e90a0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f2feeffd640 1 -- 172.21.15.2:0/3274591602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f30000053e0 con 0x556bcb4e90a0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3008018d10 con 0x556bcb4e90a0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f2feeffd640 1 -- 172.21.15.2:0/3274591602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30000055e0 con 0x556bcb4e90a0 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f3018624740 10 client.15471 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.793+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bcb57b6a0 con 0x556bcb4e90a0 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f2feeffd640 1 -- 172.21.15.2:0/3274591602 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3008018d10 con 0x556bcb4e90a0 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f2feeffd640 1 -- 172.21.15.2:0/3274591602 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f30000035f0 con 0x556bcb4e90a0 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f3018624740 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f3018624740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f3018624740 20 client.15471 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f3018624740 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb57bc20 0x556bcb57e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f3018624740 4 client.15471 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:24:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556bcb45d850 con 0x556bcb57bc20 2024-09-10T23:24:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.794+0000 7f300effd640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb57bc20 0x556bcb57e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f2feeffd640 10 client.15471 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f300effd640 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb57bc20 0x556bcb57e040 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04ec697266864de server_cookie=1cf0aaf3850c6439 in_seq=0 out_seq=0 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f2feeffd640 1 -- 172.21.15.2:0/3274591602 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x556bcb45d850 con 0x556bcb57bc20 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f2feeffd640 10 client.15471 handle_command_reply: tid=0 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 client.15471 shutdown 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 msgr2=0x556bcb4fd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 0x556bcb4fd8f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3000009cc0 tx=0x7f300001a7d0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 shutdown_connections 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556bcb57bc20 0x556bcb57e040 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f2feeffd640 0 client.15471 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bcb4f5950 0x556bcb4f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556bcb4e99c0 0x556bcb4fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.795+0000 7f3018624740 1 --2- 172.21.15.2:0/3274591602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556bcb4e90a0 0x556bcb4fd8f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.796+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 >> 172.21.15.2:0/3274591602 conn(0x556bcb4e6ed0 msgr2=0x556bcb4f45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.796+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 shutdown_connections 2024-09-10T23:24:53.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.796+0000 7f3018624740 1 -- 172.21.15.2:0/3274591602 wait complete. 2024-09-10T23:24:53.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.796+0000 7f3018624740 20 client.15471 trim_cache size 0 max 16384 2024-09-10T23:24:53.801 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:24:53.801 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:24:53.804 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:24:53.805 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:24:53.805 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:24:53.805 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2ff80b52e0 msgr2=0x7f2ff80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2ff80b52e0 0x7f2ff80b77a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3008005fd0 tx=0x7f300800f040 comp rx=0 tx=0).stop 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30101076a0 msgr2=0x7f30101975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30101076a0 0x7f30101975d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3004005940 tx=0x7f30040040c0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 shutdown_connections 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2ff80b52e0 0x7f2ff80b77a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3010108020 0x7f301019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30101076a0 0x7f30101975d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 --2- 172.21.15.2:0/718239715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010101c90 0x7f3010197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 >> 172.21.15.2:0/718239715 conn(0x7f30100fd700 msgr2=0x7f30100ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 shutdown_connections 2024-09-10T23:24:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:53.797+0000 7f301624f640 1 -- 172.21.15.2:0/718239715 wait complete. 2024-09-10T23:24:53.953 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:53 smithi002 ceph-mon[31150]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T23:24:54.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:53 smithi177 ceph-mon[35760]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T23:24:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:53 smithi154 ceph-mon[35136]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T23:24:54.497 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:24:54.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:24:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 -- 172.21.15.2:0/2848335339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc104550 msgr2=0x7f98dc10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/2848335339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc104550 0x7f98dc10cb30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009900 tx=0x7f98d002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 -- 172.21.15.2:0/2848335339 shutdown_connections 2024-09-10T23:24:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/2848335339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98dc10d100 0x7f98dc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/2848335339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc104550 0x7f98dc10cb30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/2848335339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc103b50 0x7f98dc103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 -- 172.21.15.2:0/2848335339 >> 172.21.15.2:0/2848335339 conn(0x7f98dc0fd700 msgr2=0x7f98dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 -- 172.21.15.2:0/2848335339 shutdown_connections 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.340+0000 7f98e1ad6640 1 -- 172.21.15.2:0/2848335339 wait complete. 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 Processor -- start 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 -- start start 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 0x7f98dc1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98dc10d100 0x7f98dc199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc19edb0 0x7f98dc19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc112db0 con 0x7f98dc103b50 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc112c30 con 0x7f98dc10d100 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98e1ad6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc112f30 con 0x7f98dc19edb0 2024-09-10T23:24:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.341+0000 7f98db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 0x7f98dc1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 0x7f98dc1994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60700/0 (socket says 172.21.15.2:60700) 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 -- 172.21.15.2:0/1025059080 learned_addr learned my addr 172.21.15.2:0/1025059080 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98dbfff640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc19edb0 0x7f98dc19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 -- 172.21.15.2:0/1025059080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc19edb0 msgr2=0x7f98dc19f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc19edb0 0x7f98dc19f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 -- 172.21.15.2:0/1025059080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98dc10d100 msgr2=0x7f98dc199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98daffd640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98dc10d100 0x7f98dc199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98dc10d100 0x7f98dc199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 -- 172.21.15.2:0/1025059080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc19f940 con 0x7f98dc103b50 2024-09-10T23:24:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98dbfff640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc19edb0 0x7f98dc19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98db7fe640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 0x7f98dc1994d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00e9f0 tx=0x7f98cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00cd80 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98dc1018b0 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98cc0054d0 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.342+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc010690 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.343+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98dc101df0 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.344+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98dc06b130 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.348+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f98cc004e50 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.349+0000 7f98d8ff9640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98c40b52e0 0x7f98c40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.349+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f98cc0e6360 con 0x7f98dc103b50 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.349+0000 7f98daffd640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98c40b52e0 0x7f98c40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.350+0000 7f98daffd640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98c40b52e0 0x7f98c40b77a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f98d0006010 tx=0x7f98d0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.354+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98cc056220 con 0x7f98dc103b50 2024-09-10T23:24:55.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.620+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98dc103f30 con 0x7f98dc103b50 2024-09-10T23:24:55.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.621+0000 7f98d8ff9640 1 -- 172.21.15.2:0/1025059080 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f98cc0ad1d0 con 0x7f98dc103b50 2024-09-10T23:24:55.622 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:24:55.622 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:24:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:24:55.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.624+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98c40b52e0 msgr2=0x7f98c40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.624+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98c40b52e0 0x7f98c40b77a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f98d0006010 tx=0x7f98d0000bc0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.624+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 msgr2=0x7f98dc1994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.624+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 0x7f98dc1994d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00e9f0 tx=0x7f98cc00edf0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 shutdown_connections 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98c40b52e0 0x7f98c40b77a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98dc19edb0 0x7f98dc19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98dc10d100 0x7f98dc199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 --2- 172.21.15.2:0/1025059080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98dc103b50 0x7f98dc1994d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 >> 172.21.15.2:0/1025059080 conn(0x7f98dc0fd700 msgr2=0x7f98dc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 shutdown_connections 2024-09-10T23:24:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:55.625+0000 7f98e1ad6640 1 -- 172.21.15.2:0/1025059080 wait complete. 2024-09-10T23:24:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:55 smithi177 ceph-mon[35760]: pgmap v369: 97 pgs: 97 active+clean; 658 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T23:24:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:55 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1025059080' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:55 smithi002 ceph-mon[31150]: pgmap v369: 97 pgs: 97 active+clean; 658 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T23:24:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:55 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1025059080' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:55 smithi154 ceph-mon[35136]: pgmap v369: 97 pgs: 97 active+clean; 658 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T23:24:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:55 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1025059080' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:56.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:24:56.654 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 -- 172.21.15.2:0/3482466036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c102de0 msgr2=0x7fd75c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 --2- 172.21.15.2:0/3482466036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c102de0 0x7fd75c1031c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd758009900 tx=0x7fd75802a410 comp rx=0 tx=0).stop 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 -- 172.21.15.2:0/3482466036 shutdown_connections 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 --2- 172.21.15.2:0/3482466036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c109170 0x7fd75c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 --2- 172.21.15.2:0/3482466036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c1087f0 0x7fd75c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 --2- 172.21.15.2:0/3482466036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c102de0 0x7fd75c1031c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.199+0000 7fd76425e640 1 -- 172.21.15.2:0/3482466036 >> 172.21.15.2:0/3482466036 conn(0x7fd75c0fe830 msgr2=0x7fd75c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.200+0000 7fd76425e640 1 -- 172.21.15.2:0/3482466036 shutdown_connections 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.200+0000 7fd76425e640 1 -- 172.21.15.2:0/3482466036 wait complete. 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.200+0000 7fd76425e640 1 Processor -- start 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 -- start start 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c102de0 0x7fd75c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c1087f0 0x7fd75c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 0x7fd75c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c112e30 con 0x7fd75c109170 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c112cb0 con 0x7fd75c102de0 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd76425e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c112fb0 con 0x7fd75c1087f0 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd7627fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 0x7fd75c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd7617f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c1087f0 0x7fd75c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd7627fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 0x7fd75c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60730/0 (socket says 172.21.15.2:60730) 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd7627fb640 1 -- 172.21.15.2:0/1928921828 learned_addr learned my addr 172.21.15.2:0/1928921828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.201+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c102de0 0x7fd75c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7617f9640 1 -- 172.21.15.2:0/1928921828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c102de0 msgr2=0x7fd75c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c102de0 0x7fd75c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7617f9640 1 -- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 msgr2=0x7fd75c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 0x7fd75c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7617f9640 1 -- 172.21.15.2:0/1928921828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c19f360 con 0x7fd75c1087f0 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 0x7fd75c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c1087f0 0x7fd75c1997f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0099c0 tx=0x7fd74c009e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd752ffd640 1 -- 172.21.15.2:0/1928921828 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c007ac0 con 0x7fd75c1087f0 2024-09-10T23:24:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd752ffd640 1 -- 172.21.15.2:0/1928921828 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd74c0054d0 con 0x7fd75c1087f0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c19f650 con 0x7fd75c1087f0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd752ffd640 1 -- 172.21.15.2:0/1928921828 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c004e00 con 0x7fd75c1087f0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.202+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c075380 con 0x7fd75c1087f0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 Processor -- start 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 -- start start 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e69a10 0x5560b8e75460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e759a0 0x5560b8e77d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560b8ddfea0 con 0x5560b8e759a0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560b8dcf2d0 con 0x5560b8e69a10 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.205+0000 7fd766633740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5560b8dd30e0 con 0x5560b8e690f0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:48004/0 (socket says 172.21.15.2:48004) 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 -- 172.21.15.2:0/2455968252 learned_addr learned my addr 172.21.15.2:0/2455968252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd761ffa640 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e69a10 0x5560b8e75460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd752ffd640 1 -- 172.21.15.2:0/1928921828 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd74c00e460 con 0x7fd75c1087f0 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 -- 172.21.15.2:0/2455968252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e69a10 msgr2=0x5560b8e75460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e69a10 0x5560b8e75460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 -- 172.21.15.2:0/2455968252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e759a0 msgr2=0x5560b8e77d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7617f9640 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e759a0 0x5560b8e77d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e759a0 0x5560b8e77d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7627fb640 1 -- 172.21.15.2:0/2455968252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560b8b2d650 con 0x5560b8e690f0 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.206+0000 7fd7617f9640 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e759a0 0x5560b8e77d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd7627fb640 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e694d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd75400f410 tx=0x7fd75400f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b8a0270954fb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd747fff640 1 -- 172.21.15.2:0/2455968252 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754004d20 con 0x5560b8e690f0 2024-09-10T23:24:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd752ffd640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd747fff640 1 -- 172.21.15.2:0/2455968252 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7540119b0 con 0x5560b8e690f0 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd747fff640 1 -- 172.21.15.2:0/2455968252 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754005620 con 0x5560b8e690f0 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.207+0000 7fd752ffd640 1 -- 172.21.15.2:0/1928921828 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd74c0e5bc0 con 0x7fd75c1087f0 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 -- 172.21.15.2:0/2455968252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 msgr2=0x5560b8e694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e694d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd75400f410 tx=0x7fd75400f8d0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd758031440 tx=0x7fd758040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 -- 172.21.15.2:0/2455968252 shutdown_connections 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e759a0 0x5560b8e77d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e69a10 0x5560b8e75460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 --2- 172.21.15.2:0/2455968252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e694d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 -- 172.21.15.2:0/2455968252 >> 172.21.15.2:0/2455968252 conn(0x5560b8e66f20 msgr2=0x5560b8e680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 -- 172.21.15.2:0/2455968252 shutdown_connections 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.208+0000 7fd766633740 1 -- 172.21.15.2:0/2455968252 wait complete. 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 -- start start 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 Processor -- start 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e75290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e69a10 0x5560b8e726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e72d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560b8c30700 con 0x5560b8e69a10 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560b8d6a160 con 0x5560b8e759a0 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5560b8e78620 con 0x5560b8e690f0 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd766633740 10 client.0 _ll_register_callbacks cb 0x5560b8d839e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.209+0000 7fd761ffa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e75290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd761ffa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e75290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:48012/0 (socket says 172.21.15.2:48012) 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd761ffa640 1 -- 172.21.15.2:0/1760078950 learned_addr learned my addr 172.21.15.2:0/1760078950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e72d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e69a10 0x5560b8e726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 -- 172.21.15.2:0/1760078950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 msgr2=0x5560b8e75290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e75290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 -- 172.21.15.2:0/1760078950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e69a10 msgr2=0x5560b8e726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e69a10 0x5560b8e726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 -- 172.21.15.2:0/1760078950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560b8d97c90 con 0x5560b8e759a0 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e75290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e72d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd75400f3e0 tx=0x7fd754011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6acd395d63af2353 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.210+0000 7fd7457fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:24:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd7457fa640 1 -- 172.21.15.2:0/1760078950 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754009c70 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7540119b0 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd7457fa640 1 -- 172.21.15.2:0/1760078950 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd754011710 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd7457fa640 1 -- 172.21.15.2:0/1760078950 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd754004a40 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd766633740 10 client.25034 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560b8e83ec0 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.211+0000 7fd7457fa640 1 -- 172.21.15.2:0/1760078950 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7540119b0 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd7457fa640 1 -- 172.21.15.2:0/1760078950 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd754005360 con 0x5560b8e759a0 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd766633740 10 client.25034 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd766633740 10 client.25034 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd766633740 20 client.25034 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd766633740 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8e85270 0x5560b8e87660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd766633740 4 client.25034 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.212+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560b8de1df0 con 0x5560b8e85270 2024-09-10T23:24:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.213+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8e85270 0x5560b8e87660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.213+0000 7fd7457fa640 10 client.25034 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.213+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8e85270 0x5560b8e87660 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ee8b06cf18afaba8 server_cookie=2a6eb51aeaafe6e in_seq=0 out_seq=0 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd7457fa640 1 -- 172.21.15.2:0/1760078950 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560b8de1df0 con 0x5560b8e85270 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd7457fa640 10 client.25034 handle_command_reply: tid=0 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 client.25034 shutdown 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 msgr2=0x5560b8e72d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e72d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd75400f3e0 tx=0x7fd754011d90 comp rx=0 tx=0).stop 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 shutdown_connections 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8e85270 0x5560b8e87660 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e72d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e69a10 0x5560b8e726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 --2- 172.21.15.2:0/1760078950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e690f0 0x5560b8e75290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 >> 172.21.15.2:0/1760078950 conn(0x5560b8e66f20 msgr2=0x5560b8e6cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd7457fa640 0 client.25034 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 shutdown_connections 2024-09-10T23:24:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.214+0000 7fd766633740 1 -- 172.21.15.2:0/1760078950 wait complete. 2024-09-10T23:24:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.215+0000 7fd766633740 20 client.25034 trim_cache size 0 max 16384 2024-09-10T23:24:57.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 Processor -- start 2024-09-10T23:24:57.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 -- start start 2024-09-10T23:24:57.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e81850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e71bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1abf90 con 0x5560b8e690f0 2024-09-10T23:24:57.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1adad0 con 0x5560b8e759a0 2024-09-10T23:24:57.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.240+0000 7fd766633740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1ac660 con 0x5560b8e69a10 2024-09-10T23:24:57.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd761ffa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e81850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:48028/0 (socket says 172.21.15.2:48028) 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 -- 172.21.15.2:0/1700350139 learned_addr learned my addr 172.21.15.2:0/1700350139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e71bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 -- 172.21.15.2:0/1700350139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 msgr2=0x5560b8e71bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e71bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 -- 172.21.15.2:0/1700350139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 msgr2=0x5560b8e81850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e81850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd7617f9640 1 -- 172.21.15.2:0/1700350139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560b8e679a0 con 0x5560b8e69a10 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.241+0000 7fd761ffa640 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e81850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.242+0000 7fd7627fb640 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e71bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.242+0000 7fd7617f9640 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e686f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0ac320 tx=0x7fd74c007c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad1fa9a73f03fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.242+0000 7fd7477fe640 1 -- 172.21.15.2:0/1700350139 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c01e030 con 0x5560b8e69a10 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.242+0000 7fd7477fe640 1 -- 172.21.15.2:0/1700350139 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd74c0b5260 con 0x5560b8e69a10 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.242+0000 7fd7477fe640 1 -- 172.21.15.2:0/1700350139 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c0b5920 con 0x5560b8e69a10 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 -- 172.21.15.2:0/1700350139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 msgr2=0x5560b8e686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e686f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0ac320 tx=0x7fd74c007c60 comp rx=0 tx=0).stop 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 -- 172.21.15.2:0/1700350139 shutdown_connections 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e71bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e686f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 --2- 172.21.15.2:0/1700350139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e81850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 -- 172.21.15.2:0/1700350139 >> 172.21.15.2:0/1700350139 conn(0x5560b8e66f20 msgr2=0x5560b8e67fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 -- 172.21.15.2:0/1700350139 shutdown_connections 2024-09-10T23:24:57.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.243+0000 7fd766633740 1 -- 172.21.15.2:0/1700350139 wait complete. 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.244+0000 7fd766633740 1 -- start start 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.244+0000 7fd766633740 1 Processor -- start 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd766633740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e76cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd761ffa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e76cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd761ffa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e76cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60786/0 (socket says 172.21.15.2:60786) 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd761ffa640 1 -- 172.21.15.2:0/3414770070 learned_addr learned my addr 172.21.15.2:0/3414770070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e77200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e77740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1ad400 con 0x5560b8e690f0 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.245+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1acd30 con 0x5560b8e759a0 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1aa020 con 0x5560b8e69a10 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7617f9640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e77200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7627fb640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7627fb640 1 -- 172.21.15.2:0/3414770070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 msgr2=0x5560b8e77200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7627fb640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e77200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7627fb640 1 -- 172.21.15.2:0/3414770070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 msgr2=0x5560b8e76cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7627fb640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e76cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd7627fb640 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560b8e625c0 con 0x5560b8e759a0 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd766633740 10 client.0 _ll_register_callbacks cb 0x7fd754015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5560b8ddd8a0 con 0x5560b8e759a0 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.246+0000 7fd761ffa640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e76cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd7627fb640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e77740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5560b8e78640 tx=0x7fd75400fe00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d32fb3227716f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd7457fa640 10 client.25037 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd7457fa640 1 -- 172.21.15.2:0/3414770070 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754009910 con 0x5560b8e759a0 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd7457fa640 1 -- 172.21.15.2:0/3414770070 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd754022040 con 0x5560b8e759a0 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd7457fa640 1 -- 172.21.15.2:0/3414770070 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd754009c70 con 0x5560b8e759a0 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd766633740 10 client.25037 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.247+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5560b8ef1e90 con 0x5560b8e759a0 2024-09-10T23:24:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd7457fa640 1 -- 172.21.15.2:0/3414770070 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd754003970 con 0x5560b8e759a0 2024-09-10T23:24:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd766633740 10 client.25037 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd766633740 10 client.25037 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:24:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd766633740 20 client.25037 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8ef2400 0x5560b8ef4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd766633740 4 client.25037 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560b8ddacd0 con 0x5560b8ef2400 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.248+0000 7fd761ffa640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8ef2400 0x5560b8ef4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd7457fa640 10 client.25037 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd761ffa640 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8ef2400 0x5560b8ef4860 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f563e9b10f7aee02 server_cookie=df378f31f4596fe8 in_seq=0 out_seq=0 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd7457fa640 1 -- 172.21.15.2:0/3414770070 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560b8ddacd0 con 0x5560b8ef2400 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd7457fa640 10 client.25037 handle_command_reply: tid=0 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 client.25037 shutdown 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 msgr2=0x5560b8e77740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e77740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5560b8e78640 tx=0x7fd75400fe00 comp rx=0 tx=0).stop 2024-09-10T23:24:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 shutdown_connections 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5560b8ef2400 0x5560b8ef4860 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd7457fa640 0 client.25037 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b8e759a0 0x5560b8e77740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b8e69a10 0x5560b8e77200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 --2- 172.21.15.2:0/3414770070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b8e690f0 0x5560b8e76cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.249+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 >> 172.21.15.2:0/3414770070 conn(0x5560b8e66f20 msgr2=0x5560b8e65750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.250+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 shutdown_connections 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.250+0000 7fd766633740 1 -- 172.21.15.2:0/3414770070 wait complete. 2024-09-10T23:24:57.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.250+0000 7fd766633740 20 client.25037 trim_cache size 0 max 16384 2024-09-10T23:24:57.254 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:24:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 msgr2=0x7fd7480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd758031440 tx=0x7fd758040040 comp rx=0 tx=0).stop 2024-09-10T23:24:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c1087f0 msgr2=0x7fd75c1997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c1087f0 0x7fd75c1997f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0099c0 tx=0x7fd74c009e80 comp rx=0 tx=0).stop 2024-09-10T23:24:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 shutdown_connections 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd75c109170 0x7fd75c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd75c1087f0 0x7fd75c1997f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 --2- 172.21.15.2:0/1928921828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c102de0 0x7fd75c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 >> 172.21.15.2:0/1928921828 conn(0x7fd75c0fe830 msgr2=0x7fd75c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.252+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 shutdown_connections 2024-09-10T23:24:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:57.253+0000 7fd76425e640 1 -- 172.21.15.2:0/1928921828 wait complete. 2024-09-10T23:24:57.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:24:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:57 smithi177 ceph-mon[35760]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:24:58.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:57 smithi002 ceph-mon[31150]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:24:58.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:57 smithi154 ceph-mon[35136]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:24:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 -- 172.21.15.2:0/159303171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c101c90 msgr2=0x7ffa4c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 --2- 172.21.15.2:0/159303171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c101c90 0x7ffa4c102070 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009900 tx=0x7ffa3c02a410 comp rx=0 tx=0).stop 2024-09-10T23:24:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 -- 172.21.15.2:0/159303171 shutdown_connections 2024-09-10T23:24:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 --2- 172.21.15.2:0/159303171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 0x7ffa4c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 --2- 172.21.15.2:0/159303171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4c1076a0 0x7ffa4c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 --2- 172.21.15.2:0/159303171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c101c90 0x7ffa4c102070 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 -- 172.21.15.2:0/159303171 >> 172.21.15.2:0/159303171 conn(0x7ffa4c0fd700 msgr2=0x7ffa4c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 -- 172.21.15.2:0/159303171 shutdown_connections 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.951+0000 7ffa5166d640 1 -- 172.21.15.2:0/159303171 wait complete. 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.952+0000 7ffa5166d640 1 Processor -- start 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.952+0000 7ffa5166d640 1 -- start start 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa5166d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4c1076a0 0x7ffa4c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa5166d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 0x7ffa4c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa5166d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c19dd50 0x7ffa4c19e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa5166d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c111cf0 con 0x7ffa4c19dd50 2024-09-10T23:24:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa5166d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c111b70 con 0x7ffa4c108020 2024-09-10T23:24:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 0x7ffa4c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 0x7ffa4c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:60172/0 (socket says 172.21.15.2:60172) 2024-09-10T23:24:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa43fff640 1 -- 172.21.15.2:0/2302357727 learned_addr learned my addr 172.21.15.2:0/2302357727 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa5166d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c111e70 con 0x7ffa4c1076a0 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4b7fe640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c19dd50 0x7ffa4c19e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4affd640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4c1076a0 0x7ffa4c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4b7fe640 1 -- 172.21.15.2:0/2302357727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4c1076a0 msgr2=0x7ffa4c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4b7fe640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4c1076a0 0x7ffa4c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4b7fe640 1 -- 172.21.15.2:0/2302357727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 msgr2=0x7ffa4c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4b7fe640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 0x7ffa4c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.953+0000 7ffa4b7fe640 1 -- 172.21.15.2:0/2302357727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c19e8e0 con 0x7ffa4c19dd50 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.954+0000 7ffa4b7fe640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c19dd50 0x7ffa4c19e200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400ea50 tx=0x7ffa4400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.954+0000 7ffa48ff9640 1 -- 172.21.15.2:0/2302357727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400e2e0 con 0x7ffa4c19dd50 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.954+0000 7ffa48ff9640 1 -- 172.21.15.2:0/2302357727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa44007900 con 0x7ffa4c19dd50 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.954+0000 7ffa48ff9640 1 -- 172.21.15.2:0/2302357727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44005670 con 0x7ffa4c19dd50 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.954+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4c19eb70 con 0x7ffa4c19dd50 2024-09-10T23:24:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.954+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4c06add0 con 0x7ffa4c19dd50 2024-09-10T23:24:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.958+0000 7ffa53a42740 1 Processor -- start 2024-09-10T23:24:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.959+0000 7ffa48ff9640 1 -- 172.21.15.2:0/2302357727 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ffa44005810 con 0x7ffa4c19dd50 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 -- start start 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 0x5598592748e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274e20 0x559859280870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859280db0 0x5598592831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5598591e6ea0 con 0x559859280db0 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5598591d62d0 con 0x559859274e20 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.960+0000 7ffa53a42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5598591da0e0 con 0x559859274500 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859280db0 0x5598592831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 0x5598592748e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 0x5598592748e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:48068/0 (socket says 172.21.15.2:48068) 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 -- 172.21.15.2:0/760885720 learned_addr learned my addr 172.21.15.2:0/760885720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 -- 172.21.15.2:0/760885720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274e20 msgr2=0x559859280870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274e20 0x559859280870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 -- 172.21.15.2:0/760885720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859280db0 msgr2=0x5598592831a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859280db0 0x5598592831a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.961+0000 7ffa43fff640 1 -- 172.21.15.2:0/760885720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559858f34650 con 0x559859274500 2024-09-10T23:24:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.962+0000 7ffa43fff640 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 0x5598592748e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa34012860 tx=0x7ffa3400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce2916aa9eaeaef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.962+0000 7ffa48ff9640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa380b5360 0x7ffa380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.962+0000 7ffa417fa640 1 -- 172.21.15.2:0/760885720 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004030 con 0x559859274500 2024-09-10T23:24:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.962+0000 7ffa417fa640 1 -- 172.21.15.2:0/760885720 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa34005020 con 0x559859274500 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.962+0000 7ffa48ff9640 1 -- 172.21.15.2:0/2302357727 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffa440e4ce0 con 0x7ffa4c19dd50 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.963+0000 7ffa417fa640 1 -- 172.21.15.2:0/760885720 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004cd0 con 0x559859274500 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.963+0000 7ffa4affd640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa380b5360 0x7ffa380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.963+0000 7ffa53a42740 1 -- 172.21.15.2:0/760885720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 msgr2=0x5598592748e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.963+0000 7ffa53a42740 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 0x5598592748e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa34012860 tx=0x7ffa3400b480 comp rx=0 tx=0).stop 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.963+0000 7ffa53a42740 1 -- 172.21.15.2:0/760885720 shutdown_connections 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa53a42740 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859280db0 0x5598592831a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa53a42740 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274e20 0x559859280870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa53a42740 1 --2- 172.21.15.2:0/760885720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274500 0x5598592748e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa53a42740 1 -- 172.21.15.2:0/760885720 >> 172.21.15.2:0/760885720 conn(0x559859272330 msgr2=0x5598592734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa4affd640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa380b5360 0x7ffa380b7820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c006010 tx=0x7ffa3c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa53a42740 1 -- 172.21.15.2:0/760885720 shutdown_connections 2024-09-10T23:24:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.964+0000 7ffa53a42740 1 -- 172.21.15.2:0/760885720 wait complete. 2024-09-10T23:24:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.965+0000 7ffa53a42740 1 -- start start 2024-09-10T23:24:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.965+0000 7ffa53a42740 1 Processor -- start 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.965+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x5598592805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.965+0000 7ffa4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x5598592805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x5598592805f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60830/0 (socket says 172.21.15.2:60830) 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 -- 172.21.15.2:0/649702489 learned_addr learned my addr 172.21.15.2:0/649702489 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559859037700 con 0x559859274500 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559859171160 con 0x559859280db0 2024-09-10T23:24:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559859283ad0 con 0x559859274e20 2024-09-10T23:24:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 -- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 msgr2=0x55985927da40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 -- 172.21.15.2:0/649702489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 msgr2=0x55985927dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa4affd640 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985919ec90 con 0x559859274500 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 10 client.0 _ll_register_callbacks cb 0x55985918a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.966+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa34005020 con 0x559859274500 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.967+0000 7ffa4affd640 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x5598592805f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009900 tx=0x7ffa3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d8e49aafb0ef65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.967+0000 7ffa327fc640 10 client.15504 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.967+0000 7ffa327fc640 1 -- 172.21.15.2:0/649702489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c04c020 con 0x559859274500 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.967+0000 7ffa327fc640 1 -- 172.21.15.2:0/649702489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffa3c0046c0 con 0x559859274500 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa327fc640 1 -- 172.21.15.2:0/649702489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa3c035050 con 0x559859274500 2024-09-10T23:24:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55985928f2e0 con 0x559859274500 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa327fc640 1 -- 172.21.15.2:0/649702489 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa3c059020 con 0x559859274500 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 10 client.15504 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 20 client.15504 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859292b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 4 client.15504 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.968+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598591e8df0 con 0x5598592906e0 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.969+0000 7ffa43fff640 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859292b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.969+0000 7ffa43fff640 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859292b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87489f2bc4739b62 server_cookie=3b4ae9d0f94e4988 in_seq=0 out_seq=0 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.969+0000 7ffa327fc640 10 client.15504 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.970+0000 7ffa327fc640 1 -- 172.21.15.2:0/649702489 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598591e8df0 con 0x5598592906e0 2024-09-10T23:24:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.970+0000 7ffa327fc640 10 client.15504 handle_command_reply: tid=0 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.970+0000 7ffa53a42740 1 client.15504 shutdown 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 msgr2=0x5598592805f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x5598592805f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009900 tx=0x7ffa3c009260 comp rx=0 tx=0).stop 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 shutdown_connections 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859292b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa327fc640 0 client.15504 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 --2- 172.21.15.2:0/649702489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x5598592805f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 >> 172.21.15.2:0/649702489 conn(0x559859272330 msgr2=0x559859277ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 shutdown_connections 2024-09-10T23:24:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 1 -- 172.21.15.2:0/649702489 wait complete. 2024-09-10T23:24:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.971+0000 7ffa53a42740 20 client.15504 trim_cache size 0 max 16384 2024-09-10T23:24:58.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.998+0000 7ffa53a42740 1 Processor -- start 2024-09-10T23:24:58.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.998+0000 7ffa53a42740 1 -- start start 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x55985927c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa53a42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1ac890 con 0x559859274500 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:48098/0 (socket says 172.21.15.2:48098) 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa43fff640 1 -- 172.21.15.2:0/1570480850 learned_addr learned my addr 172.21.15.2:0/1570480850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1ae3d0 con 0x559859280db0 2024-09-10T23:24:59.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1acf60 con 0x559859274e20 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa4b7fe640 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:58.999+0000 7ffa4affd640 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x55985927c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa43fff640 1 -- 172.21.15.2:0/1570480850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 msgr2=0x55985927ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa43fff640 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa43fff640 1 -- 172.21.15.2:0/1570480850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 msgr2=0x55985927c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa43fff640 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x55985927c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa43fff640 1 -- 172.21.15.2:0/1570480850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559858f1b9e0 con 0x559859274e20 2024-09-10T23:24:59.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa4affd640 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x55985927c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:59.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa43fff640 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927c800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005940 tx=0x7ffa340048b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4503842abfa7412c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa40ff9640 1 -- 172.21.15.2:0/1570480850 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa340053d0 con 0x559859274e20 2024-09-10T23:24:59.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.000+0000 7ffa40ff9640 1 -- 172.21.15.2:0/1570480850 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa34005a70 con 0x559859274e20 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.001+0000 7ffa40ff9640 1 -- 172.21.15.2:0/1570480850 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400fa20 con 0x559859274e20 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.001+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 msgr2=0x55985927c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.001+0000 7ffa53a42740 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927c800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005940 tx=0x7ffa340048b0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 shutdown_connections 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859280db0 0x55985927ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859274e20 0x55985927c800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 --2- 172.21.15.2:0/1570480850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274500 0x55985927c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 >> 172.21.15.2:0/1570480850 conn(0x559859272330 msgr2=0x559859273010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 shutdown_connections 2024-09-10T23:24:59.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 -- 172.21.15.2:0/1570480850 wait complete. 2024-09-10T23:24:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.002+0000 7ffa53a42740 1 -- start start 2024-09-10T23:24:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.003+0000 7ffa53a42740 1 Processor -- start 2024-09-10T23:24:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.003+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274500 0x559859271550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.003+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 0x559859288da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.003+0000 7ffa53a42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859280db0 0x559859289420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 0x559859288da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 0x559859288da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60838/0 (socket says 172.21.15.2:60838) 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 -- 172.21.15.2:0/807759652 learned_addr learned my addr 172.21.15.2:0/807759652 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1add00 con 0x559859274e20 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1ad630 con 0x559859274500 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1aa8c0 con 0x559859280db0 2024-09-10T23:24:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa4affd640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274500 0x559859271550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa4b7fe640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859280db0 0x559859289420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 -- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859280db0 msgr2=0x559859289420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859280db0 0x559859289420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 -- 172.21.15.2:0/807759652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274500 msgr2=0x559859271550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274500 0x559859271550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.004+0000 7ffa43fff640 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985926cb80 con 0x559859274e20 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa53a42740 10 client.0 _ll_register_callbacks cb 0x7ffa3c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa43fff640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 0x559859288da0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa340056e0 tx=0x7ffa34005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f749eca64f9409b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa34005a70 con 0x559859274e20 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa327fc640 10 client.15510 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa327fc640 1 -- 172.21.15.2:0/807759652 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004d30 con 0x559859274e20 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa327fc640 1 -- 172.21.15.2:0/807759652 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffa3400f730 con 0x559859274e20 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa327fc640 1 -- 172.21.15.2:0/807759652 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa3400f930 con 0x559859274e20 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa53a42740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.005+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559859301e60 con 0x559859274e20 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa327fc640 1 -- 172.21.15.2:0/807759652 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa3400fad0 con 0x559859274e20 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa53a42740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa53a42740 10 client.15510 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa53a42740 20 client.15510 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa53a42740 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859304240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa53a42740 4 client.15510 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598591e48a0 con 0x5598592906e0 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.006+0000 7ffa4affd640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859304240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa327fc640 10 client.15510 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa4affd640 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859304240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fa58026ae6b146db server_cookie=e9848f8455c5c9d2 in_seq=0 out_seq=0 2024-09-10T23:24:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa327fc640 1 -- 172.21.15.2:0/807759652 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598591e48a0 con 0x5598592906e0 2024-09-10T23:24:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa327fc640 10 client.15510 handle_command_reply: tid=0 2024-09-10T23:24:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa53a42740 1 client.15510 shutdown 2024-09-10T23:24:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 msgr2=0x559859288da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.007+0000 7ffa53a42740 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 0x559859288da0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa340056e0 tx=0x7ffa34005710 comp rx=0 tx=0).stop 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 shutdown_connections 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5598592906e0 0x559859304240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559859280db0 0x559859289420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559859274e20 0x559859288da0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 --2- 172.21.15.2:0/807759652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559859274500 0x559859271550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 >> 172.21.15.2:0/807759652 conn(0x559859272330 msgr2=0x55985927c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa327fc640 0 client.15510 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 shutdown_connections 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 1 -- 172.21.15.2:0/807759652 wait complete. 2024-09-10T23:24:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.008+0000 7ffa53a42740 20 client.15510 trim_cache size 0 max 16384 2024-09-10T23:24:59.011 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa380b5360 msgr2=0x7ffa380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa380b5360 0x7ffa380b7820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c006010 tx=0x7ffa3c031400 comp rx=0 tx=0).stop 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c19dd50 msgr2=0x7ffa4c19e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c19dd50 0x7ffa4c19e200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400ea50 tx=0x7ffa4400ef10 comp rx=0 tx=0).stop 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 shutdown_connections 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa380b5360 0x7ffa380b7820 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa4c19dd50 0x7ffa4c19e200 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa4c108020 0x7ffa4c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.009+0000 7ffa5166d640 1 --2- 172.21.15.2:0/2302357727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4c1076a0 0x7ffa4c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.010+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 >> 172.21.15.2:0/2302357727 conn(0x7ffa4c0fd700 msgr2=0x7ffa4c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.010+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 shutdown_connections 2024-09-10T23:24:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:24:59.010+0000 7ffa5166d640 1 -- 172.21.15.2:0/2302357727 wait complete. 2024-09-10T23:24:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 -- 172.21.15.2:0/1953190162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0101860 msgr2=0x7fd0e0101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 --2- 172.21.15.2:0/1953190162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0101860 0x7fd0e0101c60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009930 tx=0x7fd0d002a420 comp rx=0 tx=0).stop 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 -- 172.21.15.2:0/1953190162 shutdown_connections 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 --2- 172.21.15.2:0/1953190162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e0103370 0x7fd0e0109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 --2- 172.21.15.2:0/1953190162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e01029b0 0x7fd0e0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 --2- 172.21.15.2:0/1953190162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0101860 0x7fd0e0101c60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 -- 172.21.15.2:0/1953190162 >> 172.21.15.2:0/1953190162 conn(0x7fd0e00fd140 msgr2=0x7fd0e00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 -- 172.21.15.2:0/1953190162 shutdown_connections 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.083+0000 7fd0e6964640 1 -- 172.21.15.2:0/1953190162 wait complete. 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 Processor -- start 2024-09-10T23:24:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 -- start start 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e01029b0 0x7fd0e006b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 0x7fd0e019dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e019e220 0x7fd0e01a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e010d4b0 con 0x7fd0e0103370 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e010d330 con 0x7fd0e019e220 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0e6964640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e010d630 con 0x7fd0e01029b0 2024-09-10T23:24:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 0x7fd0e019dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.084+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 0x7fd0e019dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60848/0 (socket says 172.21.15.2:60848) 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2432126626 learned_addr learned my addr 172.21.15.2:0/2432126626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0dffff640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e01029b0 0x7fd0e006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2432126626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e01029b0 msgr2=0x7fd0e006b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e01029b0 0x7fd0e006b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2432126626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e019e220 msgr2=0x7fd0e01a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e019e220 0x7fd0e01a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e019e220 0x7fd0e01a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2432126626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e0197ab0 con 0x7fd0e0103370 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e019e220 0x7fd0e01a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 0x7fd0e019dce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e9f0 tx=0x7fd0d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0dd7fa640 1 -- 172.21.15.2:0/2432126626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400cd80 con 0x7fd0e0103370 2024-09-10T23:24:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0dd7fa640 1 -- 172.21.15.2:0/2432126626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0d40108e0 con 0x7fd0e0103370 2024-09-10T23:24:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0dd7fa640 1 -- 172.21.15.2:0/2432126626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4018980 con 0x7fd0e0103370 2024-09-10T23:24:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.085+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e0197da0 con 0x7fd0e0103370 2024-09-10T23:24:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.086+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e01982a0 con 0x7fd0e0103370 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 Processor -- start 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 -- start start 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6219556f0 con 0x55d6219e6190 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d621944b20 con 0x55d6219e8bd0 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e980f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d621948930 con 0x55d6219e3860 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219e8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60862/0 (socket says 172.21.15.2:60862) 2024-09-10T23:24:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0e4f01640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.089+0000 7fd0dffff640 1 -- 172.21.15.2:0/455213716 learned_addr learned my addr 172.21.15.2:0/455213716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dffff640 1 -- 172.21.15.2:0/455213716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 msgr2=0x55d6219e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dffff640 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dffff640 1 -- 172.21.15.2:0/455213716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 msgr2=0x55d6219eb090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dffff640 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219eb090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dffff640 1 -- 172.21.15.2:0/455213716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62190a530 con 0x55d6219e6190 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dffff640 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219e8580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd0e01014e0 tx=0x7fd0d0031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89c7af0d0285bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0dd7fa640 1 -- 172.21.15.2:0/2432126626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd0d4010430 con 0x7fd0e0103370 2024-09-10T23:24:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0c67fc640 1 -- 172.21.15.2:0/455213716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0035030 con 0x55d6219e6190 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.090+0000 7fd0c67fc640 1 -- 172.21.15.2:0/455213716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0d0040070 con 0x55d6219e6190 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.091+0000 7fd0dd7fa640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b52e0 0x7fd0c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.091+0000 7fd0c67fc640 1 -- 172.21.15.2:0/455213716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0003950 con 0x55d6219e6190 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.091+0000 7fd0dd7fa640 1 -- 172.21.15.2:0/2432126626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd0d40e61a0 con 0x7fd0e0103370 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.091+0000 7fd0e980f740 1 -- 172.21.15.2:0/455213716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 msgr2=0x55d6219e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.091+0000 7fd0e980f740 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219e8580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd0e01014e0 tx=0x7fd0d0031bc0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b52e0 0x7fd0c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b52e0 0x7fd0c80b77a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8005fd0 tx=0x7fd0d8009790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 -- 172.21.15.2:0/455213716 shutdown_connections 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219e8580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 --2- 172.21.15.2:0/455213716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 -- 172.21.15.2:0/455213716 >> 172.21.15.2:0/455213716 conn(0x55d6219de9b0 msgr2=0x55d6219df740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 -- 172.21.15.2:0/455213716 shutdown_connections 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.092+0000 7fd0e980f740 1 -- 172.21.15.2:0/455213716 wait complete. 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.093+0000 7fd0e980f740 1 -- start start 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.093+0000 7fd0e980f740 1 Processor -- start 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219ed510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d62187cab0 con 0x55d6219e6190 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d6218ea730 con 0x55d6219e8bd0 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d6219ebba0 con 0x55d6219e3860 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60868/0 (socket says 172.21.15.2:60868) 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 -- 172.21.15.2:0/1552435622 learned_addr learned my addr 172.21.15.2:0/1552435622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0dffff640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0e980f740 10 client.0 _ll_register_callbacks cb 0x55d62193e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 -- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 msgr2=0x55d6219ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 -- 172.21.15.2:0/1552435622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 msgr2=0x55d6219ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.094+0000 7fd0df7fe640 1 -- 172.21.15.2:0/1552435622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6216a6790 con 0x55d6219e6190 2024-09-10T23:24:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219ed510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ac670 tx=0x7fd0d40acf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b90ba49272aeaae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/1552435622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40e5040 con 0x55d6219e6190 2024-09-10T23:24:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/1552435622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd0d40abbd0 con 0x55d6219e6190 2024-09-10T23:24:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d0040070 con 0x55d6219e6190 2024-09-10T23:24:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/1552435622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd0d40ad070 con 0x55d6219e6190 2024-09-10T23:24:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.095+0000 7fd0e980f740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d62171f620 con 0x55d6219e6190 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/1552435622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0d4096020 con 0x55d6219e6190 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/1552435622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0d40a82c0 con 0x55d6219e6190 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 20 client.15522 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d6219f8780 0x55d6219fab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 4 client.15522 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.096+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d621957640 con 0x55d6219f8780 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.097+0000 7fd0dffff640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d6219f8780 0x55d6219fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.097+0000 7fd0bf7fe640 10 client.15522 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.097+0000 7fd0dffff640 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d6219f8780 0x55d6219fab70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8c02ce7be8c8b0 server_cookie=c526e02de1f7705e in_seq=0 out_seq=0 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.098+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/1552435622 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d621957640 con 0x55d6219f8780 2024-09-10T23:24:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.098+0000 7fd0bf7fe640 10 client.15522 handle_command_reply: tid=0 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.098+0000 7fd0e980f740 1 client.15522 shutdown 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 msgr2=0x55d6219ed510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219ed510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ac670 tx=0x7fd0d40acf10 comp rx=0 tx=0).stop 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 shutdown_connections 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d6219f8780 0x55d6219fab70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e6190 0x55d6219ed510 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0bf7fe640 0 client.15522 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 --2- 172.21.15.2:0/1552435622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 >> 172.21.15.2:0/1552435622 conn(0x55d6219de9b0 msgr2=0x55d6219ddbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 shutdown_connections 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 1 -- 172.21.15.2:0/1552435622 wait complete. 2024-09-10T23:24:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.099+0000 7fd0e980f740 20 client.15522 trim_cache size 0 max 16384 2024-09-10T23:24:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 Processor -- start 2024-09-10T23:24:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 -- start start 2024-09-10T23:24:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 0x55d6219ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e2110 0x55d6219e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e01ac720 con 0x55d6219e3860 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e01ae260 con 0x55d6219e8bd0 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0e980f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e01acdf0 con 0x55d6219e2110 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 0x55d6219ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 0x55d6219ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60882/0 (socket says 172.21.15.2:60882) 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0dffff640 1 -- 172.21.15.2:0/2178143236 learned_addr learned my addr 172.21.15.2:0/2178143236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.128+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e2110 0x55d6219e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2178143236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e2110 msgr2=0x55d6219e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e2110 0x55d6219e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2178143236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 msgr2=0x55d6219ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 0x55d6219ee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0df7fe640 1 -- 172.21.15.2:0/2178143236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6219e28e0 con 0x55d6219e8bd0 2024-09-10T23:24:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0dffff640 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 0x55d6219ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219e2c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e9c0 tx=0x7fd0d4018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f08415e71d704c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.129+0000 7fd0c5ffb640 1 -- 172.21.15.2:0/2178143236 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40e5030 con 0x55d6219e8bd0 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.130+0000 7fd0c5ffb640 1 -- 172.21.15.2:0/2178143236 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0d4096070 con 0x55d6219e8bd0 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.130+0000 7fd0c5ffb640 1 -- 172.21.15.2:0/2178143236 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40a82c0 con 0x55d6219e8bd0 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.130+0000 7fd0e980f740 1 -- 172.21.15.2:0/2178143236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 msgr2=0x55d6219e2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.130+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219e2c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e9c0 tx=0x7fd0d4018420 comp rx=0 tx=0).stop 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 -- 172.21.15.2:0/2178143236 shutdown_connections 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e2110 0x55d6219e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219e2c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2178143236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e3860 0x55d6219ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 -- 172.21.15.2:0/2178143236 >> 172.21.15.2:0/2178143236 conn(0x55d6219de9b0 msgr2=0x55d6219e1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 -- 172.21.15.2:0/2178143236 shutdown_connections 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 -- 172.21.15.2:0/2178143236 wait complete. 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 -- start start 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.131+0000 7fd0e980f740 1 Processor -- start 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 0x55d6219f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219f4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 0x55d6219f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e01adb90 con 0x55d6219e2110 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e01ad4c0 con 0x55d6219e8bd0 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e01aa700 con 0x55d6219e3860 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 0x55d6219f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60898/0 (socket says 172.21.15.2:60898) 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 -- 172.21.15.2:0/2724054169 learned_addr learned my addr 172.21.15.2:0/2724054169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:24:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e4f01640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0e980f740 10 client.0 _ll_register_callbacks cb 0x7fd0d4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 -- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 msgr2=0x55d6219f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 -- 172.21.15.2:0/2724054169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 msgr2=0x55d6219f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.132+0000 7fd0dffff640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0dffff640 1 -- 172.21.15.2:0/2724054169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6219f2e00 con 0x55d6219e2110 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d4096070 con 0x55d6219e2110 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0dffff640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 0x55d6219f3da0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd0d002a460 tx=0x7fd0d0031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8f6ee69139c7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0bf7fe640 10 client.15528 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/2724054169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d005c060 con 0x55d6219e2110 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/2724054169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd0d0005450 con 0x55d6219e2110 2024-09-10T23:24:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/2724054169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd0d0035040 con 0x55d6219e2110 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0e980f740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.133+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d621a65e10 con 0x55d6219e2110 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/2724054169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0d00046c0 con 0x55d6219e2110 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0e980f740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0e980f740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0e980f740 20 client.15528 populate_metadata read hostname 'smithi002' 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d621a662f0 0x55d621a686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0e980f740 4 client.15528 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6219530f0 con 0x55d621a662f0 2024-09-10T23:24:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.134+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d621a662f0 0x55d621a686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.135+0000 7fd0bf7fe640 10 client.15528 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.135+0000 7fd0df7fe640 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d621a662f0 0x55d621a686e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce289401db7b3289 server_cookie=45a788c25d6a1c1f in_seq=0 out_seq=0 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/2724054169 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d6219530f0 con 0x55d621a662f0 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0bf7fe640 10 client.15528 handle_command_reply: tid=0 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 client.15528 shutdown 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 msgr2=0x55d6219f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 0x55d6219f3da0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd0d002a460 tx=0x7fd0d0031780 comp rx=0 tx=0).stop 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 shutdown_connections 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d621a662f0 0x55d621a686e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6219e8bd0 0x55d6219f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6219e3860 0x55d6219f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0bf7fe640 0 client.15528 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 --2- 172.21.15.2:0/2724054169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6219e2110 0x55d6219f3da0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 >> 172.21.15.2:0/2724054169 conn(0x55d6219de9b0 msgr2=0x55d6219e2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 shutdown_connections 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 1 -- 172.21.15.2:0/2724054169 wait complete. 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.142+0000 7fd0e980f740 20 client.15528 trim_cache size 0 max 16384 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:24:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:24:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b52e0 msgr2=0x7fd0c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b52e0 0x7fd0c80b77a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8005fd0 tx=0x7fd0d8009790 comp rx=0 tx=0).stop 2024-09-10T23:24:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 msgr2=0x7fd0e019dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 0x7fd0e019dce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e9f0 tx=0x7fd0d400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 shutdown_connections 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0c80b52e0 0x7fd0c80b77a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e019e220 0x7fd0e01a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e0103370 0x7fd0e019dce0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 --2- 172.21.15.2:0/2432126626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e01029b0 0x7fd0e006b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 >> 172.21.15.2:0/2432126626 conn(0x7fd0e00fd140 msgr2=0x7fd0e0105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 shutdown_connections 2024-09-10T23:24:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:24:59.143+0000 7fd0e6964640 1 -- 172.21.15.2:0/2432126626 wait complete. 2024-09-10T23:24:59.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:24:59.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:24:59 smithi002 ceph-mon[31150]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:25:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:24:59 smithi177 ceph-mon[35760]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:25:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:24:59 smithi154 ceph-mon[35136]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:25:00.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 -- 172.21.15.2:0/3247899254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 msgr2=0x7fb79c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/3247899254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c108c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb790009900 tx=0x7fb79002a410 comp rx=0 tx=0).stop 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 -- 172.21.15.2:0/3247899254 shutdown_connections 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/3247899254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c109150 0x7fb79c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/3247899254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c108c10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/3247899254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb79c102dc0 0x7fb79c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 -- 172.21.15.2:0/3247899254 >> 172.21.15.2:0/3247899254 conn(0x7fb79c0fe870 msgr2=0x7fb79c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 -- 172.21.15.2:0/3247899254 shutdown_connections 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.573+0000 7fb7a1a38640 1 -- 172.21.15.2:0/3247899254 wait complete. 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 Processor -- start 2024-09-10T23:25:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 -- start start 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c102dc0 0x7fb79c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb79c109150 0x7fb79c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c112da0 con 0x7fb79c1087d0 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c112c20 con 0x7fb79c102dc0 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb7a1a38640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c112f20 con 0x7fb79c109150 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb79a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb79a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60926/0 (socket says 172.21.15.2:60926) 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.574+0000 7fb79a7fc640 1 -- 172.21.15.2:0/4039611801 learned_addr learned my addr 172.21.15.2:0/4039611801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb79c109150 0x7fb79c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79affd640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c102dc0 0x7fb79c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79a7fc640 1 -- 172.21.15.2:0/4039611801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb79c109150 msgr2=0x7fb79c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb79c109150 0x7fb79c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79a7fc640 1 -- 172.21.15.2:0/4039611801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c102dc0 msgr2=0x7fb79c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c102dc0 0x7fb79c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79a7fc640 1 -- 172.21.15.2:0/4039611801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c1a76b0 con 0x7fb79c1087d0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79affd640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c102dc0 0x7fb79c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c0759e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb790005940 tx=0x7fb790004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb7a0a36640 1 -- 172.21.15.2:0/4039611801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79003f030 con 0x7fb79c1087d0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79c1a7940 con 0x7fb79c1087d0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.575+0000 7fb7a0a36640 1 -- 172.21.15.2:0/4039611801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb790003aa0 con 0x7fb79c1087d0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.576+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79c1a7e70 con 0x7fb79c1087d0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.577+0000 7fb7a0a36640 1 -- 172.21.15.2:0/4039611801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790035070 con 0x7fb79c1087d0 2024-09-10T23:25:00.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.579+0000 7fb7a0a36640 1 -- 172.21.15.2:0/4039611801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb790003c50 con 0x7fb79c1087d0 2024-09-10T23:25:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 Processor -- start 2024-09-10T23:25:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 -- start start 2024-09-10T23:25:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a0a36640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7840b51b0 0x7fb7840b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc29a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dc290bea0 con 0x558dc29a1d80 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558dc28fb2d0 con 0x558dc29954d0 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.580+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558dc28ff0e0 con 0x558dc2995df0 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb7a0a36640 1 -- 172.21.15.2:0/4039611801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb7901065e0 con 0x7fb79c1087d0 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7840b51b0 0x7fb7840b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:60282/0 (socket says 172.21.15.2:60282) 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 -- 172.21.15.2:0/3352861766 learned_addr learned my addr 172.21.15.2:0/3352861766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 -- 172.21.15.2:0/3352861766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 msgr2=0x558dc29a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 -- 172.21.15.2:0/3352861766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 msgr2=0x558dc29a4170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc29a4170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.581+0000 7fb79affd640 1 -- 172.21.15.2:0/3352861766 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dc2659650 con 0x558dc29954d0 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.582+0000 7fb79affd640 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29958b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00bd40 tx=0x7fb78c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc1faf5117fa4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.582+0000 7fb781ffb640 1 -- 172.21.15.2:0/3352861766 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c004220 con 0x558dc29954d0 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.582+0000 7fb781ffb640 1 -- 172.21.15.2:0/3352861766 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb78c00be30 con 0x558dc29954d0 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.582+0000 7fb781ffb640 1 -- 172.21.15.2:0/3352861766 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c004220 con 0x558dc29954d0 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/3352861766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 msgr2=0x558dc29958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7840b51b0 0x7fb7840b7670 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb79c077560 tx=0x7fb794009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29958b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00bd40 tx=0x7fb78c00f730 comp rx=0 tx=0).stop 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/3352861766 shutdown_connections 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc29a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/3352861766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29958b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/3352861766 >> 172.21.15.2:0/3352861766 conn(0x558dc2993300 msgr2=0x558dc29944a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/3352861766 shutdown_connections 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.583+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/3352861766 wait complete. 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.584+0000 7fb7a3e0d740 1 -- start start 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.584+0000 7fb7a3e0d740 1 Processor -- start 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb79affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb79affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:60292/0 (socket says 172.21.15.2:60292) 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb79a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.585+0000 7fb79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:48184/0 (socket says 172.21.15.2:48184) 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60932/0 (socket says 172.21.15.2:60932) 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79affd640 1 -- 172.21.15.2:0/897186206 learned_addr learned my addr 172.21.15.2:0/897186206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dc275c700 con 0x558dc29a1d80 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558dc2896160 con 0x558dc29954d0 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558dc29a4a00 con 0x558dc2995df0 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79affd640 1 -- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 msgr2=0x558dc299e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79affd640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79affd640 1 -- 172.21.15.2:0/897186206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 msgr2=0x558dc299ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79affd640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79affd640 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dc28c3c90 con 0x558dc29954d0 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.586+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.587+0000 7fb77affd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.587+0000 7fb79affd640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a1570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005d00 tx=0x7fb78c00b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48d836efb2c8111 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.587+0000 7fb7a3e0d740 10 client.0 _ll_register_callbacks cb 0x558dc28af9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.587+0000 7fb77affd640 1 -- 172.21.15.2:0/897186206 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c02a060 con 0x558dc29954d0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.587+0000 7fb77affd640 1 -- 172.21.15.2:0/897186206 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb78c004020 con 0x558dc29954d0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.587+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb78c00be30 con 0x558dc29954d0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb77affd640 1 -- 172.21.15.2:0/897186206 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb78c004220 con 0x558dc29954d0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb7a3e0d740 10 client.25073 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558dc29aff00 con 0x558dc29954d0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb77affd640 1 -- 172.21.15.2:0/897186206 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb78c0038c0 con 0x558dc29954d0 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb7a3e0d740 10 client.25073 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb7a3e0d740 10 client.25073 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:25:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb7a3e0d740 20 client.25073 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.588+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc29b1320 0x558dc29b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.589+0000 7fb7a3e0d740 4 client.25073 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.589+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558dc290ddf0 con 0x558dc29b1320 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.589+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc29b1320 0x558dc29b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.589+0000 7fb77affd640 10 client.25073 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.589+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc29b1320 0x558dc29b3710 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=233870b40ffd5775 server_cookie=4dbe4bccd9cd269a in_seq=0 out_seq=0 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb77affd640 1 -- 172.21.15.2:0/897186206 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558dc290ddf0 con 0x558dc29b1320 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb77affd640 10 client.25073 handle_command_reply: tid=0 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb7a3e0d740 1 client.25073 shutdown 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 msgr2=0x558dc29a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a1570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005d00 tx=0x7fb78c00b880 comp rx=0 tx=0).stop 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 shutdown_connections 2024-09-10T23:25:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.590+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc29b1320 0x558dc29b3710 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb77affd640 0 client.25073 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/897186206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a1570 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 >> 172.21.15.2:0/897186206 conn(0x558dc2993300 msgr2=0x558dc2998ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 shutdown_connections 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/897186206 wait complete. 2024-09-10T23:25:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.591+0000 7fb7a3e0d740 20 client.25073 trim_cache size 0 max 16384 2024-09-10T23:25:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.617+0000 7fb7a3e0d740 1 Processor -- start 2024-09-10T23:25:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.617+0000 7fb7a3e0d740 1 -- start start 2024-09-10T23:25:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.617+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc2992c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.617+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.617+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.617+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1b0210 con 0x558dc29a1d80 2024-09-10T23:25:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1b1d50 con 0x558dc29954d0 2024-09-10T23:25:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1b08e0 con 0x558dc2995df0 2024-09-10T23:25:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60936/0 (socket says 172.21.15.2:60936) 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 -- 172.21.15.2:0/4218371275 learned_addr learned my addr 172.21.15.2:0/4218371275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79affd640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc2992c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 -- 172.21.15.2:0/4218371275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 msgr2=0x558dc299ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 -- 172.21.15.2:0/4218371275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 msgr2=0x558dc2992c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc2992c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 -- 172.21.15.2:0/4218371275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dc2993d80 con 0x558dc29a1d80 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79affd640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc2992c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.618+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299bbd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb794004100 tx=0x7fb794012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12ea7d5f7627d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.619+0000 7fb7817fa640 1 -- 172.21.15.2:0/4218371275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79402a070 con 0x558dc29a1d80 2024-09-10T23:25:00.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.619+0000 7fb7817fa640 1 -- 172.21.15.2:0/4218371275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79401bd20 con 0x558dc29a1d80 2024-09-10T23:25:00.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.619+0000 7fb7817fa640 1 -- 172.21.15.2:0/4218371275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79401ad50 con 0x558dc29a1d80 2024-09-10T23:25:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.619+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/4218371275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 msgr2=0x558dc299bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.619+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299bbd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb794004100 tx=0x7fb794012000 comp rx=0 tx=0).stop 2024-09-10T23:25:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/4218371275 shutdown_connections 2024-09-10T23:25:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc299bbd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc299ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/4218371275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc2992c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/4218371275 >> 172.21.15.2:0/4218371275 conn(0x558dc2993300 msgr2=0x558dc299e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/4218371275 shutdown_connections 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/4218371275 wait complete. 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.620+0000 7fb7a3e0d740 1 -- start start 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 Processor -- start 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc2a17050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1b1680 con 0x558dc29a1d80 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1b0fb0 con 0x558dc29954d0 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1ae1f0 con 0x558dc2995df0 2024-09-10T23:25:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb7a3e0d740 10 client.0 _ll_register_callbacks cb 0x7fb78c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc2a17050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb79affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc2a17050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60950/0 (socket says 172.21.15.2:60950) 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.621+0000 7fb79b7fe640 1 -- 172.21.15.2:0/253042613 learned_addr learned my addr 172.21.15.2:0/253042613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79affd640 1 -- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 msgr2=0x558dc29a6bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79affd640 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a6bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79affd640 1 -- 172.21.15.2:0/253042613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 msgr2=0x558dc2a17050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79affd640 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc2a17050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79affd640 1 -- 172.21.15.2:0/253042613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dc2a17790 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79b7fe640 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc2a17050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb79affd640 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a6610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb78c003ec0 tx=0x7fb78c00b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d38647ccdb962c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb77affd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb77affd640 1 -- 172.21.15.2:0/253042613 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c02a040 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb77affd640 1 -- 172.21.15.2:0/253042613 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb78c005530 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.622+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb79401bd20 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb77affd640 1 -- 172.21.15.2:0/253042613 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb78c034060 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 10 client.25076 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558dc2a1eab0 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb77affd640 1 -- 172.21.15.2:0/253042613 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79401bd20 con 0x558dc29954d0 2024-09-10T23:25:00.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb77affd640 1 -- 172.21.15.2:0/253042613 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb78c037030 con 0x558dc29954d0 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 10 client.25076 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 10 client.25076 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 20 client.25076 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc2a1f170 0x558dc2a21590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 4 client.25076 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.623+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558dc29098a0 con 0x558dc2a1f170 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.624+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc2a1f170 0x558dc2a21590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.624+0000 7fb79a7fc640 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc2a1f170 0x558dc2a21590 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=401f217b7722e6ec server_cookie=ccf49e57ebc03029 in_seq=0 out_seq=0 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.624+0000 7fb77affd640 10 client.25076 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.624+0000 7fb77affd640 1 -- 172.21.15.2:0/253042613 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558dc29098a0 con 0x558dc2a1f170 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.624+0000 7fb77affd640 10 client.25076 handle_command_reply: tid=0 2024-09-10T23:25:00.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.624+0000 7fb7a3e0d740 1 client.25076 shutdown 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 msgr2=0x558dc29a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a6610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb78c003ec0 tx=0x7fb78c00b660 comp rx=0 tx=0).stop 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 shutdown_connections 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558dc2a1f170 0x558dc2a21590 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dc29a1d80 0x558dc2a17050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558dc2995df0 0x558dc29a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 --2- 172.21.15.2:0/253042613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558dc29954d0 0x558dc29a6610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 >> 172.21.15.2:0/253042613 conn(0x558dc2993300 msgr2=0x558dc299fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb77affd640 0 client.25076 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 shutdown_connections 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 1 -- 172.21.15.2:0/253042613 wait complete. 2024-09-10T23:25:00.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.625+0000 7fb7a3e0d740 20 client.25076 trim_cache size 0 max 16384 2024-09-10T23:25:00.630 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:00.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7840b51b0 msgr2=0x7fb7840b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7840b51b0 0x7fb7840b7670 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb79c077560 tx=0x7fb794009500 comp rx=0 tx=0).stop 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 msgr2=0x7fb79c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c0759e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb790005940 tx=0x7fb790004270 comp rx=0 tx=0).stop 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 shutdown_connections 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7840b51b0 0x7fb7840b7670 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb79c109150 0x7fb79c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb79c1087d0 0x7fb79c0759e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 --2- 172.21.15.2:0/4039611801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79c102dc0 0x7fb79c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 >> 172.21.15.2:0/4039611801 conn(0x7fb79c0fe870 msgr2=0x7fb79c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 shutdown_connections 2024-09-10T23:25:00.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:00.626+0000 7fb7a1a38640 1 -- 172.21.15.2:0/4039611801 wait complete. 2024-09-10T23:25:01.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:25:01.651 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:02.096 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:01 smithi002 ceph-mon[31150]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-10T23:25:02.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.209+0000 7f2bf38f3640 1 -- 172.21.15.2:0/1444350150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec103ca0 msgr2=0x7f2bec104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.209+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/1444350150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec103ca0 0x7f2bec104080 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009900 tx=0x7f2be802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 -- 172.21.15.2:0/1444350150 shutdown_connections 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/1444350150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bec10d100 0x7f2bec10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/1444350150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bec1045c0 0x7f2bec10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/1444350150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec103ca0 0x7f2bec104080 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 -- 172.21.15.2:0/1444350150 >> 172.21.15.2:0/1444350150 conn(0x7f2bec0fd700 msgr2=0x7f2bec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 -- 172.21.15.2:0/1444350150 shutdown_connections 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 -- 172.21.15.2:0/1444350150 wait complete. 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 Processor -- start 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.210+0000 7f2bf38f3640 1 -- start start 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf38f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bec103ca0 0x7f2bec10be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf38f3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bec1045c0 0x7f2bec10c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf38f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 0x7f2bec1a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf38f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec112dd0 con 0x7f2bec10d100 2024-09-10T23:25:02.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf38f3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec112c50 con 0x7f2bec1045c0 2024-09-10T23:25:02.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf38f3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec112f50 con 0x7f2bec103ca0 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf1e90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 0x7f2bec1a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf168f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bec103ca0 0x7f2bec10be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bec1045c0 0x7f2bec10c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf1e90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 0x7f2bec1a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59314/0 (socket says 172.21.15.2:59314) 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.211+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3597395811 learned_addr learned my addr 172.21.15.2:0/3597395811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3597395811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bec103ca0 msgr2=0x7f2bec10be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bec103ca0 0x7f2bec10be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3597395811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bec1045c0 msgr2=0x7f2bec10c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bec1045c0 0x7f2bec10c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3597395811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bec1a2770 con 0x7f2bec10d100 2024-09-10T23:25:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 0x7f2bec1a1fa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2be400b970 tx=0x7f2be400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2be27fc640 1 -- 172.21.15.2:0/3597395811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4019070 con 0x7f2bec10d100 2024-09-10T23:25:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2be27fc640 1 -- 172.21.15.2:0/3597395811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2be4014440 con 0x7f2bec10d100 2024-09-10T23:25:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2be27fc640 1 -- 172.21.15.2:0/3597395811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be40075d0 con 0x7f2bec10d100 2024-09-10T23:25:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bec1a2a60 con 0x7f2bec10d100 2024-09-10T23:25:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.212+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bec1ac340 con 0x7f2bec10d100 2024-09-10T23:25:02.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.216+0000 7f2bf5cc8740 1 Processor -- start 2024-09-10T23:25:02.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.216+0000 7f2be27fc640 1 -- 172.21.15.2:0/3597395811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2be400cb40 con 0x7f2bec10d100 2024-09-10T23:25:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.216+0000 7f2bf5cc8740 1 -- start start 2024-09-10T23:25:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e4238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2be27fc640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bd80b52e0 0x7f2bd80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e432170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e399ea0 con 0x55bb9e4234d0 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e3892d0 con 0x55bb9e423df0 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e38d0e0 con 0x55bb9e42fd80 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2be27fc640 1 -- 172.21.15.2:0/3597395811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2be40e5380 con 0x7f2bec10d100 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf1e90640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e432170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf168f640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bd80b52e0 0x7f2bd80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e4238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e4238b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59328/0 (socket says 172.21.15.2:59328) 2024-09-10T23:25:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.217+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/3729242657 learned_addr learned my addr 172.21.15.2:0/3729242657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.218+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3729242657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 msgr2=0x55bb9e42f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.218+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.218+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3729242657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 msgr2=0x55bb9e4238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.218+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e4238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.218+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3729242657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9e0e7650 con 0x55bb9e42fd80 2024-09-10T23:25:02.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.218+0000 7f2bf168f640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bd80b52e0 0x7f2bd80b77a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2be8031440 tx=0x7f2be8005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:02.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.219+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e432170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2be40e2e90 tx=0x7f2be4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfff0c3702fcc0ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:02.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.219+0000 7f2bd77fe640 1 -- 172.21.15.2:0/3729242657 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be404fb00 con 0x55bb9e42fd80 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.219+0000 7f2bd77fe640 1 -- 172.21.15.2:0/3729242657 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2be40930b0 con 0x55bb9e42fd80 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.219+0000 7f2bd77fe640 1 -- 172.21.15.2:0/3729242657 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be404f920 con 0x55bb9e42fd80 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3729242657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 msgr2=0x55bb9e432170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e432170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2be40e2e90 tx=0x7f2be4004a40 comp rx=0 tx=0).stop 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3729242657 shutdown_connections 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e432170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3729242657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e4238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3729242657 >> 172.21.15.2:0/3729242657 conn(0x55bb9e421300 msgr2=0x55bb9e4224a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3729242657 shutdown_connections 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.220+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3729242657 wait complete. 2024-09-10T23:25:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.221+0000 7f2bf5cc8740 1 -- start start 2024-09-10T23:25:02.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.221+0000 7f2bf5cc8740 1 Processor -- start 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.221+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e4234d0 0x55bb9e42f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.221+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.221+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 0x55bb9e42d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e1ea700 con 0x55bb9e42fd80 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 0x55bb9e42d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 0x55bb9e42d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59332/0 (socket says 172.21.15.2:59332) 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3977815856 learned_addr learned my addr 172.21.15.2:0/3977815856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf168f640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e4234d0 0x55bb9e42f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e324160 con 0x55bb9e423df0 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e4329a0 con 0x55bb9e4234d0 2024-09-10T23:25:02.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3977815856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e4234d0 msgr2=0x55bb9e42f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e4234d0 0x55bb9e42f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 msgr2=0x55bb9e42cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf1e90640 1 -- 172.21.15.2:0/3977815856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9e351c90 con 0x55bb9e42fd80 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf5cc8740 10 client.0 _ll_register_callbacks cb 0x55bb9e33d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.222+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb9e39bdf0 con 0x55bb9e42fd80 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 0x55bb9e42d260 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2be40abb90 tx=0x7f2be4014820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b4c4331ed0aea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bd4ff9640 10 client.15555 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/3977815856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be40ab710 con 0x55bb9e42fd80 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/3977815856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2be40b4e60 con 0x55bb9e42fd80 2024-09-10T23:25:02.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/3977815856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2be40b50e0 con 0x55bb9e42fd80 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf5cc8740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bb9e43e0c0 con 0x55bb9e42fd80 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/3977815856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2be40b0100 con 0x55bb9e42fd80 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf5cc8740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf5cc8740 10 client.15555 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf5cc8740 20 client.15555 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.223+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e43f410 0x55bb9e441800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.224+0000 7f2bf5cc8740 4 client.15555 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.224+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb9e3978a0 con 0x55bb9e43f410 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.224+0000 7f2bf168f640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e43f410 0x55bb9e441800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.224+0000 7f2bf168f640 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e43f410 0x55bb9e441800 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1f914eac7b6be9e server_cookie=9e7b884386729dc4 in_seq=0 out_seq=0 2024-09-10T23:25:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.224+0000 7f2bd4ff9640 10 client.15555 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/3977815856 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb9e3978a0 con 0x55bb9e43f410 2024-09-10T23:25:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bd4ff9640 10 client.15555 handle_command_reply: tid=0 2024-09-10T23:25:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 client.15555 shutdown 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 msgr2=0x55bb9e42d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 0x55bb9e42d260 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2be40abb90 tx=0x7f2be4014820 comp rx=0 tx=0).stop 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 shutdown_connections 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e43f410 0x55bb9e441800 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e42fd80 0x55bb9e42d260 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bd4ff9640 0 client.15555 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.225+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3977815856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e4234d0 0x55bb9e42f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.226+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 >> 172.21.15.2:0/3977815856 conn(0x55bb9e421300 msgr2=0x55bb9e426ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.226+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 shutdown_connections 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.226+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3977815856 wait complete. 2024-09-10T23:25:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.226+0000 7f2bf5cc8740 20 client.15555 trim_cache size 0 max 16384 2024-09-10T23:25:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.239+0000 7f2bf5cc8740 1 Processor -- start 2024-09-10T23:25:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 -- start start 2024-09-10T23:25:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e420c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e431170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1b49b0 con 0x55bb9e4234d0 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1b64f0 con 0x55bb9e423df0 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1b5080 con 0x55bb9e42fd80 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf168f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e420c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:49548/0 (socket says 172.21.15.2:49548) 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf168f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e420c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59334/0 (socket says 172.21.15.2:59334) 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/3184655131 learned_addr learned my addr 172.21.15.2:0/3184655131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e431170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/3184655131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 msgr2=0x55bb9e431170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e431170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/3184655131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 msgr2=0x55bb9e420c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e420c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/3184655131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9e42b090 con 0x55bb9e423df0 2024-09-10T23:25:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.240+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e431170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.241+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42e8d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00aa20 tx=0x7f2bdc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4977bbb281a9eb0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.241+0000 7f2bd6ffd640 1 -- 172.21.15.2:0/3184655131 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc004300 con 0x55bb9e423df0 2024-09-10T23:25:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.241+0000 7f2bd6ffd640 1 -- 172.21.15.2:0/3184655131 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bdc0044a0 con 0x55bb9e423df0 2024-09-10T23:25:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.241+0000 7f2bd6ffd640 1 -- 172.21.15.2:0/3184655131 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0035f0 con 0x55bb9e423df0 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3184655131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 msgr2=0x55bb9e42e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42e8d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00aa20 tx=0x7f2bdc004730 comp rx=0 tx=0).stop 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3184655131 shutdown_connections 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e431170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e423df0 0x55bb9e42e8d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/3184655131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e4234d0 0x55bb9e420c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3184655131 >> 172.21.15.2:0/3184655131 conn(0x55bb9e421300 msgr2=0x55bb9e42e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3184655131 shutdown_connections 2024-09-10T23:25:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/3184655131 wait complete. 2024-09-10T23:25:02.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.242+0000 7f2bf5cc8740 1 -- start start 2024-09-10T23:25:02.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 Processor -- start 2024-09-10T23:25:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e4234d0 0x55bb9e437c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 0x55bb9e438170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e428db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1b5e20 con 0x55bb9e423df0 2024-09-10T23:25:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1b5750 con 0x55bb9e4234d0 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1b2990 con 0x55bb9e42fd80 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf5cc8740 10 client.0 _ll_register_callbacks cb 0x7f2bdc00ad80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 0x55bb9e438170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf0e8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 0x55bb9e438170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59342/0 (socket says 172.21.15.2:59342) 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/680536425 learned_addr learned my addr 172.21.15.2:0/680536425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.243+0000 7f2bf1e90640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e428db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/680536425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 msgr2=0x55bb9e428db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e428db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf168f640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e4234d0 0x55bb9e437c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e4234d0 msgr2=0x55bb9e437c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e4234d0 0x55bb9e437c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf0e8e640 1 -- 172.21.15.2:0/680536425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9e4292f0 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf0e8e640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 0x55bb9e438170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc004700 tx=0x7f2bdc004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb37a3c6171b087 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bd4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/680536425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc004300 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb9e394cd0 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.244+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/680536425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2bdc005200 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/680536425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2bdc00aa50 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 10 client.15561 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb9e42a4c0 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/680536425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bb9e394cd0 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/680536425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2bdc01e480 con 0x55bb9e423df0 2024-09-10T23:25:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 10 client.15561 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 10 client.15561 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:25:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 20 client.15561 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e4ad070 0x55bb9e4af460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 4 client.15561 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.245+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb9e30aaa0 con 0x55bb9e4ad070 2024-09-10T23:25:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.246+0000 7f2bf168f640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e4ad070 0x55bb9e4af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.246+0000 7f2bd4ff9640 10 client.15561 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf168f640 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e4ad070 0x55bb9e4af460 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d799c6dc033e1af server_cookie=c9231f6b1d3e34bc in_seq=0 out_seq=0 2024-09-10T23:25:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bd4ff9640 1 -- 172.21.15.2:0/680536425 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb9e30aaa0 con 0x55bb9e4ad070 2024-09-10T23:25:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bd4ff9640 10 client.15561 handle_command_reply: tid=0 2024-09-10T23:25:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 client.15561 shutdown 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 msgr2=0x55bb9e438170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 0x55bb9e438170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc004700 tx=0x7f2bdc004e90 comp rx=0 tx=0).stop 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 shutdown_connections 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb9e42fd80 0x55bb9e428db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55bb9e4ad070 0x55bb9e4af460 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bd4ff9640 0 client.15561 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb9e423df0 0x55bb9e438170 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 --2- 172.21.15.2:0/680536425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb9e4234d0 0x55bb9e437c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.247+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 >> 172.21.15.2:0/680536425 conn(0x55bb9e421300 msgr2=0x55bb9e42e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 shutdown_connections 2024-09-10T23:25:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf5cc8740 1 -- 172.21.15.2:0/680536425 wait complete. 2024-09-10T23:25:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf5cc8740 20 client.15561 trim_cache size 0 max 16384 2024-09-10T23:25:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bd80b52e0 msgr2=0x7f2bd80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bd80b52e0 0x7f2bd80b77a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2be8031440 tx=0x7f2be8005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 msgr2=0x7f2bec1a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.248+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 0x7f2bec1a1fa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2be400b970 tx=0x7f2be400be30 comp rx=0 tx=0).stop 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 shutdown_connections 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2bd80b52e0 0x7f2bd80b77a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bec10d100 0x7f2bec1a1fa0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bec1045c0 0x7f2bec10c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 --2- 172.21.15.2:0/3597395811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bec103ca0 0x7f2bec10be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 >> 172.21.15.2:0/3597395811 conn(0x7f2bec0fd700 msgr2=0x7f2bec10f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 shutdown_connections 2024-09-10T23:25:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:02.249+0000 7f2bf38f3640 1 -- 172.21.15.2:0/3597395811 wait complete. 2024-09-10T23:25:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:01 smithi154 ceph-mon[35136]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-10T23:25:02.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:01 smithi177 ceph-mon[35760]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-10T23:25:02.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:25:03.219 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:03.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 -- 172.21.15.2:0/1402081734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d001076a0 msgr2=0x7f0d00107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 --2- 172.21.15.2:0/1402081734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d001076a0 0x7f0d00107ae0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009900 tx=0x7f0cf402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 -- 172.21.15.2:0/1402081734 shutdown_connections 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 --2- 172.21.15.2:0/1402081734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00108020 0x7f0d0010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 --2- 172.21.15.2:0/1402081734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d001076a0 0x7f0d00107ae0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 --2- 172.21.15.2:0/1402081734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d00101c90 0x7f0d00102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 -- 172.21.15.2:0/1402081734 >> 172.21.15.2:0/1402081734 conn(0x7f0d000fd700 msgr2=0x7f0d000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 -- 172.21.15.2:0/1402081734 shutdown_connections 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.772+0000 7f0d06627640 1 -- 172.21.15.2:0/1402081734 wait complete. 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.773+0000 7f0d06627640 1 Processor -- start 2024-09-10T23:25:03.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.773+0000 7f0d06627640 1 -- start start 2024-09-10T23:25:03.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d06627640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00101c90 0x7f0d00199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d06627640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d001076a0 0x7f0d00199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d06627640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d00108020 0x7f0d0019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d06627640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00111d30 con 0x7f0d00108020 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d001076a0 0x7f0d00199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d001076a0 0x7f0d00199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:54400/0 (socket says 172.21.15.2:54400) 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1684413952 learned_addr learned my addr 172.21.15.2:0/1684413952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00101c90 0x7f0d00199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d04bc4640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d00108020 0x7f0d0019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00111bb0 con 0x7f0d00101c90 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.774+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00111eb0 con 0x7f0d001076a0 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.775+0000 7f0d04bc4640 1 -- 172.21.15.2:0/1684413952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d001076a0 msgr2=0x7f0d00199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.775+0000 7f0d04bc4640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d001076a0 0x7f0d00199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.775+0000 7f0d04bc4640 1 -- 172.21.15.2:0/1684413952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00101c90 msgr2=0x7f0d00199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.775+0000 7f0d04bc4640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00101c90 0x7f0d00199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.775+0000 7f0d04bc4640 1 -- 172.21.15.2:0/1684413952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0019f3f0 con 0x7f0d00108020 2024-09-10T23:25:03.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.775+0000 7f0d04bc4640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d00108020 0x7f0d0019ec20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800e940 tx=0x7f0cf800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.776+0000 7f0cfd7fa640 1 -- 172.21.15.2:0/1684413952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8004d20 con 0x7f0d00108020 2024-09-10T23:25:03.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.776+0000 7f0cfd7fa640 1 -- 172.21.15.2:0/1684413952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf8005020 con 0x7f0d00108020 2024-09-10T23:25:03.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.776+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0019f6e0 con 0x7f0d00108020 2024-09-10T23:25:03.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.776+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d001a5da0 con 0x7f0d00108020 2024-09-10T23:25:03.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.776+0000 7f0cfd7fa640 1 -- 172.21.15.2:0/1684413952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80116d0 con 0x7f0d00108020 2024-09-10T23:25:03.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.779+0000 7f0d089fc740 1 Processor -- start 2024-09-10T23:25:03.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0cfd7fa640 1 -- 172.21.15.2:0/1684413952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0cf800f040 con 0x7f0d00108020 2024-09-10T23:25:03.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 -- start start 2024-09-10T23:25:03.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013db8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c701344ea0 con 0x55c7013db490 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c7013342d0 con 0x55c7013cbb70 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.780+0000 7f0d089fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c7013380e0 con 0x55c7013dbe10 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:49590/0 (socket says 172.21.15.2:49590) 2024-09-10T23:25:03.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1600777044 learned_addr learned my addr 172.21.15.2:0/1600777044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:03.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013db8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1600777044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 msgr2=0x55c7013e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1600777044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 msgr2=0x55c7013db8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013db8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1600777044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c701092650 con 0x55c7013cbb70 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cfd7fa640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ce80b5420 0x7f0ce80b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.781+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013db8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.782+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013cbf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4004730 tx=0x7f0cf40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96180c1db153903 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.782+0000 7f0cfd7fa640 1 -- 172.21.15.2:0/1684413952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0cf80e5870 con 0x7f0d00108020 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.782+0000 7f0ce67fc640 1 -- 172.21.15.2:0/1600777044 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4035050 con 0x55c7013cbb70 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.782+0000 7f0ce67fc640 1 -- 172.21.15.2:0/1600777044 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf40314a0 con 0x55c7013cbb70 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.782+0000 7f0ce67fc640 1 -- 172.21.15.2:0/1600777044 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf403b6c0 con 0x55c7013cbb70 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.782+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ce80b5420 0x7f0ce80b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 -- 172.21.15.2:0/1600777044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 msgr2=0x55c7013cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ce80b5420 0x7f0ce80b78e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0005fd0 tx=0x7f0cf000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013cbf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4004730 tx=0x7f0cf40046c0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 -- 172.21.15.2:0/1600777044 shutdown_connections 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013db8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1600777044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013cbf50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 -- 172.21.15.2:0/1600777044 >> 172.21.15.2:0/1600777044 conn(0x55c7013ce090 msgr2=0x55c7013ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 -- 172.21.15.2:0/1600777044 shutdown_connections 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.783+0000 7f0d089fc740 1 -- 172.21.15.2:0/1600777044 wait complete. 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.784+0000 7f0d089fc740 1 -- start start 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.784+0000 7f0d089fc740 1 Processor -- start 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.784+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013e5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.784+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013e2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59384/0 (socket says 172.21.15.2:59384) 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1203451882 learned_addr learned my addr 172.21.15.2:0/1203451882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c701195700 con 0x55c7013db490 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c7012cf160 con 0x55c7013cbb70 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c7013e5e90 con 0x55c7013dbe10 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0d04bc4640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0d089fc740 10 client.0 _ll_register_callbacks cb 0x55c7012e89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cfffff640 1 -- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 msgr2=0x55c7013e3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cfffff640 1 -- 172.21.15.2:0/1203451882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 msgr2=0x55c7013e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013e2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.785+0000 7f0cfffff640 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7012fcc90 con 0x55c7013cbb70 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013e5610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0004610 tx=0x7f0cf00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c329f376e1dc7e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0cdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1203451882 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0005220 con 0x55c7013cbb70 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1203451882 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0cf00053c0 con 0x55c7013cbb70 2024-09-10T23:25:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cf40314a0 con 0x55c7013cbb70 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1203451882 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0cf00055c0 con 0x55c7013cbb70 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0d089fc740 10 client.25100 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7013d80c0 con 0x55c7013cbb70 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.786+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1203451882 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf40314a0 con 0x55c7013cbb70 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1203451882 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0cf00317f0 con 0x55c7013cbb70 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0d089fc740 10 client.25100 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0d089fc740 10 client.25100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0d089fc740 20 client.25100 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c7013fd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0d089fc740 4 client.25100 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.787+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c701346df0 con 0x55c7013fb540 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.788+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c7013fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.788+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c7013fd980 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d8f9ced28d25c22 server_cookie=93a4384736473e28 in_seq=0 out_seq=0 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.788+0000 7f0cdf7fe640 10 client.25100 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1203451882 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c701346df0 con 0x55c7013fb540 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0cdf7fe640 10 client.25100 handle_command_reply: tid=0 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 client.25100 shutdown 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 msgr2=0x55c7013e5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013e5610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0004610 tx=0x7f0cf00046c0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 shutdown_connections 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c7013fd980 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0cdf7fe640 0 client.25100 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c7013e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013db490 0x55c7013e2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1203451882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013cbb70 0x55c7013e5610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 >> 172.21.15.2:0/1203451882 conn(0x55c7013ce090 msgr2=0x55c7013dddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 shutdown_connections 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 1 -- 172.21.15.2:0/1203451882 wait complete. 2024-09-10T23:25:03.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.789+0000 7f0d089fc740 20 client.25100 trim_cache size 0 max 16384 2024-09-10T23:25:03.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 Processor -- start 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 -- start start 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013cbb70 0x55c7013cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013dbe10 0x55c701403250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00072c30 con 0x55c7013dbe10 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00074770 con 0x55c7013db490 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.816+0000 7f0d089fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00073300 con 0x55c7013cbb70 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cfffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013cbb70 0x55c7013cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cfffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013cbb70 0x55c7013cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:54432/0 (socket says 172.21.15.2:54432) 2024-09-10T23:25:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cfffff640 1 -- 172.21.15.2:0/3721955455 learned_addr learned my addr 172.21.15.2:0/3721955455 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:03.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0d04bc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013dbe10 0x55c701403250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cff7fe640 1 -- 172.21.15.2:0/3721955455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013cbb70 msgr2=0x55c7013cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013cbb70 0x55c7013cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cff7fe640 1 -- 172.21.15.2:0/3721955455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013dbe10 msgr2=0x55c701403250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013dbe10 0x55c701403250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.817+0000 7f0cff7fe640 1 -- 172.21.15.2:0/3721955455 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7013e33b0 con 0x55c7013db490 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.818+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d6c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c7013fe1f0 tx=0x7f0cf4031de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db70d668ac5926ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.818+0000 7f0ce5ffb640 1 -- 172.21.15.2:0/3721955455 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4052070 con 0x55c7013db490 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.818+0000 7f0ce5ffb640 1 -- 172.21.15.2:0/3721955455 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf4005020 con 0x55c7013db490 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.818+0000 7f0ce5ffb640 1 -- 172.21.15.2:0/3721955455 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4035040 con 0x55c7013db490 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 -- 172.21.15.2:0/3721955455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 msgr2=0x55c7013d6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d6c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c7013fe1f0 tx=0x7f0cf4031de0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 -- 172.21.15.2:0/3721955455 shutdown_connections 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013dbe10 0x55c701403250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d6c20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 --2- 172.21.15.2:0/3721955455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013cbb70 0x55c7013cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 -- 172.21.15.2:0/3721955455 >> 172.21.15.2:0/3721955455 conn(0x55c7013ce090 msgr2=0x55c7013ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 -- 172.21.15.2:0/3721955455 shutdown_connections 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 -- 172.21.15.2:0/3721955455 wait complete. 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.819+0000 7f0d089fc740 1 -- start start 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 Processor -- start 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 0x55c7013d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c701467450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d000740a0 con 0x55c7013cbb70 2024-09-10T23:25:03.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d000739d0 con 0x55c7013db490 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d089fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00070c10 con 0x55c7013dbe10 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0cfffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 0x55c7013d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0cfffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 0x55c7013d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59398/0 (socket says 172.21.15.2:59398) 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0cfffff640 1 -- 172.21.15.2:0/1441098333 learned_addr learned my addr 172.21.15.2:0/1441098333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.820+0000 7f0d04bc4640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c701467450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0d089fc740 10 client.0 _ll_register_callbacks cb 0x7f0cf0005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 msgr2=0x55c701467450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c701467450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1441098333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 msgr2=0x55c7013d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 0x55c7013d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cff7fe640 1 -- 172.21.15.2:0/1441098333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c701467a90 con 0x55c7013db490 2024-09-10T23:25:03.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 0x55c7013d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cf4005020 con 0x55c7013db490 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cff7fe640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d2e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55c7013fe1f0 tx=0x7f0cf4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4561a13303b6ff82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cdf7fe640 10 client.25106 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1441098333 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4064050 con 0x55c7013db490 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1441098333 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0cf40053d0 con 0x55c7013db490 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1441098333 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0cf405a070 con 0x55c7013db490 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0d089fc740 10 client.25106 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.821+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c701468c90 con 0x55c7013db490 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1441098333 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0cf40038f0 con 0x55c7013db490 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0d089fc740 10 client.25106 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0d089fc740 10 client.25106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0d089fc740 20 client.25106 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:03.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c70146ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0d089fc740 4 client.25106 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c7013428a0 con 0x55c7013fb540 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.822+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c70146ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.823+0000 7f0cfffff640 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c70146ae70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12b8e04b04378b89 server_cookie=93221f34fdd7453 in_seq=0 out_seq=0 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.823+0000 7f0cdf7fe640 10 client.25106 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.823+0000 7f0cdf7fe640 1 -- 172.21.15.2:0/1441098333 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c7013428a0 con 0x55c7013fb540 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.823+0000 7f0cdf7fe640 10 client.25106 handle_command_reply: tid=0 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.823+0000 7f0d089fc740 1 client.25106 shutdown 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 msgr2=0x55c7013d2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d2e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55c7013fe1f0 tx=0x7f0cf4000bc0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.830 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:03.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 shutdown_connections 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c7013fb540 0x55c70146ae70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0cdf7fe640 0 client.25106 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7013dbe10 0x55c701467450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7013db490 0x55c7013d2e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 --2- 172.21.15.2:0/1441098333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7013cbb70 0x55c7013d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 >> 172.21.15.2:0/1441098333 conn(0x55c7013ce090 msgr2=0x55c7013dd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 shutdown_connections 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 1 -- 172.21.15.2:0/1441098333 wait complete. 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.824+0000 7f0d089fc740 20 client.25106 trim_cache size 0 max 16384 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ce80b5420 msgr2=0x7f0ce80b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ce80b5420 0x7f0ce80b78e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0005fd0 tx=0x7f0cf000b390 comp rx=0 tx=0).stop 2024-09-10T23:25:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d00108020 msgr2=0x7f0d0019ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d00108020 0x7f0d0019ec20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800e940 tx=0x7f0cf800ee00 comp rx=0 tx=0).stop 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 shutdown_connections 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ce80b5420 0x7f0ce80b78e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d00108020 0x7f0d0019ec20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d001076a0 0x7f0d00199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 --2- 172.21.15.2:0/1684413952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00101c90 0x7f0d00199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 >> 172.21.15.2:0/1684413952 conn(0x7f0d000fd700 msgr2=0x7f0d0006a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 shutdown_connections 2024-09-10T23:25:03.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:03.825+0000 7f0d06627640 1 -- 172.21.15.2:0/1684413952 wait complete. 2024-09-10T23:25:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:03 smithi002 ceph-mon[31150]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T23:25:04.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:03 smithi154 ceph-mon[35136]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T23:25:04.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:03 smithi177 ceph-mon[35760]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T23:25:05.668 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:25:05.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:25:05.980 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:06.235 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:05 smithi002 ceph-mon[31150]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T23:25:06.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:05 smithi154 ceph-mon[35136]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T23:25:06.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:05 smithi177 ceph-mon[35760]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 -- 172.21.15.2:0/163519122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe81087d0 msgr2=0x7febe8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 --2- 172.21.15.2:0/163519122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe81087d0 0x7febe8108c10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7febdc009900 tx=0x7febdc02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 -- 172.21.15.2:0/163519122 shutdown_connections 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 --2- 172.21.15.2:0/163519122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe8109150 0x7febe810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 --2- 172.21.15.2:0/163519122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe81087d0 0x7febe8108c10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 --2- 172.21.15.2:0/163519122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febe8102dc0 0x7febe81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.480+0000 7febeda90640 1 -- 172.21.15.2:0/163519122 >> 172.21.15.2:0/163519122 conn(0x7febe80fe830 msgr2=0x7febe8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.481+0000 7febeda90640 1 -- 172.21.15.2:0/163519122 shutdown_connections 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.481+0000 7febeda90640 1 -- 172.21.15.2:0/163519122 wait complete. 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.481+0000 7febeda90640 1 Processor -- start 2024-09-10T23:25:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.481+0000 7febeda90640 1 -- start start 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febeda90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 0x7febe81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febeda90640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe81087d0 0x7febe8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febeda90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febe8109150 0x7febe819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febeda90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febe8112dd0 con 0x7febe8102dc0 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febeda90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febe8112c50 con 0x7febe8109150 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febeda90640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febe8112f50 con 0x7febe81087d0 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 0x7febe81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 0x7febe81992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59412/0 (socket says 172.21.15.2:59412) 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe77fe640 1 -- 172.21.15.2:0/2808491421 learned_addr learned my addr 172.21.15.2:0/2808491421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe6ffd640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe81087d0 0x7febe8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe7fff640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febe8109150 0x7febe819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe6ffd640 1 -- 172.21.15.2:0/2808491421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febe8109150 msgr2=0x7febe819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe6ffd640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febe8109150 0x7febe819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.482+0000 7febe6ffd640 1 -- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 msgr2=0x7febe81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe6ffd640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 0x7febe81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe6ffd640 1 -- 172.21.15.2:0/2808491421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe819f370 con 0x7febe81087d0 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe77fe640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 0x7febe81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe6ffd640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe81087d0 0x7febe8199800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febdc02a930 tx=0x7febdc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe4ff9640 1 -- 172.21.15.2:0/2808491421 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc03f030 con 0x7febe81087d0 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe819f600 con 0x7febe81087d0 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe4ff9640 1 -- 172.21.15.2:0/2808491421 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febdc003aa0 con 0x7febe81087d0 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe8075380 con 0x7febe81087d0 2024-09-10T23:25:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.483+0000 7febe4ff9640 1 -- 172.21.15.2:0/2808491421 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc035070 con 0x7febe81087d0 2024-09-10T23:25:06.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.486+0000 7febefe65740 1 Processor -- start 2024-09-10T23:25:06.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.487+0000 7febefe65740 1 -- start start 2024-09-10T23:25:06.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.487+0000 7febe4ff9640 1 -- 172.21.15.2:0/2808491421 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7febdc03a3c0 con 0x7febe81087d0 2024-09-10T23:25:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.487+0000 7febefe65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d4012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.487+0000 7febefe65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.487+0000 7febefe65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.487+0000 7febefe65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d9d377e60 con 0x563d9d40d790 2024-09-10T23:25:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d4012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d4012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:54484/0 (socket says 172.21.15.2:54484) 2024-09-10T23:25:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe7fff640 1 -- 172.21.15.2:0/2783700941 learned_addr learned my addr 172.21.15.2:0/2783700941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d9d367290 con 0x563d9d401800 2024-09-10T23:25:06.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563d9d36b0a0 con 0x563d9d400ee0 2024-09-10T23:25:06.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe4ff9640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febd00b5360 0x7febd00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe4ff9640 1 -- 172.21.15.2:0/2808491421 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febdc106320 con 0x7febe81087d0 2024-09-10T23:25:06.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe7fff640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febd00b5360 0x7febd00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe77fe640 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.488+0000 7febe6ffd640 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe77fe640 1 -- 172.21.15.2:0/2783700941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 msgr2=0x563d9d4012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe77fe640 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d4012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe77fe640 1 -- 172.21.15.2:0/2783700941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 msgr2=0x563d9d40fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe77fe640 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe77fe640 1 -- 172.21.15.2:0/2783700941 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d9d0c5930 con 0x563d9d401800 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe7fff640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febd00b5360 0x7febd00b7820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7febe0005f40 tx=0x7febe0018f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe6ffd640 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.489+0000 7febe77fe640 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40d250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febd8005fd0 tx=0x7febd800f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4536692fd98f03d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.490+0000 7febcdffb640 1 -- 172.21.15.2:0/2783700941 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd801d070 con 0x563d9d401800 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.490+0000 7febcdffb640 1 -- 172.21.15.2:0/2783700941 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febd8010cf0 con 0x563d9d401800 2024-09-10T23:25:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.490+0000 7febcdffb640 1 -- 172.21.15.2:0/2783700941 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8018e20 con 0x563d9d401800 2024-09-10T23:25:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.491+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 msgr2=0x563d9d40d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.491+0000 7febefe65740 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40d250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febd8005fd0 tx=0x7febd800f810 comp rx=0 tx=0).stop 2024-09-10T23:25:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 shutdown_connections 2024-09-10T23:25:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40d250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 --2- 172.21.15.2:0/2783700941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d4012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 >> 172.21.15.2:0/2783700941 conn(0x563d9d3fed10 msgr2=0x563d9d3ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 shutdown_connections 2024-09-10T23:25:06.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.492+0000 7febefe65740 1 -- 172.21.15.2:0/2783700941 wait complete. 2024-09-10T23:25:06.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 -- start start 2024-09-10T23:25:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 Processor -- start 2024-09-10T23:25:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d9d1c8890 con 0x563d9d40d790 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d9d301d40 con 0x563d9d401800 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563d9d410440 con 0x563d9d400ee0 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.493+0000 7febefe65740 10 client.0 _ll_register_callbacks cb 0x563d9d365c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59436/0 (socket says 172.21.15.2:59436) 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 -- 172.21.15.2:0/326645615 learned_addr learned my addr 172.21.15.2:0/326645615 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe77fe640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe6ffd640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 -- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 msgr2=0x563d9d40a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 -- 172.21.15.2:0/326645615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 msgr2=0x563d9d40ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 -- 172.21.15.2:0/326645615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d9d419800 con 0x563d9d40d790 2024-09-10T23:25:06.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febe7fff640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40b150 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7febe000cb80 tx=0x7febe0018cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804ddc6c6e4f4a5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.494+0000 7febc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:06.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febc6ffd640 1 -- 172.21.15.2:0/326645615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0003970 con 0x563d9d40d790 2024-09-10T23:25:06.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febc6ffd640 1 -- 172.21.15.2:0/326645615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febe0003b10 con 0x563d9d40d790 2024-09-10T23:25:06.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febd8010cf0 con 0x563d9d40d790 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febc6ffd640 1 -- 172.21.15.2:0/326645615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7febe0003d10 con 0x563d9d40d790 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d9d41c1b0 con 0x563d9d40d790 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febc6ffd640 1 -- 172.21.15.2:0/326645615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febd8010cf0 con 0x563d9d40d790 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febc6ffd640 1 -- 172.21.15.2:0/326645615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7febe000f040 con 0x563d9d40d790 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 20 client.15588 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.495+0000 7febefe65740 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d41d720 0x563d9d41fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.496+0000 7febefe65740 4 client.15588 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.496+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d9d379db0 con 0x563d9d41d720 2024-09-10T23:25:06.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.496+0000 7febe77fe640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d41d720 0x563d9d41fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febe77fe640 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d41d720 0x563d9d41fb40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ef304060d5047d8 server_cookie=9651acf0bf1db666 in_seq=0 out_seq=0 2024-09-10T23:25:06.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febc6ffd640 10 client.15588 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:06.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febc6ffd640 1 -- 172.21.15.2:0/326645615 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d9d379db0 con 0x563d9d41d720 2024-09-10T23:25:06.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febc6ffd640 10 client.15588 handle_command_reply: tid=0 2024-09-10T23:25:06.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febefe65740 1 client.15588 shutdown 2024-09-10T23:25:06.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 msgr2=0x563d9d40b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.497+0000 7febefe65740 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40b150 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7febe000cb80 tx=0x7febe0018cf0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 shutdown_connections 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d41d720 0x563d9d41fb40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d40b150 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d40ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 --2- 172.21.15.2:0/326645615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 >> 172.21.15.2:0/326645615 conn(0x563d9d3fed10 msgr2=0x563d9d3fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febc6ffd640 0 client.15588 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:06.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 shutdown_connections 2024-09-10T23:25:06.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 1 -- 172.21.15.2:0/326645615 wait complete. 2024-09-10T23:25:06.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.498+0000 7febefe65740 20 client.15588 trim_cache size 0 max 16384 2024-09-10T23:25:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 Processor -- start 2024-09-10T23:25:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 -- start start 2024-09-10T23:25:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d425410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d425950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febd400e420 con 0x563d9d40d790 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febd400ff60 con 0x563d9d401800 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febefe65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febd400eaf0 con 0x563d9d400ee0 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d425950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febe6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d425410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d425950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59446/0 (socket says 172.21.15.2:59446) 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febe7fff640 1 -- 172.21.15.2:0/784308014 learned_addr learned my addr 172.21.15.2:0/784308014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.516+0000 7febe77fe640 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe7fff640 1 -- 172.21.15.2:0/784308014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 msgr2=0x563d9d40c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe7fff640 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe7fff640 1 -- 172.21.15.2:0/784308014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 msgr2=0x563d9d425410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe7fff640 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d425410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe7fff640 1 -- 172.21.15.2:0/784308014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d9d3ff790 con 0x563d9d40d790 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe6ffd640 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d425410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febe7fff640 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d425950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7febe000c6a0 tx=0x7febe000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d80788bc4f5bca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febcd7fa640 1 -- 172.21.15.2:0/784308014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe003f070 con 0x563d9d40d790 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febcd7fa640 1 -- 172.21.15.2:0/784308014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febe0022040 con 0x563d9d40d790 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.517+0000 7febcd7fa640 1 -- 172.21.15.2:0/784308014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0005410 con 0x563d9d40d790 2024-09-10T23:25:06.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 -- 172.21.15.2:0/784308014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 msgr2=0x563d9d425950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d425950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7febe000c6a0 tx=0x7febe000ce80 comp rx=0 tx=0).stop 2024-09-10T23:25:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 -- 172.21.15.2:0/784308014 shutdown_connections 2024-09-10T23:25:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d425950 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d425410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 --2- 172.21.15.2:0/784308014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d40c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 -- 172.21.15.2:0/784308014 >> 172.21.15.2:0/784308014 conn(0x563d9d3fed10 msgr2=0x563d9d40bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.518+0000 7febefe65740 1 -- 172.21.15.2:0/784308014 shutdown_connections 2024-09-10T23:25:06.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.519+0000 7febefe65740 1 -- 172.21.15.2:0/784308014 wait complete. 2024-09-10T23:25:06.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.519+0000 7febefe65740 1 -- start start 2024-09-10T23:25:06.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.519+0000 7febefe65740 1 Processor -- start 2024-09-10T23:25:06.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febefe65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d415dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febefe65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d4122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febefe65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d4127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febefe65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febd400f890 con 0x563d9d40d790 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febefe65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febd400f1c0 con 0x563d9d401800 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febefe65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febd400c400 con 0x563d9d400ee0 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febe77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d415dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febe77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d415dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:54508/0 (socket says 172.21.15.2:54508) 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febe77fe640 1 -- 172.21.15.2:0/3937347859 learned_addr learned my addr 172.21.15.2:0/3937347859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febe7fff640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d4127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.520+0000 7febe6ffd640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d4122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febefe65740 10 client.0 _ll_register_callbacks cb 0x7febe0004e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe77fe640 1 -- 172.21.15.2:0/3937347859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 msgr2=0x563d9d4122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe77fe640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d4122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe77fe640 1 -- 172.21.15.2:0/3937347859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 msgr2=0x563d9d4127f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:06.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe77fe640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d4127f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe77fe640 1 -- 172.21.15.2:0/3937347859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d9d412f30 con 0x563d9d400ee0 2024-09-10T23:25:06.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe7fff640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d4127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:06.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febe77fe640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d415dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febd80188f0 tx=0x7febd800abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f4cc64635a980c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:25:06.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febc6ffd640 1 -- 172.21.15.2:0/3937347859 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd801d040 con 0x563d9d400ee0 2024-09-10T23:25:06.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.521+0000 7febc6ffd640 1 -- 172.21.15.2:0/3937347859 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febd8018c30 con 0x563d9d400ee0 2024-09-10T23:25:06.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.522+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe0022040 con 0x563d9d400ee0 2024-09-10T23:25:06.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.522+0000 7febc6ffd640 1 -- 172.21.15.2:0/3937347859 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7febd8018e50 con 0x563d9d400ee0 2024-09-10T23:25:06.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.522+0000 7febefe65740 10 client.25192 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:06.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.522+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d9d48b590 con 0x563d9d400ee0 2024-09-10T23:25:06.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.522+0000 7febc6ffd640 1 -- 172.21.15.2:0/3937347859 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febe0022040 con 0x563d9d400ee0 2024-09-10T23:25:06.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febc6ffd640 1 -- 172.21.15.2:0/3937347859 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7febd802d070 con 0x563d9d400ee0 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febefe65740 10 client.25192 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febefe65740 10 client.25192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febefe65740 20 client.25192 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febefe65740 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d48bb50 0x563d9d48df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febefe65740 4 client.25192 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d9d375860 con 0x563d9d48bb50 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.523+0000 7febe6ffd640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d48bb50 0x563d9d48df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.524+0000 7febe6ffd640 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d48bb50 0x563d9d48df70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=717695e1fafbb5f5 server_cookie=d4fee24a7f7cf401 in_seq=0 out_seq=0 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.524+0000 7febc6ffd640 10 client.25192 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.525+0000 7febc6ffd640 1 -- 172.21.15.2:0/3937347859 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d9d375860 con 0x563d9d48bb50 2024-09-10T23:25:06.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.525+0000 7febc6ffd640 10 client.25192 handle_command_reply: tid=0 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.525+0000 7febefe65740 1 client.25192 shutdown 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 msgr2=0x563d9d415dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d415dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febd80188f0 tx=0x7febd800abe0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 shutdown_connections 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563d9d48bb50 0x563d9d48df70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d9d40d790 0x563d9d4127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febc6ffd640 0 client.25192 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d9d401800 0x563d9d4122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 --2- 172.21.15.2:0/3937347859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563d9d400ee0 0x563d9d415dd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 >> 172.21.15.2:0/3937347859 conn(0x563d9d3fed10 msgr2=0x563d9d418ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 shutdown_connections 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 1 -- 172.21.15.2:0/3937347859 wait complete. 2024-09-10T23:25:06.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.526+0000 7febefe65740 20 client.25192 trim_cache size 0 max 16384 2024-09-10T23:25:06.539 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:25:06.539 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:25:06.539 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "d286be0d-7f8e-4b41-8c4c-3ae5cc460094", 2024-09-10T23:25:06.539 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:25:06.539 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febd00b5360 msgr2=0x7febd00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febd00b5360 0x7febd00b7820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7febe0005f40 tx=0x7febe0018f70 comp rx=0 tx=0).stop 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe81087d0 msgr2=0x7febe8199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe81087d0 0x7febe8199800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febdc02a930 tx=0x7febdc004270 comp rx=0 tx=0).stop 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 shutdown_connections 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febd00b5360 0x7febd00b7820 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febe8109150 0x7febe819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febe81087d0 0x7febe8199800 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febdc02a930 tx=0x7febdc004270 comp rx=0 tx=0).stop 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 --2- 172.21.15.2:0/2808491421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febe8102dc0 0x7febe81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.527+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 >> 172.21.15.2:0/2808491421 conn(0x7febe80fe830 msgr2=0x7febe8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.528+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 shutdown_connections 2024-09-10T23:25:06.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:06.528+0000 7febeda90640 1 -- 172.21.15.2:0/2808491421 wait complete. 2024-09-10T23:25:07.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:25:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:08.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:07 smithi002 ceph-mon[31150]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T23:25:08.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:07 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:25:08.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:08.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:07 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:25:08.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:07 smithi154 ceph-mon[35136]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T23:25:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:07 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:25:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:07 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:25:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:08.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.298+0000 7fca8db72640 1 -- 172.21.15.2:0/159077125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca88101c90 msgr2=0x7fca88102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.298+0000 7fca8db72640 1 --2- 172.21.15.2:0/159077125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca88101c90 0x7fca88102070 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fca78009900 tx=0x7fca7802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:08.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 -- 172.21.15.2:0/159077125 shutdown_connections 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 --2- 172.21.15.2:0/159077125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88108020 0x7fca8810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 --2- 172.21.15.2:0/159077125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca881076a0 0x7fca88107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 --2- 172.21.15.2:0/159077125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca88101c90 0x7fca88102070 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 -- 172.21.15.2:0/159077125 >> 172.21.15.2:0/159077125 conn(0x7fca880fd700 msgr2=0x7fca880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 -- 172.21.15.2:0/159077125 shutdown_connections 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 -- 172.21.15.2:0/159077125 wait complete. 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.299+0000 7fca8db72640 1 Processor -- start 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 -- start start 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 0x7fca88074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 0x7fca8806fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca88108020 0x7fca8806ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca88111d30 con 0x7fca881076a0 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 0x7fca8806fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 0x7fca88074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 0x7fca88074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:54524/0 (socket says 172.21.15.2:54524) 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 0x7fca8806fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59488/0 (socket says 172.21.15.2:59488) 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca877fe640 1 -- 172.21.15.2:0/2099865414 learned_addr learned my addr 172.21.15.2:0/2099865414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca88111bb0 con 0x7fca88108020 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.300+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca88111eb0 con 0x7fca88101c90 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca87fff640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca88108020 0x7fca8806ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca877fe640 1 -- 172.21.15.2:0/2099865414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca88108020 msgr2=0x7fca8806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca877fe640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca88108020 0x7fca8806ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca877fe640 1 -- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 msgr2=0x7fca8806fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca877fe640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 0x7fca8806fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca877fe640 1 -- 172.21.15.2:0/2099865414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca88070520 con 0x7fca88101c90 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 0x7fca8806fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca877fe640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 0x7fca88074ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca78005ab0 tx=0x7fca7803ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca84ff9640 1 -- 172.21.15.2:0/2099865414 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78035070 con 0x7fca88101c90 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca84ff9640 1 -- 172.21.15.2:0/2099865414 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca78003cb0 con 0x7fca88101c90 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.301+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca880707b0 con 0x7fca88101c90 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.302+0000 7fca84ff9640 1 -- 172.21.15.2:0/2099865414 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca780433c0 con 0x7fca88101c90 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.302+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8806da30 con 0x7fca88101c90 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.304+0000 7fca8ff47740 1 Processor -- start 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 -- start start 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e012828e50 con 0x55e0128b2480 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e012818280 con 0x55e0128bed30 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca8ff47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e01281c090 con 0x55e0128b2da0 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca87fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca86ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca87fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59492/0 (socket says 172.21.15.2:59492) 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca87fff640 1 -- 172.21.15.2:0/2282812213 learned_addr learned my addr 172.21.15.2:0/2282812213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca86ffd640 1 -- 172.21.15.2:0/2282812213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 msgr2=0x55e0128be7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128be7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.305+0000 7fca86ffd640 1 -- 172.21.15.2:0/2282812213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 msgr2=0x55e0128b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca86ffd640 1 -- 172.21.15.2:0/2282812213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e012576650 con 0x55e0128bed30 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca87fff640 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca84ff9640 1 -- 172.21.15.2:0/2099865414 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fca78003800 con 0x7fca88101c90 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c1120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00bfb0 tx=0x7fca7c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6ba414401406876 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca6dffb640 1 -- 172.21.15.2:0/2282812213 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004220 con 0x55e0128bed30 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca6dffb640 1 -- 172.21.15.2:0/2282812213 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca7c0043c0 con 0x55e0128bed30 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.306+0000 7fca6dffb640 1 -- 172.21.15.2:0/2282812213 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0119e0 con 0x55e0128bed30 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca84ff9640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b52e0 0x7fca700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca87fff640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b52e0 0x7fca700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 -- 172.21.15.2:0/2282812213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 msgr2=0x55e0128c1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca84ff9640 1 -- 172.21.15.2:0/2099865414 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fca78109ff0 con 0x7fca88101c90 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c1120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00bfb0 tx=0x7fca7c010860 comp rx=0 tx=0).stop 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 -- 172.21.15.2:0/2282812213 shutdown_connections 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c1120 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128be7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2282812213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 -- 172.21.15.2:0/2282812213 >> 172.21.15.2:0/2282812213 conn(0x55e0128b02b0 msgr2=0x55e0128b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 -- 172.21.15.2:0/2282812213 shutdown_connections 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.307+0000 7fca8ff47740 1 -- 172.21.15.2:0/2282812213 wait complete. 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.308+0000 7fca87fff640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b52e0 0x7fca700b77a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fca80005f40 tx=0x7fca80009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.308+0000 7fca8ff47740 1 -- start start 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.308+0000 7fca8ff47740 1 Processor -- start 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.308+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.308+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.308+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128bc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca8ff47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e012679700 con 0x55e0128b2480 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca8ff47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e0127b3110 con 0x55e0128bed30 2024-09-10T23:25:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca8ff47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0128c19b0 con 0x55e0128b2da0 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca8ff47740 10 client.0 _ll_register_callbacks cb 0x55e0127cc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128be6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59506/0 (socket says 172.21.15.2:59506) 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca877fe640 1 -- 172.21.15.2:0/283961657 learned_addr learned my addr 172.21.15.2:0/283961657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca87fff640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128bc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 -- 172.21.15.2:0/283961657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 msgr2=0x55e0128bc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128bc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 -- 172.21.15.2:0/283961657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 msgr2=0x55e0128be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 -- 172.21.15.2:0/283961657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0127e0c40 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca87fff640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128bc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca877fe640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca86ffd640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bbaf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca7c003f90 tx=0x7fca7c004230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6159b1ca09e96e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.309+0000 7fca66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca66ffd640 1 -- 172.21.15.2:0/283961657 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c02a060 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca66ffd640 1 -- 172.21.15.2:0/283961657 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fca7c005450 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7c0043c0 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca66ffd640 1 -- 172.21.15.2:0/283961657 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca7c005650 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca8ff47740 10 client.25201 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0128cd360 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.310+0000 7fca66ffd640 1 -- 172.21.15.2:0/283961657 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca7c0043c0 con 0x55e0128b2da0 2024-09-10T23:25:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca66ffd640 1 -- 172.21.15.2:0/283961657 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca7c003af0 con 0x55e0128b2da0 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca8ff47740 10 client.25201 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca8ff47740 10 client.25201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca8ff47740 20 client.25201 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca8ff47740 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0128cebd0 0x55e0128d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca8ff47740 4 client.25201 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e01282ada0 con 0x55e0128cebd0 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.311+0000 7fca877fe640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0128cebd0 0x55e0128d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca877fe640 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0128cebd0 0x55e0128d1030 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd37fce6d8b0615 server_cookie=3e08d27072407e7 in_seq=0 out_seq=0 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca66ffd640 10 client.25201 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca66ffd640 1 -- 172.21.15.2:0/283961657 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e01282ada0 con 0x55e0128cebd0 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca66ffd640 10 client.25201 handle_command_reply: tid=0 2024-09-10T23:25:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca8ff47740 1 client.25201 shutdown 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 msgr2=0x55e0128bbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.312+0000 7fca8ff47740 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bbaf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca7c003f90 tx=0x7fca7c004230 comp rx=0 tx=0).stop 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 shutdown_connections 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0128cebd0 0x55e0128d1030 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128bc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bbaf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 --2- 172.21.15.2:0/283961657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 >> 172.21.15.2:0/283961657 conn(0x55e0128b02b0 msgr2=0x55e0128b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca66ffd640 0 client.25201 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 shutdown_connections 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 1 -- 172.21.15.2:0/283961657 wait complete. 2024-09-10T23:25:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.313+0000 7fca8ff47740 20 client.25201 trim_cache size 0 max 16384 2024-09-10T23:25:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 Processor -- start 2024-09-10T23:25:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 -- start start 2024-09-10T23:25:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca881b48c0 con 0x55e0128b2480 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca881b6400 con 0x55e0128bed30 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca8ff47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca881b4f90 con 0x55e0128b2da0 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59520/0 (socket says 172.21.15.2:59520) 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca877fe640 1 -- 172.21.15.2:0/3758195186 learned_addr learned my addr 172.21.15.2:0/3758195186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.335+0000 7fca86ffd640 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca87fff640 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca877fe640 1 -- 172.21.15.2:0/3758195186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 msgr2=0x55e0128d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca877fe640 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca877fe640 1 -- 172.21.15.2:0/3758195186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 msgr2=0x55e0128afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca877fe640 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca877fe640 1 -- 172.21.15.2:0/3758195186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0128b2bd0 con 0x55e0128b2480 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca877fe640 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128cabe0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca780cd9f0 tx=0x7fca78000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f1cd88bc14ee0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca6d7fa640 1 -- 172.21.15.2:0/3758195186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca780cfef0 con 0x55e0128b2480 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca6d7fa640 1 -- 172.21.15.2:0/3758195186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca780d0290 con 0x55e0128b2480 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.336+0000 7fca6d7fa640 1 -- 172.21.15.2:0/3758195186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78003e60 con 0x55e0128b2480 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 -- 172.21.15.2:0/3758195186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 msgr2=0x55e0128cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128cabe0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca780cd9f0 tx=0x7fca78000bc0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 -- 172.21.15.2:0/3758195186 shutdown_connections 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 --2- 172.21.15.2:0/3758195186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128cabe0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 -- 172.21.15.2:0/3758195186 >> 172.21.15.2:0/3758195186 conn(0x55e0128b02b0 msgr2=0x55e0128ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 -- 172.21.15.2:0/3758195186 shutdown_connections 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 -- 172.21.15.2:0/3758195186 wait complete. 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.337+0000 7fca8ff47740 1 -- start start 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 Processor -- start 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca881b5d30 con 0x55e0128b2480 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca881b5660 con 0x55e0128bed30 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca881b28a0 con 0x55e0128b2da0 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca8ff47740 10 client.0 _ll_register_callbacks cb 0x7fca80009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59534/0 (socket says 172.21.15.2:59534) 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 -- 172.21.15.2:0/2791015075 learned_addr learned my addr 172.21.15.2:0/2791015075 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca87fff640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 -- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 msgr2=0x55e0128bfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 -- 172.21.15.2:0/2791015075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 msgr2=0x55e0128c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.338+0000 7fca877fe640 1 -- 172.21.15.2:0/2791015075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0128c5e90 con 0x55e0128b2480 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca877fe640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128bf720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fca780ccd00 tx=0x7fca78031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef25e2f38424c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca66ffd640 1 -- 172.21.15.2:0/2791015075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca780cfef0 con 0x55e0128b2480 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca66ffd640 1 -- 172.21.15.2:0/2791015075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fca780d9880 con 0x55e0128b2480 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca780d0290 con 0x55e0128b2480 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca66ffd640 1 -- 172.21.15.2:0/2791015075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca780d0780 con 0x55e0128b2480 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca8ff47740 10 client.15612 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.339+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0128c71a0 con 0x55e0128b2480 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca66ffd640 1 -- 172.21.15.2:0/2791015075 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca780d0290 con 0x55e0128b2480 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca66ffd640 1 -- 172.21.15.2:0/2791015075 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca78080020 con 0x55e0128b2480 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca8ff47740 10 client.15612 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca8ff47740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca8ff47740 20 client.15612 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e01294cb50 0x55e01294ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca8ff47740 4 client.15612 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e012826850 con 0x55e01294cb50 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.340+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e01294cb50 0x55e01294ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca66ffd640 10 client.15612 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca86ffd640 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e01294cb50 0x55e01294ef40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203b82f445375ae4 server_cookie=c18f370abc939f91 in_seq=0 out_seq=0 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca66ffd640 1 -- 172.21.15.2:0/2791015075 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55e012826850 con 0x55e01294cb50 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca66ffd640 10 client.15612 handle_command_reply: tid=0 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 client.15612 shutdown 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 msgr2=0x55e0128bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128bf720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fca780ccd00 tx=0x7fca78031880 comp rx=0 tx=0).stop 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 shutdown_connections 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e01294cb50 0x55e01294ef40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0128bed30 0x55e0128c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0128b2da0 0x55e0128bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca66ffd640 0 client.15612 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 --2- 172.21.15.2:0/2791015075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0128b2480 0x55e0128bf720 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 >> 172.21.15.2:0/2791015075 conn(0x55e0128b02b0 msgr2=0x55e0128bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 shutdown_connections 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 1 -- 172.21.15.2:0/2791015075 wait complete. 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.341+0000 7fca8ff47740 20 client.15612 trim_cache size 0 max 16384 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b52e0 msgr2=0x7fca700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b52e0 0x7fca700b77a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fca80005f40 tx=0x7fca80009600 comp rx=0 tx=0).stop 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 msgr2=0x7fca88074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 0x7fca88074ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca78005ab0 tx=0x7fca7803ad50 comp rx=0 tx=0).stop 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 shutdown_connections 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca700b52e0 0x7fca700b77a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca88108020 0x7fca8806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca881076a0 0x7fca8806fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 --2- 172.21.15.2:0/2099865414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca88101c90 0x7fca88074ac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 >> 172.21.15.2:0/2099865414 conn(0x7fca880fd700 msgr2=0x7fca880ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 shutdown_connections 2024-09-10T23:25:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:08.342+0000 7fca8db72640 1 -- 172.21.15.2:0/2099865414 wait complete. 2024-09-10T23:25:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:07 smithi177 ceph-mon[35760]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T23:25:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:07 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:25:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:07 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:25:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:09.175 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:25:09.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:25:09.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:08 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:25:09.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:08 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:25:09.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:08 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:25:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 -- 172.21.15.2:0/112685926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9701087f0 msgr2=0x7fd970108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 --2- 172.21.15.2:0/112685926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9701087f0 0x7fd970108c30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd958009900 tx=0x7fd95802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 -- 172.21.15.2:0/112685926 shutdown_connections 2024-09-10T23:25:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 --2- 172.21.15.2:0/112685926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd970109170 0x7fd97010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 --2- 172.21.15.2:0/112685926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9701087f0 0x7fd970108c30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 --2- 172.21.15.2:0/112685926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd970102de0 0x7fd9701031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 -- 172.21.15.2:0/112685926 >> 172.21.15.2:0/112685926 conn(0x7fd9700fe830 msgr2=0x7fd970100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 -- 172.21.15.2:0/112685926 shutdown_connections 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.006+0000 7fd974d17640 1 -- 172.21.15.2:0/112685926 wait complete. 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 Processor -- start 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 -- start start 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd970102de0 0x7fd970199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9701087f0 0x7fd970199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 0x7fd97019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd970112df0 con 0x7fd970109170 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd970112c70 con 0x7fd9701087f0 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd974d17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd970112f70 con 0x7fd970102de0 2024-09-10T23:25:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.007+0000 7fd96ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 0x7fd97019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 0x7fd97019ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59556/0 (socket says 172.21.15.2:59556) 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 -- 172.21.15.2:0/4103551401 learned_addr learned my addr 172.21.15.2:0/4103551401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96e59c640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd970102de0 0x7fd970199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96dd9b640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9701087f0 0x7fd970199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 -- 172.21.15.2:0/4103551401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd970102de0 msgr2=0x7fd970199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd970102de0 0x7fd970199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 -- 172.21.15.2:0/4103551401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9701087f0 msgr2=0x7fd970199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9701087f0 0x7fd970199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 -- 172.21.15.2:0/4103551401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97019f3d0 con 0x7fd970109170 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd96ed9d640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 0x7fd97019ec00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd96800eaa0 tx=0x7fd96800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800cdb0 con 0x7fd970109170 2024-09-10T23:25:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd968005020 con 0x7fd970109170 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680116d0 con 0x7fd970109170 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97019f6c0 con 0x7fd970109170 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.008+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9701a5f50 con 0x7fd970109170 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.010+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd970104090 con 0x7fd970109170 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.011+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd96800f040 con 0x7fd970109170 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.012+0000 7fd9677fe640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd95c0b5360 0x7fd95c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.012+0000 7fd96e59c640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd95c0b5360 0x7fd95c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.012+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd9680e5930 con 0x7fd970109170 2024-09-10T23:25:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.013+0000 7fd96e59c640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd95c0b5360 0x7fd95c0b7820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd960005d00 tx=0x7fd96000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.016+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd968016030 con 0x7fd970109170 2024-09-10T23:25:10.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:09 smithi002 ceph-mon[31150]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-10T23:25:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.240+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd97010af50 con 0x7fd970109170 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.240+0000 7fd9677fe640 1 -- 172.21.15.2:0/4103551401 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fd9680ac800 con 0x7fd970109170 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd95c0b5360 msgr2=0x7fd95c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd95c0b5360 0x7fd95c0b7820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd960005d00 tx=0x7fd96000b410 comp rx=0 tx=0).stop 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 msgr2=0x7fd97019ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 0x7fd97019ec00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd96800eaa0 tx=0x7fd96800ef60 comp rx=0 tx=0).stop 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 shutdown_connections 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd95c0b5360 0x7fd95c0b7820 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd970109170 0x7fd97019ec00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9701087f0 0x7fd970199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 --2- 172.21.15.2:0/4103551401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd970102de0 0x7fd970199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 >> 172.21.15.2:0/4103551401 conn(0x7fd9700fe830 msgr2=0x7fd970100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 shutdown_connections 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:10.243+0000 7fd974d17640 1 -- 172.21.15.2:0/4103551401 wait complete. 2024-09-10T23:25:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:09 smithi154 ceph-mon[35136]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-10T23:25:10.365 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:09 smithi177 ceph-mon[35760]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-10T23:25:11.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4103551401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4103551401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:11.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:25:11.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4103551401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:12.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:11 smithi002 ceph-mon[31150]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-10T23:25:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 -- 172.21.15.2:0/3546408831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 msgr2=0x7fbb38102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/3546408831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb38102e30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009930 tx=0x7fbb2802a420 comp rx=0 tx=0).stop 2024-09-10T23:25:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 -- 172.21.15.2:0/3546408831 shutdown_connections 2024-09-10T23:25:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/3546408831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb38103370 0x7fbb38109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/3546408831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb38102e30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/3546408831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb38101860 0x7fbb38101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 -- 172.21.15.2:0/3546408831 >> 172.21.15.2:0/3546408831 conn(0x7fbb380fd140 msgr2=0x7fbb380ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 -- 172.21.15.2:0/3546408831 shutdown_connections 2024-09-10T23:25:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.237+0000 7fbb3fc40640 1 -- 172.21.15.2:0/3546408831 wait complete. 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 Processor -- start 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 -- start start 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb38101860 0x7fbb38197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb381982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb38103370 0x7fbb38198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d500 con 0x7fbb381029b0 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d380 con 0x7fbb38103370 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3fc40640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d680 con 0x7fbb38101860 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3d1db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb381982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3d1db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb381982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37550/0 (socket says 172.21.15.2:37550) 2024-09-10T23:25:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3d1db640 1 -- 172.21.15.2:0/4019779077 learned_addr learned my addr 172.21.15.2:0/4019779077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb38101860 0x7fbb38197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.238+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb38103370 0x7fbb38198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3d1db640 1 -- 172.21.15.2:0/4019779077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb38101860 msgr2=0x7fbb38197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb38101860 0x7fbb38197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3d1db640 1 -- 172.21.15.2:0/4019779077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb38103370 msgr2=0x7fbb38198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb38103370 0x7fbb38198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3d1db640 1 -- 172.21.15.2:0/4019779077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb381997d0 con 0x7fbb381029b0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb381982e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbb28031500 tx=0x7fbb28003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb2effd640 1 -- 172.21.15.2:0/4019779077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2803f070 con 0x7fbb381029b0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb2effd640 1 -- 172.21.15.2:0/4019779077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb28003e70 con 0x7fbb381029b0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb2effd640 1 -- 172.21.15.2:0/4019779077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28035030 con 0x7fbb381029b0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb38199a60 con 0x7fbb381029b0 2024-09-10T23:25:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.239+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3819ffb0 con 0x7fbb381029b0 2024-09-10T23:25:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.243+0000 7fbb2effd640 1 -- 172.21.15.2:0/4019779077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fbb2803b460 con 0x7fbb381029b0 2024-09-10T23:25:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.243+0000 7fbb42a12740 1 Processor -- start 2024-09-10T23:25:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.243+0000 7fbb42a12740 1 -- start start 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec52c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec55580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afec58090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb42a12740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559afebc26f0 con 0x559afec53190 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb42a12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559afebb1b20 con 0x559afec50860 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb42a12740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559afebb5930 con 0x559afec55bd0 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec55580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d1db640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afec58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec55580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37552/0 (socket says 172.21.15.2:37552) 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/1427479920 learned_addr learned my addr 172.21.15.2:0/1427479920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec52c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/1427479920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 msgr2=0x559afec58090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afec58090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/1427479920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 msgr2=0x559afec52c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec52c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/1427479920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559afeb77530 con 0x559afec53190 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afec58090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec52c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.244+0000 7fbb2effd640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbb240b5360 0x7fbb240b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.245+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec55580 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400aba0 tx=0x7fbb3400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549a4ddb6a7479a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.245+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbb240b5360 0x7fbb240b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.245+0000 7fbb2effd640 1 -- 172.21.15.2:0/4019779077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbb28106a30 con 0x7fbb381029b0 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.245+0000 7fbb23fff640 1 -- 172.21.15.2:0/1427479920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3401d070 con 0x559afec53190 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.245+0000 7fbb23fff640 1 -- 172.21.15.2:0/1427479920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3400ae10 con 0x559afec53190 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.245+0000 7fbb23fff640 1 -- 172.21.15.2:0/1427479920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340188b0 con 0x559afec53190 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 -- 172.21.15.2:0/1427479920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 msgr2=0x559afec55580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec55580 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400aba0 tx=0x7fbb3400f920 comp rx=0 tx=0).stop 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbb240b5360 0x7fbb240b7820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbb38198a10 tx=0x7fbb30009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 -- 172.21.15.2:0/1427479920 shutdown_connections 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afec58090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec55580 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 --2- 172.21.15.2:0/1427479920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec52c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 -- 172.21.15.2:0/1427479920 >> 172.21.15.2:0/1427479920 conn(0x559afec4b9b0 msgr2=0x559afec4c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 -- 172.21.15.2:0/1427479920 shutdown_connections 2024-09-10T23:25:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 -- 172.21.15.2:0/1427479920 wait complete. 2024-09-10T23:25:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 -- start start 2024-09-10T23:25:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.246+0000 7fbb42a12740 1 Processor -- start 2024-09-10T23:25:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec59ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec5a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec5b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559afeae9ab0 con 0x559afec55bd0 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559afeb57730 con 0x559afec50860 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559afec58bb0 con 0x559afec53190 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb42a12740 10 client.0 _ll_register_callbacks cb 0x559afebab6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec5b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec5b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37560/0 (socket says 172.21.15.2:37560) 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 -- 172.21.15.2:0/3316703509 learned_addr learned my addr 172.21.15.2:0/3316703509 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec5a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec59ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 -- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 msgr2=0x559afec5a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec5a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 -- 172.21.15.2:0/3316703509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 msgr2=0x559afec59ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec59ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3e1dd640 1 -- 172.21.15.2:0/3316703509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559afe913790 con 0x559afec55bd0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.247+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec59ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec5b140 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009b40 tx=0x7fbb30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ce2f21d7b9167c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb217fa640 1 -- 172.21.15.2:0/3316703509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3001ed00 con 0x559afec55bd0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb217fa640 1 -- 172.21.15.2:0/3316703509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbb3001f410 con 0x559afec55bd0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3400ae10 con 0x559afec55bd0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb217fa640 1 -- 172.21.15.2:0/3316703509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb3001f610 con 0x559afec55bd0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb42a12740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559afe98c620 con 0x559afec55bd0 2024-09-10T23:25:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb217fa640 1 -- 172.21.15.2:0/3316703509 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3400ae10 con 0x559afec55bd0 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.248+0000 7fbb217fa640 1 -- 172.21.15.2:0/3316703509 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb3000f040 con 0x559afec55bd0 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb42a12740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb42a12740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb42a12740 20 client.15630 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afec65840 0x559afec67cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb42a12740 4 client.15630 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559afebc4640 con 0x559afec65840 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afec65840 0x559afec67cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afec65840 0x559afec67cc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e2ba3d8ed9b28a server_cookie=9b9bf90dcb8de8b in_seq=0 out_seq=0 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.249+0000 7fbb217fa640 10 client.15630 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb217fa640 1 -- 172.21.15.2:0/3316703509 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559afebc4640 con 0x559afec65840 2024-09-10T23:25:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb217fa640 10 client.15630 handle_command_reply: tid=0 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 client.15630 shutdown 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 msgr2=0x559afec5b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec5b140 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009b40 tx=0x7fbb30004a40 comp rx=0 tx=0).stop 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 shutdown_connections 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afec65840 0x559afec67cc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec5b140 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec5a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3316703509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec59ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb217fa640 0 client.15630 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 >> 172.21.15.2:0/3316703509 conn(0x559afec4b9b0 msgr2=0x559afec4abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 shutdown_connections 2024-09-10T23:25:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.250+0000 7fbb42a12740 1 -- 172.21.15.2:0/3316703509 wait complete. 2024-09-10T23:25:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.251+0000 7fbb42a12740 20 client.15630 trim_cache size 0 max 16384 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 Processor -- start 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 -- start start 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec5b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec4fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec50230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381a7d10 con 0x559afec55bd0 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381a9850 con 0x559afec50860 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb42a12740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381a83e0 con 0x559afec53190 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb3e1dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec50230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb3e1dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec50230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37572/0 (socket says 172.21.15.2:37572) 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb3d9dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec5b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb3e1dd640 1 -- 172.21.15.2:0/3313652818 learned_addr learned my addr 172.21.15.2:0/3313652818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.266+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec4fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/3313652818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 msgr2=0x559afec4fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec4fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/3313652818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 msgr2=0x559afec50230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec50230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3d9dc640 1 -- 172.21.15.2:0/3313652818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559afec4f970 con 0x559afec50860 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec50230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec5b120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005940 tx=0x7fbb3400a2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fddc6e9a2e54deb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb237fe640 1 -- 172.21.15.2:0/3313652818 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3401d040 con 0x559afec50860 2024-09-10T23:25:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb237fe640 1 -- 172.21.15.2:0/3313652818 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3401e040 con 0x559afec50860 2024-09-10T23:25:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.267+0000 7fbb237fe640 1 -- 172.21.15.2:0/3313652818 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34018bf0 con 0x559afec50860 2024-09-10T23:25:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 -- 172.21.15.2:0/3313652818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 msgr2=0x559afec5b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec5b120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005940 tx=0x7fbb3400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 -- 172.21.15.2:0/3313652818 shutdown_connections 2024-09-10T23:25:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec55bd0 0x559afec50230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec53190 0x559afec4fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 --2- 172.21.15.2:0/3313652818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec5b120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 -- 172.21.15.2:0/3313652818 >> 172.21.15.2:0/3313652818 conn(0x559afec4b9b0 msgr2=0x559afec55fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 -- 172.21.15.2:0/3313652818 shutdown_connections 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.268+0000 7fbb42a12740 1 -- 172.21.15.2:0/3313652818 wait complete. 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 -- start start 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 Processor -- start 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec61560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec61b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afecd07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381a9180 con 0x559afec53190 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381a8ab0 con 0x559afec50860 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381a5cf0 con 0x559afec55bd0 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.269+0000 7fbb42a12740 10 client.0 _ll_register_callbacks cb 0x7fbb30009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec61b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec61b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37574/0 (socket says 172.21.15.2:37574) 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 -- 172.21.15.2:0/701736811 learned_addr learned my addr 172.21.15.2:0/701736811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec61560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afecd07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 -- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 msgr2=0x559afecd07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afecd07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 -- 172.21.15.2:0/701736811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 msgr2=0x559afec61560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec61560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 -- 172.21.15.2:0/701736811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559afecd1010 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3e1dd640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afecd07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb3d1db640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec61b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb281044e0 tx=0x7fbb2802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7eecd5bbe4724a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb217fa640 1 -- 172.21.15.2:0/701736811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28049040 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb217fa640 1 -- 172.21.15.2:0/701736811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbb280cd4b0 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3401e040 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb217fa640 1 -- 172.21.15.2:0/701736811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb2803be60 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb42a12740 10 client.15636 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.270+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559afecd23f0 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb217fa640 1 -- 172.21.15.2:0/701736811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3401e040 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb217fa640 1 -- 172.21.15.2:0/701736811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb280d62a0 con 0x559afec53190 2024-09-10T23:25:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb42a12740 10 client.15636 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb42a12740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb42a12740 20 client.15636 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb42a12740 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afecd2d40 0x559afecd5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb42a12740 4 client.15636 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559afebc00f0 con 0x559afecd2d40 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.271+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afecd2d40 0x559afecd5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.272+0000 7fbb3d9dc640 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afecd2d40 0x559afecd5130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9c07d69f1d4ee7d server_cookie=e448f8d3d46fe3ef in_seq=0 out_seq=0 2024-09-10T23:25:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.272+0000 7fbb217fa640 10 client.15636 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb217fa640 1 -- 172.21.15.2:0/701736811 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559afebc00f0 con 0x559afecd2d40 2024-09-10T23:25:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb217fa640 10 client.15636 handle_command_reply: tid=0 2024-09-10T23:25:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 client.15636 shutdown 2024-09-10T23:25:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 msgr2=0x559afec61b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec61b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb281044e0 tx=0x7fbb2802a420 comp rx=0 tx=0).stop 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 shutdown_connections 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559afecd2d40 0x559afecd5130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559afec55bd0 0x559afecd07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559afec53190 0x559afec61b90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 --2- 172.21.15.2:0/701736811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559afec50860 0x559afec61560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 >> 172.21.15.2:0/701736811 conn(0x559afec4b9b0 msgr2=0x559afec4fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb217fa640 0 client.15636 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 shutdown_connections 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 1 -- 172.21.15.2:0/701736811 wait complete. 2024-09-10T23:25:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.276+0000 7fbb42a12740 20 client.15636 trim_cache size 0 max 16384 2024-09-10T23:25:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:25:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:25:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:25:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbb240b5360 msgr2=0x7fbb240b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbb240b5360 0x7fbb240b7820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbb38198a10 tx=0x7fbb30009600 comp rx=0 tx=0).stop 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 msgr2=0x7fbb381982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb381982e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbb28031500 tx=0x7fbb28003c80 comp rx=0 tx=0).stop 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 shutdown_connections 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbb240b5360 0x7fbb240b7820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb38103370 0x7fbb38198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb381029b0 0x7fbb381982e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 --2- 172.21.15.2:0/4019779077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb38101860 0x7fbb38197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 >> 172.21.15.2:0/4019779077 conn(0x7fbb380fd140 msgr2=0x7fbb38105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 shutdown_connections 2024-09-10T23:25:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:12.277+0000 7fbb3fc40640 1 -- 172.21.15.2:0/4019779077 wait complete. 2024-09-10T23:25:12.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:11 smithi154 ceph-mon[35136]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-10T23:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 -- 172.21.15.2:0/4135399295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701810f3d0 msgr2=0x7f70181117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 --2- 172.21.15.2:0/4135399295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701810f3d0 0x7f70181117c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7010009ca0 tx=0x7f701002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 -- 172.21.15.2:0/4135399295 shutdown_connections 2024-09-10T23:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 --2- 172.21.15.2:0/4135399295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701810f3d0 0x7f70181117c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 --2- 172.21.15.2:0/4135399295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7018075e00 0x7f701810ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 --2- 172.21.15.2:0/4135399295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70180754e0 0x7f70180758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 -- 172.21.15.2:0/4135399295 >> 172.21.15.2:0/4135399295 conn(0x7f70180fe830 msgr2=0x7f7018100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 -- 172.21.15.2:0/4135399295 shutdown_connections 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.283+0000 7f701f526640 1 -- 172.21.15.2:0/4135399295 wait complete. 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 Processor -- start 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 -- start start 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70180754e0 0x7f701819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 0x7f701819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f701810f3d0 0x7f70181a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7018114f90 con 0x7f7018075e00 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7018114e10 con 0x7f70180754e0 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701f526640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7018115110 con 0x7f701810f3d0 2024-09-10T23:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701cac1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 0x7f701819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701cac1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 0x7f701819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37600/0 (socket says 172.21.15.2:37600) 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.284+0000 7f701cac1640 1 -- 172.21.15.2:0/1851803660 learned_addr learned my addr 172.21.15.2:0/1851803660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701dac3640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f701810f3d0 0x7f70181a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701d2c2640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70180754e0 0x7f701819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701cac1640 1 -- 172.21.15.2:0/1851803660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f701810f3d0 msgr2=0x7f70181a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701cac1640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f701810f3d0 0x7f70181a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701cac1640 1 -- 172.21.15.2:0/1851803660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70180754e0 msgr2=0x7f701819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701cac1640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70180754e0 0x7f701819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701cac1640 1 -- 172.21.15.2:0/1851803660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70181a14f0 con 0x7f7018075e00 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701dac3640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f701810f3d0 0x7f70181a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701d2c2640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70180754e0 0x7f701819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701cac1640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 0x7f701819b980 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f700800d950 tx=0x7f700800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f700e7fc640 1 -- 172.21.15.2:0/1851803660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008017070 con 0x7f7018075e00 2024-09-10T23:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70181a17e0 con 0x7f7018075e00 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f700e7fc640 1 -- 172.21.15.2:0/1851803660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7008009c30 con 0x7f7018075e00 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f700e7fc640 1 -- 172.21.15.2:0/1851803660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700800f620 con 0x7f7018075e00 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.285+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70181a7ea0 con 0x7f7018075e00 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 Processor -- start 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 -- start start 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a828198b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82825840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a82828170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a8278fea0 con 0x559a828194d0 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a8277f2d0 con 0x559a82825d80 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f70218fb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a827830e0 con 0x559a82819df0 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.288+0000 7f700e7fc640 1 -- 172.21.15.2:0/1851803660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7008010460 con 0x7f7018075e00 2024-09-10T23:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a828198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a828198b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37602/0 (socket says 172.21.15.2:37602) 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 -- 172.21.15.2:0/502891887 learned_addr learned my addr 172.21.15.2:0/502891887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701d2c2640 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82825840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701cac1640 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a82828170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 -- 172.21.15.2:0/502891887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 msgr2=0x559a82825840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82825840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 -- 172.21.15.2:0/502891887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 msgr2=0x559a82828170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a82828170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 -- 172.21.15.2:0/502891887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a824dd650 con 0x559a828194d0 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701cac1640 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a82828170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f701dac3640 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a828198b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7010009360 tx=0x7f7010009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8535d9508fc756f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.289+0000 7f70037fe640 1 -- 172.21.15.2:0/502891887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010031cf0 con 0x559a828194d0 2024-09-10T23:25:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f70037fe640 1 -- 172.21.15.2:0/502891887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7010036040 con 0x559a828194d0 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f70037fe640 1 -- 172.21.15.2:0/502891887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100042a0 con 0x559a828194d0 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f700e7fc640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70040b5360 0x7f70040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f701d2c2640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70040b5360 0x7f70040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f700e7fc640 1 -- 172.21.15.2:0/1851803660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f70080e5840 con 0x7f7018075e00 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f70218fb740 1 -- 172.21.15.2:0/502891887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 msgr2=0x559a828198b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.290+0000 7f70218fb740 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a828198b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7010009360 tx=0x7f7010009390 comp rx=0 tx=0).stop 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 -- 172.21.15.2:0/502891887 shutdown_connections 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a82828170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82825840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 --2- 172.21.15.2:0/502891887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a828198b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 -- 172.21.15.2:0/502891887 >> 172.21.15.2:0/502891887 conn(0x559a82817300 msgr2=0x559a828184a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 -- 172.21.15.2:0/502891887 shutdown_connections 2024-09-10T23:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f701d2c2640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70040b5360 0x7f70040b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x559a828181e0 tx=0x7f7014005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 -- 172.21.15.2:0/502891887 wait complete. 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 -- start start 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.291+0000 7f70218fb740 1 Processor -- start 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a828194d0 0x559a82825590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82819df0 0x559a828229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a82822f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a825e0700 con 0x559a82825d80 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a8271a160 con 0x559a82819df0 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a828289a0 con 0x559a828194d0 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f70218fb740 10 client.0 _ll_register_callbacks cb 0x559a827339e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a82822f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a82822f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37606/0 (socket says 172.21.15.2:37606) 2024-09-10T23:25:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 -- 172.21.15.2:0/3805923664 learned_addr learned my addr 172.21.15.2:0/3805923664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701d2c2640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a828194d0 0x559a82825590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701cac1640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82819df0 0x559a828229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 -- 172.21.15.2:0/3805923664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a828194d0 msgr2=0x559a82825590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a828194d0 0x559a82825590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 -- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82819df0 msgr2=0x559a828229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82819df0 0x559a828229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 -- 172.21.15.2:0/3805923664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a82747c90 con 0x559a82825d80 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f701dac3640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a82822f20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7010009a60 tx=0x7f7010003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52463b5db8af9e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.292+0000 7f7000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f7000ff9640 1 -- 172.21.15.2:0/3805923664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010052020 con 0x559a82825d80 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7010036040 con 0x559a82825d80 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f7000ff9640 1 -- 172.21.15.2:0/3805923664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7010031cf0 con 0x559a82825d80 2024-09-10T23:25:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f7000ff9640 1 -- 172.21.15.2:0/3805923664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f701004a040 con 0x559a82825d80 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f70218fb740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a82834190 con 0x559a82825d80 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f7000ff9640 1 -- 172.21.15.2:0/3805923664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7010036040 con 0x559a82825d80 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f7000ff9640 1 -- 172.21.15.2:0/3805923664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f701004d030 con 0x559a82825d80 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f70218fb740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.293+0000 7f70218fb740 10 client.15648 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f70218fb740 20 client.15648 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f70218fb740 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828354e0 0x559a828378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f70218fb740 4 client.15648 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a82791df0 con 0x559a828354e0 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f701d2c2640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828354e0 0x559a828378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f7000ff9640 10 client.15648 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.294+0000 7f701d2c2640 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828354e0 0x559a828378d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=72d77b79f67add4f server_cookie=4e0a424a4ee49faf in_seq=0 out_seq=0 2024-09-10T23:25:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f7000ff9640 1 -- 172.21.15.2:0/3805923664 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a82791df0 con 0x559a828354e0 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f7000ff9640 10 client.15648 handle_command_reply: tid=0 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 client.15648 shutdown 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 msgr2=0x559a82822f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a82822f20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7010009a60 tx=0x7f7010003a70 comp rx=0 tx=0).stop 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 shutdown_connections 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828354e0 0x559a828378d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a82822f20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82819df0 0x559a828229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f7000ff9640 0 client.15648 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 --2- 172.21.15.2:0/3805923664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a828194d0 0x559a82825590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.295+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 >> 172.21.15.2:0/3805923664 conn(0x559a82817300 msgr2=0x559a8281ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.296+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 shutdown_connections 2024-09-10T23:25:12.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.296+0000 7f70218fb740 1 -- 172.21.15.2:0/3805923664 wait complete. 2024-09-10T23:25:12.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.296+0000 7f70218fb740 20 client.15648 trim_cache size 0 max 16384 2024-09-10T23:25:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 Processor -- start 2024-09-10T23:25:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 -- start start 2024-09-10T23:25:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a828194d0 0x559a82818a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82816310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a8281fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b0570 con 0x559a82825d80 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b20b0 con 0x559a828194d0 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.309+0000 7f70218fb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b0c40 con 0x559a82819df0 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a8281fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a8281fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37620/0 (socket says 172.21.15.2:37620) 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 -- 172.21.15.2:0/160551979 learned_addr learned my addr 172.21.15.2:0/160551979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701cac1640 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82816310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701d2c2640 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a828194d0 0x559a82818a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 -- 172.21.15.2:0/160551979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 msgr2=0x559a82816310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82816310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 -- 172.21.15.2:0/160551979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a828194d0 msgr2=0x559a82818a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a828194d0 0x559a82818a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 -- 172.21.15.2:0/160551979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a82825900 con 0x559a82825d80 2024-09-10T23:25:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f701dac3640 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a8281fc10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7010006010 tx=0x7f7010009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1e7e76b18cd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.310+0000 7f7002ffd640 1 -- 172.21.15.2:0/160551979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010052070 con 0x559a82825d80 2024-09-10T23:25:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f7002ffd640 1 -- 172.21.15.2:0/160551979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7010036070 con 0x559a82825d80 2024-09-10T23:25:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f7002ffd640 1 -- 172.21.15.2:0/160551979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100316b0 con 0x559a82825d80 2024-09-10T23:25:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 -- 172.21.15.2:0/160551979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 msgr2=0x559a8281fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a8281fc10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7010006010 tx=0x7f7010009ba0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 -- 172.21.15.2:0/160551979 shutdown_connections 2024-09-10T23:25:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a82825d80 0x559a8281fc10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a82816310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 --2- 172.21.15.2:0/160551979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a828194d0 0x559a82818a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 -- 172.21.15.2:0/160551979 >> 172.21.15.2:0/160551979 conn(0x559a82817300 msgr2=0x559a82815c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 -- 172.21.15.2:0/160551979 shutdown_connections 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.311+0000 7f70218fb740 1 -- 172.21.15.2:0/160551979 wait complete. 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 -- start start 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 Processor -- start 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a8282de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a8282e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a8282ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b19e0 con 0x559a828194d0 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b1310 con 0x559a82825d80 2024-09-10T23:25:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70181ae550 con 0x559a82819df0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f70218fb740 10 client.0 _ll_register_callbacks cb 0x7f70140095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f701d2c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a8282de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f701d2c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a8282de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37632/0 (socket says 172.21.15.2:37632) 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.312+0000 7f701d2c2640 1 -- 172.21.15.2:0/249716243 learned_addr learned my addr 172.21.15.2:0/249716243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701dac3640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a8282ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701cac1640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a8282e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701d2c2640 1 -- 172.21.15.2:0/249716243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 msgr2=0x559a8282e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701d2c2640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a8282e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701d2c2640 1 -- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 msgr2=0x559a8282ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701d2c2640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a8282ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701d2c2640 1 -- 172.21.15.2:0/249716243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8282b270 con 0x559a828194d0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701cac1640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a8282e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f701d2c2640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a8282de40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x559a82837e40 tx=0x7f70140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b641a383c5a8984c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f7000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f7000ff9640 1 -- 172.21.15.2:0/249716243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014030400 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f7000ff9640 1 -- 172.21.15.2:0/249716243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f70140305a0 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.313+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7010036070 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f7000ff9640 1 -- 172.21.15.2:0/249716243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70140307a0 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a828a2a10 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f7000ff9640 1 -- 172.21.15.2:0/249716243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7010036070 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f7000ff9640 1 -- 172.21.15.2:0/249716243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7014011940 con 0x559a828194d0 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 10 client.15654 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 20 client.15654 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828a3170 0x559a828a5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 4 client.15654 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a8278d8a0 con 0x559a828a3170 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.314+0000 7f701cac1640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828a3170 0x559a828a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f7000ff9640 10 client.15654 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f701cac1640 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828a3170 0x559a828a5590 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fa870b9005f7dabd server_cookie=1ae4c69e57c4e28e in_seq=0 out_seq=0 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f7000ff9640 1 -- 172.21.15.2:0/249716243 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a8278d8a0 con 0x559a828a3170 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f7000ff9640 10 client.15654 handle_command_reply: tid=0 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 client.15654 shutdown 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 msgr2=0x559a8282de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a8282de40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x559a82837e40 tx=0x7f70140046c0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 shutdown_connections 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x559a828a3170 0x559a828a5590 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a82825d80 0x559a8282ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a82819df0 0x559a8282e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 --2- 172.21.15.2:0/249716243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a828194d0 0x559a8282de40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f7000ff9640 0 client.15654 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.315+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 >> 172.21.15.2:0/249716243 conn(0x559a82817300 msgr2=0x559a82824830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 shutdown_connections 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f70218fb740 1 -- 172.21.15.2:0/249716243 wait complete. 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f70218fb740 20 client.15654 trim_cache size 0 max 16384 2024-09-10T23:25:12.321 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:12.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70040b5360 msgr2=0x7f70040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70040b5360 0x7f70040b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x559a828181e0 tx=0x7f7014005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:12.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 msgr2=0x7f701819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 0x7f701819b980 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f700800d950 tx=0x7f700800de10 comp rx=0 tx=0).stop 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 shutdown_connections 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70040b5360 0x7f70040b7820 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f701810f3d0 0x7f70181a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7018075e00 0x7f701819b980 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 --2- 172.21.15.2:0/1851803660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70180754e0 0x7f701819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.316+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 >> 172.21.15.2:0/1851803660 conn(0x7f70180fe830 msgr2=0x7f7018111580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.317+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 shutdown_connections 2024-09-10T23:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:12.317+0000 7f701f526640 1 -- 172.21.15.2:0/1851803660 wait complete. 2024-09-10T23:25:12.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:11 smithi177 ceph-mon[35760]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-10T23:25:12.570 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 90% (10882/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T23:25:13.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:25:13.294 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T23:25:13.543 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-10T23:25:13.544 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:25:13.547 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T23:25:13.599 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T23:25:13.602 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:25:13.602 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T23:25:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 -- 172.21.15.2:0/1557886923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788104600 msgr2=0x7f578810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 --2- 172.21.15.2:0/1557886923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788104600 0x7f578810caf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f577c009900 tx=0x7f577c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 -- 172.21.15.2:0/1557886923 shutdown_connections 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 --2- 172.21.15.2:0/1557886923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f578810d140 0x7f578810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 --2- 172.21.15.2:0/1557886923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788104600 0x7f578810caf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 --2- 172.21.15.2:0/1557886923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788103ce0 0x7f57881040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 -- 172.21.15.2:0/1557886923 >> 172.21.15.2:0/1557886923 conn(0x7f57880fd700 msgr2=0x7f57880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 -- 172.21.15.2:0/1557886923 shutdown_connections 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.918+0000 7f578d749640 1 -- 172.21.15.2:0/1557886923 wait complete. 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 Processor -- start 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 -- start start 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 0x7f578819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5788104600 0x7f578819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578810d140 0x7f57881a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5788112db0 con 0x7f5788103ce0 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5788112c30 con 0x7f578810d140 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f578d749640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5788112f30 con 0x7f5788104600 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f5786ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 0x7f578819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f5786ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 0x7f578819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37662/0 (socket says 172.21.15.2:37662) 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.919+0000 7f5786ffd640 1 -- 172.21.15.2:0/3953067937 learned_addr learned my addr 172.21.15.2:0/3953067937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f57877fe640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578810d140 0x7f57881a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f57867fc640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5788104600 0x7f578819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f5786ffd640 1 -- 172.21.15.2:0/3953067937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5788104600 msgr2=0x7f578819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f5786ffd640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5788104600 0x7f578819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f5786ffd640 1 -- 172.21.15.2:0/3953067937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578810d140 msgr2=0x7f57881a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f5786ffd640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578810d140 0x7f57881a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f5786ffd640 1 -- 172.21.15.2:0/3953067937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57881a1510 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f5786ffd640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 0x7f578819b460 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f577800c920 tx=0x7f577800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f576ffff640 1 -- 172.21.15.2:0/3953067937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778007c70 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57881a1800 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f576ffff640 1 -- 172.21.15.2:0/3953067937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5778007e10 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f576ffff640 1 -- 172.21.15.2:0/3953067937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778018820 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.920+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881a7ec0 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 Processor -- start 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 -- start start 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f576ffff640 1 -- 172.21.15.2:0/3953067937 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f577800f450 con 0x7f5788103ce0 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e6b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e77840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d2de1ea0 con 0x5559d2e6b4d0 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559d2dd12d0 con 0x5559d2e6bdf0 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f578fb1e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5559d2dd50e0 con 0x5559d2e77d80 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e6b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e6b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37672/0 (socket says 172.21.15.2:37672) 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f57877fe640 1 -- 172.21.15.2:0/4869875 learned_addr learned my addr 172.21.15.2:0/4869875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f5786ffd640 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e77840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.923+0000 7f57867fc640 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f57877fe640 1 -- 172.21.15.2:0/4869875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 msgr2=0x5559d2e7a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f57877fe640 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f57877fe640 1 -- 172.21.15.2:0/4869875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 msgr2=0x5559d2e77840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f57877fe640 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e77840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f57877fe640 1 -- 172.21.15.2:0/4869875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d2b2f650 con 0x5559d2e6b4d0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f5786ffd640 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e77840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f57877fe640 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e6b8b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5780010370 tx=0x7f5780010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344562371d5141d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f576d7fa640 1 -- 172.21.15.2:0/4869875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780016070 con 0x5559d2e6b4d0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f576ffff640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57700b52e0 0x7f57700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f576d7fa640 1 -- 172.21.15.2:0/4869875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5780004d20 con 0x5559d2e6b4d0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f576d7fa640 1 -- 172.21.15.2:0/4869875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780005420 con 0x5559d2e6b4d0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f5786ffd640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57700b52e0 0x7f57700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.924+0000 7f576ffff640 1 -- 172.21.15.2:0/3953067937 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f57780e5c40 con 0x7f5788103ce0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 -- 172.21.15.2:0/4869875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 msgr2=0x5559d2e6b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e6b8b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5780010370 tx=0x7f5780010830 comp rx=0 tx=0).stop 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f5786ffd640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57700b52e0 0x7f57700b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f57780e3ac0 tx=0x7f577801ad40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 -- 172.21.15.2:0/4869875 shutdown_connections 2024-09-10T23:25:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e77840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 --2- 172.21.15.2:0/4869875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e6b8b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 -- 172.21.15.2:0/4869875 >> 172.21.15.2:0/4869875 conn(0x5559d2e69300 msgr2=0x5559d2e6a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 -- 172.21.15.2:0/4869875 shutdown_connections 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 -- 172.21.15.2:0/4869875 wait complete. 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 -- start start 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.925+0000 7f578fb1e740 1 Processor -- start 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6b4d0 0x5559d2e77690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6bdf0 0x5559d2e74ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e75110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d2c32700 con 0x5559d2e77d80 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559d2d6c160 con 0x5559d2e6b4d0 2024-09-10T23:25:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5559d2e7aa00 con 0x5559d2e6bdf0 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 10 client.0 _ll_register_callbacks cb 0x5559d2d859e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e75110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e75110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37688/0 (socket says 172.21.15.2:37688) 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 -- 172.21.15.2:0/3533803205 learned_addr learned my addr 172.21.15.2:0/3533803205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57867fc640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6bdf0 0x5559d2e74ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6b4d0 0x5559d2e77690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 -- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6bdf0 msgr2=0x5559d2e74ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6bdf0 0x5559d2e74ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 -- 172.21.15.2:0/3533803205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6b4d0 msgr2=0x5559d2e77690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6b4d0 0x5559d2e77690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 -- 172.21.15.2:0/3533803205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d2d99c90 con 0x5559d2e77d80 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f57877fe640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e75110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f57800055d0 tx=0x7f5780012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dae9a67eda26fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f576aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f576aff5640 1 -- 172.21.15.2:0/3533803205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780016040 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f576aff5640 1 -- 172.21.15.2:0/3533803205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5780005880 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.926+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5780004d20 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f576aff5640 1 -- 172.21.15.2:0/3533803205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5780012510 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 10 client.15666 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5559d2e86300 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f576aff5640 1 -- 172.21.15.2:0/3533803205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5780004d20 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f576aff5640 1 -- 172.21.15.2:0/3533803205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5780033080 con 0x5559d2e77d80 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 10 client.15666 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 10 client.15666 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 20 client.15666 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2e876b0 0x5559d2e89aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 4 client.15666 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559d2de3df0 con 0x5559d2e876b0 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.927+0000 7f57867fc640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2e876b0 0x5559d2e89aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.928+0000 7f57867fc640 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2e876b0 0x5559d2e89aa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=43e3d770371be29c server_cookie=5d8b100e336b763e in_seq=0 out_seq=0 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.928+0000 7f576aff5640 10 client.15666 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.928+0000 7f576aff5640 1 -- 172.21.15.2:0/3533803205 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559d2de3df0 con 0x5559d2e876b0 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.928+0000 7f576aff5640 10 client.15666 handle_command_reply: tid=0 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.928+0000 7f578fb1e740 1 client.15666 shutdown 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 msgr2=0x5559d2e75110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e75110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f57800055d0 tx=0x7f5780012f00 comp rx=0 tx=0).stop 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 shutdown_connections 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2e876b0 0x5559d2e89aa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e75110 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6bdf0 0x5559d2e74ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3533803205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6b4d0 0x5559d2e77690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 >> 172.21.15.2:0/3533803205 conn(0x5559d2e69300 msgr2=0x5559d2e6ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f576aff5640 0 client.15666 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 shutdown_connections 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 1 -- 172.21.15.2:0/3533803205 wait complete. 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.929+0000 7f578fb1e740 20 client.15666 trim_cache size 0 max 16384 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 Processor -- start 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 -- start start 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6b4d0 0x5559d2e83c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e68310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e79170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57881b0530 con 0x5559d2e77d80 2024-09-10T23:25:14.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57881b2070 con 0x5559d2e6bdf0 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f578fb1e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57881b0c00 con 0x5559d2e6b4d0 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e79170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e79170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37690/0 (socket says 172.21.15.2:37690) 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 -- 172.21.15.2:0/3195064378 learned_addr learned my addr 172.21.15.2:0/3195064378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 -- 172.21.15.2:0/3195064378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6b4d0 msgr2=0x5559d2e83c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6b4d0 0x5559d2e83c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 -- 172.21.15.2:0/3195064378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 msgr2=0x5559d2e68310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e68310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.942+0000 7f57877fe640 1 -- 172.21.15.2:0/3195064378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d2e77a00 con 0x5559d2e77d80 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f57877fe640 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e79170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f57800055a0 tx=0x7f5780009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ef33508068b47f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f576cff9640 1 -- 172.21.15.2:0/3195064378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780016070 con 0x5559d2e77d80 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f576cff9640 1 -- 172.21.15.2:0/3195064378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5780036020 con 0x5559d2e77d80 2024-09-10T23:25:14.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f576cff9640 1 -- 172.21.15.2:0/3195064378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578002aab0 con 0x5559d2e77d80 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 -- 172.21.15.2:0/3195064378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 msgr2=0x5559d2e79170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e79170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f57800055a0 tx=0x7f5780009600 comp rx=0 tx=0).stop 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 -- 172.21.15.2:0/3195064378 shutdown_connections 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e77d80 0x5559d2e79170 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e68310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 --2- 172.21.15.2:0/3195064378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e6b4d0 0x5559d2e83c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 -- 172.21.15.2:0/3195064378 >> 172.21.15.2:0/3195064378 conn(0x5559d2e69300 msgr2=0x5559d2e67c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 -- 172.21.15.2:0/3195064378 shutdown_connections 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.943+0000 7f578fb1e740 1 -- 172.21.15.2:0/3195064378 wait complete. 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 -- start start 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 Processor -- start 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e7feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e803f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57881b19a0 con 0x5559d2e6b4d0 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57881b12d0 con 0x5559d2e6bdf0 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57881ae510 con 0x5559d2e77d80 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f578fb1e740 10 client.0 _ll_register_callbacks cb 0x7f5780009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e7feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e7feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37698/0 (socket says 172.21.15.2:37698) 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 -- 172.21.15.2:0/2564286436 learned_addr learned my addr 172.21.15.2:0/2564286436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 -- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 msgr2=0x5559d2e7ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 -- 172.21.15.2:0/2564286436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 msgr2=0x5559d2e803f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e803f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.944+0000 7f57877fe640 1 -- 172.21.15.2:0/2564286436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d2e7b370 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f57877fe640 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e7feb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f578002a8b0 tx=0x7f5780012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d164e37527920618 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f576aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f576aff5640 1 -- 172.21.15.2:0/2564286436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780041020 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f576aff5640 1 -- 172.21.15.2:0/2564286436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5780037040 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5780036020 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f576aff5640 1 -- 172.21.15.2:0/2564286436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5780016040 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 10 client.15672 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5559d2ef4d50 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f576aff5640 1 -- 172.21.15.2:0/2564286436 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5780036020 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f576aff5640 1 -- 172.21.15.2:0/2564286436 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5780033040 con 0x5559d2e6b4d0 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 10 client.15672 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:14.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 10 client.15672 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 20 client.15672 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2ef5390 0x5559d2ef77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 4 client.15672 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.945+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559d2ddf8a0 con 0x5559d2ef5390 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f57867fc640 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2ef5390 0x5559d2ef77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f576aff5640 10 client.15672 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f57867fc640 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2ef5390 0x5559d2ef77b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=16ac84a255bdd762 server_cookie=6c25bb2891af8a62 in_seq=0 out_seq=0 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f576aff5640 1 -- 172.21.15.2:0/2564286436 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559d2ddf8a0 con 0x5559d2ef5390 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f576aff5640 10 client.15672 handle_command_reply: tid=0 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 client.15672 shutdown 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 msgr2=0x5559d2e7feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e7feb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f578002a8b0 tx=0x7f5780012dd0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 shutdown_connections 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5559d2ef5390 0x5559d2ef77b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559d2e77d80 0x5559d2e7ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559d2e6bdf0 0x5559d2e803f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 --2- 172.21.15.2:0/2564286436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d2e6b4d0 0x5559d2e7feb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f576aff5640 0 client.15672 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.946+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 >> 172.21.15.2:0/2564286436 conn(0x5559d2e69300 msgr2=0x5559d2e6a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 shutdown_connections 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578fb1e740 1 -- 172.21.15.2:0/2564286436 wait complete. 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578fb1e740 20 client.15672 trim_cache size 0 max 16384 2024-09-10T23:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57700b52e0 msgr2=0x7f57700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57700b52e0 0x7f57700b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f57780e3ac0 tx=0x7f577801ad40 comp rx=0 tx=0).stop 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 msgr2=0x7f578819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 0x7f578819b460 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f577800c920 tx=0x7f577800cde0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 shutdown_connections 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f57700b52e0 0x7f57700b77a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578810d140 0x7f57881a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5788104600 0x7f578819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 --2- 172.21.15.2:0/3953067937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5788103ce0 0x7f578819b460 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 >> 172.21.15.2:0/3953067937 conn(0x7f57880fd700 msgr2=0x7f57880ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 shutdown_connections 2024-09-10T23:25:14.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:13.947+0000 7f578d749640 1 -- 172.21.15.2:0/3953067937 wait complete. 2024-09-10T23:25:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:13 smithi002 ceph-mon[31150]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-10T23:25:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:13 smithi154 ceph-mon[35136]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-10T23:25:14.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:13 smithi177 ceph-mon[35760]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-10T23:25:14.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:25:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:15.157 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T23:25:15.317 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T23:25:15.359 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:25:15.361 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:25:15.361 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T23:25:15.402 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:25:15.406 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:25:15.406 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T23:25:15.423 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-10T23:25:15.424 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-10T23:25:15.424 DEBUG:teuthology.orchestra.run.smithi002:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-10T23:25:15.490 INFO:tasks.workunit.client.0.smithi002.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-10T23:25:15.491 INFO:tasks.workunit.client.0.smithi002.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-10T23:25:15.491 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-10T23:25:15.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 -- 172.21.15.2:0/2863765370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 msgr2=0x7faf14104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 --2- 172.21.15.2:0/2863765370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14104080 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faf04009900 tx=0x7faf0402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 -- 172.21.15.2:0/2863765370 shutdown_connections 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 --2- 172.21.15.2:0/2863765370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf1410d100 0x7faf1410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 --2- 172.21.15.2:0/2863765370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf141045c0 0x7faf1410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 --2- 172.21.15.2:0/2863765370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14104080 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 -- 172.21.15.2:0/2863765370 >> 172.21.15.2:0/2863765370 conn(0x7faf140fd700 msgr2=0x7faf140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 -- 172.21.15.2:0/2863765370 shutdown_connections 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 -- 172.21.15.2:0/2863765370 wait complete. 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 Processor -- start 2024-09-10T23:25:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.681+0000 7faf19e27640 1 -- start start 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf19e27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf19e27640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf141045c0 0x7faf141997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf19e27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf1410d100 0x7faf1419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf19e27640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf14112d70 con 0x7faf14103ca0 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf19e27640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf14112bf0 con 0x7faf141045c0 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf19e27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf14112ef0 con 0x7faf1410d100 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37724/0 (socket says 172.21.15.2:37724) 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 -- 172.21.15.2:0/3818591000 learned_addr learned my addr 172.21.15.2:0/3818591000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf12ffd640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf141045c0 0x7faf141997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf13fff640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf1410d100 0x7faf1419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 -- 172.21.15.2:0/3818591000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf1410d100 msgr2=0x7faf1419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf1410d100 0x7faf1419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 -- 172.21.15.2:0/3818591000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf141045c0 msgr2=0x7faf141997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf141045c0 0x7faf141997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 -- 172.21.15.2:0/3818591000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1419f310 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf137fe640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14199260 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faf04005940 tx=0x7faf040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.682+0000 7faf10ff9640 1 -- 172.21.15.2:0/3818591000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0403f030 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.683+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1419f5a0 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.683+0000 7faf10ff9640 1 -- 172.21.15.2:0/3818591000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf04003cb0 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.683+0000 7faf10ff9640 1 -- 172.21.15.2:0/3818591000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04035070 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.683+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf141a5cc0 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.685+0000 7faf1c1fc740 1 Processor -- start 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.685+0000 7faf10ff9640 1 -- 172.21.15.2:0/3818591000 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faf0403bbf0 con 0x7faf14103ca0 2024-09-10T23:25:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.685+0000 7faf1c1fc740 1 -- start start 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef14adf0 0x55b3ef156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 0x55b3ef159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef0c0ea0 con 0x55b3ef156d80 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef0b02d0 con 0x55b3ef14a4d0 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef0b40e0 con 0x55b3ef14adf0 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 0x55b3ef159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 0x55b3ef159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37732/0 (socket says 172.21.15.2:37732) 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 -- 172.21.15.2:0/3270900295 learned_addr learned my addr 172.21.15.2:0/3270900295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf137fe640 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef14adf0 0x55b3ef156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf13fff640 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 -- 172.21.15.2:0/3270900295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef14adf0 msgr2=0x55b3ef156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef14adf0 0x55b3ef156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 -- 172.21.15.2:0/3270900295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 msgr2=0x55b3ef14a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef14a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 -- 172.21.15.2:0/3270900295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3eee0e650 con 0x55b3ef156d80 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf12ffd640 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 0x55b3ef159170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faf0800bc60 tx=0x7faf0800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643c8b5774cfbcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faf10ff9640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faefc0b52e0 0x7faefc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faef9ffb640 1 -- 172.21.15.2:0/3270900295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08015070 con 0x55b3ef156d80 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faef9ffb640 1 -- 172.21.15.2:0/3270900295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0801a910 con 0x55b3ef156d80 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.686+0000 7faef9ffb640 1 -- 172.21.15.2:0/3270900295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08011880 con 0x55b3ef156d80 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf13fff640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faefc0b52e0 0x7faefc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf10ff9640 1 -- 172.21.15.2:0/3818591000 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faf04106830 con 0x7faf14103ca0 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 -- 172.21.15.2:0/3270900295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 msgr2=0x55b3ef159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 0x55b3ef159170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faf0800bc60 tx=0x7faf0800f730 comp rx=0 tx=0).stop 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf13fff640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faefc0b52e0 0x7faefc0b77a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005fd0 tx=0x7faf0c009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 -- 172.21.15.2:0/3270900295 shutdown_connections 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef156d80 0x55b3ef159170 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef14adf0 0x55b3ef156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/3270900295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef14a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 -- 172.21.15.2:0/3270900295 >> 172.21.15.2:0/3270900295 conn(0x55b3ef148300 msgr2=0x55b3ef1494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 -- 172.21.15.2:0/3270900295 shutdown_connections 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.687+0000 7faf1c1fc740 1 -- 172.21.15.2:0/3270900295 wait complete. 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 -- start start 2024-09-10T23:25:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 Processor -- start 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef153f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b3eef11700 con 0x55b3ef14adf0 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef04b160 con 0x55b3ef14a4d0 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b3ef159a00 con 0x55b3ef156d80 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf1c1fc740 10 client.0 _ll_register_callbacks cb 0x55b3ef0649e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf12ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf12ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37744/0 (socket says 172.21.15.2:37744) 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf12ffd640 1 -- 172.21.15.2:0/2157122126 learned_addr learned my addr 172.21.15.2:0/2157122126 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.688+0000 7faf137fe640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf13fff640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf12ffd640 1 -- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 msgr2=0x55b3ef153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf12ffd640 1 -- 172.21.15.2:0/2157122126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 msgr2=0x55b3ef1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf12ffd640 1 -- 172.21.15.2:0/2157122126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ef078c90 con 0x55b3ef14adf0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf13fff640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef153a20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faf08011520 tx=0x7faf0800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c86770fcdcc5c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faef2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faef2ffd640 1 -- 172.21.15.2:0/2157122126 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08028060 con 0x55b3ef14adf0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faef2ffd640 1 -- 172.21.15.2:0/2157122126 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faf0801aac0 con 0x55b3ef14adf0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf0801a910 con 0x55b3ef14adf0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faef2ffd640 1 -- 172.21.15.2:0/2157122126 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf08015070 con 0x55b3ef14adf0 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf1c1fc740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3ef1652f0 con 0x55b3ef14adf0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.689+0000 7faef2ffd640 1 -- 172.21.15.2:0/2157122126 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0801a910 con 0x55b3ef14adf0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faef2ffd640 1 -- 172.21.15.2:0/2157122126 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf08004870 con 0x55b3ef14adf0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf1c1fc740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf1c1fc740 10 client.15684 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf1c1fc740 20 client.15684 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef168ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf1c1fc740 4 client.15684 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3ef0c2df0 con 0x55b3ef1666f0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf137fe640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef168ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faef2ffd640 10 client.15684 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.690+0000 7faf137fe640 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef168ae0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=529d368b545c822a server_cookie=c5194a146a3b0071 in_seq=0 out_seq=0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faef2ffd640 1 -- 172.21.15.2:0/2157122126 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3ef0c2df0 con 0x55b3ef1666f0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faef2ffd640 10 client.15684 handle_command_reply: tid=0 2024-09-10T23:25:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 client.15684 shutdown 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 msgr2=0x55b3ef153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef153a20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faf08011520 tx=0x7faf0800bf80 comp rx=0 tx=0).stop 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 shutdown_connections 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef168ae0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef153a20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.691+0000 7faef2ffd640 0 client.15684 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.692+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2157122126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.692+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 >> 172.21.15.2:0/2157122126 conn(0x55b3ef148300 msgr2=0x55b3ef14de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.692+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 shutdown_connections 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.692+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2157122126 wait complete. 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.692+0000 7faf1c1fc740 20 client.15684 trim_cache size 0 max 16384 2024-09-10T23:25:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 Processor -- start 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 -- start start 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef155760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef150c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef151170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ae2c0 con 0x55b3ef14adf0 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf141afe00 con 0x55b3ef14a4d0 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ae990 con 0x55b3ef156d80 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf12ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf12ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37750/0 (socket says 172.21.15.2:37750) 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf12ffd640 1 -- 172.21.15.2:0/2712655588 learned_addr learned my addr 172.21.15.2:0/2712655588 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf13fff640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf137fe640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf12ffd640 1 -- 172.21.15.2:0/2712655588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 msgr2=0x55b3ef151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.705+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faf12ffd640 1 -- 172.21.15.2:0/2712655588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 msgr2=0x55b3ef155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faf12ffd640 1 -- 172.21.15.2:0/2712655588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ef1542f0 con 0x55b3ef14adf0 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faf137fe640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faf13fff640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef150c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faf08011570 tx=0x7faf0800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1827134efb0921 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faef97fa640 1 -- 172.21.15.2:0/2712655588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08033020 con 0x55b3ef14adf0 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faef97fa640 1 -- 172.21.15.2:0/2712655588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0800b4d0 con 0x55b3ef14adf0 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.706+0000 7faef97fa640 1 -- 172.21.15.2:0/2712655588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08028070 con 0x55b3ef14adf0 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2712655588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 msgr2=0x55b3ef150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef150c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faf08011570 tx=0x7faf0800f730 comp rx=0 tx=0).stop 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2712655588 shutdown_connections 2024-09-10T23:25:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14adf0 0x55b3ef150c30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2712655588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14a4d0 0x55b3ef155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2712655588 >> 172.21.15.2:0/2712655588 conn(0x55b3ef148300 msgr2=0x55b3ef155050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2712655588 shutdown_connections 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2712655588 wait complete. 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 -- start start 2024-09-10T23:25:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.707+0000 7faf1c1fc740 1 Processor -- start 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 0x55b3ef15b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14adf0 0x55b3ef15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef1d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf141af730 con 0x55b3ef14a4d0 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf141af060 con 0x55b3ef14adf0 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ac2a0 con 0x55b3ef156d80 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 10 client.0 _ll_register_callbacks cb 0x7faf0800bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 0x55b3ef15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 0x55b3ef15b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37766/0 (socket says 172.21.15.2:37766) 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 -- 172.21.15.2:0/2664635247 learned_addr learned my addr 172.21.15.2:0/2664635247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf13fff640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef1d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14adf0 0x55b3ef15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 -- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 msgr2=0x55b3ef1d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef1d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 -- 172.21.15.2:0/2664635247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14adf0 msgr2=0x55b3ef15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14adf0 0x55b3ef15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 -- 172.21.15.2:0/2664635247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ef1d2820 con 0x55b3ef14a4d0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14adf0 0x55b3ef15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf137fe640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 0x55b3ef15b160 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faf04006010 tx=0x7faf040045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eaeee0ca2623a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faef2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faef2ffd640 1 -- 172.21.15.2:0/2664635247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04049040 con 0x55b3ef14a4d0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faef2ffd640 1 -- 172.21.15.2:0/2664635247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faf040cd260 con 0x55b3ef14a4d0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.708+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf0800b4d0 con 0x55b3ef14a4d0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faef2ffd640 1 -- 172.21.15.2:0/2664635247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf040d4e60 con 0x55b3ef14a4d0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3ef1d39c0 con 0x55b3ef14a4d0 2024-09-10T23:25:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faef2ffd640 1 -- 172.21.15.2:0/2664635247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0800b4d0 con 0x55b3ef14a4d0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faef2ffd640 1 -- 172.21.15.2:0/2664635247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf040d6100 con 0x55b3ef14a4d0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 10 client.15690 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 20 client.15690 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef1d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 4 client.15690 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3ef0be8a0 con 0x55b3ef1666f0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.709+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef1d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faef2ffd640 10 client.15690 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf12ffd640 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef1d6140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb4d9e0abc52d208 server_cookie=bd05670f674f880f in_seq=0 out_seq=0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faef2ffd640 1 -- 172.21.15.2:0/2664635247 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3ef0be8a0 con 0x55b3ef1666f0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faef2ffd640 10 client.15690 handle_command_reply: tid=0 2024-09-10T23:25:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 client.15690 shutdown 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 msgr2=0x55b3ef15b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 0x55b3ef15b160 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faf04006010 tx=0x7faf040045a0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 shutdown_connections 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b3ef1666f0 0x55b3ef1d6140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3ef156d80 0x55b3ef1d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3ef14adf0 0x55b3ef15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 --2- 172.21.15.2:0/2664635247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b3ef14a4d0 0x55b3ef15b160 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 >> 172.21.15.2:0/2664635247 conn(0x55b3ef148300 msgr2=0x55b3ef155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.710+0000 7faef2ffd640 0 client.15690 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 shutdown_connections 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf1c1fc740 1 -- 172.21.15.2:0/2664635247 wait complete. 2024-09-10T23:25:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf1c1fc740 20 client.15690 trim_cache size 0 max 16384 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faefc0b52e0 msgr2=0x7faefc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faefc0b52e0 0x7faefc0b77a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005fd0 tx=0x7faf0c009580 comp rx=0 tx=0).stop 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 msgr2=0x7faf14199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14199260 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faf04005940 tx=0x7faf040042f0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 shutdown_connections 2024-09-10T23:25:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faefc0b52e0 0x7faefc0b77a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf1410d100 0x7faf1419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf141045c0 0x7faf141997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 --2- 172.21.15.2:0/3818591000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf14103ca0 0x7faf14199260 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 >> 172.21.15.2:0/3818591000 conn(0x7faf140fd700 msgr2=0x7faf140fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 shutdown_connections 2024-09-10T23:25:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:15.711+0000 7faf19e27640 1 -- 172.21.15.2:0/3818591000 wait complete. 2024-09-10T23:25:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:15 smithi154 ceph-mon[35136]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-10T23:25:16.329 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:15 smithi002 ceph-mon[31150]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-10T23:25:16.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:15 smithi177 ceph-mon[35760]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-10T23:25:16.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:25:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 -- 172.21.15.2:0/3692205375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20641076e0 msgr2=0x7f2064107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 --2- 172.21.15.2:0/3692205375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20641076e0 0x7f2064107b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2058009900 tx=0x7f205802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 -- 172.21.15.2:0/3692205375 shutdown_connections 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 --2- 172.21.15.2:0/3692205375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 0x7f206410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 --2- 172.21.15.2:0/3692205375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20641076e0 0x7f2064107b20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 --2- 172.21.15.2:0/3692205375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2064101cd0 0x7f20641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 -- 172.21.15.2:0/3692205375 >> 172.21.15.2:0/3692205375 conn(0x7f20640fd720 msgr2=0x7f20640ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 -- 172.21.15.2:0/3692205375 shutdown_connections 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.384+0000 7f2069a1f640 1 -- 172.21.15.2:0/3692205375 wait complete. 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 Processor -- start 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 -- start start 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 0x7f20640fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20641076e0 0x7f20640fe160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 0x7f20640fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2064111d20 con 0x7f2064101cd0 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2064111ba0 con 0x7f20641076e0 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2069a1f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2064111ea0 con 0x7f2064108060 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 0x7f20640fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 0x7f20640fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37782/0 (socket says 172.21.15.2:37782) 2024-09-10T23:25:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 -- 172.21.15.2:0/1402368355 learned_addr learned my addr 172.21.15.2:0/1402368355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f20637fe640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 0x7f20640fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 -- 172.21.15.2:0/1402368355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 msgr2=0x7f20640fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 0x7f20640fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 -- 172.21.15.2:0/1402368355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20641076e0 msgr2=0x7f20640fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.385+0000 7f2062ffd640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20641076e0 0x7f20640fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2062ffd640 1 -- 172.21.15.2:0/1402368355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20641a7730 con 0x7f2064101cd0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f20637fe640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 0x7f20640fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2062ffd640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 0x7f20640fdc20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f205400cce0 tx=0x7f205400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2068a1d640 1 -- 172.21.15.2:0/1402368355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205400f650 con 0x7f2064101cd0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20641a7a20 con 0x7f2064101cd0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2068a1d640 1 -- 172.21.15.2:0/1402368355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205400fca0 con 0x7f2064101cd0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2068a1d640 1 -- 172.21.15.2:0/1402368355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054018b40 con 0x7f2064101cd0 2024-09-10T23:25:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.386+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20641a7f60 con 0x7f2064101cd0 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.388+0000 7f206bdf4740 1 Processor -- start 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.388+0000 7f2068a1d640 1 -- 172.21.15.2:0/1402368355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f205400f7f0 con 0x7f2064101cd0 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 -- start start 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a7c1230ea0 con 0x55a7c12ba4d0 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7c12202d0 con 0x55a7c12badf0 2024-09-10T23:25:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f206bdf4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a7c12240e0 con 0x55a7c12c6d80 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ba8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37786/0 (socket says 172.21.15.2:37786) 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 -- 172.21.15.2:0/3080335604 learned_addr learned my addr 172.21.15.2:0/3080335604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20627fc640 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f2062ffd640 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 -- 172.21.15.2:0/3080335604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 msgr2=0x55a7c12c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 -- 172.21.15.2:0/3080335604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 msgr2=0x55a7c12c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f2068a1d640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f204c0b52e0 0x7f204c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f20637fe640 1 -- 172.21.15.2:0/3080335604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c0f7e650 con 0x55a7c12ba4d0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f2062ffd640 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.389+0000 7f2068a1d640 1 -- 172.21.15.2:0/1402368355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f20540e61b0 con 0x7f2064101cd0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f20637fe640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f204c0b52e0 0x7f204c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f20637fe640 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ba8b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a950 tx=0x7f205c00ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39e29f73b343b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f2049ffb640 1 -- 172.21.15.2:0/3080335604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c01b630 con 0x55a7c12ba4d0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f2049ffb640 1 -- 172.21.15.2:0/3080335604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c015030 con 0x55a7c12ba4d0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f2049ffb640 1 -- 172.21.15.2:0/3080335604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c011c80 con 0x55a7c12ba4d0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f206bdf4740 1 -- 172.21.15.2:0/3080335604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 msgr2=0x55a7c12ba8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f20637fe640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f204c0b52e0 0x7f204c0b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f205c019000 tx=0x7f205c01a7b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.390+0000 7f206bdf4740 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ba8b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a950 tx=0x7f205c00ae10 comp rx=0 tx=0).stop 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- 172.21.15.2:0/3080335604 shutdown_connections 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 --2- 172.21.15.2:0/3080335604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ba8b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- 172.21.15.2:0/3080335604 >> 172.21.15.2:0/3080335604 conn(0x55a7c12b8300 msgr2=0x55a7c12b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- 172.21.15.2:0/3080335604 shutdown_connections 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- 172.21.15.2:0/3080335604 wait complete. 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- start start 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 Processor -- start 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 0x55a7c12c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12c6d80 0x55a7c12c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a7c1081700 con 0x55a7c12badf0 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7c11bb160 con 0x55a7c12c6d80 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a7c12c9a00 con 0x55a7c12ba4d0 2024-09-10T23:25:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.391+0000 7f206bdf4740 10 client.0 _ll_register_callbacks cb 0x55a7c11d49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 0x55a7c12c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 0x55a7c12c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37800/0 (socket says 172.21.15.2:37800) 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 -- 172.21.15.2:0/2041779730 learned_addr learned my addr 172.21.15.2:0/2041779730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f2062ffd640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20637fe640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12c6d80 0x55a7c12c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 -- 172.21.15.2:0/2041779730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 msgr2=0x55a7c12c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 -- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12c6d80 msgr2=0x55a7c12c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12c6d80 0x55a7c12c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 -- 172.21.15.2:0/2041779730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c11e8c90 con 0x55a7c12badf0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f20627fc640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 0x55a7c12c3a60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2058033000 tx=0x7f2058031e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a80963ed624ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f2042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:17.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f2042ffd640 1 -- 172.21.15.2:0/2041779730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058040070 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f2042ffd640 1 -- 172.21.15.2:0/2041779730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2058004030 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.392+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c015030 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f2042ffd640 1 -- 172.21.15.2:0/2041779730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2058035040 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a7c12d5300 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f2042ffd640 1 -- 172.21.15.2:0/2041779730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c015030 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f2042ffd640 1 -- 172.21.15.2:0/2041779730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f205803c440 con 0x55a7c12badf0 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 10 client.15702 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 20 client.15702 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c12d6860 0x55a7c12d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 4 client.15702 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7c1232df0 con 0x55a7c12d6860 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.393+0000 7f2062ffd640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c12d6860 0x55a7c12d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.394+0000 7f2062ffd640 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c12d6860 0x55a7c12d8c50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=290e5fcd392e45ab server_cookie=e8efdd51139a2d7c in_seq=0 out_seq=0 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.394+0000 7f2042ffd640 10 client.15702 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f2042ffd640 1 -- 172.21.15.2:0/2041779730 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7c1232df0 con 0x55a7c12d6860 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f2042ffd640 10 client.15702 handle_command_reply: tid=0 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 client.15702 shutdown 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 msgr2=0x55a7c12c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 0x55a7c12c3a60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2058033000 tx=0x7f2058031e80 comp rx=0 tx=0).stop 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 shutdown_connections 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12c6d80 0x55a7c12c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c12d6860 0x55a7c12d8c50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12badf0 0x55a7c12c3a60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 --2- 172.21.15.2:0/2041779730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f2042ffd640 0 client.15702 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 >> 172.21.15.2:0/2041779730 conn(0x55a7c12b8300 msgr2=0x55a7c12bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 shutdown_connections 2024-09-10T23:25:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 1 -- 172.21.15.2:0/2041779730 wait complete. 2024-09-10T23:25:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.395+0000 7f206bdf4740 20 client.15702 trim_cache size 0 max 16384 2024-09-10T23:25:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 Processor -- start 2024-09-10T23:25:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 -- start start 2024-09-10T23:25:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 0x55a7c12c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b0600 con 0x55a7c12c6d80 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b2140 con 0x55a7c12badf0 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f206bdf4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b0cd0 con 0x55a7c12ba4d0 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f20637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 0x55a7c12c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f20637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 0x55a7c12c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37802/0 (socket says 172.21.15.2:37802) 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.408+0000 7f20637fe640 1 -- 172.21.15.2:0/867278704 learned_addr learned my addr 172.21.15.2:0/867278704 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f2062ffd640 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20627fc640 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20637fe640 1 -- 172.21.15.2:0/867278704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 msgr2=0x55a7c12c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20637fe640 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20637fe640 1 -- 172.21.15.2:0/867278704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 msgr2=0x55a7c12c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20637fe640 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20637fe640 1 -- 172.21.15.2:0/867278704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c12d8fc0 con 0x55a7c12c6d80 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20627fc640 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20637fe640 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 0x55a7c12c0c70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f205c004810 tx=0x7f205c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350183fb18fa5139 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20497fa640 1 -- 172.21.15.2:0/867278704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c034070 con 0x55a7c12c6d80 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20497fa640 1 -- 172.21.15.2:0/867278704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c015040 con 0x55a7c12c6d80 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.409+0000 7f20497fa640 1 -- 172.21.15.2:0/867278704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c011910 con 0x55a7c12c6d80 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 -- 172.21.15.2:0/867278704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 msgr2=0x55a7c12c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 0x55a7c12c0c70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f205c004810 tx=0x7f205c024000 comp rx=0 tx=0).stop 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 -- 172.21.15.2:0/867278704 shutdown_connections 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12c6d80 0x55a7c12c0c70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 --2- 172.21.15.2:0/867278704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12ba4d0 0x55a7c12c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 -- 172.21.15.2:0/867278704 >> 172.21.15.2:0/867278704 conn(0x55a7c12b8300 msgr2=0x55a7c12becf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 -- 172.21.15.2:0/867278704 shutdown_connections 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 -- 172.21.15.2:0/867278704 wait complete. 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 -- start start 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.410+0000 7f206bdf4740 1 Processor -- start 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b1a70 con 0x55a7c12ba4d0 2024-09-10T23:25:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b13a0 con 0x55a7c12badf0 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f20641ae5e0 con 0x55a7c12c6d80 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f206bdf4740 10 client.0 _ll_register_callbacks cb 0x7f2058009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37810/0 (socket says 172.21.15.2:37810) 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 -- 172.21.15.2:0/123695514 learned_addr learned my addr 172.21.15.2:0/123695514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f20637fe640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f20627fc640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 -- 172.21.15.2:0/123695514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 msgr2=0x55a7c12c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 -- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 msgr2=0x55a7c12cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 -- 172.21.15.2:0/123695514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c12ca3c0 con 0x55a7c12ba4d0 2024-09-10T23:25:17.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f20637fe640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f20627fc640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2062ffd640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ceeb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20540e3c60 tx=0x7f2054000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a19cbd21ecaa67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2042ffd640 1 -- 172.21.15.2:0/123695514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540ac090 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.411+0000 7f2042ffd640 1 -- 172.21.15.2:0/123695514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2054018d00 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c015040 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f2042ffd640 1 -- 172.21.15.2:0/123695514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20540a8090 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 10 client.15708 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a7c1344100 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f2042ffd640 1 -- 172.21.15.2:0/123695514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c015040 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f2042ffd640 1 -- 172.21.15.2:0/123695514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20540a8b90 con 0x55a7c12ba4d0 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 10 client.15708 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 10 client.15708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 20 client.15708 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c1344850 0x55a7c1346c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 4 client.15708 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7c122e8a0 con 0x55a7c1344850 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.412+0000 7f20627fc640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c1344850 0x55a7c1346c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f2042ffd640 10 client.15708 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f20627fc640 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c1344850 0x55a7c1346c70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55b339437c1d7684 server_cookie=f4e063c91bf0806b in_seq=0 out_seq=0 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f2042ffd640 1 -- 172.21.15.2:0/123695514 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7c122e8a0 con 0x55a7c1344850 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f2042ffd640 10 client.15708 handle_command_reply: tid=0 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 client.15708 shutdown 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 msgr2=0x55a7c12ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ceeb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20540e3c60 tx=0x7f2054000f40 comp rx=0 tx=0).stop 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 shutdown_connections 2024-09-10T23:25:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7c12c6d80 0x55a7c12c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7c12badf0 0x55a7c12cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55a7c1344850 0x55a7c1346c70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 --2- 172.21.15.2:0/123695514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a7c12ba4d0 0x55a7c12ceeb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 >> 172.21.15.2:0/123695514 conn(0x55a7c12b8300 msgr2=0x55a7c12b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f2042ffd640 0 client.15708 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 shutdown_connections 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 1 -- 172.21.15.2:0/123695514 wait complete. 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.413+0000 7f206bdf4740 20 client.15708 trim_cache size 0 max 16384 2024-09-10T23:25:17.422 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f204c0b52e0 msgr2=0x7f204c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f204c0b52e0 0x7f204c0b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f205c019000 tx=0x7f205c01a7b0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 msgr2=0x7f20640fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 0x7f20640fdc20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f205400cce0 tx=0x7f205400a620 comp rx=0 tx=0).stop 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 shutdown_connections 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f204c0b52e0 0x7f204c0b77a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2064108060 0x7f20640fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20641076e0 0x7f20640fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 --2- 172.21.15.2:0/1402368355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2064101cd0 0x7f20640fdc20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 >> 172.21.15.2:0/1402368355 conn(0x7f20640fd720 msgr2=0x7f2064104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 shutdown_connections 2024-09-10T23:25:17.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:17.414+0000 7f2069a1f640 1 -- 172.21.15.2:0/1402368355 wait complete. 2024-09-10T23:25:18.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:17 smithi002 ceph-mon[31150]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:25:18.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:25:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:17 smithi154 ceph-mon[35136]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:25:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:18.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:17 smithi177 ceph-mon[35760]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 -- 172.21.15.2:0/1035963633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c103bb0 msgr2=0x7f5f5c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/1035963633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c103f90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 -- 172.21.15.2:0/1035963633 shutdown_connections 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/1035963633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5c10d160 0x7f5f5c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/1035963633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c1045b0 0x7f5f5c10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/1035963633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c103f90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 -- 172.21.15.2:0/1035963633 >> 172.21.15.2:0/1035963633 conn(0x7f5f5c0fd700 msgr2=0x7f5f5c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 -- 172.21.15.2:0/1035963633 shutdown_connections 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.953+0000 7f5f62ca5640 1 -- 172.21.15.2:0/1035963633 wait complete. 2024-09-10T23:25:18.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 Processor -- start 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 -- start start 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5c1045b0 0x7f5f5c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 0x7f5f5c1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c112da0 con 0x7f5f5c10d160 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c112c20 con 0x7f5f5c1045b0 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f62ca5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c112f20 con 0x7f5f5c103bb0 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f61242640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 0x7f5f5c1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f61242640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 0x7f5f5c1a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37832/0 (socket says 172.21.15.2:37832) 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f61242640 1 -- 172.21.15.2:0/299034812 learned_addr learned my addr 172.21.15.2:0/299034812 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.954+0000 7f5f60a41640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5c1045b0 0x7f5f5c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f61242640 1 -- 172.21.15.2:0/299034812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c103bb0 msgr2=0x7f5f5c19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f61242640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f61242640 1 -- 172.21.15.2:0/299034812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5c1045b0 msgr2=0x7f5f5c19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f61242640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5c1045b0 0x7f5f5c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f61242640 1 -- 172.21.15.2:0/299034812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c1a1540 con 0x7f5f5c10d160 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f60a41640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f61242640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 0x7f5f5c1a0d70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d750 tx=0x7f5f5400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f59ffb640 1 -- 172.21.15.2:0/299034812 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54017070 con 0x7f5f5c10d160 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f59ffb640 1 -- 172.21.15.2:0/299034812 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f540054d0 con 0x7f5f5c10d160 2024-09-10T23:25:18.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c1a1830 con 0x7f5f5c10d160 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f59ffb640 1 -- 172.21.15.2:0/299034812 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004c60 con 0x7f5f5c10d160 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.955+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c1a7ef0 con 0x7f5f5c10d160 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.958+0000 7f5f6507a740 1 Processor -- start 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.958+0000 7f5f59ffb640 1 -- 172.21.15.2:0/299034812 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5f54004e00 con 0x7f5f5c10d160 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 -- start start 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x5613578618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135786d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x561357870170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5613577d7ea0 con 0x561357861df0 2024-09-10T23:25:18.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5613577c72d0 con 0x5613578614d0 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f6507a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5613577cb0e0 con 0x56135786dd80 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135786d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135786d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37848/0 (socket says 172.21.15.2:37848) 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 -- 172.21.15.2:0/727352474 learned_addr learned my addr 172.21.15.2:0/727352474 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x561357870170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x5613578618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 -- 172.21.15.2:0/727352474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 msgr2=0x561357870170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x561357870170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 -- 172.21.15.2:0/727352474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 msgr2=0x5613578618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x5613578618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.959+0000 7f5f60a41640 1 -- 172.21.15.2:0/727352474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561357525650 con 0x561357861df0 2024-09-10T23:25:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f59ffb640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f440b52e0 0x7f5f440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f60a41640 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135786d840 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27771ff15dc83a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f440b52e0 0x7f5f440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f42ffd640 1 -- 172.21.15.2:0/727352474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c03f070 con 0x561357861df0 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f59ffb640 1 -- 172.21.15.2:0/299034812 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5f540e5650 con 0x7f5f5c10d160 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f42ffd640 1 -- 172.21.15.2:0/727352474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c032e40 con 0x561357861df0 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.960+0000 7f5f42ffd640 1 -- 172.21.15.2:0/727352474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c035070 con 0x561357861df0 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 -- 172.21.15.2:0/727352474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 msgr2=0x56135786d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f440b52e0 0x7f5f440b77a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009270 tx=0x7f5f50005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135786d840 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c032cd0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 -- 172.21.15.2:0/727352474 shutdown_connections 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x561357870170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135786d840 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 --2- 172.21.15.2:0/727352474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x5613578618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 -- 172.21.15.2:0/727352474 >> 172.21.15.2:0/727352474 conn(0x56135785f300 msgr2=0x5613578604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 -- 172.21.15.2:0/727352474 shutdown_connections 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 -- 172.21.15.2:0/727352474 wait complete. 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 -- start start 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.961+0000 7f5f6507a740 1 Processor -- start 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 0x56135786d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x56135786aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135786dd80 0x56135786b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561357628700 con 0x5613578614d0 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561357762160 con 0x56135786dd80 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5613578709f0 con 0x561357861df0 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 10 client.0 _ll_register_callbacks cb 0x56135777b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 0x56135786d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 0x56135786d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37858/0 (socket says 172.21.15.2:37858) 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 -- 172.21.15.2:0/1429529684 learned_addr learned my addr 172.21.15.2:0/1429529684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f61242640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135786dd80 0x56135786b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x56135786aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 -- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 msgr2=0x56135786aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x56135786aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 -- 172.21.15.2:0/1429529684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135786dd80 msgr2=0x56135786b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135786dd80 0x56135786b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 -- 172.21.15.2:0/1429529684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56135778fc90 con 0x5613578614d0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f61242640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135786dd80 0x56135786b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f60a41640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 0x56135786d630 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c000c00 tx=0x7f5f4c031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d295dbc00ec82dff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f3bfff640 1 -- 172.21.15.2:0/1429529684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c04b060 con 0x5613578614d0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f3bfff640 1 -- 172.21.15.2:0/1429529684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5f4c004440 con 0x5613578614d0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.962+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613577d9df0 con 0x5613578614d0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f3bfff640 1 -- 172.21.15.2:0/1429529684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f4c03f030 con 0x5613578614d0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 10 client.15720 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56135787c340 con 0x5613578614d0 2024-09-10T23:25:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f3bfff640 1 -- 172.21.15.2:0/1429529684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5613577d9df0 con 0x5613578614d0 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f3bfff640 1 -- 172.21.15.2:0/1429529684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f4c004a90 con 0x5613578614d0 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 10 client.15720 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 20 client.15720 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x56135787fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 4 client.15720 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613577d58a0 con 0x56135787d690 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.963+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x56135787fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.964+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x56135787fa80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a3b21b9b75d4dc server_cookie=b8aa0b2864dfbdd1 in_seq=0 out_seq=0 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.964+0000 7f5f3bfff640 10 client.15720 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f3bfff640 1 -- 172.21.15.2:0/1429529684 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613577d58a0 con 0x56135787d690 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f3bfff640 10 client.15720 handle_command_reply: tid=0 2024-09-10T23:25:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 client.15720 shutdown 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 msgr2=0x56135786d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 0x56135786d630 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c000c00 tx=0x7f5f4c031810 comp rx=0 tx=0).stop 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 shutdown_connections 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x56135787fa80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f3bfff640 0 client.15720 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135786dd80 0x56135786b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x56135786aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 --2- 172.21.15.2:0/1429529684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613578614d0 0x56135786d630 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 >> 172.21.15.2:0/1429529684 conn(0x56135785f300 msgr2=0x561357864ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 shutdown_connections 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 1 -- 172.21.15.2:0/1429529684 wait complete. 2024-09-10T23:25:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.965+0000 7f5f6507a740 20 client.15720 trim_cache size 0 max 16384 2024-09-10T23:25:18.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 Processor -- start 2024-09-10T23:25:18.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 -- start start 2024-09-10T23:25:18.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357860800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135785ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x56135786c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1b0530 con 0x561357861df0 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1b2070 con 0x5613578614d0 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f6507a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1b0c00 con 0x56135786dd80 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135785ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135785ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37874/0 (socket says 172.21.15.2:37874) 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 -- 172.21.15.2:0/4101974702 learned_addr learned my addr 172.21.15.2:0/4101974702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f61242640 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x56135786c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f60a41640 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357860800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 -- 172.21.15.2:0/4101974702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 msgr2=0x56135786c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x56135786c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 -- 172.21.15.2:0/4101974702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 msgr2=0x561357860800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357860800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.979+0000 7f5f5bfff640 1 -- 172.21.15.2:0/4101974702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56135786b3b0 con 0x561357861df0 2024-09-10T23:25:18.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135785ec10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5f50011be0 tx=0x7f5f50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33b0c6a266f2d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f427fc640 1 -- 172.21.15.2:0/4101974702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5001b070 con 0x561357861df0 2024-09-10T23:25:18.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f427fc640 1 -- 172.21.15.2:0/4101974702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f50022e30 con 0x561357861df0 2024-09-10T23:25:18.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f427fc640 1 -- 172.21.15.2:0/4101974702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50005770 con 0x561357861df0 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 -- 172.21.15.2:0/4101974702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 msgr2=0x56135785ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135785ec10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5f50011be0 tx=0x7f5f50004a40 comp rx=0 tx=0).stop 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 -- 172.21.15.2:0/4101974702 shutdown_connections 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135786dd80 0x56135786c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561357861df0 0x56135785ec10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 --2- 172.21.15.2:0/4101974702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357860800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 -- 172.21.15.2:0/4101974702 >> 172.21.15.2:0/4101974702 conn(0x56135785f300 msgr2=0x56135786c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.980+0000 7f5f6507a740 1 -- 172.21.15.2:0/4101974702 shutdown_connections 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 -- 172.21.15.2:0/4101974702 wait complete. 2024-09-10T23:25:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 -- start start 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 Processor -- start 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357875ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x561357876220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 0x561357872cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1b19a0 con 0x56135786dd80 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1b12d0 con 0x5613578614d0 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1ae510 con 0x561357861df0 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f61242640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 0x561357872cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f6507a740 10 client.0 _ll_register_callbacks cb 0x7f5f50009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.981+0000 7f5f61242640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 0x561357872cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37884/0 (socket says 172.21.15.2:37884) 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 -- 172.21.15.2:0/2995461147 learned_addr learned my addr 172.21.15.2:0/2995461147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f5bfff640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x561357876220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f60a41640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357875ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 -- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 msgr2=0x561357876220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x561357876220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 -- 172.21.15.2:0/2995461147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 msgr2=0x561357875ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357875ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 -- 172.21.15.2:0/2995461147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561357876910 con 0x56135786dd80 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f61242640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 0x561357872cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5f540abdb0 tx=0x7f5f540a7cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39b956a08723aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f3bfff640 1 -- 172.21.15.2:0/2995461147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540d0060 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f3bfff640 1 -- 172.21.15.2:0/2995461147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5f54005120 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f50022e30 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f3bfff640 1 -- 172.21.15.2:0/2995461147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f54020040 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f6507a740 10 client.15726 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.982+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613578ea7d0 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f3bfff640 1 -- 172.21.15.2:0/2995461147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f50022e30 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f3bfff640 1 -- 172.21.15.2:0/2995461147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f540b4f20 con 0x56135786dd80 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f6507a740 10 client.15726 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f6507a740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f6507a740 20 client.15726 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f6507a740 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x5613578ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f6507a740 4 client.15726 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613577d2cd0 con 0x56135787d690 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f60a41640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x5613578ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f60a41640 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x5613578ecf10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82f382ed7665b305 server_cookie=7ffd6390a933c672 in_seq=0 out_seq=0 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.983+0000 7f5f3bfff640 10 client.15726 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f3bfff640 1 -- 172.21.15.2:0/2995461147 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613577d2cd0 con 0x56135787d690 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f3bfff640 10 client.15726 handle_command_reply: tid=0 2024-09-10T23:25:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 client.15726 shutdown 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 msgr2=0x561357872cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 0x561357872cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5f540abdb0 tx=0x7f5f540a7cc0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 shutdown_connections 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135787d690 0x5613578ecf10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135786dd80 0x561357872cb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561357861df0 0x561357876220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 --2- 172.21.15.2:0/2995461147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613578614d0 0x561357875ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 >> 172.21.15.2:0/2995461147 conn(0x56135785f300 msgr2=0x56135786c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f3bfff640 0 client.15726 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 shutdown_connections 2024-09-10T23:25:18.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 1 -- 172.21.15.2:0/2995461147 wait complete. 2024-09-10T23:25:18.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.984+0000 7f5f6507a740 20 client.15726 trim_cache size 0 max 16384 2024-09-10T23:25:18.993 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f440b52e0 msgr2=0x7f5f440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f440b52e0 0x7f5f440b77a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009270 tx=0x7f5f50005bd0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 msgr2=0x7f5f5c1a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 0x7f5f5c1a0d70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d750 tx=0x7f5f5400dc10 comp rx=0 tx=0).stop 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 shutdown_connections 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f440b52e0 0x7f5f440b77a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5c10d160 0x7f5f5c1a0d70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5c1045b0 0x7f5f5c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 --2- 172.21.15.2:0/299034812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5c103bb0 0x7f5f5c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 >> 172.21.15.2:0/299034812 conn(0x7f5f5c0fd700 msgr2=0x7f5f5c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 shutdown_connections 2024-09-10T23:25:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:18.985+0000 7f5f62ca5640 1 -- 172.21.15.2:0/299034812 wait complete. 2024-09-10T23:25:20.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:19 smithi002 ceph-mon[31150]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:25:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:19 smithi154 ceph-mon[35136]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:25:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:19 smithi177 ceph-mon[35760]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:25:20.871 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:25:20.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:25:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 -- 172.21.15.2:0/370546713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8104600 msgr2=0x7f63c810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/370546713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8104600 0x7f63c810caf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009900 tx=0x7f63bc02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 -- 172.21.15.2:0/370546713 shutdown_connections 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/370546713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c810d140 0x7f63c810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/370546713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8104600 0x7f63c810caf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/370546713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c8103ce0 0x7f63c81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 -- 172.21.15.2:0/370546713 >> 172.21.15.2:0/370546713 conn(0x7f63c80fd720 msgr2=0x7f63c80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 -- 172.21.15.2:0/370546713 shutdown_connections 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.608+0000 7f63ce2ee640 1 -- 172.21.15.2:0/370546713 wait complete. 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 Processor -- start 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 -- start start 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c8103ce0 0x7f63c8101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8104600 0x7f63c8101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 0x7f63c8102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8112db0 con 0x7f63c810d140 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8112c30 con 0x7f63c8104600 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63ce2ee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8112f30 con 0x7f63c8103ce0 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.609+0000 7f63cc88b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 0x7f63c8102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 0x7f63c8102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34010/0 (socket says 172.21.15.2:34010) 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 -- 172.21.15.2:0/1474567291 learned_addr learned my addr 172.21.15.2:0/1474567291 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63c77fe640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8104600 0x7f63c8101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63c7fff640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c8103ce0 0x7f63c8101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 -- 172.21.15.2:0/1474567291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c8103ce0 msgr2=0x7f63c8101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c8103ce0 0x7f63c8101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 -- 172.21.15.2:0/1474567291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8104600 msgr2=0x7f63c8101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8104600 0x7f63c8101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 -- 172.21.15.2:0/1474567291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c81a76e0 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63cc88b640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 0x7f63c8102410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f63c000eaa0 tx=0x7f63c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63c57fa640 1 -- 172.21.15.2:0/1474567291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c000cdb0 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63c57fa640 1 -- 172.21.15.2:0/1474567291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63c0005020 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c81a79d0 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63c57fa640 1 -- 172.21.15.2:0/1474567291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c00116d0 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.610+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c81a7e90 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.613+0000 7f63d06c3740 1 Processor -- start 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.613+0000 7f63c57fa640 1 -- 172.21.15.2:0/1474567291 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f63c000f040 con 0x7f63c810d140 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 -- start start 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c9422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c950b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d76c8b8e60 con 0x55d76c942800 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d76c8a8290 con 0x55d76c941ee0 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63d06c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d76c8ac0a0 con 0x55d76c94e790 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34012/0 (socket says 172.21.15.2:34012) 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 -- 172.21.15.2:0/541722379 learned_addr learned my addr 172.21.15.2:0/541722379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c77fe640 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c950b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 -- 172.21.15.2:0/541722379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 msgr2=0x55d76c950b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c950b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c77fe640 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c9422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 -- 172.21.15.2:0/541722379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 msgr2=0x55d76c9422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c9422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 -- 172.21.15.2:0/541722379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d76c606930 con 0x55d76c942800 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c77fe640 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c9422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c7fff640 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94e250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f63b800bce0 tx=0x7f63b800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228647c6b18bf997 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.614+0000 7f63c57fa640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63b00b52e0 0x7f63b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63ae7fc640 1 -- 172.21.15.2:0/541722379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8015070 con 0x55d76c942800 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63c77fe640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63b00b52e0 0x7f63b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63ae7fc640 1 -- 172.21.15.2:0/541722379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63b801a910 con 0x55d76c942800 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63ae7fc640 1 -- 172.21.15.2:0/541722379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b80119a0 con 0x55d76c942800 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63c57fa640 1 -- 172.21.15.2:0/1474567291 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63c00e5b40 con 0x7f63c810d140 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 -- 172.21.15.2:0/541722379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 msgr2=0x55d76c94e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63c77fe640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63b00b52e0 0x7f63b00b77a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f63bc000c00 tx=0x7f63bc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94e250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f63b800bce0 tx=0x7f63b800f730 comp rx=0 tx=0).stop 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 -- 172.21.15.2:0/541722379 shutdown_connections 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c950b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94e250 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 --2- 172.21.15.2:0/541722379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c9422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.615+0000 7f63d06c3740 1 -- 172.21.15.2:0/541722379 >> 172.21.15.2:0/541722379 conn(0x55d76c93fd10 msgr2=0x55d76c940eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 -- 172.21.15.2:0/541722379 shutdown_connections 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 -- 172.21.15.2:0/541722379 wait complete. 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 -- start start 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 Processor -- start 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c94b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c94c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d76c709890 con 0x55d76c942800 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d76c842d40 con 0x55d76c941ee0 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d76c951440 con 0x55d76c94e790 2024-09-10T23:25:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.616+0000 7f63d06c3740 10 client.0 _ll_register_callbacks cb 0x55d76c8a6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34024/0 (socket says 172.21.15.2:34024) 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 -- 172.21.15.2:0/410003966 learned_addr learned my addr 172.21.15.2:0/410003966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c7fff640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c94b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63cc88b640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c94c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 -- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 msgr2=0x55d76c94c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c94c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 -- 172.21.15.2:0/410003966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 msgr2=0x55d76c94b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c94b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 -- 172.21.15.2:0/410003966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d76c95a870 con 0x55d76c942800 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63c77fe640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94bcb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f63bc032fd0 tx=0x7f63bc005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e432a378e04da68a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:21.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63a77fe640 1 -- 172.21.15.2:0/410003966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc035040 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63a77fe640 1 -- 172.21.15.2:0/410003966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63bc004050 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63b801a910 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63a77fe640 1 -- 172.21.15.2:0/410003966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63bc004250 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63d06c3740 10 client.15738 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.617+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d76c95d190 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63a77fe640 1 -- 172.21.15.2:0/410003966 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63b801a910 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63a77fe640 1 -- 172.21.15.2:0/410003966 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63bc03a040 con 0x55d76c942800 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63d06c3740 10 client.15738 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63d06c3740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63d06c3740 20 client.15738 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63d06c3740 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c95e740 0x55d76c960ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63d06c3740 4 client.15738 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d76c8badb0 con 0x55d76c95e740 2024-09-10T23:25:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.618+0000 7f63c7fff640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c95e740 0x55d76c960ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.619+0000 7f63c7fff640 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c95e740 0x55d76c960ba0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a442fdafc34497e server_cookie=dbd6b5c9eb1a5c61 in_seq=0 out_seq=0 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.619+0000 7f63a77fe640 10 client.15738 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.619+0000 7f63a77fe640 1 -- 172.21.15.2:0/410003966 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d76c8badb0 con 0x55d76c95e740 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.619+0000 7f63a77fe640 10 client.15738 handle_command_reply: tid=0 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.619+0000 7f63d06c3740 1 client.15738 shutdown 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 msgr2=0x55d76c94bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94bcb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f63bc032fd0 tx=0x7f63bc005b50 comp rx=0 tx=0).stop 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 shutdown_connections 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c95e740 0x55d76c960ba0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c94e790 0x55d76c94c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c94bcb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63a77fe640 0 client.15738 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 --2- 172.21.15.2:0/410003966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c94b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 >> 172.21.15.2:0/410003966 conn(0x55d76c93fd10 msgr2=0x55d76c93ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 shutdown_connections 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 1 -- 172.21.15.2:0/410003966 wait complete. 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.620+0000 7f63d06c3740 20 client.15738 trim_cache size 0 max 16384 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 Processor -- start 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 -- start start 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c941220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c942800 0x55d76c966470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 0x55d76c9669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63c81b0540 con 0x55d76c94e790 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63c81b2080 con 0x55d76c941ee0 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63d06c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63c81b0c10 con 0x55d76c942800 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63cc88b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 0x55d76c9669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63cc88b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 0x55d76c9669b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34028/0 (socket says 172.21.15.2:34028) 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63cc88b640 1 -- 172.21.15.2:0/16755232 learned_addr learned my addr 172.21.15.2:0/16755232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.638+0000 7f63c7fff640 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c941220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63c77fe640 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c942800 0x55d76c966470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63cc88b640 1 -- 172.21.15.2:0/16755232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c942800 msgr2=0x55d76c966470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63cc88b640 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c942800 0x55d76c966470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63cc88b640 1 -- 172.21.15.2:0/16755232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 msgr2=0x55d76c941220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63cc88b640 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c941220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63cc88b640 1 -- 172.21.15.2:0/16755232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d76c93fb40 con 0x55d76c94e790 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63cc88b640 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 0x55d76c9669b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f63c00ac240 tx=0x7f63c00b5180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b62b20e6be2cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63adffb640 1 -- 172.21.15.2:0/16755232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c001f070 con 0x55d76c94e790 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63adffb640 1 -- 172.21.15.2:0/16755232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63c00ac2b0 con 0x55d76c94e790 2024-09-10T23:25:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.639+0000 7f63adffb640 1 -- 172.21.15.2:0/16755232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c00cf0f0 con 0x55d76c94e790 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 -- 172.21.15.2:0/16755232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 msgr2=0x55d76c9669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 0x55d76c9669b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f63c00ac240 tx=0x7f63c00b5180 comp rx=0 tx=0).stop 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 -- 172.21.15.2:0/16755232 shutdown_connections 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c94e790 0x55d76c9669b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c942800 0x55d76c966470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 --2- 172.21.15.2:0/16755232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c941ee0 0x55d76c941220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 -- 172.21.15.2:0/16755232 >> 172.21.15.2:0/16755232 conn(0x55d76c93fd10 msgr2=0x55d76c94d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 -- 172.21.15.2:0/16755232 shutdown_connections 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 -- 172.21.15.2:0/16755232 wait complete. 2024-09-10T23:25:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 -- start start 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.640+0000 7f63d06c3740 1 Processor -- start 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c941ee0 0x55d76c9536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c953be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c94e790 0x55d76c954120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63c81b19b0 con 0x55d76c942800 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63c81b12e0 con 0x55d76c94e790 2024-09-10T23:25:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63c81ae520 con 0x55d76c941ee0 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 10 client.0 _ll_register_callbacks cb 0x7f63bc041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c953be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c953be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34038/0 (socket says 172.21.15.2:34038) 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 -- 172.21.15.2:0/2019022469 learned_addr learned my addr 172.21.15.2:0/2019022469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c7fff640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c941ee0 0x55d76c9536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63cc88b640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c94e790 0x55d76c954120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 -- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c941ee0 msgr2=0x55d76c9536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c941ee0 0x55d76c9536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 -- 172.21.15.2:0/2019022469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c94e790 msgr2=0x55d76c954120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c94e790 0x55d76c954120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 -- 172.21.15.2:0/2019022469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d76c95a6a0 con 0x55d76c942800 2024-09-10T23:25:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63c77fe640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c953be0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009900 tx=0x7f63bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609dff43c74cff5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63a77fe640 1 -- 172.21.15.2:0/2019022469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc035070 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63a77fe640 1 -- 172.21.15.2:0/2019022469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63bc0051a0 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.641+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63c00ac2b0 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63a77fe640 1 -- 172.21.15.2:0/2019022469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63bc0053a0 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 10 client.15744 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d76c9cc8a0 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63a77fe640 1 -- 172.21.15.2:0/2019022469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63c00ac2b0 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63a77fe640 1 -- 172.21.15.2:0/2019022469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63bc067030 con 0x55d76c942800 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 10 client.15744 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 20 client.15744 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c9cd0a0 0x55d76c9cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 4 client.15744 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d76c8b6860 con 0x55d76c9cd0a0 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.642+0000 7f63c7fff640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c9cd0a0 0x55d76c9cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.643+0000 7f63a77fe640 10 client.15744 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.643+0000 7f63c7fff640 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c9cd0a0 0x55d76c9cf4c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eba68c6a5802da3 server_cookie=983caea40eeacf1b in_seq=0 out_seq=0 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63a77fe640 1 -- 172.21.15.2:0/2019022469 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d76c8b6860 con 0x55d76c9cd0a0 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63a77fe640 10 client.15744 handle_command_reply: tid=0 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 client.15744 shutdown 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 msgr2=0x55d76c953be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c953be0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009900 tx=0x7f63bc0048f0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 shutdown_connections 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d76c9cd0a0 0x55d76c9cf4c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d76c94e790 0x55d76c954120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d76c942800 0x55d76c953be0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 --2- 172.21.15.2:0/2019022469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d76c941ee0 0x55d76c9536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 >> 172.21.15.2:0/2019022469 conn(0x55d76c93fd10 msgr2=0x55d76c94d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.645+0000 7f63a77fe640 0 client.15744 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 shutdown_connections 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63d06c3740 1 -- 172.21.15.2:0/2019022469 wait complete. 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63d06c3740 20 client.15744 trim_cache size 0 max 16384 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "5ec070e2-21f4-4ff8-b35f-6dee14a62655", 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:25:21.659 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63b00b52e0 msgr2=0x7f63b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63b00b52e0 0x7f63b00b77a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f63bc000c00 tx=0x7f63bc031400 comp rx=0 tx=0).stop 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 msgr2=0x7f63c8102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 0x7f63c8102410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f63c000eaa0 tx=0x7f63c000ef60 comp rx=0 tx=0).stop 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 shutdown_connections 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63b00b52e0 0x7f63b00b77a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c810d140 0x7f63c8102410 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8104600 0x7f63c8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 --2- 172.21.15.2:0/1474567291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c8103ce0 0x7f63c8101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:21.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 >> 172.21.15.2:0/1474567291 conn(0x7f63c80fd720 msgr2=0x7f63c80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:21.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 shutdown_connections 2024-09-10T23:25:21.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:21.646+0000 7f63ce2ee640 1 -- 172.21.15.2:0/1474567291 wait complete. 2024-09-10T23:25:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:21 smithi154 ceph-mon[35136]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T23:25:22.287 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:21 smithi002 ceph-mon[31150]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T23:25:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:21 smithi177 ceph-mon[35760]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T23:25:22.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:25:22.734 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:23.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:23 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:25:23.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:23 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:23.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:23 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:25:23.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:23 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 -- 172.21.15.2:0/724442682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d18102dc0 msgr2=0x7f4d181031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 --2- 172.21.15.2:0/724442682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d18102dc0 0x7f4d181031a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009900 tx=0x7f4d1402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 -- 172.21.15.2:0/724442682 shutdown_connections 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 --2- 172.21.15.2:0/724442682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d18109150 0x7f4d1810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 --2- 172.21.15.2:0/724442682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d181087d0 0x7f4d18108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 --2- 172.21.15.2:0/724442682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d18102dc0 0x7f4d181031a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 -- 172.21.15.2:0/724442682 >> 172.21.15.2:0/724442682 conn(0x7f4d180fe830 msgr2=0x7f4d18100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 -- 172.21.15.2:0/724442682 shutdown_connections 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.240+0000 7f4d1f434640 1 -- 172.21.15.2:0/724442682 wait complete. 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 Processor -- start 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 -- start start 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d18102dc0 0x7f4d181992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 0x7f4d181997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d18109150 0x7f4d1819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18112e10 con 0x7f4d181087d0 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18112c90 con 0x7f4d18109150 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1f434640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18112f90 con 0x7f4d18102dc0 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 0x7f4d181997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 0x7f4d181997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34064/0 (socket says 172.21.15.2:34064) 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.241+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2982508352 learned_addr learned my addr 172.21.15.2:0/2982508352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d18102dc0 0x7f4d181992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d18109150 0x7f4d1819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2982508352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d18102dc0 msgr2=0x7f4d181992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d18102dc0 0x7f4d181992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2982508352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d18109150 msgr2=0x7f4d1819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d18109150 0x7f4d1819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2982508352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1819f350 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 0x7f4d181997e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00d950 tx=0x7f4d0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d0a7fc640 1 -- 172.21.15.2:0/2982508352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c017070 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d0a7fc640 1 -- 172.21.15.2:0/2982508352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d0c009c30 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1819f640 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d0a7fc640 1 -- 172.21.15.2:0/2982508352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00f620 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.242+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181a5ed0 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 Processor -- start 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 -- start start 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b060f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d0a7fc640 1 -- 172.21.15.2:0/2982508352 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f4d0c010460 con 0x7f4d181087d0 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b061fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0622530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594b0585e50 con 0x5594b0620140 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594b0575280 con 0x5594b060f480 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d21809740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5594b0579090 con 0x5594b060fda0 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0622530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0622530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34080/0 (socket says 172.21.15.2:34080) 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/3820241723 learned_addr learned my addr 172.21.15.2:0/3820241723 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b060f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.245+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b061fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/3820241723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 msgr2=0x5594b061fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b061fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/3820241723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 msgr2=0x5594b060f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b060f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/3820241723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b02d3650 con 0x5594b0620140 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b060f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0622530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0ebc40 tx=0x7f4d0c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18647291f3aa2ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d0a7fc640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4d040b5360 0x7f4d040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d037fe640 1 -- 172.21.15.2:0/3820241723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0f4070 con 0x5594b0620140 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4d040b5360 0x7f4d040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d037fe640 1 -- 172.21.15.2:0/3820241723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d0c0abac0 con 0x5594b0620140 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d037fe640 1 -- 172.21.15.2:0/3820241723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0abd80 con 0x5594b0620140 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.246+0000 7f4d0a7fc640 1 -- 172.21.15.2:0/2982508352 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4d0c0e5730 con 0x7f4d181087d0 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 -- 172.21.15.2:0/3820241723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 msgr2=0x5594b0622530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4d040b5360 0x7f4d040b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d10005fd0 tx=0x7f4d10009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0622530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0ebc40 tx=0x7f4d0c0ed690 comp rx=0 tx=0).stop 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 -- 172.21.15.2:0/3820241723 shutdown_connections 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0622530 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b061fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 --2- 172.21.15.2:0/3820241723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b060f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 -- 172.21.15.2:0/3820241723 >> 172.21.15.2:0/3820241723 conn(0x5594b060d2b0 msgr2=0x5594b060e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 -- 172.21.15.2:0/3820241723 shutdown_connections 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.247+0000 7f4d21809740 1 -- 172.21.15.2:0/3820241723 wait complete. 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 -- start start 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 Processor -- start 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060f480 0x5594b061f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 0x5594b061ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b0620140 0x5594b061d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594b03d6700 con 0x5594b060fda0 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594b0510110 con 0x5594b0620140 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5594b0622df0 con 0x5594b060f480 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d21809740 10 client.0 _ll_register_callbacks cb 0x5594b0529990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 0x5594b061ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 0x5594b061ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34086/0 (socket says 172.21.15.2:34086) 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2467406733 learned_addr learned my addr 172.21.15.2:0/2467406733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.248+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060f480 0x5594b061f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b0620140 0x5594b061d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060f480 msgr2=0x5594b061f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060f480 0x5594b061f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2467406733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b0620140 msgr2=0x5594b061d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b0620140 0x5594b061d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/2467406733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594b053dc40 con 0x5594b060fda0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060f480 0x5594b061f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 0x5594b061ce10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0eb1b0 tx=0x7f4d0c00df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d08ae8275e3a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d00ff9640 1 -- 172.21.15.2:0/2467406733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c04fe20 con 0x5594b060fda0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d00ff9640 1 -- 172.21.15.2:0/2467406733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4d0c0e5be0 con 0x5594b060fda0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d0c0abac0 con 0x5594b060fda0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d00ff9640 1 -- 172.21.15.2:0/2467406733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d0c020030 con 0x5594b060fda0 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d21809740 10 client.15756 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594b062e6c0 con 0x5594b060fda0 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.249+0000 7f4d00ff9640 1 -- 172.21.15.2:0/2467406733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d0c009de0 con 0x5594b060fda0 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d00ff9640 1 -- 172.21.15.2:0/2467406733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4d0c0ac210 con 0x5594b060fda0 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d21809740 10 client.15756 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d21809740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d21809740 20 client.15756 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d21809740 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b062fa10 0x5594b0631e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d21809740 4 client.15756 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d0c0abac0 con 0x5594b062fa10 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b062fa10 0x5594b0631e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b062fa10 0x5594b0631e00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9536dd1e359380 server_cookie=ad8d0d49d895749a in_seq=0 out_seq=0 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.250+0000 7f4d00ff9640 10 client.15756 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.251+0000 7f4d00ff9640 1 -- 172.21.15.2:0/2467406733 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4d0c0abac0 con 0x5594b062fa10 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.251+0000 7f4d00ff9640 10 client.15756 handle_command_reply: tid=0 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.251+0000 7f4d21809740 1 client.15756 shutdown 2024-09-10T23:25:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.251+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 msgr2=0x5594b061ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.251+0000 7f4d21809740 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 0x5594b061ce10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0eb1b0 tx=0x7f4d0c00df40 comp rx=0 tx=0).stop 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 shutdown_connections 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b062fa10 0x5594b0631e00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b0620140 0x5594b061d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060fda0 0x5594b061ce10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 --2- 172.21.15.2:0/2467406733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060f480 0x5594b061f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d00ff9640 0 client.15756 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 >> 172.21.15.2:0/2467406733 conn(0x5594b060d2b0 msgr2=0x5594b0612e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 shutdown_connections 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 1 -- 172.21.15.2:0/2467406733 wait complete. 2024-09-10T23:25:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.252+0000 7f4d21809740 20 client.15756 trim_cache size 0 max 16384 2024-09-10T23:25:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 Processor -- start 2024-09-10T23:25:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 -- start start 2024-09-10T23:25:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 0x5594b062c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060fda0 0x5594b060e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b0620140 0x5594b060e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181ac1b0 con 0x5594b060f480 2024-09-10T23:25:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181adcf0 con 0x5594b060fda0 2024-09-10T23:25:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d21809740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181ac880 con 0x5594b0620140 2024-09-10T23:25:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d1d1d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 0x5594b062c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d1d1d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 0x5594b062c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34094/0 (socket says 172.21.15.2:34094) 2024-09-10T23:25:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.270+0000 7f4d1d1d0640 1 -- 172.21.15.2:0/4258943630 learned_addr learned my addr 172.21.15.2:0/4258943630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060fda0 0x5594b060e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b0620140 0x5594b060e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d1d0640 1 -- 172.21.15.2:0/4258943630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b0620140 msgr2=0x5594b060e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b0620140 0x5594b060e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d1d0640 1 -- 172.21.15.2:0/4258943630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060fda0 msgr2=0x5594b060e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060fda0 0x5594b060e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d1d0640 1 -- 172.21.15.2:0/4258943630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b06225a0 con 0x5594b060f480 2024-09-10T23:25:23.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060fda0 0x5594b060e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:23.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 0x5594b062c020 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d1402a930 tx=0x7f4d14005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f7a449dcaac862 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d02ffd640 1 -- 172.21.15.2:0/4258943630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14035040 con 0x5594b060f480 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d02ffd640 1 -- 172.21.15.2:0/4258943630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d14004430 con 0x5594b060f480 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.271+0000 7f4d02ffd640 1 -- 172.21.15.2:0/4258943630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d140035f0 con 0x5594b060f480 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 -- 172.21.15.2:0/4258943630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 msgr2=0x5594b062c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 0x5594b062c020 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d1402a930 tx=0x7f4d14005c00 comp rx=0 tx=0).stop 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 -- 172.21.15.2:0/4258943630 shutdown_connections 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b0620140 0x5594b060e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060fda0 0x5594b060e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 --2- 172.21.15.2:0/4258943630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b060f480 0x5594b062c020 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 -- 172.21.15.2:0/4258943630 >> 172.21.15.2:0/4258943630 conn(0x5594b060d2b0 msgr2=0x5594b061b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 -- 172.21.15.2:0/4258943630 shutdown_connections 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 -- 172.21.15.2:0/4258943630 wait complete. 2024-09-10T23:25:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 -- start start 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.272+0000 7f4d21809740 1 Processor -- start 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b06289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b0623040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0623730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181ad620 con 0x5594b0620140 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181acf50 con 0x5594b060f480 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181aa190 con 0x5594b060fda0 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d21809740 10 client.0 _ll_register_callbacks cb 0x7f4d10009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0623730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b0623040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1c9cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b0623040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:55010/0 (socket says 172.21.15.2:55010) 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0623730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34098/0 (socket says 172.21.15.2:34098) 2024-09-10T23:25:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1c9cf640 1 -- 172.21.15.2:0/405479650 learned_addr learned my addr 172.21.15.2:0/405479650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b06289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 -- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 msgr2=0x5594b0623040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b0623040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 -- 172.21.15.2:0/405479650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 msgr2=0x5594b06289d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b06289d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d9d1640 1 -- 172.21.15.2:0/405479650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594b060fbd0 con 0x5594b0620140 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b06289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.273+0000 7f4d1c9cf640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b0623040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d1d9d1640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0623730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5594b0620110 tx=0x7f4d10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e47e6b4cbdf40b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d00ff9640 1 -- 172.21.15.2:0/405479650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1002f060 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d14004430 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d00ff9640 1 -- 172.21.15.2:0/405479650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4d10021b10 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d00ff9640 1 -- 172.21.15.2:0/405479650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d10021d10 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 10 client.15762 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594b069d700 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d00ff9640 1 -- 172.21.15.2:0/405479650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d14004430 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d00ff9640 1 -- 172.21.15.2:0/405479650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4d1000f040 con 0x5594b0620140 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 10 client.15762 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 20 client.15762 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.274+0000 7f4d21809740 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b069de90 0x5594b06a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d21809740 4 client.15762 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594b0587da0 con 0x5594b069de90 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b069de90 0x5594b06a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d00ff9640 10 client.15762 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d1d1d0640 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b069de90 0x5594b06a02b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91368e84e4b5a1f1 server_cookie=e765831755706923 in_seq=0 out_seq=0 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d00ff9640 1 -- 172.21.15.2:0/405479650 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x5594b0587da0 con 0x5594b069de90 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.275+0000 7f4d00ff9640 10 client.15762 handle_command_reply: tid=0 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 client.15762 shutdown 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 msgr2=0x5594b0623730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0623730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5594b0620110 tx=0x7f4d10004a40 comp rx=0 tx=0).stop 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 shutdown_connections 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5594b069de90 0x5594b06a02b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594b0620140 0x5594b0623730 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594b060fda0 0x5594b0623040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 --2- 172.21.15.2:0/405479650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594b060f480 0x5594b06289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d00ff9640 0 client.15762 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 >> 172.21.15.2:0/405479650 conn(0x5594b060d2b0 msgr2=0x5594b061b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 shutdown_connections 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 1 -- 172.21.15.2:0/405479650 wait complete. 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d21809740 20 client.15762 trim_cache size 0 max 16384 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:25:23.290 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:23.291 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:23.292 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:25:23.293 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:23 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:25:23.293 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:23 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:23.293 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:23 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:25:23.293 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:23 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4d040b5360 msgr2=0x7f4d040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d1f434640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4d040b5360 0x7f4d040b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d10005fd0 tx=0x7f4d10009600 comp rx=0 tx=0).stop 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 msgr2=0x7f4d181997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.276+0000 7f4d1f434640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 0x7f4d181997e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00d950 tx=0x7f4d0c00de10 comp rx=0 tx=0).stop 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 shutdown_connections 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4d040b5360 0x7f4d040b7820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d18109150 0x7f4d1819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d181087d0 0x7f4d181997e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 --2- 172.21.15.2:0/2982508352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d18102dc0 0x7f4d181992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 >> 172.21.15.2:0/2982508352 conn(0x7f4d180fe830 msgr2=0x7f4d18100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 shutdown_connections 2024-09-10T23:25:23.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:23.277+0000 7f4d1f434640 1 -- 172.21.15.2:0/2982508352 wait complete. 2024-09-10T23:25:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:23 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:25:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:23 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:23 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:25:23.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:23 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:24.016 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:25:24.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:25:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:24.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:24 smithi154 ceph-mon[35136]: pgmap v383: 97 pgs: 97 active+clean; 735 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 14 op/s 2024-09-10T23:25:24.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:24 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:25:24.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:24 smithi002 ceph-mon[31150]: pgmap v383: 97 pgs: 97 active+clean; 735 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 14 op/s 2024-09-10T23:25:24.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:24 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:25:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:24 smithi177 ceph-mon[35760]: pgmap v383: 97 pgs: 97 active+clean; 735 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 14 op/s 2024-09-10T23:25:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:24 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 -- 172.21.15.2:0/3081716782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398109150 msgr2=0x7fd39810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/3081716782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398109150 0x7fd39810f950 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd390009ca0 tx=0x7fd39002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 -- 172.21.15.2:0/3081716782 shutdown_connections 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/3081716782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398109150 0x7fd39810f950 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/3081716782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 0x7fd398108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/3081716782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd398102dc0 0x7fd3981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 -- 172.21.15.2:0/3081716782 >> 172.21.15.2:0/3081716782 conn(0x7fd3980fe830 msgr2=0x7fd398100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 -- 172.21.15.2:0/3081716782 shutdown_connections 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.774+0000 7fd39d7d3640 1 -- 172.21.15.2:0/3081716782 wait complete. 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 Processor -- start 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 -- start start 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 0x7fd3981992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 0x7fd398199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd398109150 0x7fd39819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd398112e10 con 0x7fd398102dc0 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd398112c90 con 0x7fd398109150 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd39d7d3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd398112f90 con 0x7fd3981087d0 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd396ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 0x7fd3981992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd396ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 0x7fd3981992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34124/0 (socket says 172.21.15.2:34124) 2024-09-10T23:25:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd396ffd640 1 -- 172.21.15.2:0/2049836899 learned_addr learned my addr 172.21.15.2:0/2049836899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd3977fe640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd398109150 0x7fd39819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd38ffff640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 0x7fd398199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.775+0000 7fd396ffd640 1 -- 172.21.15.2:0/2049836899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 msgr2=0x7fd398199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd396ffd640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 0x7fd398199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd396ffd640 1 -- 172.21.15.2:0/2049836899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd398109150 msgr2=0x7fd39819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd396ffd640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd398109150 0x7fd39819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd396ffd640 1 -- 172.21.15.2:0/2049836899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39819f370 con 0x7fd398102dc0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd38ffff640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 0x7fd398199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd396ffd640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 0x7fd3981992c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b4a0 tx=0x7fd38800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388014070 con 0x7fd398102dc0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39819f660 con 0x7fd398102dc0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd388010ac0 con 0x7fd398102dc0 2024-09-10T23:25:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388017c30 con 0x7fd398102dc0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.776+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3981a5da0 con 0x7fd398102dc0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.777+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3981031a0 con 0x7fd398102dc0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.778+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd388010610 con 0x7fd398102dc0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.779+0000 7fd394ff9640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3840b52e0 0x7fd3840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.779+0000 7fd38ffff640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3840b52e0 0x7fd3840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.779+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd3880e5590 con 0x7fd398102dc0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.780+0000 7fd38ffff640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3840b52e0 0x7fd3840b77a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd398102120 tx=0x7fd380005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:24.783+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3880ac400 con 0x7fd398102dc0 2024-09-10T23:25:25.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.008+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd39802e5c0 con 0x7fd398102dc0 2024-09-10T23:25:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.009+0000 7fd394ff9640 1 -- 172.21.15.2:0/2049836899 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fd3880abd00 con 0x7fd398102dc0 2024-09-10T23:25:25.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:25:25.010 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:25:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:25:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3840b52e0 msgr2=0x7fd3840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3840b52e0 0x7fd3840b77a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd398102120 tx=0x7fd380005e50 comp rx=0 tx=0).stop 2024-09-10T23:25:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 msgr2=0x7fd3981992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 0x7fd3981992c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b4a0 tx=0x7fd38800b960 comp rx=0 tx=0).stop 2024-09-10T23:25:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 shutdown_connections 2024-09-10T23:25:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3840b52e0 0x7fd3840b77a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd398109150 0x7fd39819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3981087d0 0x7fd398199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 --2- 172.21.15.2:0/2049836899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd398102dc0 0x7fd3981992c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 >> 172.21.15.2:0/2049836899 conn(0x7fd3980fe830 msgr2=0x7fd398100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 shutdown_connections 2024-09-10T23:25:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:25.011+0000 7fd39d7d3640 1 -- 172.21.15.2:0/2049836899 wait complete. 2024-09-10T23:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- 172.21.15.2:0/1422390676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 msgr2=0x7fec78102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/1422390676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec78102e60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fec68009930 tx=0x7fec6802a420 comp rx=0 tx=0).stop 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- 172.21.15.2:0/1422390676 shutdown_connections 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/1422390676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec781033a0 0x7fec78109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/1422390676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec78102e60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/1422390676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec78101890 0x7fec78101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- 172.21.15.2:0/1422390676 >> 172.21.15.2:0/1422390676 conn(0x7fec780fd170 msgr2=0x7fec780ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- 172.21.15.2:0/1422390676 shutdown_connections 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- 172.21.15.2:0/1422390676 wait complete. 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 Processor -- start 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- start start 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec78101890 0x7fec7806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec7819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec781033a0 0x7fec7819ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d500 con 0x7fec781029e0 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d380 con 0x7fec78101890 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.372+0000 7fec7f4a9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d680 con 0x7fec781033a0 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec7819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec7819d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34146/0 (socket says 172.21.15.2:34146) 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 -- 172.21.15.2:0/3778229377 learned_addr learned my addr 172.21.15.2:0/3778229377 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7da46640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec781033a0 0x7fec7819ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7d245640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec78101890 0x7fec7806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 -- 172.21.15.2:0/3778229377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec781033a0 msgr2=0x7fec7819ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec781033a0 0x7fec7819ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 -- 172.21.15.2:0/3778229377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec78101890 msgr2=0x7fec7806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec78101890 0x7fec7806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 -- 172.21.15.2:0/3778229377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec781a0880 con 0x7fec781029e0 2024-09-10T23:25:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7ca44640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec7819d9d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fec68009a50 tx=0x7fec680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec6e7fc640 1 -- 172.21.15.2:0/3778229377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6803f030 con 0x7fec781029e0 2024-09-10T23:25:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec6e7fc640 1 -- 172.21.15.2:0/3778229377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec68003cb0 con 0x7fec781029e0 2024-09-10T23:25:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781a0b10 con 0x7fec781029e0 2024-09-10T23:25:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec6e7fc640 1 -- 172.21.15.2:0/3778229377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68035070 con 0x7fec781029e0 2024-09-10T23:25:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.373+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781a1000 con 0x7fec781029e0 2024-09-10T23:25:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 Processor -- start 2024-09-10T23:25:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 -- start start 2024-09-10T23:25:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec6e7fc640 1 -- 172.21.15.2:0/3778229377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fec6803bb90 con 0x7fec781029e0 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20dd860 0x55c4d20dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20e2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4d204f6f0 con 0x55c4d20e0190 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c4d203eb20 con 0x55c4d20e2bd0 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec82272740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c4d2042930 con 0x55c4d20dd860 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20e2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20e2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34162/0 (socket says 172.21.15.2:34162) 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 -- 172.21.15.2:0/1847599112 learned_addr learned my addr 172.21.15.2:0/1847599112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7da46640 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20dd860 0x55c4d20dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7ca44640 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 -- 172.21.15.2:0/1847599112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20dd860 msgr2=0x55c4d20dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20dd860 0x55c4d20dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 -- 172.21.15.2:0/1847599112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e2bd0 msgr2=0x55c4d20e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.377+0000 7fec7d245640 1 -- 172.21.15.2:0/1847599112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4d2004530 con 0x55c4d20e0190 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec6e7fc640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec640b52e0 0x7fec640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec7d245640 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20e2580 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fec7400cc60 tx=0x7fec7400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f4589cedfc681a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec7da46640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec640b52e0 0x7fec640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec6e7fc640 1 -- 172.21.15.2:0/3778229377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fec681068c0 con 0x7fec781029e0 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec637fe640 1 -- 172.21.15.2:0/1847599112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74014070 con 0x55c4d20e0190 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec637fe640 1 -- 172.21.15.2:0/1847599112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec740047a0 con 0x55c4d20e0190 2024-09-10T23:25:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.378+0000 7fec637fe640 1 -- 172.21.15.2:0/1847599112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74010690 con 0x55c4d20e0190 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- 172.21.15.2:0/1847599112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 msgr2=0x55c4d20e2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec7da46640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec640b52e0 0x7fec640b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fec70005fd0 tx=0x7fec70009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20e2580 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fec7400cc60 tx=0x7fec7400e720 comp rx=0 tx=0).stop 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- 172.21.15.2:0/1847599112 shutdown_connections 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20e2580 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- 172.21.15.2:0/1847599112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20dd860 0x55c4d20dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- 172.21.15.2:0/1847599112 >> 172.21.15.2:0/1847599112 conn(0x55c4d20d89b0 msgr2=0x55c4d20d9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- 172.21.15.2:0/1847599112 shutdown_connections 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- 172.21.15.2:0/1847599112 wait complete. 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- start start 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 Processor -- start 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4d1f76ab0 con 0x55c4d20dd860 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c4d1fe4730 con 0x55c4d20e0190 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c4d20e5bb0 con 0x55c4d20e2bd0 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.379+0000 7fec82272740 10 client.0 _ll_register_callbacks cb 0x55c4d20386b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20e6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34170/0 (socket says 172.21.15.2:34170) 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 -- 172.21.15.2:0/2095809717 learned_addr learned my addr 172.21.15.2:0/2095809717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7da46640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 -- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 msgr2=0x55c4d20e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 -- 172.21.15.2:0/2095809717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 msgr2=0x55c4d20e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 -- 172.21.15.2:0/2095809717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4d1da0790 con 0x55c4d20dd860 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec7d245640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20e6f30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fec74010c60 tx=0x7fec74010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00725728a3d2c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec60ff9640 1 -- 172.21.15.2:0/2095809717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74014070 con 0x55c4d20dd860 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec60ff9640 1 -- 172.21.15.2:0/2095809717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fec74004020 con 0x55c4d20dd860 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec740047a0 con 0x55c4d20dd860 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec60ff9640 1 -- 172.21.15.2:0/2095809717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec74010e30 con 0x55c4d20dd860 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec82272740 10 client.15780 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.380+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c4d1e19620 con 0x55c4d20dd860 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec60ff9640 1 -- 172.21.15.2:0/2095809717 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec740047a0 con 0x55c4d20dd860 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec60ff9640 1 -- 172.21.15.2:0/2095809717 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec740035f0 con 0x55c4d20dd860 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec82272740 10 client.15780 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec82272740 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec82272740 20 client.15780 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec82272740 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d20f24e0 0x55c4d20f4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec82272740 4 client.15780 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4d2051640 con 0x55c4d20f24e0 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.381+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d20f24e0 0x55c4d20f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d20f24e0 0x55c4d20f4920 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbad08a78b75a8bd server_cookie=715af715d0bd6ae1 in_seq=0 out_seq=0 2024-09-10T23:25:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec60ff9640 10 client.15780 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec60ff9640 1 -- 172.21.15.2:0/2095809717 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4d2051640 con 0x55c4d20f24e0 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec60ff9640 10 client.15780 handle_command_reply: tid=0 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec82272740 1 client.15780 shutdown 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 msgr2=0x55c4d20e6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.382+0000 7fec82272740 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20e6f30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fec74010c60 tx=0x7fec74010c90 comp rx=0 tx=0).stop 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 shutdown_connections 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d20f24e0 0x55c4d20f4920 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec60ff9640 0 client.15780 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 --2- 172.21.15.2:0/2095809717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20e6f30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 >> 172.21.15.2:0/2095809717 conn(0x55c4d20d89b0 msgr2=0x55c4d20d7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 shutdown_connections 2024-09-10T23:25:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 1 -- 172.21.15.2:0/2095809717 wait complete. 2024-09-10T23:25:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.383+0000 7fec82272740 20 client.15780 trim_cache size 0 max 16384 2024-09-10T23:25:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 Processor -- start 2024-09-10T23:25:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 -- start start 2024-09-10T23:25:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20da7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20dad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec781a9df0 con 0x55c4d20dd860 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec781ab930 con 0x55c4d20e0190 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec82272740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec781aa4c0 con 0x55c4d20e2bd0 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20d7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34178/0 (socket says 172.21.15.2:34178) 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 -- 172.21.15.2:0/2017849677 learned_addr learned my addr 172.21.15.2:0/2017849677 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7da46640 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20da7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 -- 172.21.15.2:0/2017849677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 msgr2=0x55c4d20dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20dad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 -- 172.21.15.2:0/2017849677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 msgr2=0x55c4d20da7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20da7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7d245640 1 -- 172.21.15.2:0/2017849677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4d20dffc0 con 0x55c4d20dd860 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.398+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20da7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec7d245640 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20d7ae0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fec74005b90 tx=0x7fec7400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ce2afa2b96f702 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec62ffd640 1 -- 172.21.15.2:0/2017849677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74031030 con 0x55c4d20dd860 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec62ffd640 1 -- 172.21.15.2:0/2017849677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec74005540 con 0x55c4d20dd860 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec62ffd640 1 -- 172.21.15.2:0/2017849677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74014040 con 0x55c4d20dd860 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 -- 172.21.15.2:0/2017849677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 msgr2=0x55c4d20d7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20d7ae0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fec74005b90 tx=0x7fec7400c9b0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 -- 172.21.15.2:0/2017849677 shutdown_connections 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20e0190 0x55c4d20da7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 --2- 172.21.15.2:0/2017849677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20dd860 0x55c4d20d7ae0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.399+0000 7fec82272740 1 -- 172.21.15.2:0/2017849677 >> 172.21.15.2:0/2017849677 conn(0x55c4d20d89b0 msgr2=0x55c4d20d73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 -- 172.21.15.2:0/2017849677 shutdown_connections 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 -- 172.21.15.2:0/2017849677 wait complete. 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 -- start start 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 Processor -- start 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20dd860 0x55c4d20eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20ed890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20edf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec781ab260 con 0x55c4d20e0190 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec781aab90 con 0x55c4d20dd860 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec781a7dd0 con 0x55c4d20e2bd0 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec82272740 10 client.0 _ll_register_callbacks cb 0x7fec7400cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec7ca44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec7ca44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34188/0 (socket says 172.21.15.2:34188) 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.400+0000 7fec7ca44640 1 -- 172.21.15.2:0/2293272810 learned_addr learned my addr 172.21.15.2:0/2293272810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7da46640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7d245640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20dd860 0x55c4d20eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7ca44640 1 -- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 msgr2=0x55c4d20edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7ca44640 1 -- 172.21.15.2:0/2293272810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20dd860 msgr2=0x55c4d20eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20dd860 0x55c4d20eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7ca44640 1 -- 172.21.15.2:0/2293272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4d20ec3b0 con 0x55c4d20e0190 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7da46640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7d245640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20dd860 0x55c4d20eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec7ca44640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20ed890 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fec680c9660 tx=0x7fec6802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab64938c02d28c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec60ff9640 1 -- 172.21.15.2:0/2293272810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68049040 con 0x55c4d20e0190 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec60ff9640 1 -- 172.21.15.2:0/2293272810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fec680c9300 con 0x55c4d20e0190 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec74005540 con 0x55c4d20e0190 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec60ff9640 1 -- 172.21.15.2:0/2293272810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec68003e60 con 0x55c4d20e0190 2024-09-10T23:25:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec82272740 10 client.15786 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c4d215f610 con 0x55c4d20e0190 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.401+0000 7fec60ff9640 1 -- 172.21.15.2:0/2293272810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec74005540 con 0x55c4d20e0190 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec60ff9640 1 -- 172.21.15.2:0/2293272810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec680cd2f0 con 0x55c4d20e0190 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec82272740 10 client.15786 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec82272740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec82272740 20 client.15786 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec82272740 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d215ffc0 0x55c4d21623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec82272740 4 client.15786 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4d204d0f0 con 0x55c4d215ffc0 2024-09-10T23:25:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec7d245640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d215ffc0 0x55c4d21623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec7d245640 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d215ffc0 0x55c4d21623e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ce4b3832237828 server_cookie=60e8d8892a1e5e40 in_seq=0 out_seq=0 2024-09-10T23:25:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.402+0000 7fec60ff9640 10 client.15786 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec60ff9640 1 -- 172.21.15.2:0/2293272810 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4d204d0f0 con 0x55c4d215ffc0 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec60ff9640 10 client.15786 handle_command_reply: tid=0 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 client.15786 shutdown 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 msgr2=0x55c4d20ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20ed890 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fec680c9660 tx=0x7fec6802a420 comp rx=0 tx=0).stop 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 shutdown_connections 2024-09-10T23:25:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c4d215ffc0 0x55c4d21623e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4d20e2bd0 0x55c4d20edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4d20e0190 0x55c4d20ed890 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec60ff9640 0 client.15786 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 --2- 172.21.15.2:0/2293272810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4d20dd860 0x55c4d20eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 >> 172.21.15.2:0/2293272810 conn(0x55c4d20d89b0 msgr2=0x55c4d20da7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 shutdown_connections 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 1 -- 172.21.15.2:0/2293272810 wait complete. 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.414+0000 7fec82272740 20 client.15786 trim_cache size 0 max 16384 2024-09-10T23:25:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:25:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:25:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:25:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:25:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec640b52e0 msgr2=0x7fec640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec640b52e0 0x7fec640b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fec70005fd0 tx=0x7fec70009500 comp rx=0 tx=0).stop 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 msgr2=0x7fec7819d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec7819d9d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fec68009a50 tx=0x7fec680042f0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 shutdown_connections 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec640b52e0 0x7fec640b77a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec781033a0 0x7fec7819ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec781029e0 0x7fec7819d9d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 --2- 172.21.15.2:0/3778229377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec78101890 0x7fec7806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 >> 172.21.15.2:0/3778229377 conn(0x7fec780fd170 msgr2=0x7fec78105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 shutdown_connections 2024-09-10T23:25:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:25.415+0000 7fec7f4a9640 1 -- 172.21.15.2:0/3778229377 wait complete. 2024-09-10T23:25:25.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:25:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:26 smithi154 ceph-mon[35136]: pgmap v384: 97 pgs: 97 active+clean; 735 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 13 op/s 2024-09-10T23:25:26.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:26 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2049836899' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:26.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:26 smithi002 ceph-mon[31150]: pgmap v384: 97 pgs: 97 active+clean; 735 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 13 op/s 2024-09-10T23:25:26.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:26 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2049836899' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:26 smithi177 ceph-mon[35760]: pgmap v384: 97 pgs: 97 active+clean; 735 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 13 op/s 2024-09-10T23:25:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:26 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2049836899' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 -- 172.21.15.2:0/1068935763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 msgr2=0x7f53e4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 --2- 172.21.15.2:0/1068935763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e4102070 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009900 tx=0x7f53e002a410 comp rx=0 tx=0).stop 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 -- 172.21.15.2:0/1068935763 shutdown_connections 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 --2- 172.21.15.2:0/1068935763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 0x7f53e410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 --2- 172.21.15.2:0/1068935763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 0x7f53e4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 --2- 172.21.15.2:0/1068935763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e4102070 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 -- 172.21.15.2:0/1068935763 >> 172.21.15.2:0/1068935763 conn(0x7f53e40fd700 msgr2=0x7f53e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 -- 172.21.15.2:0/1068935763 shutdown_connections 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 -- 172.21.15.2:0/1068935763 wait complete. 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 Processor -- start 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.455+0000 7f53ec798640 1 -- start start 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ec798640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e40fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ec798640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 0x7f53e40fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ec798640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 0x7f53e40fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ec798640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4111ca0 con 0x7f53e4101c90 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ec798640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4111b20 con 0x7f53e41076a0 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ec798640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4111e20 con 0x7f53e4108020 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ea534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e40fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 0x7f53e40fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ea534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e40fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34200/0 (socket says 172.21.15.2:34200) 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ea534640 1 -- 172.21.15.2:0/3880418725 learned_addr learned my addr 172.21.15.2:0/3880418725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ead35640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 0x7f53e40fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 -- 172.21.15.2:0/3880418725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 msgr2=0x7f53e40fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 0x7f53e40fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 -- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 msgr2=0x7f53e40fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e40fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 -- 172.21.15.2:0/3880418725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e41a7700 con 0x7f53e41076a0 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ea534640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e40fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53ead35640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 0x7f53e40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.456+0000 7f53e9d33640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 0x7f53e40fe140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53d400e9f0 tx=0x7f53d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.457+0000 7f53db7fe640 1 -- 172.21.15.2:0/3880418725 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d400ccc0 con 0x7f53e41076a0 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.457+0000 7f53db7fe640 1 -- 172.21.15.2:0/3880418725 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d40108e0 con 0x7f53e41076a0 2024-09-10T23:25:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.457+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e41a79f0 con 0x7f53e41076a0 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.457+0000 7f53db7fe640 1 -- 172.21.15.2:0/3880418725 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4018880 con 0x7f53e41076a0 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.457+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e41a7f30 con 0x7f53e41076a0 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.459+0000 7f53eeb6d740 1 Processor -- start 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.459+0000 7f53eeb6d740 1 -- start start 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 0x55759d5738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d57f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d582170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55759d4e9ea0 con 0x55759d573df0 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55759d4d92d0 con 0x55759d5734d0 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55759d4dd0e0 con 0x55759d57fd80 2024-09-10T23:25:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 0x55759d5738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ea534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d57f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 0x55759d5738b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:52518/0 (socket says 172.21.15.2:52518) 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 -- 172.21.15.2:0/314408376 learned_addr learned my addr 172.21.15.2:0/314408376 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 -- 172.21.15.2:0/314408376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 msgr2=0x55759d582170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d582170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 -- 172.21.15.2:0/314408376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 msgr2=0x55759d57f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d57f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 -- 172.21.15.2:0/314408376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55759d237650 con 0x55759d5734d0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53ead35640 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 0x55759d5738b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0117a0 tx=0x7f53dc011c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5baa3d1f1c7e2e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53db7fe640 1 -- 172.21.15.2:0/3880418725 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f53d4010430 con 0x7f53e41076a0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.460+0000 7f53d8ff9640 1 -- 172.21.15.2:0/314408376 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011220 con 0x55759d5734d0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53d8ff9640 1 -- 172.21.15.2:0/314408376 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53dc00fa60 con 0x55759d5734d0 2024-09-10T23:25:26.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53d8ff9640 1 -- 172.21.15.2:0/314408376 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc005650 con 0x55759d5734d0 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53db7fe640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53d00b52e0 0x7f53d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 -- 172.21.15.2:0/314408376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 msgr2=0x55759d5738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 0x55759d5738b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0117a0 tx=0x7f53dc011c60 comp rx=0 tx=0).stop 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 -- 172.21.15.2:0/314408376 shutdown_connections 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d582170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d57f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/314408376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d5734d0 0x55759d5738b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53eeb6d740 1 -- 172.21.15.2:0/314408376 >> 172.21.15.2:0/314408376 conn(0x55759d571300 msgr2=0x55759d5724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53ea534640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53d00b52e0 0x7f53d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.461+0000 7f53db7fe640 1 -- 172.21.15.2:0/3880418725 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53d40e5ee0 con 0x7f53e41076a0 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 -- 172.21.15.2:0/314408376 shutdown_connections 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 -- 172.21.15.2:0/314408376 wait complete. 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53ea534640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53d00b52e0 0x7f53d00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53e0031440 tx=0x7f53e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 -- start start 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 Processor -- start 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d57f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d57cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d57fd80 0x55759d57d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55759d33a700 con 0x55759d57fd80 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55759d474160 con 0x55759d573df0 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55759d582a00 con 0x55759d5734d0 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.462+0000 7f53eeb6d740 10 client.0 _ll_register_callbacks cb 0x55759d48d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d57f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d57f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:55096/0 (socket says 172.21.15.2:55096) 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 -- 172.21.15.2:0/1009898298 learned_addr learned my addr 172.21.15.2:0/1009898298 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53e9d33640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d57cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ead35640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d57fd80 0x55759d57d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 -- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 msgr2=0x55759d57cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d57cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 -- 172.21.15.2:0/1009898298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d57fd80 msgr2=0x55759d57d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d57fd80 0x55759d57d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 -- 172.21.15.2:0/1009898298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55759d4a1c90 con 0x55759d5734d0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53e9d33640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d57cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53ea534640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d57f680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009a20 tx=0x7f53e0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80fed3c7b03e6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53cdffb640 1 -- 172.21.15.2:0/1009898298 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e004d070 con 0x55759d5734d0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53cdffb640 1 -- 172.21.15.2:0/1009898298 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53e0003800 con 0x55759d5734d0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.463+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53dc00fa60 con 0x55759d5734d0 2024-09-10T23:25:26.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53cdffb640 1 -- 172.21.15.2:0/1009898298 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53e0043070 con 0x55759d5734d0 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 10 client.25369 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55759d58e350 con 0x55759d5734d0 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53cdffb640 1 -- 172.21.15.2:0/1009898298 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53dc00fa60 con 0x55759d5734d0 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53cdffb640 1 -- 172.21.15.2:0/1009898298 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53e0052bc0 con 0x55759d5734d0 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 10 client.25369 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 10 client.25369 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 20 client.25369 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d58f810 0x55759d591c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 4 client.25369 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55759d4ebdf0 con 0x55759d58f810 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.464+0000 7f53e9d33640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d58f810 0x55759d591c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.465+0000 7f53e9d33640 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d58f810 0x55759d591c00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e9919fae08d1f404 server_cookie=b15a5d1e01c807c8 in_seq=0 out_seq=0 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.465+0000 7f53cdffb640 10 client.25369 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:26.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.465+0000 7f53cdffb640 1 -- 172.21.15.2:0/1009898298 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55759d4ebdf0 con 0x55759d58f810 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.465+0000 7f53cdffb640 10 client.25369 handle_command_reply: tid=0 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 client.25369 shutdown 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 msgr2=0x55759d57f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d57f680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009a20 tx=0x7f53e0009260 comp rx=0 tx=0).stop 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 shutdown_connections 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d58f810 0x55759d591c00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d57fd80 0x55759d57d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d57cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/1009898298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d57f680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53cdffb640 0 client.25369 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 >> 172.21.15.2:0/1009898298 conn(0x55759d571300 msgr2=0x55759d576ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 shutdown_connections 2024-09-10T23:25:26.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 1 -- 172.21.15.2:0/1009898298 wait complete. 2024-09-10T23:25:26.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.466+0000 7f53eeb6d740 20 client.25369 trim_cache size 0 max 16384 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 Processor -- start 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 -- start start 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 0x55759d58bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d5723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d581170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b0610 con 0x55759d5734d0 2024-09-10T23:25:26.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b2150 con 0x55759d573df0 2024-09-10T23:25:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.479+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b0ce0 con 0x55759d57fd80 2024-09-10T23:25:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 0x55759d58bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 0x55759d58bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34234/0 (socket says 172.21.15.2:34234) 2024-09-10T23:25:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 -- 172.21.15.2:0/190912066 learned_addr learned my addr 172.21.15.2:0/190912066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ead35640 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d581170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53e9d33640 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d5723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 -- 172.21.15.2:0/190912066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 msgr2=0x55759d581170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d581170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 -- 172.21.15.2:0/190912066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 msgr2=0x55759d5723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d5723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 -- 172.21.15.2:0/190912066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55759d57d450 con 0x55759d5734d0 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53ea534640 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 0x55759d58bc30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f53e00096c0 tx=0x7f53e0004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538ce3ffbf67444d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53cffff640 1 -- 172.21.15.2:0/190912066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e004d070 con 0x55759d5734d0 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53cffff640 1 -- 172.21.15.2:0/190912066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e00316a0 con 0x55759d5734d0 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.480+0000 7f53cffff640 1 -- 172.21.15.2:0/190912066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0035040 con 0x55759d5734d0 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 -- 172.21.15.2:0/190912066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 msgr2=0x55759d58bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 0x55759d58bc30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f53e00096c0 tx=0x7f53e0004500 comp rx=0 tx=0).stop 2024-09-10T23:25:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 -- 172.21.15.2:0/190912066 shutdown_connections 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d57fd80 0x55759d581170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d573df0 0x55759d5723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/190912066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d5734d0 0x55759d58bc30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 -- 172.21.15.2:0/190912066 >> 172.21.15.2:0/190912066 conn(0x55759d571300 msgr2=0x55759d57b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 -- 172.21.15.2:0/190912066 shutdown_connections 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.481+0000 7f53eeb6d740 1 -- 172.21.15.2:0/190912066 wait complete. 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 -- start start 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 Processor -- start 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d5880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d588660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d57fd80 0x55759d582ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b1a80 con 0x55759d573df0 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b13b0 con 0x55759d57fd80 2024-09-10T23:25:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41ae5f0 con 0x55759d5734d0 2024-09-10T23:25:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53e9d33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d588660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53eeb6d740 10 client.0 _ll_register_callbacks cb 0x7f53e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53ea534640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d5880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53e9d33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d588660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34248/0 (socket says 172.21.15.2:34248) 2024-09-10T23:25:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53e9d33640 1 -- 172.21.15.2:0/985056092 learned_addr learned my addr 172.21.15.2:0/985056092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53ead35640 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d57fd80 0x55759d582ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53e9d33640 1 -- 172.21.15.2:0/985056092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 msgr2=0x55759d5880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.482+0000 7f53e9d33640 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d5880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53e9d33640 1 -- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d57fd80 msgr2=0x55759d582ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53e9d33640 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d57fd80 0x55759d582ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53e9d33640 1 -- 172.21.15.2:0/985056092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55759d5836d0 con 0x55759d573df0 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53e9d33640 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d588660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f53d40ac6f0 tx=0x7f53d4009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1229e311af4debd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53cdffb640 1 -- 172.21.15.2:0/985056092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40a6e60 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53cdffb640 1 -- 172.21.15.2:0/985056092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53d40ab9c0 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e00316a0 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53cdffb640 1 -- 172.21.15.2:0/985056092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53d40ac760 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53eeb6d740 10 client.15804 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55759d5fd3c0 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53cdffb640 1 -- 172.21.15.2:0/985056092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e00316a0 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.483+0000 7f53cdffb640 1 -- 172.21.15.2:0/985056092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53d40ab5c0 con 0x55759d573df0 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 10 client.15804 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 10 client.15804 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 20 client.15804 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d5fdaf0 0x55759d5fff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 4 client.15804 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55759d4e78a0 con 0x55759d5fdaf0 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53ea534640 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d5fdaf0 0x55759d5fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53ea534640 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d5fdaf0 0x55759d5fff10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f45075bbcb850916 server_cookie=257c0e5ad1351f68 in_seq=0 out_seq=0 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53cdffb640 10 client.15804 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53cdffb640 1 -- 172.21.15.2:0/985056092 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55759d4e78a0 con 0x55759d5fdaf0 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53cdffb640 10 client.15804 handle_command_reply: tid=0 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.484+0000 7f53eeb6d740 1 client.15804 shutdown 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 msgr2=0x55759d588660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d588660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f53d40ac6f0 tx=0x7f53d4009700 comp rx=0 tx=0).stop 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 shutdown_connections 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55759d5fdaf0 0x55759d5fff10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55759d57fd80 0x55759d582ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55759d573df0 0x55759d588660 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 --2- 172.21.15.2:0/985056092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55759d5734d0 0x55759d5880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53cdffb640 0 client.15804 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 >> 172.21.15.2:0/985056092 conn(0x55759d571300 msgr2=0x55759d57e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 shutdown_connections 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 1 -- 172.21.15.2:0/985056092 wait complete. 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53eeb6d740 20 client.15804 trim_cache size 0 max 16384 2024-09-10T23:25:26.491 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53d00b52e0 msgr2=0x7f53d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53d00b52e0 0x7f53d00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53e0031440 tx=0x7f53e00058d0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 msgr2=0x7f53e40fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 0x7f53e40fe140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53d400e9f0 tx=0x7f53d400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 shutdown_connections 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53d00b52e0 0x7f53d00b77a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e4108020 0x7f53e40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e41076a0 0x7f53e40fe140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.485+0000 7f53ec798640 1 --2- 172.21.15.2:0/3880418725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4101c90 0x7f53e40fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.486+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 >> 172.21.15.2:0/3880418725 conn(0x7f53e40fd700 msgr2=0x7f53e406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.486+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 shutdown_connections 2024-09-10T23:25:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:26.486+0000 7f53ec798640 1 -- 172.21.15.2:0/3880418725 wait complete. 2024-09-10T23:25:27.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:27.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:25:27.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:27.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:28.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 -- 172.21.15.2:0/1905793831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc102dc0 msgr2=0x7f01cc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 --2- 172.21.15.2:0/1905793831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc102dc0 0x7f01cc1031a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009900 tx=0x7f01bc02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 -- 172.21.15.2:0/1905793831 shutdown_connections 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 --2- 172.21.15.2:0/1905793831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01cc109150 0x7f01cc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 --2- 172.21.15.2:0/1905793831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc1087d0 0x7f01cc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 --2- 172.21.15.2:0/1905793831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc102dc0 0x7f01cc1031a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 -- 172.21.15.2:0/1905793831 >> 172.21.15.2:0/1905793831 conn(0x7f01cc0fe830 msgr2=0x7f01cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 -- 172.21.15.2:0/1905793831 shutdown_connections 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.072+0000 7f01d19f5640 1 -- 172.21.15.2:0/1905793831 wait complete. 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 Processor -- start 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 -- start start 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc102dc0 0x7f01cc19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 0x7f01cc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01cc109150 0x7f01cc1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc112e20 con 0x7f01cc1087d0 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc112ca0 con 0x7f01cc102dc0 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01d19f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc112fa0 con 0x7f01cc109150 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 0x7f01cc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 0x7f01cc19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34264/0 (socket says 172.21.15.2:34264) 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3065567155 learned_addr learned my addr 172.21.15.2:0/3065567155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01caffd640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc102dc0 0x7f01cc19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.073+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01cc109150 0x7f01cc1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3065567155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01cc109150 msgr2=0x7f01cc1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01cc109150 0x7f01cc1a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3065567155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc102dc0 msgr2=0x7f01cc19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc102dc0 0x7f01cc19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3065567155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc1a1570 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 0x7f01cc19ba00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c890 tx=0x7f01c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01d09f3640 1 -- 172.21.15.2:0/3065567155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004220 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01d09f3640 1 -- 172.21.15.2:0/3065567155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c00043c0 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc1a1860 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01d09f3640 1 -- 172.21.15.2:0/3065567155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004a00 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.074+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1a7f20 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 Processor -- start 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 -- start start 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d09f3640 1 -- 172.21.15.2:0/3065567155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f01c00079b0 con 0x7f01cc1087d0 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x5613328ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328eda10 0x5613328f9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 0x5613328fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561332863ea0 con 0x5613328f99a0 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5613328532d0 con 0x5613328ed0f0 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01d3dca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5613328570e0 con 0x5613328eda10 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 0x5613328fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 0x5613328fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34268/0 (socket says 172.21.15.2:34268) 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3308003436 learned_addr learned my addr 172.21.15.2:0/3308003436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x5613328ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01caffd640 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328eda10 0x5613328f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3308003436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328eda10 msgr2=0x5613328f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328eda10 0x5613328f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3308003436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 msgr2=0x5613328ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x5613328ed4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.077+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3308003436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613325b1650 con 0x5613328f99a0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 0x5613328fbd90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01c00ebc10 tx=0x7f01c00ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eeff8c41dd8f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01d09f3640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01b40b52e0 0x7f01b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01b1ffb640 1 -- 172.21.15.2:0/3308003436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00f4070 con 0x5613328f99a0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01b40b52e0 0x7f01b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01b1ffb640 1 -- 172.21.15.2:0/3308003436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c00abc40 con 0x5613328f99a0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01b1ffb640 1 -- 172.21.15.2:0/3308003436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00abf00 con 0x5613328f99a0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.078+0000 7f01d09f3640 1 -- 172.21.15.2:0/3065567155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f01c00e58b0 con 0x7f01cc1087d0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 -- 172.21.15.2:0/3308003436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 msgr2=0x5613328fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01b40b52e0 0x7f01b40b77a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01c4005fd0 tx=0x7f01c4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 0x5613328fbd90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01c00ebc10 tx=0x7f01c00ed690 comp rx=0 tx=0).stop 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 -- 172.21.15.2:0/3308003436 shutdown_connections 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328f99a0 0x5613328fbd90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328eda10 0x5613328f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3308003436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x5613328ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 -- 172.21.15.2:0/3308003436 >> 172.21.15.2:0/3308003436 conn(0x5613328eaf20 msgr2=0x5613328ec0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 -- 172.21.15.2:0/3308003436 shutdown_connections 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 -- 172.21.15.2:0/3308003436 wait complete. 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 -- start start 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.079+0000 7f01d3dca740 1 Processor -- start 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 0x5613328f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328eda10 0x5613328f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5613326b4700 con 0x5613328ed0f0 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5613327ee160 con 0x5613328eda10 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5613328fc620 con 0x5613328f99a0 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01d3dca740 10 client.0 _ll_register_callbacks cb 0x5613328079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 0x5613328f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 0x5613328f9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34280/0 (socket says 172.21.15.2:34280) 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 -- 172.21.15.2:0/1652270555 learned_addr learned my addr 172.21.15.2:0/1652270555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328eda10 0x5613328f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 -- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 msgr2=0x5613328f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 -- 172.21.15.2:0/1652270555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328eda10 msgr2=0x5613328f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328eda10 0x5613328f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 -- 172.21.15.2:0/1652270555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56133281bc90 con 0x5613328ed0f0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01caffd640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 0x5613328f9270 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009230 tx=0x7f01bc005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bddd0ef902ec2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.080+0000 7f01aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01aaffd640 1 -- 172.21.15.2:0/1652270555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc035040 con 0x5613328ed0f0 2024-09-10T23:25:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01aaffd640 1 -- 172.21.15.2:0/1652270555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f01bc0055c0 con 0x5613328ed0f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01c00abc40 con 0x5613328ed0f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01aaffd640 1 -- 172.21.15.2:0/1652270555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01bc004770 con 0x5613328ed0f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 10 client.15816 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561332907f30 con 0x5613328ed0f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01aaffd640 1 -- 172.21.15.2:0/1652270555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c00abc40 con 0x5613328ed0f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01aaffd640 1 -- 172.21.15.2:0/1652270555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01bc003c30 con 0x5613328ed0f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 10 client.15816 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 10 client.15816 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 20 client.15816 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5613329093f0 0x56133290b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 4 client.15816 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.081+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561332865df0 con 0x5613329093f0 2024-09-10T23:25:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.082+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5613329093f0 0x56133290b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.082+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5613329093f0 0x56133290b840 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f439e51038f774ec server_cookie=433107cd032b73c7 in_seq=0 out_seq=0 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.082+0000 7f01aaffd640 10 client.15816 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01aaffd640 1 -- 172.21.15.2:0/1652270555 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561332865df0 con 0x5613329093f0 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01aaffd640 10 client.15816 handle_command_reply: tid=0 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 client.15816 shutdown 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 msgr2=0x5613328f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 0x5613328f9270 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009230 tx=0x7f01bc005040 comp rx=0 tx=0).stop 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 shutdown_connections 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5613329093f0 0x56133290b840 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328eda10 0x5613328f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 --2- 172.21.15.2:0/1652270555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328ed0f0 0x5613328f9270 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01aaffd640 0 client.15816 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 >> 172.21.15.2:0/1652270555 conn(0x5613328eaf20 msgr2=0x5613328f0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 shutdown_connections 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 1 -- 172.21.15.2:0/1652270555 wait complete. 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.083+0000 7f01d3dca740 20 client.15816 trim_cache size 0 max 16384 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 Processor -- start 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 -- start start 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x561332905850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1b0590 con 0x5613328eda10 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1b20d0 con 0x5613328ed0f0 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01d3dca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1b0c60 con 0x5613328f99a0 2024-09-10T23:25:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328ebf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34284/0 (socket says 172.21.15.2:34284) 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 -- 172.21.15.2:0/662576116 learned_addr learned my addr 172.21.15.2:0/662576116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01caffd640 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x561332905850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 -- 172.21.15.2:0/662576116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 msgr2=0x5613328f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 -- 172.21.15.2:0/662576116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 msgr2=0x561332905850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x561332905850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 -- 172.21.15.2:0/662576116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613328f7010 con 0x5613328eda10 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.097+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328ebf70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f01c00a8700 tx=0x7f01c00ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964d736f9477d272 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01b17fa640 1 -- 172.21.15.2:0/662576116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00dd180 con 0x5613328eda10 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01b17fa640 1 -- 172.21.15.2:0/662576116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c00eb320 con 0x5613328eda10 2024-09-10T23:25:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01b17fa640 1 -- 172.21.15.2:0/662576116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00dd700 con 0x5613328eda10 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 -- 172.21.15.2:0/662576116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 msgr2=0x5613328ebf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328ebf70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f01c00a8700 tx=0x7f01c00ed690 comp rx=0 tx=0).stop 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 -- 172.21.15.2:0/662576116 shutdown_connections 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328f99a0 0x5613328f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328ebf70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 --2- 172.21.15.2:0/662576116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328ed0f0 0x561332905850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 -- 172.21.15.2:0/662576116 >> 172.21.15.2:0/662576116 conn(0x5613328eaf20 msgr2=0x5613328f1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 -- 172.21.15.2:0/662576116 shutdown_connections 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.098+0000 7f01d3dca740 1 -- 172.21.15.2:0/662576116 wait complete. 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 -- start start 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 Processor -- start 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328ed0f0 0x5613328fdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328fe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328f99a0 0x561332975310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1b1a00 con 0x5613328eda10 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1b1330 con 0x5613328f99a0 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1ae570 con 0x5613328ed0f0 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01d3dca740 10 client.0 _ll_register_callbacks cb 0x7f01bc004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328fe230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34292/0 (socket says 172.21.15.2:34292) 2024-09-10T23:25:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3932193967 learned_addr learned my addr 172.21.15.2:0/3932193967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.099+0000 7f01caffd640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328ed0f0 0x5613328fdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328f99a0 0x561332975310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328ed0f0 msgr2=0x5613328fdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328ed0f0 0x5613328fdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3932193967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328f99a0 msgr2=0x561332975310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328f99a0 0x561332975310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01ca7fc640 1 -- 172.21.15.2:0/3932193967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561332975850 con 0x5613328eda10 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01caffd640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328ed0f0 0x5613328fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01cb7fe640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328f99a0 0x561332975310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01ca7fc640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328fe230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f01c00edb90 tx=0x7f01c0005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6d1d9cd9b43feb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01aaffd640 1 -- 172.21.15.2:0/3932193967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c001d070 con 0x5613328eda10 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01aaffd640 1 -- 172.21.15.2:0/3932193967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f01c00eb730 con 0x5613328eda10 2024-09-10T23:25:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01c00eb320 con 0x5613328eda10 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01aaffd640 1 -- 172.21.15.2:0/3932193967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01c00f4030 con 0x5613328eda10 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01d3dca740 10 client.15822 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561332976b20 con 0x5613328eda10 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.100+0000 7f01aaffd640 1 -- 172.21.15.2:0/3932193967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c00eb320 con 0x5613328eda10 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01aaffd640 1 -- 172.21.15.2:0/3932193967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01c00a83a0 con 0x5613328eda10 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01d3dca740 10 client.15822 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01d3dca740 10 client.15822 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01d3dca740 20 client.15822 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561332976da0 0x561332979190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01d3dca740 4 client.15822 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613328618a0 con 0x561332976da0 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01caffd640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561332976da0 0x561332979190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01caffd640 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561332976da0 0x561332979190 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5fa8cbf9872d4cfd server_cookie=8d8ce32302f6eddb in_seq=0 out_seq=0 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.101+0000 7f01aaffd640 10 client.15822 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01aaffd640 1 -- 172.21.15.2:0/3932193967 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613328618a0 con 0x561332976da0 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01aaffd640 10 client.15822 handle_command_reply: tid=0 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 client.15822 shutdown 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 msgr2=0x5613328fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328fe230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f01c00edb90 tx=0x7f01c0005760 comp rx=0 tx=0).stop 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 shutdown_connections 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561332976da0 0x561332979190 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5613328f99a0 0x561332975310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5613328eda10 0x5613328fe230 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 --2- 172.21.15.2:0/3932193967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5613328ed0f0 0x5613328fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01aaffd640 0 client.15822 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 >> 172.21.15.2:0/3932193967 conn(0x5613328eaf20 msgr2=0x5613328e9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 shutdown_connections 2024-09-10T23:25:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 1 -- 172.21.15.2:0/3932193967 wait complete. 2024-09-10T23:25:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d3dca740 20 client.15822 trim_cache size 0 max 16384 2024-09-10T23:25:28.119 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01b40b52e0 msgr2=0x7f01b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d19f5640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01b40b52e0 0x7f01b40b77a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01c4005fd0 tx=0x7f01c4009600 comp rx=0 tx=0).stop 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 msgr2=0x7f01cc19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.102+0000 7f01d19f5640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 0x7f01cc19ba00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c890 tx=0x7f01c000cd50 comp rx=0 tx=0).stop 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 shutdown_connections 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f01b40b52e0 0x7f01b40b77a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01cc109150 0x7f01cc1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1087d0 0x7f01cc19ba00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 --2- 172.21.15.2:0/3065567155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc102dc0 0x7f01cc19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 >> 172.21.15.2:0/3065567155 conn(0x7f01cc0fe830 msgr2=0x7f01cc104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 shutdown_connections 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:28.103+0000 7f01d19f5640 1 -- 172.21.15.2:0/3065567155 wait complete. 2024-09-10T23:25:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:28 smithi154 ceph-mon[35136]: pgmap v385: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:25:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:25:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:25:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:28 smithi177 ceph-mon[35760]: pgmap v385: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:25:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:25:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:25:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:28.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:28 smithi002 ceph-mon[31150]: pgmap v385: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:25:28.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:25:28.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:25:28.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:25:29.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:25:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 -- 172.21.15.2:0/407497765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914109150 msgr2=0x7fa91410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/407497765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914109150 0x7fa91410f950 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009ca0 tx=0x7fa90c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 -- 172.21.15.2:0/407497765 shutdown_connections 2024-09-10T23:25:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/407497765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914109150 0x7fa91410f950 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/407497765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9141087d0 0x7fa914108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/407497765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa914102dc0 0x7fa9141031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 -- 172.21.15.2:0/407497765 >> 172.21.15.2:0/407497765 conn(0x7fa9140fe870 msgr2=0x7fa914100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 -- 172.21.15.2:0/407497765 shutdown_connections 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 -- 172.21.15.2:0/407497765 wait complete. 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 Processor -- start 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.817+0000 7fa91c7b5640 1 -- start start 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91c7b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 0x7fa9141991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91c7b5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9141087d0 0x7fa9141996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91c7b5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa914109150 0x7fa91419ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91c7b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa914112e10 con 0x7fa914102dc0 2024-09-10T23:25:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91c7b5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa914112c90 con 0x7fa9141087d0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91c7b5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa914112f90 con 0x7fa914109150 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 0x7fa9141991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 0x7fa9141991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34316/0 (socket says 172.21.15.2:34316) 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 -- 172.21.15.2:0/3232758083 learned_addr learned my addr 172.21.15.2:0/3232758083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91ad52640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa914109150 0x7fa91419ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa919d50640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9141087d0 0x7fa9141996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 -- 172.21.15.2:0/3232758083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa914109150 msgr2=0x7fa91419ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa914109150 0x7fa91419ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 -- 172.21.15.2:0/3232758083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9141087d0 msgr2=0x7fa9141996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9141087d0 0x7fa9141996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 -- 172.21.15.2:0/3232758083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91419f250 con 0x7fa914102dc0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.818+0000 7fa91a551640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 0x7fa9141991a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa91000d770 tx=0x7fa91000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.819+0000 7fa90b7fe640 1 -- 172.21.15.2:0/3232758083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910017070 con 0x7fa914102dc0 2024-09-10T23:25:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.819+0000 7fa90b7fe640 1 -- 172.21.15.2:0/3232758083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9100054d0 con 0x7fa914102dc0 2024-09-10T23:25:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.819+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91419f540 con 0x7fa914102dc0 2024-09-10T23:25:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.819+0000 7fa90b7fe640 1 -- 172.21.15.2:0/3232758083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910004c30 con 0x7fa914102dc0 2024-09-10T23:25:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.819+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9141a5c00 con 0x7fa914102dc0 2024-09-10T23:25:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 Processor -- start 2024-09-10T23:25:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 -- start start 2024-09-10T23:25:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3593840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3596170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558be34fdea0 con 0x558be3587df0 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558be34ed2d0 con 0x558be35874d0 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558be34f10e0 con 0x558be3593d80 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.822+0000 7fa90b7fe640 1 -- 172.21.15.2:0/3232758083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa910004e10 con 0x7fa914102dc0 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3593840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3593840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34326/0 (socket says 172.21.15.2:34326) 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 -- 172.21.15.2:0/357689458 learned_addr learned my addr 172.21.15.2:0/357689458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91ad52640 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa919d50640 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3596170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 -- 172.21.15.2:0/357689458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 msgr2=0x558be3596170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3596170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 -- 172.21.15.2:0/357689458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 msgr2=0x558be35878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35878b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 -- 172.21.15.2:0/357689458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be324b650 con 0x558be3587df0 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91ad52640 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa91a551640 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3593840 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa9100ebc20 tx=0x7fa9100ed670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48d4de07fb63161 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa908ff9640 1 -- 172.21.15.2:0/357689458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9100f4070 con 0x558be3587df0 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.823+0000 7fa90b7fe640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9000b5360 0x7fa9000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa908ff9640 1 -- 172.21.15.2:0/357689458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9100e5c90 con 0x558be3587df0 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa908ff9640 1 -- 172.21.15.2:0/357689458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9100a8460 con 0x558be3587df0 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91ad52640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9000b5360 0x7fa9000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa90b7fe640 1 -- 172.21.15.2:0/3232758083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa9100e56a0 con 0x7fa914102dc0 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91ad52640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9000b5360 0x7fa9000b7820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa90c02f500 tx=0x7fa90c005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 -- 172.21.15.2:0/357689458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 msgr2=0x558be3593840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3593840 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa9100ebc20 tx=0x7fa9100ed670 comp rx=0 tx=0).stop 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 -- 172.21.15.2:0/357689458 shutdown_connections 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3596170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3593840 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/357689458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 -- 172.21.15.2:0/357689458 >> 172.21.15.2:0/357689458 conn(0x558be3585300 msgr2=0x558be35864a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.824+0000 7fa91eb8a740 1 -- 172.21.15.2:0/357689458 shutdown_connections 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 -- 172.21.15.2:0/357689458 wait complete. 2024-09-10T23:25:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 -- start start 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 Processor -- start 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be35874d0 0x558be3593690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3590ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be3593d80 0x558be3591110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558be334e700 con 0x558be3587df0 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558be3488160 con 0x558be3593d80 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558be3596a00 con 0x558be35874d0 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa91eb8a740 10 client.0 _ll_register_callbacks cb 0x558be34a19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa919d50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3590ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa919d50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3590ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34330/0 (socket says 172.21.15.2:34330) 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.825+0000 7fa919d50640 1 -- 172.21.15.2:0/1244214005 learned_addr learned my addr 172.21.15.2:0/1244214005 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa91a551640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be35874d0 0x558be3593690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa91ad52640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be3593d80 0x558be3591110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa919d50640 1 -- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be35874d0 msgr2=0x558be3593690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa919d50640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be35874d0 0x558be3593690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa919d50640 1 -- 172.21.15.2:0/1244214005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be3593d80 msgr2=0x558be3591110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa919d50640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be3593d80 0x558be3591110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa919d50640 1 -- 172.21.15.2:0/1244214005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be34b5c90 con 0x558be3587df0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa919d50640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3590ae0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa90400ce30 tx=0x7fa9040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2d886285f43494 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa8fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1244214005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904011970 con 0x558be3587df0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1244214005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa904011b10 con 0x558be3587df0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9100e5c90 con 0x558be3587df0 2024-09-10T23:25:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1244214005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa904011d10 con 0x558be3587df0 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa91eb8a740 10 client.15834 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558be35a23f0 con 0x558be3587df0 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.826+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1244214005 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9100e5c90 con 0x558be3587df0 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1244214005 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa904018070 con 0x558be3587df0 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91eb8a740 10 client.15834 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91eb8a740 10 client.15834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91eb8a740 20 client.15834 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be35a38f0 0x558be35a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91eb8a740 4 client.15834 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558be34ffdf0 con 0x558be35a38f0 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91a551640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be35a38f0 0x558be35a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa91a551640 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be35a38f0 0x558be35a5d50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a45076a0abf921a1 server_cookie=e89943c92a0133d3 in_seq=0 out_seq=0 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.827+0000 7fa8fdffb640 10 client.15834 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1244214005 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558be34ffdf0 con 0x558be35a38f0 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa8fdffb640 10 client.15834 handle_command_reply: tid=0 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 client.15834 shutdown 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 msgr2=0x558be3590ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3590ae0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa90400ce30 tx=0x7fa9040039c0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 shutdown_connections 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be35a38f0 0x558be35a5d50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be3593d80 0x558be3591110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3590ae0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1244214005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be35874d0 0x558be3593690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 >> 172.21.15.2:0/1244214005 conn(0x558be3585300 msgr2=0x558be358aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa8fdffb640 0 client.15834 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.828+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 shutdown_connections 2024-09-10T23:25:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.829+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1244214005 wait complete. 2024-09-10T23:25:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.829+0000 7fa91eb8a740 20 client.15834 trim_cache size 0 max 16384 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 Processor -- start 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 -- start start 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be359fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3587df0 0x558be358dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 0x558be358e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141ae300 con 0x558be3593d80 2024-09-10T23:25:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141afe40 con 0x558be35874d0 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141ae9d0 con 0x558be3587df0 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91ad52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 0x558be358e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91ad52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 0x558be358e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34336/0 (socket says 172.21.15.2:34336) 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.842+0000 7fa91ad52640 1 -- 172.21.15.2:0/2422031772 learned_addr learned my addr 172.21.15.2:0/2422031772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa919d50640 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3587df0 0x558be358dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91a551640 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be359fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91ad52640 1 -- 172.21.15.2:0/2422031772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3587df0 msgr2=0x558be358dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91ad52640 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3587df0 0x558be358dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91ad52640 1 -- 172.21.15.2:0/2422031772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 msgr2=0x558be359fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91ad52640 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be359fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91ad52640 1 -- 172.21.15.2:0/2422031772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be3590890 con 0x558be3593d80 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa91ad52640 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 0x558be358e230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009ca0 tx=0x7fa90c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcfa044510ac6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa8fffff640 1 -- 172.21.15.2:0/2422031772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c031920 con 0x558be3593d80 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa8fffff640 1 -- 172.21.15.2:0/2422031772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa90c036050 con 0x558be3593d80 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.843+0000 7fa8fffff640 1 -- 172.21.15.2:0/2422031772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c004820 con 0x558be3593d80 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- 172.21.15.2:0/2422031772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 msgr2=0x558be358e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 0x558be358e230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009ca0 tx=0x7fa90c041000 comp rx=0 tx=0).stop 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- 172.21.15.2:0/2422031772 shutdown_connections 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3593d80 0x558be358e230 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3587df0 0x558be358dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/2422031772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be359fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- 172.21.15.2:0/2422031772 >> 172.21.15.2:0/2422031772 conn(0x558be3585300 msgr2=0x558be3592930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- 172.21.15.2:0/2422031772 shutdown_connections 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- 172.21.15.2:0/2422031772 wait complete. 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- start start 2024-09-10T23:25:29.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 Processor -- start 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35986d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3598c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3609940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141af770 con 0x558be3587df0 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141af0a0 con 0x558be35874d0 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.844+0000 7fa91eb8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141ac2e0 con 0x558be3593d80 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa91eb8a740 10 client.0 _ll_register_callbacks cb 0x7fa904004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3598c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa91a551640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3598c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34350/0 (socket says 172.21.15.2:34350) 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 -- 172.21.15.2:0/1361933258 learned_addr learned my addr 172.21.15.2:0/1361933258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa91ad52640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3609940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 -- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 msgr2=0x558be3609940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3609940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 -- 172.21.15.2:0/1361933258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 msgr2=0x558be35986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 -- 172.21.15.2:0/1361933258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be360a080 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa91a551640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa919d50640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3598c70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa9040243f0 tx=0x7fa904011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6dcc1c5b31f361 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa8fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1361933258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904032060 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.845+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1361933258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa904005450 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa90c036050 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1361933258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa904005650 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 10 client.15840 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558be3611450 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1361933258 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa90c036050 con 0x558be3587df0 2024-09-10T23:25:29.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1361933258 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa904018040 con 0x558be3587df0 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 20 client.15840 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be3611ba0 0x558be3613fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 4 client.15840 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.846+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558be34fb8a0 con 0x558be3611ba0 2024-09-10T23:25:29.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91a551640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be3611ba0 0x558be3613fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91a551640 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be3611ba0 0x558be3613fc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40859c6385a7680b server_cookie=fbd770168aa5be77 in_seq=0 out_seq=0 2024-09-10T23:25:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa8fdffb640 10 client.15840 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa8fdffb640 1 -- 172.21.15.2:0/1361933258 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558be34fb8a0 con 0x558be3611ba0 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa8fdffb640 10 client.15840 handle_command_reply: tid=0 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 client.15840 shutdown 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 msgr2=0x558be3598c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3598c70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa9040243f0 tx=0x7fa904011c20 comp rx=0 tx=0).stop 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 shutdown_connections 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558be3611ba0 0x558be3613fc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558be3593d80 0x558be3609940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558be3587df0 0x558be3598c70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 --2- 172.21.15.2:0/1361933258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be35874d0 0x558be35986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 >> 172.21.15.2:0/1361933258 conn(0x558be3585300 msgr2=0x558be3583c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.847+0000 7fa8fdffb640 0 client.15840 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 shutdown_connections 2024-09-10T23:25:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91eb8a740 1 -- 172.21.15.2:0/1361933258 wait complete. 2024-09-10T23:25:29.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91eb8a740 20 client.15840 trim_cache size 0 max 16384 2024-09-10T23:25:29.856 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:29.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9000b5360 msgr2=0x7fa9000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9000b5360 0x7fa9000b7820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa90c02f500 tx=0x7fa90c005fa0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 msgr2=0x7fa9141991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 0x7fa9141991a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa91000d770 tx=0x7fa91000dc30 comp rx=0 tx=0).stop 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 shutdown_connections 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9000b5360 0x7fa9000b7820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa914109150 0x7fa91419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9141087d0 0x7fa9141996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 --2- 172.21.15.2:0/3232758083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa914102dc0 0x7fa9141991a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 >> 172.21.15.2:0/3232758083 conn(0x7fa9140fe870 msgr2=0x7fa914100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 shutdown_connections 2024-09-10T23:25:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:29.848+0000 7fa91c7b5640 1 -- 172.21.15.2:0/3232758083 wait complete. 2024-09-10T23:25:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:30 smithi154 ceph-mon[35136]: pgmap v386: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:25:30.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:30 smithi002 ceph-mon[31150]: pgmap v386: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:25:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:30 smithi177 ceph-mon[35760]: pgmap v386: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:25:30.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:25:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 -- 172.21.15.2:0/293497363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010a920 msgr2=0x7fd6d010cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/293497363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010a920 0x7fd6d010cd10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009900 tx=0x7fd6c402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 -- 172.21.15.2:0/293497363 shutdown_connections 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/293497363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d010d250 0x7fd6d010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/293497363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010a920 0x7fd6d010cd10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/293497363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0101810 0x7fd6d0101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 -- 172.21.15.2:0/293497363 >> 172.21.15.2:0/293497363 conn(0x7fd6d0076f50 msgr2=0x7fd6d0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 -- 172.21.15.2:0/293497363 shutdown_connections 2024-09-10T23:25:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 -- 172.21.15.2:0/293497363 wait complete. 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.393+0000 7fd6d69ce640 1 Processor -- start 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 -- start start 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0101810 0x7fd6d01992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d010a920 0x7fd6d0199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 0x7fd6d019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0112d90 con 0x7fd6d010d250 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0112c10 con 0x7fd6d010a920 2024-09-10T23:25:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d69ce640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0112f10 con 0x7fd6d0101810 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d4f6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 0x7fd6d019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d4f6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 0x7fd6d019ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36240/0 (socket says 172.21.15.2:36240) 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/2097993612 learned_addr learned my addr 172.21.15.2:0/2097993612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6cffff640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0101810 0x7fd6d01992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.394+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d010a920 0x7fd6d0199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/2097993612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0101810 msgr2=0x7fd6d01992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0101810 0x7fd6d01992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/2097993612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d010a920 msgr2=0x7fd6d0199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d010a920 0x7fd6d0199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/2097993612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d019f390 con 0x7fd6d010d250 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 0x7fd6d019ebc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800eb10 tx=0x7fd6c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6cd7fa640 1 -- 172.21.15.2:0/2097993612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8004b20 con 0x7fd6d010d250 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d019f680 con 0x7fd6d010d250 2024-09-10T23:25:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6cd7fa640 1 -- 172.21.15.2:0/2097993612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c8004cc0 con 0x7fd6d010d250 2024-09-10T23:25:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6cd7fa640 1 -- 172.21.15.2:0/2097993612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8010670 con 0x7fd6d010d250 2024-09-10T23:25:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.395+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d01a5d40 con 0x7fd6d010d250 2024-09-10T23:25:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.397+0000 7fd6d8da3740 1 Processor -- start 2024-09-10T23:25:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6cd7fa640 1 -- 172.21.15.2:0/2097993612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd6c8005020 con 0x7fd6d010d250 2024-09-10T23:25:31.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 -- start start 2024-09-10T23:25:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563660020ea0 con 0x5636600aadf0 2024-09-10T23:25:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5636600102d0 con 0x5636600bb190 2024-09-10T23:25:31.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5636600140e0 con 0x5636600aa4d0 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600bac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36254/0 (socket says 172.21.15.2:36254) 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6cffff640 1 -- 172.21.15.2:0/2742752538 learned_addr learned my addr 172.21.15.2:0/2742752538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.398+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cffff640 1 -- 172.21.15.2:0/2742752538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 msgr2=0x5636600aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cffff640 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cffff640 1 -- 172.21.15.2:0/2742752538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 msgr2=0x5636600bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cffff640 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cffff640 1 -- 172.21.15.2:0/2742752538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56365fd6e650 con 0x5636600aadf0 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cd7fa640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd6b80b52e0 0x7fd6b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cffff640 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600bac50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009d50 tx=0x7fd6c0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae294ca77a2c9ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd6b80b52e0 0x7fd6b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6cd7fa640 1 -- 172.21.15.2:0/2097993612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd6c80e61a0 con 0x7fd6d010d250 2024-09-10T23:25:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6b67fc640 1 -- 172.21.15.2:0/2742752538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c001e070 con 0x5636600aadf0 2024-09-10T23:25:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6b67fc640 1 -- 172.21.15.2:0/2742752538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c0019ae0 con 0x5636600aadf0 2024-09-10T23:25:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.399+0000 7fd6b67fc640 1 -- 172.21.15.2:0/2742752538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000ea80 con 0x5636600aadf0 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 -- 172.21.15.2:0/2742752538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 msgr2=0x5636600bac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd6b80b52e0 0x7fd6b80b77a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4031440 tx=0x7fd6c4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600bac50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009d50 tx=0x7fd6c0011810 comp rx=0 tx=0).stop 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 -- 172.21.15.2:0/2742752538 shutdown_connections 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600bac50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/2742752538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 -- 172.21.15.2:0/2742752538 >> 172.21.15.2:0/2742752538 conn(0x5636600a8300 msgr2=0x5636600a94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 -- 172.21.15.2:0/2742752538 shutdown_connections 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 -- 172.21.15.2:0/2742752538 wait complete. 2024-09-10T23:25:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.400+0000 7fd6d8da3740 1 -- start start 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 Processor -- start 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 0x5636600baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aadf0 0x5636600b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56365fe71700 con 0x5636600aa4d0 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56365ffab160 con 0x5636600bb190 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5636600bde40 con 0x5636600aadf0 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d8da3740 10 client.0 _ll_register_callbacks cb 0x56365ffc49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 0x5636600baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 0x5636600baa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36260/0 (socket says 172.21.15.2:36260) 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6cffff640 1 -- 172.21.15.2:0/3528537229 learned_addr learned my addr 172.21.15.2:0/3528537229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aadf0 0x5636600b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6cffff640 1 -- 172.21.15.2:0/3528537229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aadf0 msgr2=0x5636600b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.401+0000 7fd6cffff640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aadf0 0x5636600b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6cffff640 1 -- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 msgr2=0x5636600b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6cffff640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6cffff640 1 -- 172.21.15.2:0/3528537229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56365ffd8c90 con 0x5636600aa4d0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aadf0 0x5636600b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6cffff640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 0x5636600baa00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0005890 tx=0x7fd6c0005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e950fca162b36ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6af7fe640 1 -- 172.21.15.2:0/3528537229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0026020 con 0x5636600aa4d0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6af7fe640 1 -- 172.21.15.2:0/3528537229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd6c0019840 con 0x5636600aa4d0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c0019ae0 con 0x5636600aa4d0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6af7fe640 1 -- 172.21.15.2:0/3528537229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6c001e040 con 0x5636600aa4d0 2024-09-10T23:25:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6d8da3740 10 client.15852 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5636600c9690 con 0x5636600aa4d0 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.402+0000 7fd6af7fe640 1 -- 172.21.15.2:0/3528537229 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c0019ae0 con 0x5636600aa4d0 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6af7fe640 1 -- 172.21.15.2:0/3528537229 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6c000ec10 con 0x5636600aa4d0 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6d8da3740 10 client.15852 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6d8da3740 10 client.15852 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6d8da3740 20 client.15852 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5636600caa40 0x5636600cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6d8da3740 4 client.15852 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563660022df0 con 0x5636600caa40 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5636600caa40 0x5636600cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5636600caa40 0x5636600cce30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9fa6269d2bcc3155 server_cookie=56e8865f9bfb15d9 in_seq=0 out_seq=0 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.403+0000 7fd6af7fe640 10 client.15852 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6af7fe640 1 -- 172.21.15.2:0/3528537229 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563660022df0 con 0x5636600caa40 2024-09-10T23:25:31.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6af7fe640 10 client.15852 handle_command_reply: tid=0 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 client.15852 shutdown 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 msgr2=0x5636600baa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 0x5636600baa00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0005890 tx=0x7fd6c0005d90 comp rx=0 tx=0).stop 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 shutdown_connections 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aadf0 0x5636600b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.404+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5636600caa40 0x5636600cce30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.405+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3528537229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aa4d0 0x5636600baa00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.405+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 >> 172.21.15.2:0/3528537229 conn(0x5636600a8300 msgr2=0x5636600adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.405+0000 7fd6af7fe640 0 client.15852 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.405+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 shutdown_connections 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.405+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3528537229 wait complete. 2024-09-10T23:25:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.405+0000 7fd6d8da3740 20 client.15852 trim_cache size 0 max 16384 2024-09-10T23:25:31.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 Processor -- start 2024-09-10T23:25:31.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 -- start start 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01ac120 con 0x5636600aadf0 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01adc60 con 0x5636600bb190 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01ac7f0 con 0x5636600aa4d0 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600a90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36264/0 (socket says 172.21.15.2:36264) 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.418+0000 7fd6cf7fe640 1 -- 172.21.15.2:0/3663670653 learned_addr learned my addr 172.21.15.2:0/3663670653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cffff640 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cf7fe640 1 -- 172.21.15.2:0/3663670653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 msgr2=0x5636600c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cf7fe640 1 -- 172.21.15.2:0/3663670653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 msgr2=0x5636600a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cf7fe640 1 -- 172.21.15.2:0/3663670653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636600b8f70 con 0x5636600aadf0 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600a90c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd6c402a930 tx=0x7fd6c403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6e2ce2e2d2890d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6b5ffb640 1 -- 172.21.15.2:0/3663670653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4035040 con 0x5636600aadf0 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6b5ffb640 1 -- 172.21.15.2:0/3663670653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c4057070 con 0x5636600aadf0 2024-09-10T23:25:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.419+0000 7fd6b5ffb640 1 -- 172.21.15.2:0/3663670653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40046e0 con 0x5636600aadf0 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3663670653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 msgr2=0x5636600a90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600a90c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd6c402a930 tx=0x7fd6c403f000 comp rx=0 tx=0).stop 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3663670653 shutdown_connections 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600bb190 0x5636600a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600aadf0 0x5636600a90c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/3663670653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3663670653 >> 172.21.15.2:0/3663670653 conn(0x5636600a8300 msgr2=0x5636600bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3663670653 shutdown_connections 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 -- 172.21.15.2:0/3663670653 wait complete. 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 -- start start 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.420+0000 7fd6d8da3740 1 Processor -- start 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600aadf0 0x5636600d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 0x5636600d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01ad590 con 0x5636600bb190 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01acec0 con 0x5636600aadf0 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01aa100 con 0x5636600aa4d0 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 10 client.0 _ll_register_callbacks cb 0x7fd6c001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 0x5636600d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6cffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 0x5636600d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36266/0 (socket says 172.21.15.2:36266) 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/186546798 learned_addr learned my addr 172.21.15.2:0/186546798 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6cf7fe640 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600aadf0 0x5636600d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/186546798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 msgr2=0x5636600c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600aadf0 msgr2=0x5636600d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600aadf0 0x5636600d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 -- 172.21.15.2:0/186546798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636600d2ef0 con 0x5636600bb190 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d4f6b640 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 0x5636600d2710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800cfb0 tx=0x7fd6c80ac7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4158ccc5d4758b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6af7fe640 1 -- 172.21.15.2:0/186546798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80d3020 con 0x5636600bb190 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6af7fe640 1 -- 172.21.15.2:0/186546798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd6c80b5c70 con 0x5636600bb190 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.421+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c4057070 con 0x5636600bb190 2024-09-10T23:25:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6af7fe640 1 -- 172.21.15.2:0/186546798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6c80e5070 con 0x5636600bb190 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 10 client.15858 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563660137880 con 0x5636600bb190 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6af7fe640 1 -- 172.21.15.2:0/186546798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c4057070 con 0x5636600bb190 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6af7fe640 1 -- 172.21.15.2:0/186546798 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6c80ab640 con 0x5636600bb190 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 10 client.15858 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 10 client.15858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 20 client.15858 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x563660138050 0x56366013a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 4 client.15858 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56366001e8a0 con 0x563660138050 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.422+0000 7fd6cffff640 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x563660138050 0x56366013a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6cffff640 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x563660138050 0x56366013a470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=616bce5053be3f4c server_cookie=e71ab8fbfa662c09 in_seq=0 out_seq=0 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6af7fe640 10 client.15858 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6af7fe640 1 -- 172.21.15.2:0/186546798 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56366001e8a0 con 0x563660138050 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6af7fe640 10 client.15858 handle_command_reply: tid=0 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 client.15858 shutdown 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 msgr2=0x5636600d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 0x5636600d2710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800cfb0 tx=0x7fd6c80ac7b0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 shutdown_connections 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x563660138050 0x56366013a470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6af7fe640 0 client.15858 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636600bb190 0x5636600d2710 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636600aadf0 0x5636600d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 --2- 172.21.15.2:0/186546798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636600aa4d0 0x5636600c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 >> 172.21.15.2:0/186546798 conn(0x5636600a8300 msgr2=0x5636600a90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.423+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 shutdown_connections 2024-09-10T23:25:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d8da3740 1 -- 172.21.15.2:0/186546798 wait complete. 2024-09-10T23:25:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d8da3740 20 client.15858 trim_cache size 0 max 16384 2024-09-10T23:25:31.431 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd6b80b52e0 msgr2=0x7fd6b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd6b80b52e0 0x7fd6b80b77a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4031440 tx=0x7fd6c4009260 comp rx=0 tx=0).stop 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 msgr2=0x7fd6d019ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 0x7fd6d019ebc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800eb10 tx=0x7fd6c800c2d0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 shutdown_connections 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd6b80b52e0 0x7fd6b80b77a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d010d250 0x7fd6d019ebc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d010a920 0x7fd6d0199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 --2- 172.21.15.2:0/2097993612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d0101810 0x7fd6d01992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 >> 172.21.15.2:0/2097993612 conn(0x7fd6d0076f50 msgr2=0x7fd6d01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 shutdown_connections 2024-09-10T23:25:31.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:31.424+0000 7fd6d69ce640 1 -- 172.21.15.2:0/2097993612 wait complete. 2024-09-10T23:25:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:32 smithi154 ceph-mon[35136]: pgmap v387: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:32.287 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:32 smithi002 ceph-mon[31150]: pgmap v387: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:32.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:25:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:32 smithi177 ceph-mon[35760]: pgmap v387: 97 pgs: 97 active+clean; 800 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 -- 172.21.15.2:0/3629599945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb520108020 msgr2=0x7fb52010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 --2- 172.21.15.2:0/3629599945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb520108020 0x7fb52010e820 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb518009ca0 tx=0x7fb51802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 -- 172.21.15.2:0/3629599945 shutdown_connections 2024-09-10T23:25:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 --2- 172.21.15.2:0/3629599945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb520108020 0x7fb52010e820 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 --2- 172.21.15.2:0/3629599945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5201076a0 0x7fb520107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 --2- 172.21.15.2:0/3629599945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520101c90 0x7fb520102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 -- 172.21.15.2:0/3629599945 >> 172.21.15.2:0/3629599945 conn(0x7fb5200fd700 msgr2=0x7fb5200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 -- 172.21.15.2:0/3629599945 shutdown_connections 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.054+0000 7fb527d4f640 1 -- 172.21.15.2:0/3629599945 wait complete. 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 Processor -- start 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 -- start start 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb520101c90 0x7fb52019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 0x7fb52019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520108020 0x7fb5201a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb520111ce0 con 0x7fb5201076a0 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb520111b60 con 0x7fb520101c90 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb527d4f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb520111e60 con 0x7fb520108020 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb5252ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 0x7fb52019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb5252ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 0x7fb52019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36284/0 (socket says 172.21.15.2:36284) 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.055+0000 7fb5252ea640 1 -- 172.21.15.2:0/744905066 learned_addr learned my addr 172.21.15.2:0/744905066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb525aeb640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb520101c90 0x7fb52019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5262ec640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520108020 0x7fb5201a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5252ea640 1 -- 172.21.15.2:0/744905066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520108020 msgr2=0x7fb5201a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5252ea640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520108020 0x7fb5201a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5252ea640 1 -- 172.21.15.2:0/744905066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb520101c90 msgr2=0x7fb52019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5252ea640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb520101c90 0x7fb52019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5252ea640 1 -- 172.21.15.2:0/744905066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5201a13b0 con 0x7fb5201076a0 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5262ec640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520108020 0x7fb5201a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb525aeb640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb520101c90 0x7fb52019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb5252ea640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 0x7fb52019b840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c920 tx=0x7fb51000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb516ffd640 1 -- 172.21.15.2:0/744905066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510007c70 con 0x7fb5201076a0 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb516ffd640 1 -- 172.21.15.2:0/744905066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb510007e10 con 0x7fb5201076a0 2024-09-10T23:25:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5201a16a0 con 0x7fb5201076a0 2024-09-10T23:25:33.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb516ffd640 1 -- 172.21.15.2:0/744905066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510018820 con 0x7fb5201076a0 2024-09-10T23:25:33.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.056+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5201a7d60 con 0x7fb5201076a0 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.059+0000 7fb52a124740 1 Processor -- start 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 -- start start 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f834d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f8f9a0 0x5632e1f91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5632e1ef9ea0 con 0x5632e1f83a10 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5632e1ee92d0 con 0x5632e1f830f0 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb52a124740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5632e1eed0e0 con 0x5632e1f8f9a0 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb516ffd640 1 -- 172.21.15.2:0/744905066 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb51000f450 con 0x7fb5201076a0 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36300/0 (socket says 172.21.15.2:36300) 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 -- 172.21.15.2:0/389489922 learned_addr learned my addr 172.21.15.2:0/389489922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb5262ec640 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb5252ea640 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f8f9a0 0x5632e1f91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 -- 172.21.15.2:0/389489922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f8f9a0 msgr2=0x5632e1f91d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f8f9a0 0x5632e1f91d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 -- 172.21.15.2:0/389489922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 msgr2=0x5632e1f834d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f834d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.060+0000 7fb525aeb640 1 -- 172.21.15.2:0/389489922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632e1c47650 con 0x5632e1f83a10 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb5252ea640 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f8f9a0 0x5632e1f91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb525aeb640 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8f460 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb51c008c60 tx=0x7fb51c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb9b1c267a44ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb50bfff640 1 -- 172.21.15.2:0/389489922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c014070 con 0x5632e1f83a10 2024-09-10T23:25:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb50bfff640 1 -- 172.21.15.2:0/389489922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb51c0047a0 con 0x5632e1f83a10 2024-09-10T23:25:33.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb50bfff640 1 -- 172.21.15.2:0/389489922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c010630 con 0x5632e1f83a10 2024-09-10T23:25:33.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb516ffd640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb50c0b52e0 0x7fb50c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb5262ec640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb50c0b52e0 0x7fb50c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.061+0000 7fb516ffd640 1 -- 172.21.15.2:0/744905066 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb5100e5df0 con 0x7fb5201076a0 2024-09-10T23:25:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 -- 172.21.15.2:0/389489922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 msgr2=0x5632e1f8f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8f460 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb51c008c60 tx=0x7fb51c00e720 comp rx=0 tx=0).stop 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb5262ec640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb50c0b52e0 0x7fb50c0b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb518009ca0 tx=0x7fb5180093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 -- 172.21.15.2:0/389489922 shutdown_connections 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f8f9a0 0x5632e1f91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8f460 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 --2- 172.21.15.2:0/389489922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f834d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 -- 172.21.15.2:0/389489922 >> 172.21.15.2:0/389489922 conn(0x5632e1f80f20 msgr2=0x5632e1f820c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 -- 172.21.15.2:0/389489922 shutdown_connections 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 -- 172.21.15.2:0/389489922 wait complete. 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.062+0000 7fb52a124740 1 -- start start 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 Processor -- start 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f8f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5632e1d4a700 con 0x5632e1f83a10 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5632e1e84160 con 0x5632e1f8f9a0 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5632e1f92620 con 0x5632e1f830f0 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb52a124740 10 client.0 _ll_register_callbacks cb 0x5632e1e9d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb5252ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb5252ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36310/0 (socket says 172.21.15.2:36310) 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb5252ea640 1 -- 172.21.15.2:0/3635410258 learned_addr learned my addr 172.21.15.2:0/3635410258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb525aeb640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f8f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.063+0000 7fb5262ec640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5252ea640 1 -- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 msgr2=0x5632e1f8f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5252ea640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f8f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5252ea640 1 -- 172.21.15.2:0/3635410258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f8f9a0 msgr2=0x5632e1f8cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5252ea640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5252ea640 1 -- 172.21.15.2:0/3635410258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632e1eb1c90 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5262ec640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5252ea640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8c6b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb5100ac2c0 tx=0x7fb5100abfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b2c7a8f9dc8907 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5097fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5097fa640 1 -- 172.21.15.2:0/3635410258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5100aca20 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5097fa640 1 -- 172.21.15.2:0/3635410258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb5100b56c0 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb51c0047a0 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5097fa640 1 -- 172.21.15.2:0/3635410258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb5100accc0 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb52a124740 10 client.15870 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5632e1f9df20 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.064+0000 7fb5097fa640 1 -- 172.21.15.2:0/3635410258 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb51c0047a0 con 0x5632e1f83a10 2024-09-10T23:25:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb5097fa640 1 -- 172.21.15.2:0/3635410258 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb5100a7f10 con 0x5632e1f83a10 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb52a124740 10 client.15870 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb52a124740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb52a124740 20 client.15870 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb52a124740 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e1fa1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb52a124740 4 client.15870 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632e1efbdf0 con 0x5632e1f9f3e0 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb525aeb640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e1fa1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb5097fa640 10 client.15870 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.065+0000 7fb525aeb640 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e1fa1820 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9bb4bc1e7eae75f server_cookie=3bcf7a69f59e614a in_seq=0 out_seq=0 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb5097fa640 1 -- 172.21.15.2:0/3635410258 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632e1efbdf0 con 0x5632e1f9f3e0 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb5097fa640 10 client.15870 handle_command_reply: tid=0 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 client.15870 shutdown 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 msgr2=0x5632e1f8c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8c6b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb5100ac2c0 tx=0x7fb5100abfd0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 shutdown_connections 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e1fa1820 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb5097fa640 0 client.15870 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f83a10 0x5632e1f8c6b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 --2- 172.21.15.2:0/3635410258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f8f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 >> 172.21.15.2:0/3635410258 conn(0x5632e1f80f20 msgr2=0x5632e1f86ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.066+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 shutdown_connections 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.067+0000 7fb52a124740 1 -- 172.21.15.2:0/3635410258 wait complete. 2024-09-10T23:25:33.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.067+0000 7fb52a124740 20 client.15870 trim_cache size 0 max 16384 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 Processor -- start 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 -- start start 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f9b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f83a10 0x5632e1f81f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b0470 con 0x5632e1f8f9a0 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b1fb0 con 0x5632e1f83a10 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb52a124740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b0b40 con 0x5632e1f830f0 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb5262ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb5262ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36314/0 (socket says 172.21.15.2:36314) 2024-09-10T23:25:33.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.082+0000 7fb5262ec640 1 -- 172.21.15.2:0/4285433176 learned_addr learned my addr 172.21.15.2:0/4285433176 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5252ea640 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f83a10 0x5632e1f81f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb525aeb640 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f9b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5262ec640 1 -- 172.21.15.2:0/4285433176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 msgr2=0x5632e1f9b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5262ec640 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f9b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5262ec640 1 -- 172.21.15.2:0/4285433176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f83a10 msgr2=0x5632e1f81f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5262ec640 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f83a10 0x5632e1f81f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5262ec640 1 -- 172.21.15.2:0/4285433176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632e1f83840 con 0x5632e1f8f9a0 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb525aeb640 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f9b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb5262ec640 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8e3f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb518032fa0 tx=0x7fb51803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dccd3fa2dee4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb50b7fe640 1 -- 172.21.15.2:0/4285433176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5180318e0 con 0x5632e1f8f9a0 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb50b7fe640 1 -- 172.21.15.2:0/4285433176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb518036040 con 0x5632e1f8f9a0 2024-09-10T23:25:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.083+0000 7fb50b7fe640 1 -- 172.21.15.2:0/4285433176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518004320 con 0x5632e1f8f9a0 2024-09-10T23:25:33.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 -- 172.21.15.2:0/4285433176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 msgr2=0x5632e1f8e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8e3f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb518032fa0 tx=0x7fb51803f000 comp rx=0 tx=0).stop 2024-09-10T23:25:33.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 -- 172.21.15.2:0/4285433176 shutdown_connections 2024-09-10T23:25:33.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f8e3f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f83a10 0x5632e1f81f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 --2- 172.21.15.2:0/4285433176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f830f0 0x5632e1f9b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 -- 172.21.15.2:0/4285433176 >> 172.21.15.2:0/4285433176 conn(0x5632e1f80f20 msgr2=0x5632e1f8dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 -- 172.21.15.2:0/4285433176 shutdown_connections 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 -- 172.21.15.2:0/4285433176 wait complete. 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.084+0000 7fb52a124740 1 -- start start 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 Processor -- start 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f89ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f83a10 0x5632e1f978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f97e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b18e0 con 0x5632e1f8f9a0 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b1210 con 0x5632e1f830f0 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201ae450 con 0x5632e1f83a10 2024-09-10T23:25:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb52a124740 10 client.0 _ll_register_callbacks cb 0x7fb51000c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f97e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f97e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36330/0 (socket says 172.21.15.2:36330) 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 -- 172.21.15.2:0/3547475399 learned_addr learned my addr 172.21.15.2:0/3547475399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5252ea640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f83a10 0x5632e1f978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb525aeb640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f89ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 -- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f83a10 msgr2=0x5632e1f978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f83a10 0x5632e1f978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 -- 172.21.15.2:0/3547475399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 msgr2=0x5632e1f89ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f89ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5262ec640 1 -- 172.21.15.2:0/3547475399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632e1f8d000 con 0x5632e1f8f9a0 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.085+0000 7fb5252ea640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f83a10 0x5632e1f978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5262ec640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f97e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb5180048c0 tx=0x7fb5180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ba7ac0c2b8919a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5097fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5097fa640 1 -- 172.21.15.2:0/3547475399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5180318e0 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5097fa640 1 -- 172.21.15.2:0/3547475399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb51802f870 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb518036040 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5097fa640 1 -- 172.21.15.2:0/3547475399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb51802fa70 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 10 client.15876 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5632e1f89570 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5097fa640 1 -- 172.21.15.2:0/3547475399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb518036040 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb5097fa640 1 -- 172.21.15.2:0/3547475399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb518043040 con 0x5632e1f8f9a0 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 10 client.15876 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 20 client.15876 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.086+0000 7fb52a124740 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e200f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.087+0000 7fb52a124740 4 client.15876 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.087+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632e1ef78a0 con 0x5632e1f9f3e0 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.087+0000 7fb525aeb640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e200f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.087+0000 7fb525aeb640 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e200f600 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21764aa434642507 server_cookie=a8cd17e3be850c99 in_seq=0 out_seq=0 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.087+0000 7fb5097fa640 10 client.15876 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb5097fa640 1 -- 172.21.15.2:0/3547475399 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632e1ef78a0 con 0x5632e1f9f3e0 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb5097fa640 10 client.15876 handle_command_reply: tid=0 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 client.15876 shutdown 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 msgr2=0x5632e1f97e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f97e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb5180048c0 tx=0x7fb5180048f0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 shutdown_connections 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5632e1f9f3e0 0x5632e200f600 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632e1f8f9a0 0x5632e1f97e20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5632e1f83a10 0x5632e1f978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 --2- 172.21.15.2:0/3547475399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5632e1f830f0 0x5632e1f89ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb5097fa640 0 client.15876 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 >> 172.21.15.2:0/3547475399 conn(0x5632e1f80f20 msgr2=0x5632e1f8e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 shutdown_connections 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 1 -- 172.21.15.2:0/3547475399 wait complete. 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb52a124740 20 client.15876 trim_cache size 0 max 16384 2024-09-10T23:25:33.095 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb50c0b52e0 msgr2=0x7fb50c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.088+0000 7fb527d4f640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb50c0b52e0 0x7fb50c0b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb518009ca0 tx=0x7fb5180093f0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 msgr2=0x7fb52019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 0x7fb52019b840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c920 tx=0x7fb51000cde0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 shutdown_connections 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb50c0b52e0 0x7fb50c0b77a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb520108020 0x7fb5201a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5201076a0 0x7fb52019b840 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 --2- 172.21.15.2:0/744905066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb520101c90 0x7fb52019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 >> 172.21.15.2:0/744905066 conn(0x7fb5200fd700 msgr2=0x7fb52006ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 shutdown_connections 2024-09-10T23:25:33.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:33.089+0000 7fb527d4f640 1 -- 172.21.15.2:0/744905066 wait complete. 2024-09-10T23:25:33.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:33 smithi002 ceph-mon[31150]: pgmap v388: 97 pgs: 97 active+clean; 857 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:33.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:33 smithi177 ceph-mon[35760]: pgmap v388: 97 pgs: 97 active+clean; 857 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:33.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:33 smithi154 ceph-mon[35136]: pgmap v388: 97 pgs: 97 active+clean; 857 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:34.790 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:25:34.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:25:35.064 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:35.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:35 smithi002 ceph-mon[31150]: pgmap v389: 97 pgs: 97 active+clean; 857 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 -- 172.21.15.2:0/3906007708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4102dc0 msgr2=0x7f55e41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/3906007708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4102dc0 0x7f55e41031a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009900 tx=0x7f55d402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 -- 172.21.15.2:0/3906007708 shutdown_connections 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/3906007708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55e4109150 0x7f55e410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/3906007708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41087d0 0x7f55e4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/3906007708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4102dc0 0x7f55e41031a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 -- 172.21.15.2:0/3906007708 >> 172.21.15.2:0/3906007708 conn(0x7f55e40fe830 msgr2=0x7f55e4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 -- 172.21.15.2:0/3906007708 shutdown_connections 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.566+0000 7f55ea2dd640 1 -- 172.21.15.2:0/3906007708 wait complete. 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.567+0000 7f55ea2dd640 1 Processor -- start 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.567+0000 7f55ea2dd640 1 -- start start 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.567+0000 7f55ea2dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55e4102dc0 0x7f55e4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.567+0000 7f55ea2dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 0x7f55e41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55ea2dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e4109150 0x7f55e419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55ea2dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4112e10 con 0x7f55e41087d0 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55ea2dd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4112c90 con 0x7f55e4109150 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55ea2dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4112f90 con 0x7f55e4102dc0 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 0x7f55e41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 0x7f55e41997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36350/0 (socket says 172.21.15.2:36350) 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 -- 172.21.15.2:0/370286940 learned_addr learned my addr 172.21.15.2:0/370286940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e3fff640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55e4102dc0 0x7f55e4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e887a640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e4109150 0x7f55e419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 -- 172.21.15.2:0/370286940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55e4102dc0 msgr2=0x7f55e4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55e4102dc0 0x7f55e4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 -- 172.21.15.2:0/370286940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e4109150 msgr2=0x7f55e419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e4109150 0x7f55e419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 -- 172.21.15.2:0/370286940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e419f310 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e37fe640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 0x7f55e41997a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c920 tx=0x7f55d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e17fa640 1 -- 172.21.15.2:0/370286940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8007c70 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e17fa640 1 -- 172.21.15.2:0/370286940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d8007e10 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e419f600 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.568+0000 7f55e17fa640 1 -- 172.21.15.2:0/370286940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8018820 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.569+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a5e90 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 Processor -- start 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55e17fa640 1 -- 172.21.15.2:0/370286940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f55d800f450 con 0x7f55e41087d0 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 -- start start 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d10c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d11c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d11ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55575d082e60 con 0x55575d10c800 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55575d072290 con 0x55575d10bee0 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55575d0760a0 con 0x55575d11cba0 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d11c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d11c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36356/0 (socket says 172.21.15.2:36356) 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.571+0000 7f55e3fff640 1 -- 172.21.15.2:0/781387136 learned_addr learned my addr 172.21.15.2:0/781387136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e887a640 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d10c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e37fe640 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d11ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e3fff640 1 -- 172.21.15.2:0/781387136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 msgr2=0x55575d11ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e3fff640 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d11ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e3fff640 1 -- 172.21.15.2:0/781387136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 msgr2=0x55575d10c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e3fff640 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d10c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e3fff640 1 -- 172.21.15.2:0/781387136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cdd0930 con 0x55575d10c800 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e37fe640 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d11ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e17fa640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f55cc0b5360 0x7f55cc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e887a640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f55cc0b5360 0x7f55cc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e3fff640 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d11c660 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f55d4033000 tx=0x7f55d4031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fd18593ca24570 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55e17fa640 1 -- 172.21.15.2:0/370286940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f55d80e5bd0 con 0x7f55e41087d0 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55ca7fc640 1 -- 172.21.15.2:0/781387136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4040070 con 0x55575d10c800 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55ca7fc640 1 -- 172.21.15.2:0/781387136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d40316a0 con 0x55575d10c800 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.572+0000 7f55ca7fc640 1 -- 172.21.15.2:0/781387136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4035040 con 0x55575d10c800 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 -- 172.21.15.2:0/781387136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 msgr2=0x55575d11c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55e887a640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f55cc0b5360 0x7f55cc0b7820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00a400 tx=0x7f55dc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d11c660 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f55d4033000 tx=0x7f55d4031de0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 -- 172.21.15.2:0/781387136 shutdown_connections 2024-09-10T23:25:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d11ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d11c660 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/781387136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d10c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 -- 172.21.15.2:0/781387136 >> 172.21.15.2:0/781387136 conn(0x55575d109d10 msgr2=0x55575d10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 -- 172.21.15.2:0/781387136 shutdown_connections 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 -- 172.21.15.2:0/781387136 wait complete. 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.573+0000 7f55ec6b2740 1 -- start start 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 Processor -- start 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d10bee0 0x55575d119b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10c800 0x55575d11a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 0x55575d11a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55575ced3890 con 0x55575d11cba0 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55575d00cd40 con 0x55575d10c800 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55575d11f7f0 con 0x55575d10bee0 2024-09-10T23:25:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55ec6b2740 10 client.0 _ll_register_callbacks cb 0x55575d070c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55e887a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 0x55575d11a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55e887a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 0x55575d11a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36360/0 (socket says 172.21.15.2:36360) 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55e887a640 1 -- 172.21.15.2:0/167202520 learned_addr learned my addr 172.21.15.2:0/167202520 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55e37fe640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10c800 0x55575d11a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.574+0000 7f55e3fff640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d10bee0 0x55575d119b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55e887a640 1 -- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d10bee0 msgr2=0x55575d119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55e887a640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d10bee0 0x55575d119b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55e887a640 1 -- 172.21.15.2:0/167202520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10c800 msgr2=0x55575d11a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55e887a640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10c800 0x55575d11a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55e887a640 1 -- 172.21.15.2:0/167202520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575d128c00 con 0x55575d11cba0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55e887a640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 0x55575d11a5e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f55dc018ed0 tx=0x7f55dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb8403a962434f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55c37fe640 1 -- 172.21.15.2:0/167202520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc028060 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55c37fe640 1 -- 172.21.15.2:0/167202520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f55dc023670 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55d40316a0 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55c37fe640 1 -- 172.21.15.2:0/167202520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55dc023870 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55ec6b2740 10 client.15888 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55575d12b580 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55c37fe640 1 -- 172.21.15.2:0/167202520 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d40316a0 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.575+0000 7f55c37fe640 1 -- 172.21.15.2:0/167202520 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55dc02ea20 con 0x55575d11cba0 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55ec6b2740 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55ec6b2740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55ec6b2740 20 client.15888 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d12cae0 0x55575d12eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55ec6b2740 4 client.15888 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55575d084db0 con 0x55575d12cae0 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55e3fff640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d12cae0 0x55575d12eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55e3fff640 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d12cae0 0x55575d12eef0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a6bd73e1251b125 server_cookie=c7f1584dcbf68c7b in_seq=0 out_seq=0 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.576+0000 7f55c37fe640 10 client.15888 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55c37fe640 1 -- 172.21.15.2:0/167202520 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55575d084db0 con 0x55575d12cae0 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55c37fe640 10 client.15888 handle_command_reply: tid=0 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 client.15888 shutdown 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 msgr2=0x55575d11a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 0x55575d11a5e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f55dc018ed0 tx=0x7f55dc004a40 comp rx=0 tx=0).stop 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 shutdown_connections 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d12cae0 0x55575d12eef0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d11cba0 0x55575d11a5e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10c800 0x55575d11a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/167202520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d10bee0 0x55575d119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55c37fe640 0 client.15888 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:35.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 >> 172.21.15.2:0/167202520 conn(0x55575d109d10 msgr2=0x55575d108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 shutdown_connections 2024-09-10T23:25:35.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 1 -- 172.21.15.2:0/167202520 wait complete. 2024-09-10T23:25:35.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.577+0000 7f55ec6b2740 20 client.15888 trim_cache size 0 max 16384 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 Processor -- start 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 -- start start 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d11b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d134d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41ac180 con 0x55575d10c800 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41adcc0 con 0x55575d10bee0 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.595+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41ac850 con 0x55575d11cba0 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1347c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36370/0 (socket says 172.21.15.2:36370) 2024-09-10T23:25:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 -- 172.21.15.2:0/3093167303 learned_addr learned my addr 172.21.15.2:0/3093167303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e3fff640 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d11b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e887a640 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d134d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 -- 172.21.15.2:0/3093167303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 msgr2=0x55575d134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d134d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 -- 172.21.15.2:0/3093167303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 msgr2=0x55575d11b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d11b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 -- 172.21.15.2:0/3093167303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575d11d710 con 0x55575d10c800 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55e37fe640 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1347c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f55d80e36e0 tx=0x7f55d800fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5752342e4eb4848 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55c9ffb640 1 -- 172.21.15.2:0/3093167303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d80acaa0 con 0x55575d10c800 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55c9ffb640 1 -- 172.21.15.2:0/3093167303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d80ac3a0 con 0x55575d10c800 2024-09-10T23:25:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.596+0000 7f55c9ffb640 1 -- 172.21.15.2:0/3093167303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d80a8610 con 0x55575d10c800 2024-09-10T23:25:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 -- 172.21.15.2:0/3093167303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 msgr2=0x55575d1347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1347c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f55d80e36e0 tx=0x7f55d800fe60 comp rx=0 tx=0).stop 2024-09-10T23:25:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 -- 172.21.15.2:0/3093167303 shutdown_connections 2024-09-10T23:25:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d134d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1347c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/3093167303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d11b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 -- 172.21.15.2:0/3093167303 >> 172.21.15.2:0/3093167303 conn(0x55575d109d10 msgr2=0x55575d11b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 -- 172.21.15.2:0/3093167303 shutdown_connections 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 -- 172.21.15.2:0/3093167303 wait complete. 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.597+0000 7f55ec6b2740 1 -- start start 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 Processor -- start 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d1250d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1215b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d121af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41ad5f0 con 0x55575d10c800 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41acf20 con 0x55575d10bee0 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41aa160 con 0x55575d11cba0 2024-09-10T23:25:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55ec6b2740 10 client.0 _ll_register_callbacks cb 0x7f55dc009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36382/0 (socket says 172.21.15.2:36382) 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 -- 172.21.15.2:0/1163108052 learned_addr learned my addr 172.21.15.2:0/1163108052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e887a640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e3fff640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d1250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 -- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 msgr2=0x55575d121af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d121af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 -- 172.21.15.2:0/1163108052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 msgr2=0x55575d1250d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d1250d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.598+0000 7f55e37fe640 1 -- 172.21.15.2:0/1163108052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575d122190 con 0x55575d10c800 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55e37fe640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1215b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55d80a9610 tx=0x7f55d800fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb01125d1ab8fb22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55c37fe640 1 -- 172.21.15.2:0/1163108052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d80b56a0 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55c37fe640 1 -- 172.21.15.2:0/1163108052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f55d80e3ba0 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55d80ac3a0 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55c37fe640 1 -- 172.21.15.2:0/1163108052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55d80b0e80 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 10 client.15894 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55575d19a8e0 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55c37fe640 1 -- 172.21.15.2:0/1163108052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d80ac3a0 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55c37fe640 1 -- 172.21.15.2:0/1163108052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55d80cf0b0 con 0x55575d10c800 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 10 client.15894 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 20 client.15894 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d19af60 0x55575d19d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 4 client.15894 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:25:35.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.599+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55575d080860 con 0x55575d19af60 2024-09-10T23:25:35.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.600+0000 7f55e3fff640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d19af60 0x55575d19d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.600+0000 7f55e3fff640 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d19af60 0x55575d19d380 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75d087334378307b server_cookie=8b0233574eeab647 in_seq=0 out_seq=0 2024-09-10T23:25:35.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.600+0000 7f55c37fe640 10 client.15894 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.601+0000 7f55c37fe640 1 -- 172.21.15.2:0/1163108052 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55575d080860 con 0x55575d19af60 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.601+0000 7f55c37fe640 10 client.15894 handle_command_reply: tid=0 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.601+0000 7f55ec6b2740 1 client.15894 shutdown 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 msgr2=0x55575d1215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1215b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55d80a9610 tx=0x7f55d800fcc0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 shutdown_connections 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55575d19af60 0x55575d19d380 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55c37fe640 0 client.15894 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55575d11cba0 0x55575d121af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55575d10c800 0x55575d1215b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 --2- 172.21.15.2:0/1163108052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55575d10bee0 0x55575d1250d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 >> 172.21.15.2:0/1163108052 conn(0x55575d109d10 msgr2=0x55575d128260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 shutdown_connections 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 1 -- 172.21.15.2:0/1163108052 wait complete. 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ec6b2740 20 client.15894 trim_cache size 0 max 16384 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "954996e6-3229-41a9-9ed5-393c0330a189", 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:25:35.607 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:25:35.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f55cc0b5360 msgr2=0x7f55cc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f55cc0b5360 0x7f55cc0b7820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00a400 tx=0x7f55dc00d040 comp rx=0 tx=0).stop 2024-09-10T23:25:35.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 msgr2=0x7f55e41997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.602+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 0x7f55e41997a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c920 tx=0x7f55d800cde0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 shutdown_connections 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f55cc0b5360 0x7f55cc0b7820 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e4109150 0x7f55e419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e41087d0 0x7f55e41997a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 --2- 172.21.15.2:0/370286940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55e4102dc0 0x7f55e4199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 >> 172.21.15.2:0/370286940 conn(0x7f55e40fe830 msgr2=0x7f55e4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 shutdown_connections 2024-09-10T23:25:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:35.603+0000 7f55ea2dd640 1 -- 172.21.15.2:0/370286940 wait complete. 2024-09-10T23:25:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:35 smithi177 ceph-mon[35760]: pgmap v389: 97 pgs: 97 active+clean; 857 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:35.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:35 smithi154 ceph-mon[35136]: pgmap v389: 97 pgs: 97 active+clean; 857 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:36.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:25:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:36 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:25:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:36 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:36 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:25:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:36 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:36 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:25:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:36 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:36.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:36 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:25:36.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:36 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:36.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:36 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:25:36.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:36 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:36.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:36 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:25:36.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:36 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:25:37.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 -- 172.21.15.2:0/727379302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c1087d0 msgr2=0x7f608c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 --2- 172.21.15.2:0/727379302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c1087d0 0x7f608c108c10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6080009900 tx=0x7f608002a410 comp rx=0 tx=0).stop 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 -- 172.21.15.2:0/727379302 shutdown_connections 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 --2- 172.21.15.2:0/727379302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c109150 0x7f608c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 --2- 172.21.15.2:0/727379302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c1087d0 0x7f608c108c10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 --2- 172.21.15.2:0/727379302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 -- 172.21.15.2:0/727379302 >> 172.21.15.2:0/727379302 conn(0x7f608c0fe830 msgr2=0x7f608c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 -- 172.21.15.2:0/727379302 shutdown_connections 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.016+0000 7f6090b4a640 1 -- 172.21.15.2:0/727379302 wait complete. 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.017+0000 7f6090b4a640 1 Processor -- start 2024-09-10T23:25:37.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.017+0000 7f6090b4a640 1 -- start start 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6090b4a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6090b4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c1087d0 0x7f608c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6090b4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 0x7f608c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6090b4a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f608c112e10 con 0x7f608c109150 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6090b4a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f608c112c90 con 0x7f608c1087d0 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6090b4a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f608c112f90 con 0x7f608c102dc0 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 0x7f608c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:38200/0 (socket says 172.21.15.2:38200) 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 0x7f608c19ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36386/0 (socket says 172.21.15.2:36386) 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 -- 172.21.15.2:0/3342496287 learned_addr learned my addr 172.21.15.2:0/3342496287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:37.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f6089d9b640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c1087d0 0x7f608c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 -- 172.21.15.2:0/3342496287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c1087d0 msgr2=0x7f608c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c1087d0 0x7f608c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 -- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 msgr2=0x7f608c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 0x7f608c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 -- 172.21.15.2:0/3342496287 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c19f3d0 con 0x7f608c102dc0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608ad9d640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 0x7f608c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.018+0000 7f608a59c640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c199320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d950 tx=0x7f607c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.019+0000 7f607b7fe640 1 -- 172.21.15.2:0/3342496287 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c017070 con 0x7f608c102dc0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.019+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608c19f6c0 con 0x7f608c102dc0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.019+0000 7f607b7fe640 1 -- 172.21.15.2:0/3342496287 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f607c009c30 con 0x7f608c102dc0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.019+0000 7f607b7fe640 1 -- 172.21.15.2:0/3342496287 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c00f620 con 0x7f608c102dc0 2024-09-10T23:25:37.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.019+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608c1a5f50 con 0x7f608c102dc0 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.021+0000 7f6092f1f740 1 Processor -- start 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.021+0000 7f6092f1f740 1 -- start start 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36b480 0x5653bf36b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36bda0 0x5653bf3777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf37a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6092f1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5653bf2e1e50 con 0x5653bf377d30 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6092f1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5653bf2d1280 con 0x5653bf36b480 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6092f1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5653bf2d5090 con 0x5653bf36bda0 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf37a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf37a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36388/0 (socket says 172.21.15.2:36388) 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 -- 172.21.15.2:0/2039702633 learned_addr learned my addr 172.21.15.2:0/2039702633 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:37.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f607b7fe640 1 -- 172.21.15.2:0/3342496287 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f607c010460 con 0x7f608c102dc0 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f608ad9d640 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36b480 0x5653bf36b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 -- 172.21.15.2:0/2039702633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36bda0 msgr2=0x5653bf3777f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36bda0 0x5653bf3777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 -- 172.21.15.2:0/2039702633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36b480 msgr2=0x5653bf36b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36b480 0x5653bf36b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 -- 172.21.15.2:0/2039702633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bf02f650 con 0x5653bf377d30 2024-09-10T23:25:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.022+0000 7f6089d9b640 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf37a120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6080009900 tx=0x7f6080032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea14fdbe68117da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f6078ff9640 1 -- 172.21.15.2:0/2039702633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080040070 con 0x5653bf377d30 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f6078ff9640 1 -- 172.21.15.2:0/2039702633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60800316a0 con 0x5653bf377d30 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f6078ff9640 1 -- 172.21.15.2:0/2039702633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080035040 con 0x5653bf377d30 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f607b7fe640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60740b52e0 0x7f60740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f608ad9d640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60740b52e0 0x7f60740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f607b7fe640 1 -- 172.21.15.2:0/3342496287 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f607c0e5760 con 0x7f608c102dc0 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f6092f1f740 1 -- 172.21.15.2:0/2039702633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 msgr2=0x5653bf37a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f608ad9d640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60740b52e0 0x7f60740b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6084009fd0 tx=0x7f608400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.023+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf37a120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6080009900 tx=0x7f6080032e60 comp rx=0 tx=0).stop 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- 172.21.15.2:0/2039702633 shutdown_connections 2024-09-10T23:25:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf37a120 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36bda0 0x5653bf3777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2039702633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36b480 0x5653bf36b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- 172.21.15.2:0/2039702633 >> 172.21.15.2:0/2039702633 conn(0x5653bf3692b0 msgr2=0x5653bf36a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- 172.21.15.2:0/2039702633 shutdown_connections 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- 172.21.15.2:0/2039702633 wait complete. 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- start start 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 Processor -- start 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf377630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf374a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf375090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5653bf132700 con 0x5653bf377d30 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5653bf26c110 con 0x5653bf36bda0 2024-09-10T23:25:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5653bf37a950 con 0x5653bf36b480 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.024+0000 7f6092f1f740 10 client.0 _ll_register_callbacks cb 0x5653bf285990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf375090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf375090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36394/0 (socket says 172.21.15.2:36394) 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 -- 172.21.15.2:0/4130054827 learned_addr learned my addr 172.21.15.2:0/4130054827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6089d9b640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf374a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608a59c640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf377630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 -- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 msgr2=0x5653bf377630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf377630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 -- 172.21.15.2:0/4130054827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 msgr2=0x5653bf374a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf374a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 -- 172.21.15.2:0/4130054827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bf299c40 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f608ad9d640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf375090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6084018710 tx=0x7f6084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cbd6fd43f1407c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6071ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6071ffb640 1 -- 172.21.15.2:0/4130054827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084026020 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6071ffb640 1 -- 172.21.15.2:0/4130054827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f60840166f0 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60800316a0 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6071ffb640 1 -- 172.21.15.2:0/4130054827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f608401e040 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6092f1f740 10 client.15906 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.025+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653bf386300 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6071ffb640 1 -- 172.21.15.2:0/4130054827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60800316a0 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6071ffb640 1 -- 172.21.15.2:0/4130054827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6084021030 con 0x5653bf377d30 2024-09-10T23:25:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6092f1f740 10 client.15906 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6092f1f740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6092f1f740 20 client.15906 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6092f1f740 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf387860 0x5653bf389c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6092f1f740 4 client.15906 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653bf2e3da0 con 0x5653bf387860 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.026+0000 7f608a59c640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf387860 0x5653bf389c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6071ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f608a59c640 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf387860 0x5653bf389c50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=524a4b9ace2b86d0 server_cookie=1e18f51678a1bc87 in_seq=0 out_seq=0 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6071ffb640 1 -- 172.21.15.2:0/4130054827 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653bf2e3da0 con 0x5653bf387860 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6071ffb640 10 client.15906 handle_command_reply: tid=0 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 client.15906 shutdown 2024-09-10T23:25:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 msgr2=0x5653bf375090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf375090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6084018710 tx=0x7f6084004a40 comp rx=0 tx=0).stop 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 shutdown_connections 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf387860 0x5653bf389c50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf375090 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf374a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 --2- 172.21.15.2:0/4130054827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf377630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6071ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.027+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 >> 172.21.15.2:0/4130054827 conn(0x5653bf3692b0 msgr2=0x5653bf36ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.028+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 shutdown_connections 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.028+0000 7f6092f1f740 1 -- 172.21.15.2:0/4130054827 wait complete. 2024-09-10T23:25:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.028+0000 7f6092f1f740 20 client.15906 trim_cache size 0 max 16384 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 Processor -- start 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 -- start start 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf383b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf3767c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf379120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f608c1ae480 con 0x5653bf377d30 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f608c1affc0 con 0x5653bf36bda0 2024-09-10T23:25:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.045+0000 7f6092f1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f608c1aeb50 con 0x5653bf36b480 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf379120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf379120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36404/0 (socket says 172.21.15.2:36404) 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 -- 172.21.15.2:0/2611481701 learned_addr learned my addr 172.21.15.2:0/2611481701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f6089d9b640 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf3767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608a59c640 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf383b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 -- 172.21.15.2:0/2611481701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 msgr2=0x5653bf383b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf383b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 -- 172.21.15.2:0/2611481701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 msgr2=0x5653bf3767c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf3767c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 -- 172.21.15.2:0/2611481701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bf36f7a0 con 0x5653bf377d30 2024-09-10T23:25:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608a59c640 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf383b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f608ad9d640 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf379120 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6084011620 tx=0x7f6084009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27516f25096abb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f6073fff640 1 -- 172.21.15.2:0/2611481701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084026040 con 0x5653bf377d30 2024-09-10T23:25:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f6073fff640 1 -- 172.21.15.2:0/2611481701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f608402d620 con 0x5653bf377d30 2024-09-10T23:25:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.046+0000 7f6073fff640 1 -- 172.21.15.2:0/2611481701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084022470 con 0x5653bf377d30 2024-09-10T23:25:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 -- 172.21.15.2:0/2611481701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 msgr2=0x5653bf379120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf379120 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6084011620 tx=0x7f6084009890 comp rx=0 tx=0).stop 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 -- 172.21.15.2:0/2611481701 shutdown_connections 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf377d30 0x5653bf379120 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf3767c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 --2- 172.21.15.2:0/2611481701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf36b480 0x5653bf383b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 -- 172.21.15.2:0/2611481701 >> 172.21.15.2:0/2611481701 conn(0x5653bf3692b0 msgr2=0x5653bf3760b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 -- 172.21.15.2:0/2611481701 shutdown_connections 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 -- 172.21.15.2:0/2611481701 wait complete. 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 -- start start 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.047+0000 7f6092f1f740 1 Processor -- start 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 0x5653bf380010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf380590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf377d30 0x5653bf37adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f608c1af8f0 con 0x5653bf36b480 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f608c1af220 con 0x5653bf36bda0 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f608c1ac460 con 0x5653bf377d30 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6092f1f740 10 client.0 _ll_register_callbacks cb 0x7f6084009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 0x5653bf380010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 0x5653bf380010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36408/0 (socket says 172.21.15.2:36408) 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 -- 172.21.15.2:0/3295281897 learned_addr learned my addr 172.21.15.2:0/3295281897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6089d9b640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf380590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608ad9d640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf377d30 0x5653bf37adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 -- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf377d30 msgr2=0x5653bf37adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf377d30 0x5653bf37adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 -- 172.21.15.2:0/3295281897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 msgr2=0x5653bf380590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf380590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 -- 172.21.15.2:0/3295281897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bf37b620 con 0x5653bf36b480 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f608a59c640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 0x5653bf380010 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f607c0e3270 tx=0x7f607c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5badb4e8e3caeafd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6071ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.048+0000 7f6071ffb640 1 -- 172.21.15.2:0/3295281897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c020040 con 0x5653bf36b480 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6071ffb640 1 -- 172.21.15.2:0/3295281897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f607c0ab240 con 0x5653bf36b480 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f608402d620 con 0x5653bf36b480 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6071ffb640 1 -- 172.21.15.2:0/3295281897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f607c0abfe0 con 0x5653bf36b480 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 10 client.15912 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653bf3f53d0 con 0x5653bf36b480 2024-09-10T23:25:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6071ffb640 1 -- 172.21.15.2:0/3295281897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f608402d620 con 0x5653bf36b480 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6071ffb640 1 -- 172.21.15.2:0/3295281897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f607c0971a0 con 0x5653bf36b480 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 10 client.15912 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 20 client.15912 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf3f5b20 0x5653bf3f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 4 client.15912 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653bf2df850 con 0x5653bf3f5b20 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.049+0000 7f6089d9b640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf3f5b20 0x5653bf3f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6089d9b640 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf3f5b20 0x5653bf3f7f40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21485ba7a5d1da5b server_cookie=72021ca00943e370 in_seq=0 out_seq=0 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6071ffb640 10 client.15912 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6071ffb640 1 -- 172.21.15.2:0/3295281897 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x5653bf2df850 con 0x5653bf3f5b20 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6071ffb640 10 client.15912 handle_command_reply: tid=0 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 client.15912 shutdown 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 msgr2=0x5653bf380010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 0x5653bf380010 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f607c0e3270 tx=0x7f607c000bc0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 shutdown_connections 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653bf3f5b20 0x5653bf3f7f40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5653bf377d30 0x5653bf37adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5653bf36bda0 0x5653bf380590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 --2- 172.21.15.2:0/3295281897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653bf36b480 0x5653bf380010 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 >> 172.21.15.2:0/3295281897 conn(0x5653bf3692b0 msgr2=0x5653bf3768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6071ffb640 0 client.15912 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 shutdown_connections 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 1 -- 172.21.15.2:0/3295281897 wait complete. 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.050+0000 7f6092f1f740 20 client.15912 trim_cache size 0 max 16384 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "954996e6-3229-41a9-9ed5-393c0330a189", 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:25:37.058 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:25:37.059 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:37.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:37.061 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60740b52e0 msgr2=0x7f60740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60740b52e0 0x7f60740b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6084009fd0 tx=0x7f608400d040 comp rx=0 tx=0).stop 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 msgr2=0x7f608c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c199320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d950 tx=0x7f607c00de10 comp rx=0 tx=0).stop 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 shutdown_connections 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60740b52e0 0x7f60740b77a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c109150 0x7f608c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c1087d0 0x7f608c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 --2- 172.21.15.2:0/3342496287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f608c102dc0 0x7f608c199320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 >> 172.21.15.2:0/3342496287 conn(0x7f608c0fe830 msgr2=0x7f608c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 shutdown_connections 2024-09-10T23:25:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:25:37.051+0000 7f6090b4a640 1 -- 172.21.15.2:0/3342496287 wait complete. 2024-09-10T23:25:37.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:37 smithi002 ceph-mon[31150]: pgmap v390: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:37.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:37 smithi177 ceph-mon[35760]: pgmap v390: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:37.731 INFO:tasks.cephfs.filesystem:scrub status for tag:954996e6-3229-41a9-9ed5-393c0330a189 - {'path': '/', 'tag': '954996e6-3229-41a9-9ed5-393c0330a189', 'options': 'recursive,force'} 2024-09-10T23:25:37.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:37 smithi154 ceph-mon[35136]: pgmap v390: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 -- 172.21.15.2:0/3164756736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1044c0 msgr2=0x7f73bc10ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/3164756736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1044c0 0x7f73bc10ae40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009cd0 tx=0x7f73b402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 -- 172.21.15.2:0/3164756736 shutdown_connections 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/3164756736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1044c0 0x7f73bc10ae40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/3164756736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73bc103b00 0x7f73bc103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/3164756736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73bc1029b0 0x7f73bc102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 -- 172.21.15.2:0/3164756736 >> 172.21.15.2:0/3164756736 conn(0x7f73bc0fe270 msgr2=0x7f73bc100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 -- 172.21.15.2:0/3164756736 shutdown_connections 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 -- 172.21.15.2:0/3164756736 wait complete. 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 Processor -- start 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.514+0000 7f73c2aa3640 1 -- start start 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c2aa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 0x7f73bc198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c2aa3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73bc103b00 0x7f73bc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c2aa3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73bc1044c0 0x7f73bc199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c2aa3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc10e650 con 0x7f73bc1029b0 2024-09-10T23:25:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c2aa3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc10e4d0 con 0x7f73bc103b00 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c2aa3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc10e7d0 con 0x7f73bc1044c0 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 0x7f73bc198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 0x7f73bc198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36422/0 (socket says 172.21.15.2:36422) 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 -- 172.21.15.2:0/181454974 learned_addr learned my addr 172.21.15.2:0/181454974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73bbfff640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73bc103b00 0x7f73bc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c1040640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73bc1044c0 0x7f73bc199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 -- 172.21.15.2:0/181454974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73bc1044c0 msgr2=0x7f73bc199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73bc1044c0 0x7f73bc199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 -- 172.21.15.2:0/181454974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73bc103b00 msgr2=0x7f73bc199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73bc103b00 0x7f73bc199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 -- 172.21.15.2:0/181454974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc19a840 con 0x7f73bc1029b0 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73c083f640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 0x7f73bc198d00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f73b000d950 tx=0x7f73b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73b9ffb640 1 -- 172.21.15.2:0/181454974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0017070 con 0x7f73bc1029b0 2024-09-10T23:25:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73b9ffb640 1 -- 172.21.15.2:0/181454974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b0009c30 con 0x7f73bc1029b0 2024-09-10T23:25:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.515+0000 7f73b9ffb640 1 -- 172.21.15.2:0/181454974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b000f620 con 0x7f73bc1029b0 2024-09-10T23:25:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.516+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73bc19ab30 con 0x7f73bc1029b0 2024-09-10T23:25:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.516+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73bc1a1200 con 0x7f73bc1029b0 2024-09-10T23:25:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.518+0000 7f73b9ffb640 1 -- 172.21.15.2:0/181454974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f73b0010460 con 0x7f73bc1029b0 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.518+0000 7f73c586e740 1 Processor -- start 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 -- start start 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298d9bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298d9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9ebd0 0x55d298da1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d298d0b6f0 con 0x55d298d9c190 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d298cfab20 con 0x55d298d99860 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c586e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d298cfe930 con 0x55d298d9ebd0 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298d9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298d9e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36432/0 (socket says 172.21.15.2:36432) 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 -- 172.21.15.2:0/2753550697 learned_addr learned my addr 172.21.15.2:0/2753550697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c1040640 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298d9bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73bbfff640 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9ebd0 0x55d298da1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 -- 172.21.15.2:0/2753550697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9ebd0 msgr2=0x55d298da1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9ebd0 0x55d298da1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 -- 172.21.15.2:0/2753550697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 msgr2=0x55d298d9bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298d9bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c083f640 1 -- 172.21.15.2:0/2753550697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d298cc0530 con 0x55d298d9c190 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.519+0000 7f73c1040640 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298d9bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73b9ffb640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73ac0b52e0 0x7f73ac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73c083f640 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298d9e580 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f73b00ebc20 tx=0x7f73b00ed670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd5d9050de20021 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73c1040640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73ac0b52e0 0x7f73ac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73b9ffb640 1 -- 172.21.15.2:0/181454974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f73b00e58c0 con 0x7f73bc1029b0 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73a6ffd640 1 -- 172.21.15.2:0/2753550697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b00a8680 con 0x55d298d9c190 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73a6ffd640 1 -- 172.21.15.2:0/2753550697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b00abb40 con 0x55d298d9c190 2024-09-10T23:25:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.520+0000 7f73a6ffd640 1 -- 172.21.15.2:0/2753550697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b00ab7a0 con 0x55d298d9c190 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 -- 172.21.15.2:0/2753550697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 msgr2=0x55d298d9e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298d9e580 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f73b00ebc20 tx=0x7f73b00ed670 comp rx=0 tx=0).stop 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c1040640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73ac0b52e0 0x7f73ac0b77a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006010 tx=0x7f73b4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 -- 172.21.15.2:0/2753550697 shutdown_connections 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9ebd0 0x55d298da1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298d9e580 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 --2- 172.21.15.2:0/2753550697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298d9bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 -- 172.21.15.2:0/2753550697 >> 172.21.15.2:0/2753550697 conn(0x55d298d949b0 msgr2=0x55d298d95740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 -- 172.21.15.2:0/2753550697 shutdown_connections 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 -- 172.21.15.2:0/2753550697 wait complete. 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 -- start start 2024-09-10T23:25:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.521+0000 7f73c586e740 1 Processor -- start 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 0x55d298da2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298da4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d298c32ab0 con 0x55d298d99860 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d298ca0730 con 0x55d298d9ebd0 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d298da1b50 con 0x55d298d9c190 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 10 client.0 _ll_register_callbacks cb 0x55d298cf46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 0x55d298da2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 0x55d298da2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36442/0 (socket says 172.21.15.2:36442) 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 -- 172.21.15.2:0/4130758830 learned_addr learned my addr 172.21.15.2:0/4130758830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73bbfff640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c1040640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298da4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 -- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 msgr2=0x55d298da3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 -- 172.21.15.2:0/4130758830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 msgr2=0x55d298da4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298da4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 -- 172.21.15.2:0/4130758830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d298a5c790 con 0x55d298d99860 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c1040640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298da4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c083f640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 0x55d298da2e90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f73b00abd30 tx=0x7f73b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cbd6a3ddc36358 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f739bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f739bfff640 1 -- 172.21.15.2:0/4130758830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0020070 con 0x55d298d99860 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f739bfff640 1 -- 172.21.15.2:0/4130758830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f73b00ac490 con 0x55d298d99860 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.522+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b00abb40 con 0x55d298d99860 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f739bfff640 1 -- 172.21.15.2:0/4130758830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73b00ab980 con 0x55d298d99860 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 10 client.15924 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d298ad5620 con 0x55d298d99860 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f739bfff640 1 -- 172.21.15.2:0/4130758830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b00abb40 con 0x55d298d99860 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f739bfff640 1 -- 172.21.15.2:0/4130758830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73b0097190 con 0x55d298d99860 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 10 client.15924 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 20 client.15924 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298dae330 0x55d298db0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 4 client.15924 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d298d0d640 con 0x55d298dae330 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.523+0000 7f73bbfff640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298dae330 0x55d298db0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.524+0000 7f739bfff640 10 client.15924 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.524+0000 7f73bbfff640 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298dae330 0x55d298db0720 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d96d9bbdf08a20 server_cookie=49629b7b2c12346d in_seq=0 out_seq=0 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f739bfff640 1 -- 172.21.15.2:0/4130758830 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d298d0d640 con 0x55d298dae330 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f739bfff640 10 client.15924 handle_command_reply: tid=0 2024-09-10T23:25:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 client.15924 shutdown 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 msgr2=0x55d298da2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 0x55d298da2e90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f73b00abd30 tx=0x7f73b0005880 comp rx=0 tx=0).stop 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 shutdown_connections 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298dae330 0x55d298db0720 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298da4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 --2- 172.21.15.2:0/4130758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d99860 0x55d298da2e90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f739bfff640 0 client.15924 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 >> 172.21.15.2:0/4130758830 conn(0x55d298d949b0 msgr2=0x55d298d93bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 shutdown_connections 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 1 -- 172.21.15.2:0/4130758830 wait complete. 2024-09-10T23:25:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.525+0000 7f73c586e740 20 client.15924 trim_cache size 0 max 16384 2024-09-10T23:25:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 Processor -- start 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 -- start start 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d99860 0x55d298da1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298da2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298d98d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1a9e70 con 0x55d298d9c190 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1ab9b0 con 0x55d298d9ebd0 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c586e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1aa540 con 0x55d298d99860 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298da2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298da2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36448/0 (socket says 172.21.15.2:36448) 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 -- 172.21.15.2:0/168407681 learned_addr learned my addr 172.21.15.2:0/168407681 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c1040640 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298d98d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73c083f640 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d99860 0x55d298da1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 -- 172.21.15.2:0/168407681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d99860 msgr2=0x55d298da1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d99860 0x55d298da1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 -- 172.21.15.2:0/168407681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 msgr2=0x55d298d98d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298d98d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 -- 172.21.15.2:0/168407681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d298d98990 con 0x55d298d9c190 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.540+0000 7f73bbfff640 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298da2460 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55d298db0dd0 tx=0x7f73a800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645c67bd4bcd62d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73a67fc640 1 -- 172.21.15.2:0/168407681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8005220 con 0x55d298d9c190 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73a67fc640 1 -- 172.21.15.2:0/168407681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73a8004c50 con 0x55d298d9c190 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73a67fc640 1 -- 172.21.15.2:0/168407681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8024880 con 0x55d298d9c190 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 -- 172.21.15.2:0/168407681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 msgr2=0x55d298da2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298da2460 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55d298db0dd0 tx=0x7f73a800b410 comp rx=0 tx=0).stop 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 -- 172.21.15.2:0/168407681 shutdown_connections 2024-09-10T23:25:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d9ebd0 0x55d298d98d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9c190 0x55d298da2460 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 --2- 172.21.15.2:0/168407681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d99860 0x55d298da1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 -- 172.21.15.2:0/168407681 >> 172.21.15.2:0/168407681 conn(0x55d298d949b0 msgr2=0x55d298d95650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 -- 172.21.15.2:0/168407681 shutdown_connections 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 -- 172.21.15.2:0/168407681 wait complete. 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.541+0000 7f73c586e740 1 -- start start 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 Processor -- start 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298daa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 0x55d298da9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1ab2e0 con 0x55d298d9ebd0 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1aac10 con 0x55d298d99860 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1a7e50 con 0x55d298d9c190 2024-09-10T23:25:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c586e740 10 client.0 _ll_register_callbacks cb 0x7f73b4031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 0x55d298da9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 0x55d298da9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36458/0 (socket says 172.21.15.2:36458) 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 -- 172.21.15.2:0/1086777385 learned_addr learned my addr 172.21.15.2:0/1086777385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c083f640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298daa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73bbfff640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 -- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 msgr2=0x55d298da9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 -- 172.21.15.2:0/1086777385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 msgr2=0x55d298daa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298daa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.542+0000 7f73c1040640 1 -- 172.21.15.2:0/1086777385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d298daa3a0 con 0x55d298d9ebd0 2024-09-10T23:25:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c1040640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 0x55d298da9b70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f73b402aed0 tx=0x7f73b40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76b44c8e937866f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f739bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f739bfff640 1 -- 172.21.15.2:0/1086777385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4057060 con 0x55d298d9ebd0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f739bfff640 1 -- 172.21.15.2:0/1086777385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f73b4004250 con 0x55d298d9ebd0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73a8004c50 con 0x55d298d9ebd0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f739bfff640 1 -- 172.21.15.2:0/1086777385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73b4004450 con 0x55d298d9ebd0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 10 client.15930 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d298e1b100 con 0x55d298d9ebd0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f739bfff640 1 -- 172.21.15.2:0/1086777385 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73a8004c50 con 0x55d298d9ebd0 2024-09-10T23:25:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f739bfff640 1 -- 172.21.15.2:0/1086777385 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73b4030070 con 0x55d298d9ebd0 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 10 client.15930 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 20 client.15930 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298e1bae0 0x55d298e1df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 4 client.15930 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.543+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d298d090f0 con 0x55d298e1bae0 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.544+0000 7f73c083f640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298e1bae0 0x55d298e1df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.544+0000 7f73c083f640 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298e1bae0 0x55d298e1df00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98eef0f67a65470 server_cookie=32dc0ba4cd91842a in_seq=0 out_seq=0 2024-09-10T23:25:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.544+0000 7f739bfff640 10 client.15930 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.557+0000 7f739bfff640 1 -- 172.21.15.2:0/1086777385 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d298d090f0 con 0x55d298e1bae0 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.557+0000 7f739bfff640 10 client.15930 handle_command_reply: tid=0 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.557+0000 7f73c586e740 1 client.15930 shutdown 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.557+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 msgr2=0x55d298da9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.557+0000 7f73c586e740 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 0x55d298da9b70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f73b402aed0 tx=0x7f73b40095c0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 shutdown_connections 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d298e1bae0 0x55d298e1df00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d298d9ebd0 0x55d298da9b70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d298d9c190 0x55d298da9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 --2- 172.21.15.2:0/1086777385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d298d99860 0x55d298daa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f739bfff640 0 client.15930 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 >> 172.21.15.2:0/1086777385 conn(0x55d298d949b0 msgr2=0x55d298d9efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 shutdown_connections 2024-09-10T23:25:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 1 -- 172.21.15.2:0/1086777385 wait complete. 2024-09-10T23:25:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c586e740 20 client.15930 trim_cache size 0 max 16384 2024-09-10T23:25:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:25:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:25:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:25:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73ac0b52e0 msgr2=0x7f73ac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73ac0b52e0 0x7f73ac0b77a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006010 tx=0x7f73b4005d80 comp rx=0 tx=0).stop 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 msgr2=0x7f73bc198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 0x7f73bc198d00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f73b000d950 tx=0x7f73b000de10 comp rx=0 tx=0).stop 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 shutdown_connections 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73ac0b52e0 0x7f73ac0b77a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73bc1044c0 0x7f73bc199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73bc103b00 0x7f73bc199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.558+0000 7f73c2aa3640 1 --2- 172.21.15.2:0/181454974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc1029b0 0x7f73bc198d00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.559+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 >> 172.21.15.2:0/181454974 conn(0x7f73bc0fe270 msgr2=0x7f73bc106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.559+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 shutdown_connections 2024-09-10T23:25:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:38.559+0000 7f73c2aa3640 1 -- 172.21.15.2:0/181454974 wait complete. 2024-09-10T23:25:38.680 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:38 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:25:38.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:38 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:25:38.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:38 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:25:39.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:39 smithi177 ceph-mon[35760]: pgmap v391: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:39.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:39 smithi002 ceph-mon[31150]: pgmap v391: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:39 smithi154 ceph-mon[35136]: pgmap v391: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:41.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:41 smithi177 ceph-mon[35760]: pgmap v392: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:41.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:41 smithi002 ceph-mon[31150]: pgmap v392: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:41.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:41 smithi154 ceph-mon[35136]: pgmap v392: 97 pgs: 97 active+clean; 926 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:43.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:43 smithi177 ceph-mon[35760]: pgmap v393: 97 pgs: 97 active+clean; 985 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:43.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:43 smithi002 ceph-mon[31150]: pgmap v393: 97 pgs: 97 active+clean; 985 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:43.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:43 smithi154 ceph-mon[35136]: pgmap v393: 97 pgs: 97 active+clean; 985 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:45.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:45 smithi177 ceph-mon[35760]: pgmap v394: 97 pgs: 97 active+clean; 985 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:45.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:45 smithi002 ceph-mon[31150]: pgmap v394: 97 pgs: 97 active+clean; 985 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:45.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:45 smithi154 ceph-mon[35136]: pgmap v394: 97 pgs: 97 active+clean; 985 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:25:47.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:47 smithi177 ceph-mon[35760]: pgmap v395: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:47.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:47 smithi002 ceph-mon[31150]: pgmap v395: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:47.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:47 smithi154 ceph-mon[35136]: pgmap v395: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:25:49.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:49 smithi177 ceph-mon[35760]: pgmap v396: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:25:49.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:49 smithi002 ceph-mon[31150]: pgmap v396: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:25:49.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:49 smithi154 ceph-mon[35136]: pgmap v396: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 -- 172.21.15.2:0/1414567830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91801029b0 msgr2=0x7f9180102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 --2- 172.21.15.2:0/1414567830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91801029b0 0x7f9180102e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9168009930 tx=0x7f916802a420 comp rx=0 tx=0).stop 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 -- 172.21.15.2:0/1414567830 shutdown_connections 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 --2- 172.21.15.2:0/1414567830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9180103370 0x7f9180109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 --2- 172.21.15.2:0/1414567830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91801029b0 0x7f9180102e30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 --2- 172.21.15.2:0/1414567830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9180101860 0x7f9180101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 -- 172.21.15.2:0/1414567830 >> 172.21.15.2:0/1414567830 conn(0x7f91800fd140 msgr2=0x7f91800ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 -- 172.21.15.2:0/1414567830 shutdown_connections 2024-09-10T23:25:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 -- 172.21.15.2:0/1414567830 wait complete. 2024-09-10T23:25:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.660+0000 7f9185182640 1 Processor -- start 2024-09-10T23:25:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 -- start start 2024-09-10T23:25:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9180101860 0x7f9180105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91801029b0 0x7f9180103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 0x7f91801043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f918010d520 con 0x7f9180103370 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f918010d3a0 con 0x7f91801029b0 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f9185182640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f918010d6a0 con 0x7f9180101860 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 0x7f91801043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 0x7f91801043c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40914/0 (socket says 172.21.15.2:40914) 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 -- 172.21.15.2:0/993180494 learned_addr learned my addr 172.21.15.2:0/993180494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917e59c640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91801029b0 0x7f9180103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917ed9d640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9180101860 0x7f9180105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 -- 172.21.15.2:0/993180494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9180101860 msgr2=0x7f9180105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9180101860 0x7f9180105620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 -- 172.21.15.2:0/993180494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91801029b0 msgr2=0x7f9180103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91801029b0 0x7f9180103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.661+0000 7f917f59e640 1 -- 172.21.15.2:0/993180494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9180104c30 con 0x7f9180103370 2024-09-10T23:25:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.662+0000 7f917f59e640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 0x7f91801043c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f917000eaa0 tx=0x7f917000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.662+0000 7f9177fff640 1 -- 172.21.15.2:0/993180494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917000cdb0 con 0x7f9180103370 2024-09-10T23:25:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.662+0000 7f9177fff640 1 -- 172.21.15.2:0/993180494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9170005020 con 0x7f9180103370 2024-09-10T23:25:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.662+0000 7f9177fff640 1 -- 172.21.15.2:0/993180494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700116d0 con 0x7f9180103370 2024-09-10T23:25:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.662+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91801a2e80 con 0x7f9180103370 2024-09-10T23:25:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.662+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91801a3340 con 0x7f9180103370 2024-09-10T23:25:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.665+0000 7f918802b740 1 Processor -- start 2024-09-10T23:25:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.665+0000 7f9177fff640 1 -- 172.21.15.2:0/993180494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f917000f040 con 0x7f9180103370 2024-09-10T23:25:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.665+0000 7f918802b740 1 -- start start 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f918802b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x556054848c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f918802b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f918802b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x55605484e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f918802b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560547b86f0 con 0x556054849190 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f918802b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560547a7b20 con 0x55605484bbd0 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f918802b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5560547ab930 con 0x556054846860 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40924/0 (socket says 172.21.15.2:40924) 2024-09-10T23:25:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 -- 172.21.15.2:0/737171457 learned_addr learned my addr 172.21.15.2:0/737171457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917e59c640 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x556054848c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917e59c640 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x55605484e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 -- 172.21.15.2:0/737171457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 msgr2=0x556054848c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x556054848c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 -- 172.21.15.2:0/737171457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 msgr2=0x55605484e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x55605484e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.666+0000 7f917ed9d640 1 -- 172.21.15.2:0/737171457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605476d530 con 0x556054849190 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f917ed9d640 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484b580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f917800bd50 tx=0x7f91780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489155c4d8e7a955 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f91757fa640 1 -- 172.21.15.2:0/737171457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178005020 con 0x556054849190 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f9177fff640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f916c0b52e0 0x7f916c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f91757fa640 1 -- 172.21.15.2:0/737171457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91780047a0 con 0x556054849190 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f91757fa640 1 -- 172.21.15.2:0/737171457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178011640 con 0x556054849190 2024-09-10T23:25:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f917e59c640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f916c0b52e0 0x7f916c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.667+0000 7f9177fff640 1 -- 172.21.15.2:0/993180494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f91700e58a0 con 0x7f9180103370 2024-09-10T23:25:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 -- 172.21.15.2:0/737171457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 msgr2=0x55605484b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f917e59c640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f916c0b52e0 0x7f916c0b77a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9168005ab0 tx=0x7f9168005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484b580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f917800bd50 tx=0x7f91780107a0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 -- 172.21.15.2:0/737171457 shutdown_connections 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x55605484e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484b580 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 --2- 172.21.15.2:0/737171457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x556054848c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 -- 172.21.15.2:0/737171457 >> 172.21.15.2:0/737171457 conn(0x5560548419b0 msgr2=0x556054842740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 -- 172.21.15.2:0/737171457 shutdown_connections 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 -- 172.21.15.2:0/737171457 wait complete. 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 -- start start 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.668+0000 7f918802b740 1 Processor -- start 2024-09-10T23:25:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054846860 0x55605484fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x556054850540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054851110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560546dfab0 con 0x556054849190 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55605474d730 con 0x556054846860 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55605484ebb0 con 0x55605484bbd0 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f918802b740 10 client.0 _ll_register_callbacks cb 0x5560547a16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x556054850540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x556054850540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40940/0 (socket says 172.21.15.2:40940) 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 -- 172.21.15.2:0/2030203672 learned_addr learned my addr 172.21.15.2:0/2030203672 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054846860 0x55605484fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917f59e640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054851110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 -- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 msgr2=0x556054851110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054851110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 -- 172.21.15.2:0/2030203672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054846860 msgr2=0x55605484fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054846860 0x55605484fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 -- 172.21.15.2:0/2030203672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556054509790 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917f59e640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054851110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f917e59c640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x556054850540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9168005ec0 tx=0x7f9168009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43650d5e310e42e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.669+0000 7f91667fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f91667fc640 1 -- 172.21.15.2:0/2030203672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168035040 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f91667fc640 1 -- 172.21.15.2:0/2030203672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9168031d00 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91780047a0 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f91667fc640 1 -- 172.21.15.2:0/2030203672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9168055470 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 10 client.15942 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556054582620 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f91667fc640 1 -- 172.21.15.2:0/2030203672 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91780047a0 con 0x556054849190 2024-09-10T23:25:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f91667fc640 1 -- 172.21.15.2:0/2030203672 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f916803d450 con 0x556054849190 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 10 client.15942 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 20 client.15942 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55605485b7a0 0x55605485db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 4 client.15942 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.670+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560547ba640 con 0x55605485b7a0 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.671+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55605485b7a0 0x55605485db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.671+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55605485b7a0 0x55605485db90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d20b9aeea7afb96 server_cookie=ae716bb3f6e8fe28 in_seq=0 out_seq=0 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.671+0000 7f91667fc640 10 client.15942 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f91667fc640 1 -- 172.21.15.2:0/2030203672 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560547ba640 con 0x55605485b7a0 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f91667fc640 10 client.15942 handle_command_reply: tid=0 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 client.15942 shutdown 2024-09-10T23:25:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 msgr2=0x556054850540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x556054850540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9168005ec0 tx=0x7f9168009260 comp rx=0 tx=0).stop 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 shutdown_connections 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55605485b7a0 0x55605485db90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054851110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x556054850540 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 --2- 172.21.15.2:0/2030203672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054846860 0x55605484fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f91667fc640 0 client.15942 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 >> 172.21.15.2:0/2030203672 conn(0x5560548419b0 msgr2=0x556054840bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 shutdown_connections 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 1 -- 172.21.15.2:0/2030203672 wait complete. 2024-09-10T23:25:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.672+0000 7f918802b740 20 client.15942 trim_cache size 0 max 16384 2024-09-10T23:25:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.687+0000 7f918802b740 1 Processor -- start 2024-09-10T23:25:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.687+0000 7f918802b740 1 -- start start 2024-09-10T23:25:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f918802b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x55605484f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f918802b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f918802b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x5560548447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f918802b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91801ac1a0 con 0x556054849190 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f918802b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91801adce0 con 0x55605484bbd0 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f918802b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91801ac870 con 0x556054846860 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40948/0 (socket says 172.21.15.2:40948) 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 -- 172.21.15.2:0/2415113909 learned_addr learned my addr 172.21.15.2:0/2415113909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x55605484f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917f59e640 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x5560548447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 -- 172.21.15.2:0/2415113909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 msgr2=0x55605484f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x55605484f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 -- 172.21.15.2:0/2415113909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 msgr2=0x5560548447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x5560548447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 -- 172.21.15.2:0/2415113909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605485df00 con 0x556054849190 2024-09-10T23:25:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.688+0000 7f917e59c640 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484f640 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9168006010 tx=0x7f91680044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d357e9d49414be33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f9174ff9640 1 -- 172.21.15.2:0/2415113909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168065070 con 0x556054849190 2024-09-10T23:25:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f9174ff9640 1 -- 172.21.15.2:0/2415113909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9168050070 con 0x556054849190 2024-09-10T23:25:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f9174ff9640 1 -- 172.21.15.2:0/2415113909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168035070 con 0x556054849190 2024-09-10T23:25:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 -- 172.21.15.2:0/2415113909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 msgr2=0x55605484f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484f640 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9168006010 tx=0x7f91680044c0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 -- 172.21.15.2:0/2415113909 shutdown_connections 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55605484bbd0 0x5560548447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054849190 0x55605484f640 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 --2- 172.21.15.2:0/2415113909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556054846860 0x55605484f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 -- 172.21.15.2:0/2415113909 >> 172.21.15.2:0/2415113909 conn(0x5560548419b0 msgr2=0x55605484bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 -- 172.21.15.2:0/2415113909 shutdown_connections 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.689+0000 7f918802b740 1 -- 172.21.15.2:0/2415113909 wait complete. 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 -- start start 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 Processor -- start 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 0x556054857a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054849190 0x556054856720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054856ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91801ad610 con 0x556054846860 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91801acf40 con 0x556054849190 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91801aa180 con 0x55605484bbd0 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f918802b740 10 client.0 _ll_register_callbacks cb 0x7f9168003780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 0x556054857a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 0x556054857a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40960/0 (socket says 172.21.15.2:40960) 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917ed9d640 1 -- 172.21.15.2:0/2224777198 learned_addr learned my addr 172.21.15.2:0/2224777198 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917f59e640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054856ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917e59c640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054849190 0x556054856720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917ed9d640 1 -- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 msgr2=0x556054856ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.690+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054856ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f917ed9d640 1 -- 172.21.15.2:0/2224777198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054849190 msgr2=0x556054856720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054849190 0x556054856720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f917ed9d640 1 -- 172.21.15.2:0/2224777198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556054851480 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f917f59e640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054856ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f917e59c640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054849190 0x556054856720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f917ed9d640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 0x556054857a20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9178010ca0 tx=0x7f9178005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a15a8addfab9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f91667fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f91667fc640 1 -- 172.21.15.2:0/2224777198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917802f470 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f91667fc640 1 -- 172.21.15.2:0/2224777198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f917802f610 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9168050070 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f91667fc640 1 -- 172.21.15.2:0/2224777198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f917802f830 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f918802b740 10 client.15948 fetch_fsmap learned FSMap version 28 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560548c86a0 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f91667fc640 1 -- 172.21.15.2:0/2224777198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9168050070 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.691+0000 7f91667fc640 1 -- 172.21.15.2:0/2224777198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f917801b430 con 0x556054846860 2024-09-10T23:25:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f918802b740 10 client.15948 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f918802b740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f918802b740 20 client.15948 populate_metadata read hostname 'smithi002' 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f918802b740 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560548c8d40 0x5560548cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f918802b740 4 client.15948 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560547b60f0 con 0x5560548c8d40 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f917e59c640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560548c8d40 0x5560548cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f917e59c640 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560548c8d40 0x5560548cb160 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50cf0fd3d0f568c5 server_cookie=56db517856179606 in_seq=0 out_seq=0 2024-09-10T23:25:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.692+0000 7f91667fc640 10 client.15948 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f91667fc640 1 -- 172.21.15.2:0/2224777198 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560547b60f0 con 0x5560548c8d40 2024-09-10T23:25:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f91667fc640 10 client.15948 handle_command_reply: tid=0 2024-09-10T23:25:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 client.15948 shutdown 2024-09-10T23:25:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 msgr2=0x556054857a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 0x556054857a20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9178010ca0 tx=0x7f9178005900 comp rx=0 tx=0).stop 2024-09-10T23:25:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 shutdown_connections 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560548c8d40 0x5560548cb160 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55605484bbd0 0x556054856ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556054849190 0x556054856720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f91667fc640 0 client.15948 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 --2- 172.21.15.2:0/2224777198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556054846860 0x556054857a20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 >> 172.21.15.2:0/2224777198 conn(0x5560548419b0 msgr2=0x5560548403d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 shutdown_connections 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 1 -- 172.21.15.2:0/2224777198 wait complete. 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.706+0000 7f918802b740 20 client.15948 trim_cache size 0 max 16384 2024-09-10T23:25:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:25:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:25:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:25:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:25:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f916c0b52e0 msgr2=0x7f916c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f916c0b52e0 0x7f916c0b77a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9168005ab0 tx=0x7f9168005a20 comp rx=0 tx=0).stop 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 msgr2=0x7f91801043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 0x7f91801043c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f917000eaa0 tx=0x7f917000ef60 comp rx=0 tx=0).stop 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 shutdown_connections 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f916c0b52e0 0x7f916c0b77a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9180103370 0x7f91801043c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91801029b0 0x7f9180103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 --2- 172.21.15.2:0/993180494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9180101860 0x7f9180105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 >> 172.21.15.2:0/993180494 conn(0x7f91800fd140 msgr2=0x7f91800feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 shutdown_connections 2024-09-10T23:25:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:25:51.707+0000 7f9185182640 1 -- 172.21.15.2:0/993180494 wait complete. 2024-09-10T23:25:51.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:51 smithi177 ceph-mon[35760]: pgmap v397: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:51.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:51 smithi002 ceph-mon[31150]: pgmap v397: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:51.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:51 smithi154 ceph-mon[35136]: pgmap v397: 97 pgs: 97 active+clean; 1.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:25:53.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:53 smithi177 ceph-mon[35760]: pgmap v398: 97 pgs: 97 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 19 op/s 2024-09-10T23:25:53.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:53 smithi002 ceph-mon[31150]: pgmap v398: 97 pgs: 97 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 19 op/s 2024-09-10T23:25:53.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:53 smithi154 ceph-mon[35136]: pgmap v398: 97 pgs: 97 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 19 op/s 2024-09-10T23:25:55.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:55 smithi177 ceph-mon[35760]: pgmap v399: 97 pgs: 97 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:25:55.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:55 smithi002 ceph-mon[31150]: pgmap v399: 97 pgs: 97 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:25:55.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:55 smithi154 ceph-mon[35136]: pgmap v399: 97 pgs: 97 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:25:57.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:57 smithi177 ceph-mon[35760]: pgmap v400: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:25:57.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:57 smithi002 ceph-mon[31150]: pgmap v400: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:25:57.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:57 smithi154 ceph-mon[35136]: pgmap v400: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:25:59.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:25:59 smithi177 ceph-mon[35760]: pgmap v401: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:25:59.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:25:59 smithi002 ceph-mon[31150]: pgmap v401: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:25:59.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:25:59 smithi154 ceph-mon[35136]: pgmap v401: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:01.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:01 smithi177 ceph-mon[35760]: pgmap v402: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:01.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:01 smithi002 ceph-mon[31150]: pgmap v402: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:01.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:01 smithi154 ceph-mon[35136]: pgmap v402: 97 pgs: 97 active+clean; 1.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:03.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:03 smithi177 ceph-mon[35760]: pgmap v403: 97 pgs: 97 active+clean; 1.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:26:03.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:03 smithi002 ceph-mon[31150]: pgmap v403: 97 pgs: 97 active+clean; 1.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:26:03.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:03 smithi154 ceph-mon[35136]: pgmap v403: 97 pgs: 97 active+clean; 1.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:26:04.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.808+0000 7f30b1fad640 1 -- 172.21.15.2:0/2241583878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac1048f0 msgr2=0x7f30ac100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.808+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2241583878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac1048f0 0x7f30ac100a20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3094009930 tx=0x7f309402a420 comp rx=0 tx=0).stop 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- 172.21.15.2:0/2241583878 shutdown_connections 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2241583878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac101140 0x7f30ac10af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2241583878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac1048f0 0x7f30ac100a20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2241583878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 0x7f30ac1043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- 172.21.15.2:0/2241583878 >> 172.21.15.2:0/2241583878 conn(0x7f30ac0fc8b0 msgr2=0x7f30ac0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- 172.21.15.2:0/2241583878 shutdown_connections 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- 172.21.15.2:0/2241583878 wait complete. 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 Processor -- start 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- start start 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 0x7f30ac103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 0x7f30ac101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac1048f0 0x7f30ac102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac10e620 con 0x7f30ac101140 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac10e4a0 con 0x7f30ac1048f0 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.809+0000 7f30b1fad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac10e7a0 con 0x7f30ac103fb0 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 0x7f30ac103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 0x7f30ac103490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36574/0 (socket says 172.21.15.2:36574) 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 -- 172.21.15.2:0/2258559045 learned_addr learned my addr 172.21.15.2:0/2258559045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30a3fff640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 0x7f30ac101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30abfff640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac1048f0 0x7f30ac102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 -- 172.21.15.2:0/2258559045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 msgr2=0x7f30ac101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 0x7f30ac101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 -- 172.21.15.2:0/2258559045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac1048f0 msgr2=0x7f30ac102230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac1048f0 0x7f30ac102230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 -- 172.21.15.2:0/2258559045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac102aa0 con 0x7f30ac101140 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30abfff640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac1048f0 0x7f30ac102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30a3fff640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 0x7f30ac101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 0x7f30ac103490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f309c00d950 tx=0x7f309c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30a97fa640 1 -- 172.21.15.2:0/2258559045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c017070 con 0x7f30ac101140 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30a97fa640 1 -- 172.21.15.2:0/2258559045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f309c009c30 con 0x7f30ac101140 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac1a2e50 con 0x7f30ac101140 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30a97fa640 1 -- 172.21.15.2:0/2258559045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c00f620 con 0x7f30ac101140 2024-09-10T23:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.810+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac1a32c0 con 0x7f30ac101140 2024-09-10T23:26:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 Processor -- start 2024-09-10T23:26:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30a97fa640 1 -- 172.21.15.2:0/2258559045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f309c010460 con 0x7f30ac101140 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 -- start start 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b2cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b2f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b32090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cdc8a9c6f0 con 0x55cdc8b2d190 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cdc8a8bb20 con 0x55cdc8b2a860 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30b4e58740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cdc8a8f930 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b2f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b2f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36590/0 (socket says 172.21.15.2:36590) 2024-09-10T23:26:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30ab7fe640 1 -- 172.21.15.2:0/1965115270 learned_addr learned my addr 172.21.15.2:0/1965115270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.813+0000 7f30abfff640 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b2cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30a3fff640 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b32090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30ab7fe640 1 -- 172.21.15.2:0/1965115270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 msgr2=0x55cdc8b32090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b32090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30ab7fe640 1 -- 172.21.15.2:0/1965115270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 msgr2=0x55cdc8b2cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b2cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30ab7fe640 1 -- 172.21.15.2:0/1965115270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc8a51530 con 0x55cdc8b2d190 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b2f580 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f309c0ebc10 tx=0x7f309c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d1349d10673f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30a97fa640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30980b5360 0x7f30980b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30a1ffb640 1 -- 172.21.15.2:0/1965115270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0f4070 con 0x55cdc8b2d190 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30abfff640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30980b5360 0x7f30980b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30a97fa640 1 -- 172.21.15.2:0/2258559045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f309c0e5870 con 0x7f30ac101140 2024-09-10T23:26:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30a1ffb640 1 -- 172.21.15.2:0/1965115270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f309c091c10 con 0x55cdc8b2d190 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.814+0000 7f30a1ffb640 1 -- 172.21.15.2:0/1965115270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0e8e60 con 0x55cdc8b2d190 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 -- 172.21.15.2:0/1965115270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 msgr2=0x55cdc8b2f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b2f580 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f309c0ebc10 tx=0x7f309c0ed690 comp rx=0 tx=0).stop 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30abfff640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30980b5360 0x7f30980b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f30a4005fd0 tx=0x7f30a4009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 -- 172.21.15.2:0/1965115270 shutdown_connections 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b32090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b2f580 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 --2- 172.21.15.2:0/1965115270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b2cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 -- 172.21.15.2:0/1965115270 >> 172.21.15.2:0/1965115270 conn(0x55cdc8b259b0 msgr2=0x55cdc8b26740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 -- 172.21.15.2:0/1965115270 shutdown_connections 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 -- 172.21.15.2:0/1965115270 wait complete. 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.815+0000 7f30b4e58740 1 -- start start 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 Processor -- start 2024-09-10T23:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 0x55cdc8b33ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b34540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b35110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cdc89c3ab0 con 0x55cdc8b2a860 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cdc8a31730 con 0x55cdc8b2d190 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cdc8b32bb0 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30b4e58740 10 client.0 _ll_register_callbacks cb 0x55cdc8a856b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 0x55cdc8b33ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 0x55cdc8b33ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36606/0 (socket says 172.21.15.2:36606) 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30ab7fe640 1 -- 172.21.15.2:0/917128364 learned_addr learned my addr 172.21.15.2:0/917128364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30abfff640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b35110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.816+0000 7f30a3fff640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b34540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30ab7fe640 1 -- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 msgr2=0x55cdc8b35110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b35110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30ab7fe640 1 -- 172.21.15.2:0/917128364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 msgr2=0x55cdc8b34540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b34540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30ab7fe640 1 -- 172.21.15.2:0/917128364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc87ed790 con 0x55cdc8b2a860 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30abfff640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b35110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30a3fff640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b34540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 0x55cdc8b33ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f309c0a92b0 tx=0x7f309c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b94259be8456b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f308affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f308affd640 1 -- 172.21.15.2:0/917128364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c020060 con 0x55cdc8b2a860 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f308affd640 1 -- 172.21.15.2:0/917128364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f309c0cf070 con 0x55cdc8b2a860 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309c091c10 con 0x55cdc8b2a860 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f308affd640 1 -- 172.21.15.2:0/917128364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f309c0f4020 con 0x55cdc8b2a860 2024-09-10T23:26:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30b4e58740 10 client.15960 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cdc8866620 con 0x55cdc8b2a860 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.817+0000 7f308affd640 1 -- 172.21.15.2:0/917128364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f309c091c10 con 0x55cdc8b2a860 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f308affd640 1 -- 172.21.15.2:0/917128364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f309c0ac2a0 con 0x55cdc8b2a860 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30b4e58740 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30b4e58740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30b4e58740 20 client.15960 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30b4e58740 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8b3f340 0x55cdc8b41730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30b4e58740 4 client.15960 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdc8a9e640 con 0x55cdc8b3f340 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.818+0000 7f30a3fff640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8b3f340 0x55cdc8b41730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.819+0000 7f30a3fff640 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8b3f340 0x55cdc8b41730 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1adaf3f5ce22895 server_cookie=2ad8fec9ed1bb3a4 in_seq=0 out_seq=0 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.819+0000 7f308affd640 10 client.15960 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.819+0000 7f308affd640 1 -- 172.21.15.2:0/917128364 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cdc8a9e640 con 0x55cdc8b3f340 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.819+0000 7f308affd640 10 client.15960 handle_command_reply: tid=0 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.819+0000 7f30b4e58740 1 client.15960 shutdown 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 msgr2=0x55cdc8b33ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 0x55cdc8b33ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f309c0a92b0 tx=0x7f309c005bb0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 shutdown_connections 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8b3f340 0x55cdc8b41730 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b35110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b34540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f308affd640 0 client.15960 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 --2- 172.21.15.2:0/917128364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2a860 0x55cdc8b33ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 >> 172.21.15.2:0/917128364 conn(0x55cdc8b259b0 msgr2=0x55cdc8b24bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 shutdown_connections 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 1 -- 172.21.15.2:0/917128364 wait complete. 2024-09-10T23:26:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.820+0000 7f30b4e58740 20 client.15960 trim_cache size 0 max 16384 2024-09-10T23:26:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 Processor -- start 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 -- start start 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2a860 0x55cdc8b26450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b26990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b29cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1abfc0 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1adb00 con 0x55cdc8b2d190 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30b4e58740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1ac690 con 0x55cdc8b2a860 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b29cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b29cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36610/0 (socket says 172.21.15.2:36610) 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30abfff640 1 -- 172.21.15.2:0/325460872 learned_addr learned my addr 172.21.15.2:0/325460872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2a860 0x55cdc8b26450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.835+0000 7f30a3fff640 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b26990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30abfff640 1 -- 172.21.15.2:0/325460872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2a860 msgr2=0x55cdc8b26450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30abfff640 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2a860 0x55cdc8b26450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30abfff640 1 -- 172.21.15.2:0/325460872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 msgr2=0x55cdc8b26990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30abfff640 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b26990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30abfff640 1 -- 172.21.15.2:0/325460872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc8b41aa0 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30abfff640 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b29cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f30a40116c0 tx=0x7f30a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168d10dcb4684fab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30a17fa640 1 -- 172.21.15.2:0/325460872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4004b20 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30a17fa640 1 -- 172.21.15.2:0/325460872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30a4004cc0 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.836+0000 7f30a17fa640 1 -- 172.21.15.2:0/325460872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a401f670 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- 172.21.15.2:0/325460872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 msgr2=0x55cdc8b29cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b29cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f30a40116c0 tx=0x7f30a4016000 comp rx=0 tx=0).stop 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- 172.21.15.2:0/325460872 shutdown_connections 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b29cc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2d190 0x55cdc8b26990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- 172.21.15.2:0/325460872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2a860 0x55cdc8b26450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- 172.21.15.2:0/325460872 >> 172.21.15.2:0/325460872 conn(0x55cdc8b259b0 msgr2=0x55cdc8b33a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- 172.21.15.2:0/325460872 shutdown_connections 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- 172.21.15.2:0/325460872 wait complete. 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- start start 2024-09-10T23:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 Processor -- start 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b38db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b3a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1ad430 con 0x55cdc8b2d190 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1acd60 con 0x55cdc8b2a860 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1a9fa0 con 0x55cdc8b2fbd0 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.837+0000 7f30b4e58740 10 client.0 _ll_register_callbacks cb 0x7f30a40096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b39450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36612/0 (socket says 172.21.15.2:36612) 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 -- 172.21.15.2:0/742225831 learned_addr learned my addr 172.21.15.2:0/742225831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b38db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30abfff640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b3a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 -- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 msgr2=0x55cdc8b3a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b3a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 -- 172.21.15.2:0/742225831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 msgr2=0x55cdc8b38db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b38db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 -- 172.21.15.2:0/742225831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc8b3a850 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30a3fff640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b39450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3094005ec0 tx=0x7f3094005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830be831f945066b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f308affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f308affd640 1 -- 172.21.15.2:0/742225831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094035040 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f308affd640 1 -- 172.21.15.2:0/742225831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3094005540 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a4004cc0 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.838+0000 7f308affd640 1 -- 172.21.15.2:0/742225831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30940046c0 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 10 client.15966 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cdc8b3bc90 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f308affd640 1 -- 172.21.15.2:0/742225831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30a4004cc0 con 0x55cdc8b2d190 2024-09-10T23:26:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f308affd640 1 -- 172.21.15.2:0/742225831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3094003b90 con 0x55cdc8b2d190 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 10 client.15966 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 20 client.15966 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8bac5f0 0x55cdc8baea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 4 client.15966 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cdc8a9a0f0 con 0x55cdc8bac5f0 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.839+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8bac5f0 0x55cdc8baea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.840+0000 7f308affd640 10 client.15966 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.840+0000 7f30ab7fe640 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8bac5f0 0x55cdc8baea10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b5d3de57fa1a8be server_cookie=e8036bea5139afc3 in_seq=0 out_seq=0 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.855+0000 7f308affd640 1 -- 172.21.15.2:0/742225831 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cdc8a9a0f0 con 0x55cdc8bac5f0 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f308affd640 10 client.15966 handle_command_reply: tid=0 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 client.15966 shutdown 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 msgr2=0x55cdc8b39450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b39450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3094005ec0 tx=0x7f3094005040 comp rx=0 tx=0).stop 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 shutdown_connections 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cdc8bac5f0 0x55cdc8baea10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdc8b2fbd0 0x55cdc8b3a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cdc8b2d190 0x55cdc8b39450 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f308affd640 0 client.15966 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 --2- 172.21.15.2:0/742225831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdc8b2a860 0x55cdc8b38db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 >> 172.21.15.2:0/742225831 conn(0x55cdc8b259b0 msgr2=0x55cdc8b26450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 shutdown_connections 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 1 -- 172.21.15.2:0/742225831 wait complete. 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.856+0000 7f30b4e58740 20 client.15966 trim_cache size 0 max 16384 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:26:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:26:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30980b5360 msgr2=0x7f30980b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30980b5360 0x7f30980b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f30a4005fd0 tx=0x7f30a4009800 comp rx=0 tx=0).stop 2024-09-10T23:26:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 msgr2=0x7f30ac103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 0x7f30ac103490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f309c00d950 tx=0x7f309c00de10 comp rx=0 tx=0).stop 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 shutdown_connections 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30980b5360 0x7f30980b7820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30ac1048f0 0x7f30ac102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30ac103fb0 0x7f30ac101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 --2- 172.21.15.2:0/2258559045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ac101140 0x7f30ac103490 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 >> 172.21.15.2:0/2258559045 conn(0x7f30ac0fc8b0 msgr2=0x7f30ac107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 shutdown_connections 2024-09-10T23:26:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:04.857+0000 7f30b1fad640 1 -- 172.21.15.2:0/2258559045 wait complete. 2024-09-10T23:26:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:05 smithi177 ceph-mon[35760]: pgmap v404: 97 pgs: 97 active+clean; 1.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:05.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:05 smithi002 ceph-mon[31150]: pgmap v404: 97 pgs: 97 active+clean; 1.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:05.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:05 smithi154 ceph-mon[35136]: pgmap v404: 97 pgs: 97 active+clean; 1.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:07 smithi177 ceph-mon[35760]: pgmap v405: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:26:07.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:26:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:07 smithi002 ceph-mon[31150]: pgmap v405: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:26:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:07 smithi154 ceph-mon[35136]: pgmap v405: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:26:08.020 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:08.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 -- 172.21.15.2:0/21526965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 msgr2=0x7f3b1c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 --2- 172.21.15.2:0/21526965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c10cab0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009900 tx=0x7f3b1002a410 comp rx=0 tx=0).stop 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 -- 172.21.15.2:0/21526965 shutdown_connections 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 --2- 172.21.15.2:0/21526965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 0x7f3b1c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 --2- 172.21.15.2:0/21526965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c10cab0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 --2- 172.21.15.2:0/21526965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b1c103ca0 0x7f3b1c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 -- 172.21.15.2:0/21526965 >> 172.21.15.2:0/21526965 conn(0x7f3b1c0fd700 msgr2=0x7f3b1c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 -- 172.21.15.2:0/21526965 shutdown_connections 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 -- 172.21.15.2:0/21526965 wait complete. 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 Processor -- start 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.540+0000 7f3b24467640 1 -- start start 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b24467640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b1c103ca0 0x7f3b1c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b24467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b24467640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 0x7f3b1c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b24467640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c112dc0 con 0x7f3b1c1045c0 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b24467640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c112c40 con 0x7f3b1c10d100 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b24467640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c112f40 con 0x7f3b1c103ca0 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36630/0 (socket says 172.21.15.2:36630) 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 -- 172.21.15.2:0/3273319796 learned_addr learned my addr 172.21.15.2:0/3273319796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b22203640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b1c103ca0 0x7f3b1c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b22a04640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 0x7f3b1c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 -- 172.21.15.2:0/3273319796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b1c103ca0 msgr2=0x7f3b1c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b1c103ca0 0x7f3b1c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 -- 172.21.15.2:0/3273319796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 msgr2=0x7f3b1c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 0x7f3b1c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 -- 172.21.15.2:0/3273319796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c19f300 con 0x7f3b1c1045c0 2024-09-10T23:26:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b22a04640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 0x7f3b1c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.541+0000 7f3b21a02640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c199790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005ab0 tx=0x7f3b10003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.542+0000 7f3b1b7fe640 1 -- 172.21.15.2:0/3273319796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1003f070 con 0x7f3b1c1045c0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.542+0000 7f3b1b7fe640 1 -- 172.21.15.2:0/3273319796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b10031b50 con 0x7f3b1c1045c0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.542+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c19f590 con 0x7f3b1c1045c0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.542+0000 7f3b1b7fe640 1 -- 172.21.15.2:0/3273319796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10035030 con 0x7f3b1c1045c0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.542+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1a5cb0 con 0x7f3b1c1045c0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.544+0000 7f3b2683c740 1 Processor -- start 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.544+0000 7f3b2683c740 1 -- start start 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.544+0000 7f3b1b7fe640 1 -- 172.21.15.2:0/3273319796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3b100316a0 con 0x7f3b1c1045c0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.544+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1480 0x56032e8f1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.544+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e8fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e900120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b2683c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56032e867e50 con 0x56032e8f1da0 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b2683c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56032e857280 con 0x56032e8f1480 2024-09-10T23:26:08.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b2683c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56032e85b090 con 0x56032e8fdd30 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e8fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e8fd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36640/0 (socket says 172.21.15.2:36640) 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 -- 172.21.15.2:0/3268433271 learned_addr learned my addr 172.21.15.2:0/3268433271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b21a02640 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e900120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22a04640 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1480 0x56032e8f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 -- 172.21.15.2:0/3268433271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 msgr2=0x56032e900120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e900120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 -- 172.21.15.2:0/3268433271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1480 msgr2=0x56032e8f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1480 0x56032e8f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 -- 172.21.15.2:0/3268433271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032e5b5650 con 0x56032e8f1da0 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b22203640 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e8fd7f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0039f0 tx=0x7f3b0c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cc2961fa32cf0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b18de6640 1 -- 172.21.15.2:0/3268433271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c004b20 con 0x56032e8f1da0 2024-09-10T23:26:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b1b7fe640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3b040b5360 0x7f3b040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b18de6640 1 -- 172.21.15.2:0/3268433271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0c004cc0 con 0x56032e8f1da0 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.545+0000 7f3b18de6640 1 -- 172.21.15.2:0/3268433271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0126b0 con 0x56032e8f1da0 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b22a04640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3b040b5360 0x7f3b040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b1b7fe640 1 -- 172.21.15.2:0/3273319796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3b10106590 con 0x7f3b1c1045c0 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 -- 172.21.15.2:0/3268433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 msgr2=0x56032e8fd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b22a04640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3b040b5360 0x7f3b040b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400bc20 tx=0x7f3b14005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e8fd7f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0039f0 tx=0x7f3b0c003eb0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 -- 172.21.15.2:0/3268433271 shutdown_connections 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e900120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e8fd7f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 --2- 172.21.15.2:0/3268433271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1480 0x56032e8f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 -- 172.21.15.2:0/3268433271 >> 172.21.15.2:0/3268433271 conn(0x56032e8ef2b0 msgr2=0x56032e8f0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 -- 172.21.15.2:0/3268433271 shutdown_connections 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.546+0000 7f3b2683c740 1 -- 172.21.15.2:0/3268433271 wait complete. 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 -- start start 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 Processor -- start 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e901f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1da0 0x56032e902530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e907650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56032e6b8700 con 0x56032e8f1480 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56032e7f2110 con 0x56032e8fdd30 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56032e9009b0 con 0x56032e8f1da0 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b2683c740 10 client.0 _ll_register_callbacks cb 0x56032e80b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b22203640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e901f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b22203640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e901f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36652/0 (socket says 172.21.15.2:36652) 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b22203640 1 -- 172.21.15.2:0/1588402357 learned_addr learned my addr 172.21.15.2:0/1588402357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.547+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1da0 0x56032e902530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22203640 1 -- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1da0 msgr2=0x56032e902530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22203640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1da0 0x56032e902530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22a04640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e907650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22203640 1 -- 172.21.15.2:0/1588402357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 msgr2=0x56032e907650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22203640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e907650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22203640 1 -- 172.21.15.2:0/1588402357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56032e81fc40 con 0x56032e8f1480 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1da0 0x56032e902530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22a04640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e907650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b22203640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e901f90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c004c70 tx=0x7f3b0c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6301620a544b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1588402357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c005070 con 0x56032e8f1480 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b0c004cc0 con 0x56032e8f1480 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1588402357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3b0c005210 con 0x56032e8f1480 2024-09-10T23:26:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1588402357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b0c005410 con 0x56032e8f1480 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b2683c740 10 client.15978 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56032e910730 con 0x56032e8f1480 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.548+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1588402357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0c004cc0 con 0x56032e8f1480 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1588402357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b0c00f040 con 0x56032e8f1480 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b2683c740 10 client.15978 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b2683c740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b2683c740 20 client.15978 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e911ae0 0x56032e913ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b2683c740 4 client.15978 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56032e869da0 con 0x56032e911ae0 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.549+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e911ae0 0x56032e913ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e911ae0 0x56032e913ed0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0bdfc070ee5d5a1 server_cookie=1eef6729f2feb186 in_seq=0 out_seq=0 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b01ffb640 10 client.15978 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:08.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1588402357 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56032e869da0 con 0x56032e911ae0 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b01ffb640 10 client.15978 handle_command_reply: tid=0 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 client.15978 shutdown 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 msgr2=0x56032e901f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e901f90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c004c70 tx=0x7f3b0c009ca0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 shutdown_connections 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e911ae0 0x56032e913ed0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e907650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1da0 0x56032e902530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b01ffb640 0 client.15978 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1588402357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e901f90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.550+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 >> 172.21.15.2:0/1588402357 conn(0x56032e8ef2b0 msgr2=0x56032e8f4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.551+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 shutdown_connections 2024-09-10T23:26:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.551+0000 7f3b2683c740 1 -- 172.21.15.2:0/1588402357 wait complete. 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.551+0000 7f3b2683c740 20 client.15978 trim_cache size 0 max 16384 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 Processor -- start 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 -- start start 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e8f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1da0 0x56032e907400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e8eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ac170 con 0x56032e8f1480 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1adcb0 con 0x56032e8f1da0 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b2683c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ac840 con 0x56032e8fdd30 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b22203640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e8f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b22203640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e8f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36666/0 (socket says 172.21.15.2:36666) 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b22203640 1 -- 172.21.15.2:0/4205435661 learned_addr learned my addr 172.21.15.2:0/4205435661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b21a02640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1da0 0x56032e907400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b22a04640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e8eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.568+0000 7f3b22203640 1 -- 172.21.15.2:0/4205435661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 msgr2=0x56032e8eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b22203640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e8eebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b22203640 1 -- 172.21.15.2:0/4205435661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1da0 msgr2=0x56032e907400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b22203640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1da0 0x56032e907400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b22203640 1 -- 172.21.15.2:0/4205435661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032e914460 con 0x56032e8f1480 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b21a02640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1da0 0x56032e907400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b22a04640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e8eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b22203640 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e8f0610 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c015040 tx=0x7f3b0c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a22c10bd6fd4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b03fff640 1 -- 172.21.15.2:0/4205435661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c035070 con 0x56032e8f1480 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b03fff640 1 -- 172.21.15.2:0/4205435661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0c01e070 con 0x56032e8f1480 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b03fff640 1 -- 172.21.15.2:0/4205435661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c005010 con 0x56032e8f1480 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 -- 172.21.15.2:0/4205435661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 msgr2=0x56032e8f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e8f0610 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c015040 tx=0x7f3b0c003eb0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 -- 172.21.15.2:0/4205435661 shutdown_connections 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8fdd30 0x56032e8eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8f1da0 0x56032e907400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 --2- 172.21.15.2:0/4205435661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1480 0x56032e8f0610 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.569+0000 7f3b2683c740 1 -- 172.21.15.2:0/4205435661 >> 172.21.15.2:0/4205435661 conn(0x56032e8ef2b0 msgr2=0x56032e8eff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 -- 172.21.15.2:0/4205435661 shutdown_connections 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 -- 172.21.15.2:0/4205435661 wait complete. 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 -- start start 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 Processor -- start 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1480 0x56032e90e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e90bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e90c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ad5e0 con 0x56032e8f1da0 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1acf10 con 0x56032e8fdd30 2024-09-10T23:26:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1aa150 con 0x56032e8f1480 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b2683c740 10 client.0 _ll_register_callbacks cb 0x7f3b0c009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b21a02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e90bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b21a02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e90bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36668/0 (socket says 172.21.15.2:36668) 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b21a02640 1 -- 172.21.15.2:0/1193023716 learned_addr learned my addr 172.21.15.2:0/1193023716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.570+0000 7f3b22a04640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e90c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b22203640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1480 0x56032e90e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b21a02640 1 -- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1480 msgr2=0x56032e90e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1480 0x56032e90e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b21a02640 1 -- 172.21.15.2:0/1193023716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 msgr2=0x56032e90c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e90c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b21a02640 1 -- 172.21.15.2:0/1193023716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56032e97d8e0 con 0x56032e8f1da0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b21a02640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e90bb30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b100c9f70 tx=0x7f3b1003b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30bde2df4231bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1193023716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10049040 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1193023716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3b10104150 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b0c01e070 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1193023716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b100cc810 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b2683c740 10 client.15984 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56032e97eb30 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1193023716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0c01e070 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.571+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1193023716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b100c8f70 con 0x56032e8f1da0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 10 client.15984 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 20 client.15984 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e97f240 0x56032e981660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 4 client.15984 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56032e865850 con 0x56032e97f240 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b22203640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e97f240 0x56032e981660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b22203640 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e97f240 0x56032e981660 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fccfc583663b45c server_cookie=1900727174b1849b in_seq=0 out_seq=0 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b01ffb640 10 client.15984 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b01ffb640 1 -- 172.21.15.2:0/1193023716 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x56032e865850 con 0x56032e97f240 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b01ffb640 10 client.15984 handle_command_reply: tid=0 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.572+0000 7f3b2683c740 1 client.15984 shutdown 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 msgr2=0x56032e90bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e90bb30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b100c9f70 tx=0x7f3b1003b790 comp rx=0 tx=0).stop 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 shutdown_connections 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56032e97f240 0x56032e981660 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:26:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:26:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032e8fdd30 0x56032e90c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56032e8f1da0 0x56032e90bb30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b01ffb640 0 client.15984 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 --2- 172.21.15.2:0/1193023716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56032e8f1480 0x56032e90e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 >> 172.21.15.2:0/1193023716 conn(0x56032e8ef2b0 msgr2=0x56032e8edbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 shutdown_connections 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 1 -- 172.21.15.2:0/1193023716 wait complete. 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b2683c740 20 client.15984 trim_cache size 0 max 16384 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3b040b5360 msgr2=0x7f3b040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3b040b5360 0x7f3b040b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400bc20 tx=0x7f3b14005e90 comp rx=0 tx=0).stop 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 msgr2=0x7f3b1c199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c199790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005ab0 tx=0x7f3b10003b90 comp rx=0 tx=0).stop 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 shutdown_connections 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3b040b5360 0x7f3b040b7820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b1c10d100 0x7f3b1c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b1c1045c0 0x7f3b1c199790 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 --2- 172.21.15.2:0/3273319796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b1c103ca0 0x7f3b1c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 >> 172.21.15.2:0/3273319796 conn(0x7f3b1c0fd700 msgr2=0x7f3b1c10f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 shutdown_connections 2024-09-10T23:26:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:08.573+0000 7f3b24467640 1 -- 172.21.15.2:0/3273319796 wait complete. 2024-09-10T23:26:09.300 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:26:09.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:09.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:09 smithi002 ceph-mon[31150]: pgmap v406: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 -- 172.21.15.2:0/1564208555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc1077c0 msgr2=0x7f58cc10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 --2- 172.21.15.2:0/1564208555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc1077c0 0x7f58cc10dfc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f58c400adb0 tx=0x7f58c402b7a0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 -- 172.21.15.2:0/1564208555 shutdown_connections 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 --2- 172.21.15.2:0/1564208555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc1077c0 0x7f58cc10dfc0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 --2- 172.21.15.2:0/1564208555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc106e40 0x7f58cc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 --2- 172.21.15.2:0/1564208555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc101810 0x7f58cc101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 -- 172.21.15.2:0/1564208555 >> 172.21.15.2:0/1564208555 conn(0x7f58cc076f50 msgr2=0x7f58cc077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 -- 172.21.15.2:0/1564208555 shutdown_connections 2024-09-10T23:26:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 -- 172.21.15.2:0/1564208555 wait complete. 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 Processor -- start 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.091+0000 7f58d4658640 1 -- start start 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 0x7f58cc19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc106e40 0x7f58cc19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc1077c0 0x7f58cc1a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc110c00 con 0x7f58cc101810 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc110a80 con 0x7f58cc1077c0 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc110d80 con 0x7f58cc106e40 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 0x7f58cc19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 0x7f58cc19b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36700/0 (socket says 172.21.15.2:36700) 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 -- 172.21.15.2:0/1390217392 learned_addr learned my addr 172.21.15.2:0/1390217392 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d2bf5640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc1077c0 0x7f58cc1a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d1bf3640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc106e40 0x7f58cc19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 -- 172.21.15.2:0/1390217392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc106e40 msgr2=0x7f58cc19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc106e40 0x7f58cc19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 -- 172.21.15.2:0/1390217392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc1077c0 msgr2=0x7f58cc1a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc1077c0 0x7f58cc1a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 -- 172.21.15.2:0/1390217392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc1a14c0 con 0x7f58cc101810 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d2bf5640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc1077c0 0x7f58cc1a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d1bf3640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc106e40 0x7f58cc19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d23f4640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 0x7f58cc19b410 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f58c800d770 tx=0x7f58c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8017070 con 0x7f58cc101810 2024-09-10T23:26:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc1a17b0 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58c80054d0 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.092+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8004c30 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.093+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58cc1a7e70 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.093+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58cc101bf0 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.095+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f58c8004dd0 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.096+0000 7f58c37fe640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f58b80b52e0 0x7f58b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.096+0000 7f58d1bf3640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f58b80b52e0 0x7f58b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.096+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f58c80e5b50 con 0x7f58cc101810 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.096+0000 7f58d1bf3640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f58b80b52e0 0x7f58b80b77a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f58cc077590 tx=0x7f58bc00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.099+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f58c80aca20 con 0x7f58cc101810 2024-09-10T23:26:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:09 smithi177 ceph-mon[35760]: pgmap v406: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:09 smithi154 ceph-mon[35136]: pgmap v406: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:10.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.320+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58cc1a81a0 con 0x7f58cc101810 2024-09-10T23:26:10.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.321+0000 7f58c37fe640 1 -- 172.21.15.2:0/1390217392 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f58c80ac320 con 0x7f58cc101810 2024-09-10T23:26:10.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:26:10.323 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:26:10.324 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:26:10.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f58b80b52e0 msgr2=0x7f58b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f58b80b52e0 0x7f58b80b77a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f58cc077590 tx=0x7f58bc00a5c0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 msgr2=0x7f58cc19b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 0x7f58cc19b410 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f58c800d770 tx=0x7f58c800dc30 comp rx=0 tx=0).stop 2024-09-10T23:26:10.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 shutdown_connections 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f58b80b52e0 0x7f58b80b77a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58cc1077c0 0x7f58cc1a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58cc106e40 0x7f58cc19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 --2- 172.21.15.2:0/1390217392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58cc101810 0x7f58cc19b410 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.323+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 >> 172.21.15.2:0/1390217392 conn(0x7f58cc076f50 msgr2=0x7f58cc102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.324+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 shutdown_connections 2024-09-10T23:26:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:10.324+0000 7f58d4658640 1 -- 172.21.15.2:0/1390217392 wait complete. 2024-09-10T23:26:10.936 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1390217392' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:10.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:26:11.115 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1390217392' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1390217392' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 -- 172.21.15.2:0/612653634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0108020 msgr2=0x7f3ce010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/612653634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0108020 0x7f3ce010e820 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009900 tx=0x7f3cd802a410 comp rx=0 tx=0).stop 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 -- 172.21.15.2:0/612653634 shutdown_connections 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/612653634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0108020 0x7f3ce010e820 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/612653634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 0x7f3ce0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/612653634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ce0101c90 0x7f3ce0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 -- 172.21.15.2:0/612653634 >> 172.21.15.2:0/612653634 conn(0x7f3ce00fd700 msgr2=0x7f3ce00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 -- 172.21.15.2:0/612653634 shutdown_connections 2024-09-10T23:26:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 -- 172.21.15.2:0/612653634 wait complete. 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.748+0000 7f3ce7f69640 1 Processor -- start 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 -- start start 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 0x7f3ce0199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 0x7f3ce019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ce0108020 0x7f3ce019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0111ce0 con 0x7f3ce0101c90 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0111b60 con 0x7f3ce01076a0 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce7f69640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0111e60 con 0x7f3ce0108020 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 0x7f3ce0199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 0x7f3ce0199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36020/0 (socket says 172.21.15.2:36020) 2024-09-10T23:26:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 -- 172.21.15.2:0/2054013881 learned_addr learned my addr 172.21.15.2:0/2054013881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce6506640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ce0108020 0x7f3ce019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5504640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 0x7f3ce019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 -- 172.21.15.2:0/2054013881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ce0108020 msgr2=0x7f3ce019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ce0108020 0x7f3ce019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 -- 172.21.15.2:0/2054013881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 msgr2=0x7f3ce019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 0x7f3ce019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 -- 172.21.15.2:0/2054013881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01a53d0 con 0x7f3ce0101c90 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5504640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 0x7f3ce019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.749+0000 7f3ce5d05640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 0x7f3ce0199ff0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00ea80 tx=0x7f3cdc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.750+0000 7f3cd6ffd640 1 -- 172.21.15.2:0/2054013881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00ce40 con 0x7f3ce0101c90 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.750+0000 7f3cd6ffd640 1 -- 172.21.15.2:0/2054013881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cdc005020 con 0x7f3ce0101c90 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.750+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce01a56c0 con 0x7f3ce0101c90 2024-09-10T23:26:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.750+0000 7f3cd6ffd640 1 -- 172.21.15.2:0/2054013881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0116d0 con 0x7f3ce0101c90 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.750+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01a5bb0 con 0x7f3ce0101c90 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.752+0000 7f3cea33e740 1 Processor -- start 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.752+0000 7f3cd6ffd640 1 -- 172.21.15.2:0/2054013881 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3cdc00f040 con 0x7f3ce0101c90 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 -- start start 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890ddf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890deb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dedd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f890d55ea0 con 0x55f890ddf0f0 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f890d452d0 con 0x55f890deb9a0 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cea33e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f890d490e0 con 0x55f890ddfa10 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890ddf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890ddf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36022/0 (socket says 172.21.15.2:36022) 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 -- 172.21.15.2:0/3593173787 learned_addr learned my addr 172.21.15.2:0/3593173787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce5d05640 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890deb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce5504640 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dedd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 -- 172.21.15.2:0/3593173787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 msgr2=0x55f890deb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890deb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 -- 172.21.15.2:0/3593173787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 msgr2=0x55f890dedd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dedd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3cd6ffd640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ccc0b52e0 0x7f3ccc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.753+0000 7f3ce6506640 1 -- 172.21.15.2:0/3593173787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f890aa3650 con 0x55f890ddf0f0 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.754+0000 7f3ce5d05640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ccc0b52e0 0x7f3ccc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.754+0000 7f3ce6506640 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890ddf4d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009900 tx=0x7f3cd8032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3e8706892cb02f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.754+0000 7f3cd6ffd640 1 -- 172.21.15.2:0/2054013881 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3cdc0e5c20 con 0x7f3ce0101c90 2024-09-10T23:26:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.754+0000 7f3ccbfff640 1 -- 172.21.15.2:0/3593173787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd803f070 con 0x55f890ddf0f0 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.754+0000 7f3ccbfff640 1 -- 172.21.15.2:0/3593173787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd80316a0 con 0x55f890ddf0f0 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.754+0000 7f3ccbfff640 1 -- 172.21.15.2:0/3593173787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8035070 con 0x55f890ddf0f0 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 -- 172.21.15.2:0/3593173787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 msgr2=0x55f890ddf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3ce5d05640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ccc0b52e0 0x7f3ccc0b77a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0e3aa0 tx=0x7f3cdc0e9700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890ddf4d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009900 tx=0x7f3cd8032cd0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 -- 172.21.15.2:0/3593173787 shutdown_connections 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dedd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890deb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 --2- 172.21.15.2:0/3593173787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890ddf4d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 -- 172.21.15.2:0/3593173787 >> 172.21.15.2:0/3593173787 conn(0x55f890ddcf20 msgr2=0x55f890dde0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 -- 172.21.15.2:0/3593173787 shutdown_connections 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 -- 172.21.15.2:0/3593173787 wait complete. 2024-09-10T23:26:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 -- start start 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.755+0000 7f3cea33e740 1 Processor -- start 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890deb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890de8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890de8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f890ba6700 con 0x55f890ddf0f0 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f890ce0160 con 0x55f890deb9a0 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f890dee5c0 con 0x55f890ddfa10 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cea33e740 10 client.0 _ll_register_callbacks cb 0x55f890cf99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce6506640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890deb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce6506640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890deb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36038/0 (socket says 172.21.15.2:36038) 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce6506640 1 -- 172.21.15.2:0/1492077783 learned_addr learned my addr 172.21.15.2:0/1492077783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890de8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce6506640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890de8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 -- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 msgr2=0x55f890de8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890de8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 -- 172.21.15.2:0/1492077783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 msgr2=0x55f890deb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890deb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 -- 172.21.15.2:0/1492077783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f890d0dc90 con 0x55f890ddfa10 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce6506640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890deb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3ce5504640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890de8640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3ce006b6b0 tx=0x7f3cd0010ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a8d303b2c977fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.756+0000 7f3cc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:26:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cc97fa640 1 -- 172.21.15.2:0/1492077783 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd001d060 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd80316a0 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cc97fa640 1 -- 172.21.15.2:0/1492077783 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3cd000eda0 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cc97fa640 1 -- 172.21.15.2:0/1492077783 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3cd0018430 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 10 client.25534 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f890df9ee0 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cc97fa640 1 -- 172.21.15.2:0/1492077783 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd80316a0 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cc97fa640 1 -- 172.21.15.2:0/1492077783 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3cd00224c0 con 0x55f890ddfa10 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 10 client.25534 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 10 client.25534 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 20 client.25534 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890dfb3a0 0x55f890dfd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 4 client.25534 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.757+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f890d57df0 con 0x55f890dfb3a0 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.758+0000 7f3ce6506640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890dfb3a0 0x55f890dfd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.758+0000 7f3ce6506640 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890dfb3a0 0x55f890dfd7b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f8bb7e6657e4ce67 server_cookie=8f88fa4a95aed7cf in_seq=0 out_seq=0 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.758+0000 7f3cc97fa640 10 client.25534 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cc97fa640 1 -- 172.21.15.2:0/1492077783 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f890d57df0 con 0x55f890dfb3a0 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cc97fa640 10 client.25534 handle_command_reply: tid=0 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 client.25534 shutdown 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 msgr2=0x55f890de8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890de8640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3ce006b6b0 tx=0x7f3cd0010ca0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 shutdown_connections 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890dfb3a0 0x55f890dfd7b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890de8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cc97fa640 0 client.25534 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddfa10 0x55f890de8640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 --2- 172.21.15.2:0/1492077783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddf0f0 0x55f890deb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 >> 172.21.15.2:0/1492077783 conn(0x55f890ddcf20 msgr2=0x55f890de2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 shutdown_connections 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 1 -- 172.21.15.2:0/1492077783 wait complete. 2024-09-10T23:26:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.759+0000 7f3cea33e740 20 client.25534 trim_cache size 0 max 16384 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.772+0000 7f3cea33e740 1 Processor -- start 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.772+0000 7f3cea33e740 1 -- start start 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890ddf0f0 0x55f890de7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890dddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890deb9a0 0x55f890dde520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3cea33e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01b0470 con 0x55f890ddfa10 2024-09-10T23:26:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3cea33e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01b1fb0 con 0x55f890ddf0f0 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3cea33e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01b0b40 con 0x55f890deb9a0 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890dddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890dddfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36040/0 (socket says 172.21.15.2:36040) 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 -- 172.21.15.2:0/971854955 learned_addr learned my addr 172.21.15.2:0/971854955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce6506640 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890ddf0f0 0x55f890de7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce6506640 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890deb9a0 0x55f890dde520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 -- 172.21.15.2:0/971854955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890deb9a0 msgr2=0x55f890dde520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890deb9a0 0x55f890dde520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 -- 172.21.15.2:0/971854955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890ddf0f0 msgr2=0x55f890de7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890ddf0f0 0x55f890de7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 -- 172.21.15.2:0/971854955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f890dee500 con 0x55f890ddfa10 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce6506640 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890deb9a0 0x55f890dde520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.773+0000 7f3ce5504640 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890dddfe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0022960 tx=0x7f3cd0022fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf2578ce0dad51a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3ccb7fe640 1 -- 172.21.15.2:0/971854955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0028040 con 0x55f890ddfa10 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3ccb7fe640 1 -- 172.21.15.2:0/971854955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd000eba0 con 0x55f890ddfa10 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3ccb7fe640 1 -- 172.21.15.2:0/971854955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0005610 con 0x55f890ddfa10 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 -- 172.21.15.2:0/971854955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 msgr2=0x55f890dddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890dddfe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0022960 tx=0x7f3cd0022fa0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 -- 172.21.15.2:0/971854955 shutdown_connections 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890deb9a0 0x55f890dde520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890dddfe0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 --2- 172.21.15.2:0/971854955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890ddf0f0 0x55f890de7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 -- 172.21.15.2:0/971854955 >> 172.21.15.2:0/971854955 conn(0x55f890ddcf20 msgr2=0x55f890de6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 -- 172.21.15.2:0/971854955 shutdown_connections 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.774+0000 7f3cea33e740 1 -- 172.21.15.2:0/971854955 wait complete. 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 -- start start 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 Processor -- start 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddf0f0 0x55f890df3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890df3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dee840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01b18e0 con 0x55f890ddfa10 2024-09-10T23:26:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01b1210 con 0x55f890deb9a0 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01ae450 con 0x55f890ddf0f0 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3cea33e740 10 client.0 _ll_register_callbacks cb 0x7f3cd000b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3ce5504640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890df3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3ce5504640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890df3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36054/0 (socket says 172.21.15.2:36054) 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3ce5504640 1 -- 172.21.15.2:0/197254936 learned_addr learned my addr 172.21.15.2:0/197254936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.775+0000 7f3ce6506640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddf0f0 0x55f890df3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce5504640 1 -- 172.21.15.2:0/197254936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddf0f0 msgr2=0x55f890df3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce5504640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddf0f0 0x55f890df3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce5504640 1 -- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 msgr2=0x55f890dee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce5504640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce5504640 1 -- 172.21.15.2:0/197254936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f890deed80 con 0x55f890ddfa10 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce6506640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddf0f0 0x55f890df3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3ce5504640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890df3dd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00228e0 tx=0x7f3cd000e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc0f685e3f0921a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cc97fa640 1 -- 172.21.15.2:0/197254936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd001d070 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd000eba0 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cc97fa640 1 -- 172.21.15.2:0/197254936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3cd0005550 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cc97fa640 1 -- 172.21.15.2:0/197254936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3cd0028040 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cea33e740 10 client.16008 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f890e688a0 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.776+0000 7f3cc97fa640 1 -- 172.21.15.2:0/197254936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd000eba0 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cc97fa640 1 -- 172.21.15.2:0/197254936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3cd0018ba0 con 0x55f890ddfa10 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cea33e740 10 client.16008 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cea33e740 10 client.16008 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cea33e740 20 client.16008 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cea33e740 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890e68f60 0x55f890e6b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cea33e740 4 client.16008 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f890d538a0 con 0x55f890e68f60 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3ce6506640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890e68f60 0x55f890e6b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3ce6506640 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890e68f60 0x55f890e6b380 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=eb0444479e30165f server_cookie=4d7f478008628117 in_seq=0 out_seq=0 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.777+0000 7f3cc97fa640 10 client.16008 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cc97fa640 1 -- 172.21.15.2:0/197254936 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f890d538a0 con 0x55f890e68f60 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cc97fa640 10 client.16008 handle_command_reply: tid=0 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 client.16008 shutdown 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 msgr2=0x55f890df3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890df3dd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00228e0 tx=0x7f3cd000e850 comp rx=0 tx=0).stop 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 shutdown_connections 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f890e68f60 0x55f890e6b380 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f890deb9a0 0x55f890dee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f890ddfa10 0x55f890df3dd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 --2- 172.21.15.2:0/197254936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f890ddf0f0 0x55f890df3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 >> 172.21.15.2:0/197254936 conn(0x55f890ddcf20 msgr2=0x55f890dddf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cc97fa640 0 client.16008 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 shutdown_connections 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 1 -- 172.21.15.2:0/197254936 wait complete. 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.778+0000 7f3cea33e740 20 client.16008 trim_cache size 0 max 16384 2024-09-10T23:26:11.791 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ccc0b52e0 msgr2=0x7f3ccc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ccc0b52e0 0x7f3ccc0b77a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0e3aa0 tx=0x7f3cdc0e9700 comp rx=0 tx=0).stop 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 msgr2=0x7f3ce0199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 0x7f3ce0199ff0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00ea80 tx=0x7f3cdc00ef40 comp rx=0 tx=0).stop 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 shutdown_connections 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3ccc0b52e0 0x7f3ccc0b77a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ce0108020 0x7f3ce019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce01076a0 0x7f3ce019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 --2- 172.21.15.2:0/2054013881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ce0101c90 0x7f3ce0199ff0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 >> 172.21.15.2:0/2054013881 conn(0x7f3ce00fd700 msgr2=0x7f3ce00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 shutdown_connections 2024-09-10T23:26:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:11.779+0000 7f3ce7f69640 1 -- 172.21.15.2:0/2054013881 wait complete. 2024-09-10T23:26:11.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:11 smithi002 ceph-mon[31150]: pgmap v407: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:26:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:11 smithi177 ceph-mon[35760]: pgmap v407: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:26:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:11 smithi154 ceph-mon[35136]: pgmap v407: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:26:12.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:26:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 -- 172.21.15.2:0/4150018359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 msgr2=0x7fb680108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 --2- 172.21.15.2:0/4150018359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680108c10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009900 tx=0x7fb66c02a410 comp rx=0 tx=0).stop 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 -- 172.21.15.2:0/4150018359 shutdown_connections 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 --2- 172.21.15.2:0/4150018359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680109150 0x7fb68010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 --2- 172.21.15.2:0/4150018359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680108c10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 --2- 172.21.15.2:0/4150018359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680102dc0 0x7fb6801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 -- 172.21.15.2:0/4150018359 >> 172.21.15.2:0/4150018359 conn(0x7fb6800fe830 msgr2=0x7fb680100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 -- 172.21.15.2:0/4150018359 shutdown_connections 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.241+0000 7fb687238640 1 -- 172.21.15.2:0/4150018359 wait complete. 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 Processor -- start 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 -- start start 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680102dc0 0x7fb6801994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680109150 0x7fb68019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb680112e50 con 0x7fb6801087d0 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb680112cd0 con 0x7fb680102dc0 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb687238640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb680112fd0 con 0x7fb680109150 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36078/0 (socket says 172.21.15.2:36078) 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 -- 172.21.15.2:0/2529333991 learned_addr learned my addr 172.21.15.2:0/2529333991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb6857d5640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680109150 0x7fb68019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680102dc0 0x7fb6801994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 -- 172.21.15.2:0/2529333991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680109150 msgr2=0x7fb68019edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680109150 0x7fb68019edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 -- 172.21.15.2:0/2529333991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680102dc0 msgr2=0x7fb6801994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680102dc0 0x7fb6801994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb67ffff640 1 -- 172.21.15.2:0/2529333991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68019f5a0 con 0x7fb6801087d0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb6857d5640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680109150 0x7fb68019edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.242+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680102dc0 0x7fb6801994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.243+0000 7fb67ffff640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680199a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006010 tx=0x7fb66c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.243+0000 7fb67dffb640 1 -- 172.21.15.2:0/2529333991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c03f030 con 0x7fb6801087d0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.243+0000 7fb67dffb640 1 -- 172.21.15.2:0/2529333991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c003800 con 0x7fb6801087d0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.243+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68019f830 con 0x7fb6801087d0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.243+0000 7fb67dffb640 1 -- 172.21.15.2:0/2529333991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035070 con 0x7fb6801087d0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.243+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801a5f50 con 0x7fb6801087d0 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.245+0000 7fb68960d740 1 Processor -- start 2024-09-10T23:26:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.245+0000 7fb67dffb640 1 -- 172.21.15.2:0/2529333991 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb66c031b10 con 0x7fb6801087d0 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.245+0000 7fb68960d740 1 -- start start 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb68960d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7aa84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb68960d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb68960d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb68960d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7c7a1eea0 con 0x55d7c7aa80f0 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb68960d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d7c7a0e2d0 con 0x55d7c7ab49a0 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb68960d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d7c7a120e0 con 0x55d7c7aa8a10 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7aa84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7aa84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36092/0 (socket says 172.21.15.2:36092) 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 -- 172.21.15.2:0/1366721771 learned_addr learned my addr 172.21.15.2:0/1366721771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb684fd4640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb67ffff640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 -- 172.21.15.2:0/1366721771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 msgr2=0x55d7c7ab4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 -- 172.21.15.2:0/1366721771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 msgr2=0x55d7c7ab6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 -- 172.21.15.2:0/1366721771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c776c650 con 0x55d7c7aa80f0 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb684fd4640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb67ffff640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb6857d5640 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7aa84d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c450 tx=0x7fb67800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a55a868b20bd3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.246+0000 7fb67dffb640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6700b5360 0x7fb6700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6700b5360 0x7fb6700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb66affd640 1 -- 172.21.15.2:0/1366721771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678007430 con 0x55d7c7aa80f0 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb66affd640 1 -- 172.21.15.2:0/1366721771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb678007a80 con 0x55d7c7aa80f0 2024-09-10T23:26:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb67dffb640 1 -- 172.21.15.2:0/2529333991 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb66c106530 con 0x7fb6801087d0 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb66affd640 1 -- 172.21.15.2:0/1366721771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67800a9f0 con 0x55d7c7aa80f0 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb68960d740 1 -- 172.21.15.2:0/1366721771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 msgr2=0x55d7c7aa84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb68960d740 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7aa84d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c450 tx=0x7fb67800c910 comp rx=0 tx=0).stop 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6700b5360 0x7fb6700b7820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55d7c7aa6e00 tx=0x7fb674008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.247+0000 7fb68960d740 1 -- 172.21.15.2:0/1366721771 shutdown_connections 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 --2- 172.21.15.2:0/1366721771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7aa84d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- 172.21.15.2:0/1366721771 >> 172.21.15.2:0/1366721771 conn(0x55d7c7aa5f20 msgr2=0x55d7c7aa70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- 172.21.15.2:0/1366721771 shutdown_connections 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- 172.21.15.2:0/1366721771 wait complete. 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- start start 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 Processor -- start 2024-09-10T23:26:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ab4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7c786f700 con 0x55d7c7aa80f0 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d7c79a9160 con 0x55d7c7ab49a0 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.248+0000 7fb68960d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d7c7ab7620 con 0x55d7c7aa8a10 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb68960d740 10 client.0 _ll_register_callbacks cb 0x55d7c79c29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ab4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ab4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36102/0 (socket says 172.21.15.2:36102) 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 -- 172.21.15.2:0/3899321098 learned_addr learned my addr 172.21.15.2:0/3899321098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb67ffff640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb6857d5640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 -- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 msgr2=0x55d7c7ab16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 -- 172.21.15.2:0/3899321098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 msgr2=0x55d7c7ab1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 -- 172.21.15.2:0/3899321098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7c79d6c90 con 0x55d7c7aa80f0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb684fd4640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ab4270 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb67400a750 tx=0x7fb6740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907559cbcf1e7f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb65ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb65ffff640 1 -- 172.21.15.2:0/3899321098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674023030 con 0x55d7c7aa80f0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb65ffff640 1 -- 172.21.15.2:0/3899321098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb674015410 con 0x55d7c7aa80f0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.249+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb678007a80 con 0x55d7c7aa80f0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb65ffff640 1 -- 172.21.15.2:0/3899321098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb67401b040 con 0x55d7c7aa80f0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 10 client.16020 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7c7ac2f30 con 0x55d7c7aa80f0 2024-09-10T23:26:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb65ffff640 1 -- 172.21.15.2:0/3899321098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb678007a80 con 0x55d7c7aa80f0 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb65ffff640 1 -- 172.21.15.2:0/3899321098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb67401e030 con 0x55d7c7aa80f0 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 10 client.16020 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 10 client.16020 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 20 client.16020 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7ac4490 0x55d7c7ac6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 4 client.16020 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7c7a20df0 con 0x55d7c7ac4490 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.250+0000 7fb67ffff640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7ac4490 0x55d7c7ac6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.251+0000 7fb67ffff640 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7ac4490 0x55d7c7ac6880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0c2e9acb5ee8a0c server_cookie=2084b2914dbc7591 in_seq=0 out_seq=0 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.251+0000 7fb65ffff640 10 client.16020 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.251+0000 7fb65ffff640 1 -- 172.21.15.2:0/3899321098 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7c7a20df0 con 0x55d7c7ac4490 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.251+0000 7fb65ffff640 10 client.16020 handle_command_reply: tid=0 2024-09-10T23:26:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.251+0000 7fb68960d740 1 client.16020 shutdown 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 msgr2=0x55d7c7ab4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ab4270 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb67400a750 tx=0x7fb6740046c0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 shutdown_connections 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7ac4490 0x55d7c7ac6880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb65ffff640 0 client.16020 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa8a10 0x55d7c7ab16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 --2- 172.21.15.2:0/3899321098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ab4270 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 >> 172.21.15.2:0/3899321098 conn(0x55d7c7aa5f20 msgr2=0x55d7c7aaba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 shutdown_connections 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 1 -- 172.21.15.2:0/3899321098 wait complete. 2024-09-10T23:26:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.252+0000 7fb68960d740 20 client.16020 trim_cache size 0 max 16384 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.265+0000 7fb68960d740 1 Processor -- start 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.265+0000 7fb68960d740 1 -- start start 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb68960d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ac0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb68960d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7aa6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb68960d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb68960d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801ae400 con 0x55d7c7aa8a10 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb68960d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801aff40 con 0x55d7c7aa80f0 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb68960d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801aead0 con 0x55d7c7ab49a0 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7aa6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7aa6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36106/0 (socket says 172.21.15.2:36106) 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 -- 172.21.15.2:0/1087690977 learned_addr learned my addr 172.21.15.2:0/1087690977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb6857d5640 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb684fd4640 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ac0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 -- 172.21.15.2:0/1087690977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7ab49a0 msgr2=0x55d7c7ab3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 -- 172.21.15.2:0/1087690977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7aa80f0 msgr2=0x55d7c7ac0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ac0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 -- 172.21.15.2:0/1087690977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c7aa6c00 con 0x55d7c7aa8a10 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb67ffff640 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7aa6fe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb66c104040 tx=0x7fb66c0044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6aad375b79a5144 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb66a7fc640 1 -- 172.21.15.2:0/1087690977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c049040 con 0x55d7c7aa8a10 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.266+0000 7fb66a7fc640 1 -- 172.21.15.2:0/1087690977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c0cd400 con 0x55d7c7aa8a10 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb66a7fc640 1 -- 172.21.15.2:0/1087690977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0c8f70 con 0x55d7c7aa8a10 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 -- 172.21.15.2:0/1087690977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 msgr2=0x55d7c7aa6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7aa6fe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb66c104040 tx=0x7fb66c0044e0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 -- 172.21.15.2:0/1087690977 shutdown_connections 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7ab49a0 0x55d7c7ab3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7aa6fe0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 --2- 172.21.15.2:0/1087690977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7aa80f0 0x55d7c7ac0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 -- 172.21.15.2:0/1087690977 >> 172.21.15.2:0/1087690977 conn(0x55d7c7aa5f20 msgr2=0x55d7c7ab2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 -- 172.21.15.2:0/1087690977 shutdown_connections 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 -- 172.21.15.2:0/1087690977 wait complete. 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.267+0000 7fb68960d740 1 -- start start 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 Processor -- start 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa80f0 0x55d7c7abce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7abb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7abbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801af870 con 0x55d7c7aa8a10 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801af1a0 con 0x55d7c7ab49a0 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801ac3e0 con 0x55d7c7aa80f0 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb68960d740 10 client.0 _ll_register_callbacks cb 0x7fb67400fd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb67ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7abb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb67ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7abb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36110/0 (socket says 172.21.15.2:36110) 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb67ffff640 1 -- 172.21.15.2:0/2891992318 learned_addr learned my addr 172.21.15.2:0/2891992318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb6857d5640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7abbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.268+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa80f0 0x55d7c7abce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb67ffff640 1 -- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa80f0 msgr2=0x55d7c7abce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb67ffff640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa80f0 0x55d7c7abce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb67ffff640 1 -- 172.21.15.2:0/2891992318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 msgr2=0x55d7c7abbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb67ffff640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7abbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb67ffff640 1 -- 172.21.15.2:0/2891992318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7c7abc420 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb67ffff640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7abb920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cca00 tx=0x7fb66c0c8c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da73f756fd1a74b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb65ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb65ffff640 1 -- 172.21.15.2:0/2891992318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c049040 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb65ffff640 1 -- 172.21.15.2:0/2891992318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb66c003d20 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb66c0cd400 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb65ffff640 1 -- 172.21.15.2:0/2891992318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb66c0d6290 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb68960d740 10 client.16026 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7c7b32110 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.269+0000 7fb65ffff640 1 -- 172.21.15.2:0/2891992318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c0cd400 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb65ffff640 1 -- 172.21.15.2:0/2891992318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb66c0ccf60 con 0x55d7c7aa8a10 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb68960d740 10 client.16026 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb68960d740 10 client.16026 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb68960d740 20 client.16026 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb68960d740 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7b32880 0x55d7c7b34ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb68960d740 4 client.16026 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7c7a1c8a0 con 0x55d7c7b32880 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.270+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7b32880 0x55d7c7b34ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb65ffff640 10 client.16026 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb684fd4640 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7b32880 0x55d7c7b34ca0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=27ffe83283cba26d server_cookie=7765a54d06f9f1f9 in_seq=0 out_seq=0 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb65ffff640 1 -- 172.21.15.2:0/2891992318 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7c7a1c8a0 con 0x55d7c7b32880 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb65ffff640 10 client.16026 handle_command_reply: tid=0 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 client.16026 shutdown 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 msgr2=0x55d7c7abb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7abb920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cca00 tx=0x7fb66c0c8c30 comp rx=0 tx=0).stop 2024-09-10T23:26:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 shutdown_connections 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d7c7b32880 0x55d7c7b34ca0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7c7ab49a0 0x55d7c7abbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7c7aa8a10 0x55d7c7abb920 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 --2- 172.21.15.2:0/2891992318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c7aa80f0 0x55d7c7abce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 >> 172.21.15.2:0/2891992318 conn(0x55d7c7aa5f20 msgr2=0x55d7c7ab3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb65ffff640 0 client.16026 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 shutdown_connections 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 1 -- 172.21.15.2:0/2891992318 wait complete. 2024-09-10T23:26:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.271+0000 7fb68960d740 20 client.16026 trim_cache size 0 max 16384 2024-09-10T23:26:13.291 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6700b5360 msgr2=0x7fb6700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6700b5360 0x7fb6700b7820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55d7c7aa6e00 tx=0x7fb674008040 comp rx=0 tx=0).stop 2024-09-10T23:26:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 msgr2=0x7fb680199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680199a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006010 tx=0x7fb66c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 shutdown_connections 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6700b5360 0x7fb6700b7820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb680109150 0x7fb68019edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6801087d0 0x7fb680199a30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 --2- 172.21.15.2:0/2529333991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb680102dc0 0x7fb6801994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 >> 172.21.15.2:0/2529333991 conn(0x7fb6800fe830 msgr2=0x7fb680100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 shutdown_connections 2024-09-10T23:26:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:13.272+0000 7fb687238640 1 -- 172.21.15.2:0/2529333991 wait complete. 2024-09-10T23:26:14.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:13 smithi002 ceph-mon[31150]: pgmap v408: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:14.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:26:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:13 smithi177 ceph-mon[35760]: pgmap v408: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:14.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:13 smithi154 ceph-mon[35136]: pgmap v408: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:15.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 -- 172.21.15.2:0/3787565541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c102dc0 msgr2=0x7fbf5c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 --2- 172.21.15.2:0/3787565541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c1031a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009900 tx=0x7fbf5802a410 comp rx=0 tx=0).stop 2024-09-10T23:26:15.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 -- 172.21.15.2:0/3787565541 shutdown_connections 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 --2- 172.21.15.2:0/3787565541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c109150 0x7fbf5c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 --2- 172.21.15.2:0/3787565541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 --2- 172.21.15.2:0/3787565541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c1031a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 -- 172.21.15.2:0/3787565541 >> 172.21.15.2:0/3787565541 conn(0x7fbf5c0fe830 msgr2=0x7fbf5c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 -- 172.21.15.2:0/3787565541 shutdown_connections 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.971+0000 7fbf63293640 1 -- 172.21.15.2:0/3787565541 wait complete. 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 Processor -- start 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 -- start start 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf5c109150 0x7fbf5c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c112e10 con 0x7fbf5c1087d0 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c112c90 con 0x7fbf5c102dc0 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf63293640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c112f90 con 0x7fbf5c109150 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36120/0 (socket says 172.21.15.2:36120) 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 -- 172.21.15.2:0/829051342 learned_addr learned my addr 172.21.15.2:0/829051342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6102f640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf61830640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf5c109150 0x7fbf5c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 -- 172.21.15.2:0/829051342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf5c109150 msgr2=0x7fbf5c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf5c109150 0x7fbf5c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 -- 172.21.15.2:0/829051342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102dc0 msgr2=0x7fbf5c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 -- 172.21.15.2:0/829051342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c1a7600 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6102f640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.972+0000 7fbf6082e640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c0759e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c920 tx=0x7fbf4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.973+0000 7fbf527fc640 1 -- 172.21.15.2:0/829051342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c007c70 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.973+0000 7fbf527fc640 1 -- 172.21.15.2:0/829051342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c007e10 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.973+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c1a78f0 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.973+0000 7fbf527fc640 1 -- 172.21.15.2:0/829051342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c018820 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.973+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c1a7e30 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.975+0000 7fbf527fc640 1 -- 172.21.15.2:0/829051342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fbf4c00f450 con 0x7fbf5c1087d0 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 Processor -- start 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 -- start start 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe462460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 0x5593fe464d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5593fe3ccea0 con 0x5593fe4629a0 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593fe3bc2d0 con 0x5593fe4560f0 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf65668740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5593fe3c00e0 con 0x5593fe456a10 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 0x5593fe464d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 0x5593fe464d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36126/0 (socket says 172.21.15.2:36126) 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf6082e640 1 -- 172.21.15.2:0/3086240741 learned_addr learned my addr 172.21.15.2:0/3086240741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf6102f640 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe462460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf61830640 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf527fc640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf480b52e0 0x7fbf480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.976+0000 7fbf6082e640 1 -- 172.21.15.2:0/3086240741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 msgr2=0x5593fe462460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf6082e640 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe462460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf6082e640 1 -- 172.21.15.2:0/3086240741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 msgr2=0x5593fe4564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf6082e640 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf6082e640 1 -- 172.21.15.2:0/3086240741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593fe11a650 con 0x5593fe4629a0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf61830640 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf61830640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf480b52e0 0x7fbf480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf527fc640 1 -- 172.21.15.2:0/829051342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbf4c0e5df0 con 0x7fbf5c1087d0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf6082e640 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 0x5593fe464d90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0dd690 tx=0x7fbf4c0a8c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5c6de8caf8182c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf477fe640 1 -- 172.21.15.2:0/3086240741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0ac390 con 0x5593fe4629a0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf477fe640 1 -- 172.21.15.2:0/3086240741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c0ac0d0 con 0x5593fe4629a0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.977+0000 7fbf477fe640 1 -- 172.21.15.2:0/3086240741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0abd30 con 0x5593fe4629a0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 -- 172.21.15.2:0/3086240741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 msgr2=0x5593fe464d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf61830640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf480b52e0 0x7fbf480b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c077560 tx=0x7fbf54004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 0x5593fe464d90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0dd690 tx=0x7fbf4c0a8c10 comp rx=0 tx=0).stop 2024-09-10T23:26:15.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 -- 172.21.15.2:0/3086240741 shutdown_connections 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4629a0 0x5593fe464d90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe462460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 --2- 172.21.15.2:0/3086240741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 -- 172.21.15.2:0/3086240741 >> 172.21.15.2:0/3086240741 conn(0x5593fe453f20 msgr2=0x5593fe4550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 -- 172.21.15.2:0/3086240741 shutdown_connections 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 -- 172.21.15.2:0/3086240741 wait complete. 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 -- start start 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.978+0000 7fbf65668740 1 Processor -- start 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4560f0 0x5593fe4622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe45f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe45fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5593fe21d700 con 0x5593fe456a10 2024-09-10T23:26:15.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593fe357160 con 0x5593fe4629a0 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5593fe4655c0 con 0x5593fe4560f0 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf65668740 10 client.0 _ll_register_callbacks cb 0x5593fe3709e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe45f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe45f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36142/0 (socket says 172.21.15.2:36142) 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 -- 172.21.15.2:0/1086458335 learned_addr learned my addr 172.21.15.2:0/1086458335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6102f640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4560f0 0x5593fe4622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf61830640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe45fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 -- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4560f0 msgr2=0x5593fe4622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4560f0 0x5593fe4622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 -- 172.21.15.2:0/1086458335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 msgr2=0x5593fe45fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe45fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 -- 172.21.15.2:0/1086458335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593fe384c90 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf6082e640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe45f740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0e3c70 tx=0x7fbf4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa4793c2f9617a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.979+0000 7fbf44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf44ff9640 1 -- 172.21.15.2:0/1086458335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0abf10 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf4c0ac0d0 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf44ff9640 1 -- 172.21.15.2:0/1086458335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbf4c0e93d0 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf44ff9640 1 -- 172.21.15.2:0/1086458335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf4c0abd30 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593fe470f50 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf44ff9640 1 -- 172.21.15.2:0/1086458335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c0ac0d0 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf44ff9640 1 -- 172.21.15.2:0/1086458335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf4c0e8040 con 0x5593fe456a10 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 10 client.16038 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 20 client.16038 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4722a0 0x5593fe474690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 4 client.16038 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.980+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593fe3cedf0 con 0x5593fe4722a0 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.981+0000 7fbf6102f640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4722a0 0x5593fe474690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.981+0000 7fbf44ff9640 10 client.16038 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.981+0000 7fbf6102f640 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4722a0 0x5593fe474690 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed381013c2726599 server_cookie=a25b285293fe9313 in_seq=0 out_seq=0 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf44ff9640 1 -- 172.21.15.2:0/1086458335 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593fe3cedf0 con 0x5593fe4722a0 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf44ff9640 10 client.16038 handle_command_reply: tid=0 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 client.16038 shutdown 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 msgr2=0x5593fe45f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe45f740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0e3c70 tx=0x7fbf4c000bc0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 shutdown_connections 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4722a0 0x5593fe474690 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe45fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe45f740 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 --2- 172.21.15.2:0/1086458335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4560f0 0x5593fe4622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 >> 172.21.15.2:0/1086458335 conn(0x5593fe453f20 msgr2=0x5593fe459a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf44ff9640 0 client.16038 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 shutdown_connections 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 1 -- 172.21.15.2:0/1086458335 wait complete. 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.982+0000 7fbf65668740 20 client.16038 trim_cache size 0 max 16384 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 Processor -- start 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 -- start start 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 0x5593fe46e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe45f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe452e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c1b0520 con 0x5593fe4560f0 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c1b2060 con 0x5593fe4629a0 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf65668740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c1b0bf0 con 0x5593fe456a10 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 0x5593fe46e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 0x5593fe46e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36156/0 (socket says 172.21.15.2:36156) 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 -- 172.21.15.2:0/1006539438 learned_addr learned my addr 172.21.15.2:0/1006539438 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6082e640 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe45f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 -- 172.21.15.2:0/1006539438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 msgr2=0x5593fe45f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe45f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 -- 172.21.15.2:0/1006539438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 msgr2=0x5593fe452e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe452e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 -- 172.21.15.2:0/1006539438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593fe460110 con 0x5593fe4560f0 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.996+0000 7fbf6102f640 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 0x5593fe46e860 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbf5802a930 tx=0x7fbf580058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2208d523db9f6cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf46ffd640 1 -- 172.21.15.2:0/1006539438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58035040 con 0x5593fe4560f0 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf46ffd640 1 -- 172.21.15.2:0/1006539438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf580054f0 con 0x5593fe4560f0 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf46ffd640 1 -- 172.21.15.2:0/1006539438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf580035f0 con 0x5593fe4560f0 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 -- 172.21.15.2:0/1006539438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 msgr2=0x5593fe46e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 0x5593fe46e860 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbf5802a930 tx=0x7fbf580058b0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 -- 172.21.15.2:0/1006539438 shutdown_connections 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4629a0 0x5593fe452e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe456a10 0x5593fe45f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 --2- 172.21.15.2:0/1006539438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe4560f0 0x5593fe46e860 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 -- 172.21.15.2:0/1006539438 >> 172.21.15.2:0/1006539438 conn(0x5593fe453f20 msgr2=0x5593fe452750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 -- 172.21.15.2:0/1006539438 shutdown_connections 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.997+0000 7fbf65668740 1 -- 172.21.15.2:0/1006539438 wait complete. 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 -- start start 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 Processor -- start 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe473920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4629a0 0x5593fe473e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c1b1990 con 0x5593fe456a10 2024-09-10T23:26:15.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c1b12c0 con 0x5593fe4560f0 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c1ae500 con 0x5593fe4629a0 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf65668740 10 client.0 _ll_register_callbacks cb 0x7fbf58009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe473920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf6082e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe473920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36172/0 (socket says 172.21.15.2:36172) 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf6082e640 1 -- 172.21.15.2:0/86627620 learned_addr learned my addr 172.21.15.2:0/86627620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf6102f640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.998+0000 7fbf61830640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4629a0 0x5593fe473e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf6082e640 1 -- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4629a0 msgr2=0x5593fe473e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf6082e640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4629a0 0x5593fe473e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf6082e640 1 -- 172.21.15.2:0/86627620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 msgr2=0x5593fe4733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf6082e640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf6082e640 1 -- 172.21.15.2:0/86627620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593fe4e6810 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf6082e640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe473920 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0e2e10 tx=0x7fbf4c0a8c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a1c2c62570ab75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf44ff9640 1 -- 172.21.15.2:0/86627620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0ac390 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf44ff9640 1 -- 172.21.15.2:0/86627620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbf4c0b58d0 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf580054f0 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf44ff9640 1 -- 172.21.15.2:0/86627620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf4c0abf10 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 10 client.16044 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593fe4e7af0 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf44ff9640 1 -- 172.21.15.2:0/86627620 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf580054f0 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf44ff9640 1 -- 172.21.15.2:0/86627620 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf4c0e8070 con 0x5593fe456a10 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 10 client.16044 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 10 client.16044 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 20 client.16044 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4e8020 0x5593fe4ea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 4 client.16044 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:14.999+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593fe3ca8a0 con 0x5593fe4e8020 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.000+0000 7fbf6102f640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4e8020 0x5593fe4ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.000+0000 7fbf6102f640 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4e8020 0x5593fe4ea440 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0b65ab345238960 server_cookie=652e4e80f1906452 in_seq=0 out_seq=0 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.000+0000 7fbf44ff9640 10 client.16044 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.000+0000 7fbf44ff9640 1 -- 172.21.15.2:0/86627620 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593fe3ca8a0 con 0x5593fe4e8020 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.000+0000 7fbf44ff9640 10 client.16044 handle_command_reply: tid=0 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.000+0000 7fbf65668740 1 client.16044 shutdown 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 msgr2=0x5593fe473920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe473920 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0e2e10 tx=0x7fbf4c0a8c10 comp rx=0 tx=0).stop 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 shutdown_connections 2024-09-10T23:26:15.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5593fe4e8020 0x5593fe4ea440 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5593fe4629a0 0x5593fe473e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5593fe456a10 0x5593fe473920 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 --2- 172.21.15.2:0/86627620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593fe4560f0 0x5593fe4733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 >> 172.21.15.2:0/86627620 conn(0x5593fe453f20 msgr2=0x5593fe452f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf44ff9640 0 client.16044 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 shutdown_connections 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 1 -- 172.21.15.2:0/86627620 wait complete. 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.001+0000 7fbf65668740 20 client.16044 trim_cache size 0 max 16384 2024-09-10T23:26:15.020 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf480b52e0 msgr2=0x7fbf480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf480b52e0 0x7fbf480b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c077560 tx=0x7fbf54004a40 comp rx=0 tx=0).stop 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 msgr2=0x7fbf5c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c0759e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c920 tx=0x7fbf4c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 shutdown_connections 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf480b52e0 0x7fbf480b77a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf5c109150 0x7fbf5c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c1087d0 0x7fbf5c0759e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 --2- 172.21.15.2:0/829051342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102dc0 0x7fbf5c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 >> 172.21.15.2:0/829051342 conn(0x7fbf5c0fe830 msgr2=0x7fbf5c0fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 shutdown_connections 2024-09-10T23:26:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:15.002+0000 7fbf63293640 1 -- 172.21.15.2:0/829051342 wait complete. 2024-09-10T23:26:15.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:26:15.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:15 smithi002 ceph-mon[31150]: pgmap v409: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:16.022 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:15 smithi177 ceph-mon[35760]: pgmap v409: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:15 smithi154 ceph-mon[35136]: pgmap v409: 97 pgs: 97 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 -- 172.21.15.2:0/3121277871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c4109120 msgr2=0x7f54c410f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 --2- 172.21.15.2:0/3121277871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c4109120 0x7f54c410f920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009ca0 tx=0x7f54bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 -- 172.21.15.2:0/3121277871 shutdown_connections 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 --2- 172.21.15.2:0/3121277871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c4109120 0x7f54c410f920 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 --2- 172.21.15.2:0/3121277871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c41087a0 0x7f54c4108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 --2- 172.21.15.2:0/3121277871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4102d90 0x7f54c4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 -- 172.21.15.2:0/3121277871 >> 172.21.15.2:0/3121277871 conn(0x7f54c40fe820 msgr2=0x7f54c4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 -- 172.21.15.2:0/3121277871 shutdown_connections 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.545+0000 7f54c8e55640 1 -- 172.21.15.2:0/3121277871 wait complete. 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 Processor -- start 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 -- start start 2024-09-10T23:26:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4102d90 0x7f54c41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 0x7f54c4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4109120 0x7f54c419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4112de0 con 0x7f54c41087a0 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4112c60 con 0x7f54c4102d90 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c8e55640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4112f60 con 0x7f54c4109120 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 0x7f54c4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 0x7f54c4199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36192/0 (socket says 172.21.15.2:36192) 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54bbfff640 1 -- 172.21.15.2:0/2288194968 learned_addr learned my addr 172.21.15.2:0/2288194968 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.546+0000 7f54c259c640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4102d90 0x7f54c41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4109120 0x7f54c419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bbfff640 1 -- 172.21.15.2:0/2288194968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4109120 msgr2=0x7f54c419eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bbfff640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4109120 0x7f54c419eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bbfff640 1 -- 172.21.15.2:0/2288194968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4102d90 msgr2=0x7f54c41991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bbfff640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4102d90 0x7f54c41991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bbfff640 1 -- 172.21.15.2:0/2288194968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c419f280 con 0x7f54c41087a0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4109120 0x7f54c419eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bbfff640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 0x7f54c4199710 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c890 tx=0x7f54ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bb7fe640 1 -- 172.21.15.2:0/2288194968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac004220 con 0x7f54c41087a0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bb7fe640 1 -- 172.21.15.2:0/2288194968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54ac0043c0 con 0x7f54c41087a0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c419f570 con 0x7f54c41087a0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54bb7fe640 1 -- 172.21.15.2:0/2288194968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac004a00 con 0x7f54c41087a0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.547+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c41a5c30 con 0x7f54c41087a0 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.550+0000 7f54cb22a740 1 Processor -- start 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.550+0000 7f54cb22a740 1 -- start start 2024-09-10T23:26:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54bb7fe640 1 -- 172.21.15.2:0/2288194968 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f54ac0079b0 con 0x7f54c41087a0 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb674a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6756460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6758d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54cb22a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ceb66c0ea0 con 0x55ceb674a0f0 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54cb22a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ceb66b02d0 con 0x55ceb674aa10 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54cb22a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ceb66b40e0 con 0x55ceb67569a0 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb674a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb674a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36194/0 (socket says 172.21.15.2:36194) 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 -- 172.21.15.2:0/3999009702 learned_addr learned my addr 172.21.15.2:0/3999009702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54bbfff640 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6758d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c259c640 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6756460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 -- 172.21.15.2:0/3999009702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 msgr2=0x55ceb6758d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6758d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 -- 172.21.15.2:0/3999009702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 msgr2=0x55ceb6756460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6756460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.551+0000 7f54c2d9d640 1 -- 172.21.15.2:0/3999009702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb640e650 con 0x55ceb674a0f0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb674a4d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0098e0 tx=0x7f54bc009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ffdf49093b3e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54bb7fe640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54b00b52e0 0x7f54b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54c259c640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54b00b52e0 0x7f54b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54b8ff9640 1 -- 172.21.15.2:0/3999009702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc031df0 con 0x55ceb674a0f0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54bb7fe640 1 -- 172.21.15.2:0/2288194968 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f54ac0e5960 con 0x7f54c41087a0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54b8ff9640 1 -- 172.21.15.2:0/3999009702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54bc036070 con 0x55ceb674a0f0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.552+0000 7f54b8ff9640 1 -- 172.21.15.2:0/3999009702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc004320 con 0x55ceb674a0f0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- 172.21.15.2:0/3999009702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 msgr2=0x55ceb674a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb674a4d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0098e0 tx=0x7f54bc009910 comp rx=0 tx=0).stop 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54c259c640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54b00b52e0 0x7f54b00b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55ceb6748e00 tx=0x7f54b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- 172.21.15.2:0/3999009702 shutdown_connections 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6758d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6756460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- 172.21.15.2:0/3999009702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb674a4d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- 172.21.15.2:0/3999009702 >> 172.21.15.2:0/3999009702 conn(0x55ceb6747f20 msgr2=0x55ceb67490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- 172.21.15.2:0/3999009702 shutdown_connections 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- 172.21.15.2:0/3999009702 wait complete. 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- start start 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 Processor -- start 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb6756270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb67536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6753ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ceb6511700 con 0x55ceb674a0f0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ceb664b160 con 0x55ceb674aa10 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ceb6759610 con 0x55ceb67569a0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.553+0000 7f54cb22a740 10 client.0 _ll_register_callbacks cb 0x55ceb66649e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb6756270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb6756270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36206/0 (socket says 172.21.15.2:36206) 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 -- 172.21.15.2:0/2686692442 learned_addr learned my addr 172.21.15.2:0/2686692442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54bbfff640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb67536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6753ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 -- 172.21.15.2:0/2686692442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 msgr2=0x55ceb6753ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6753ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 -- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 msgr2=0x55ceb67536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb67536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 -- 172.21.15.2:0/2686692442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb6678c90 con 0x55ceb674a0f0 2024-09-10T23:26:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6753ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54c259c640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb6756270 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f54b4003c40 tx=0x7f54b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d57098b4539ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54a9ffb640 1 -- 172.21.15.2:0/2686692442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b401fd20 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54bc036070 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54a9ffb640 1 -- 172.21.15.2:0/2686692442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f54b4017030 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54a9ffb640 1 -- 172.21.15.2:0/2686692442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54b4005020 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54cb22a740 10 client.16056 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.554+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ceb6769390 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54a9ffb640 1 -- 172.21.15.2:0/2686692442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54bc036070 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54a9ffb640 1 -- 172.21.15.2:0/2686692442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f54b4027410 con 0x55ceb674a0f0 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54cb22a740 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54cb22a740 10 client.16056 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:26:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54cb22a740 20 client.16056 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54cb22a740 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb676a8f0 0x55ceb676cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54cb22a740 4 client.16056 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ceb66c2df0 con 0x55ceb676a8f0 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.555+0000 7f54bbfff640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb676a8f0 0x55ceb676cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54a9ffb640 10 client.16056 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54bbfff640 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb676a8f0 0x55ceb676cd40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c993fb4efe7d15f server_cookie=211b7e2aa3852bf in_seq=0 out_seq=0 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54a9ffb640 1 -- 172.21.15.2:0/2686692442 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ceb66c2df0 con 0x55ceb676a8f0 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54a9ffb640 10 client.16056 handle_command_reply: tid=0 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54cb22a740 1 client.16056 shutdown 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 msgr2=0x55ceb6756270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.556+0000 7f54cb22a740 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb6756270 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f54b4003c40 tx=0x7f54b40046c0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 shutdown_connections 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb6753ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb67536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb676a8f0 0x55ceb676cd40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 --2- 172.21.15.2:0/2686692442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb6756270 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54a9ffb640 0 client.16056 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 >> 172.21.15.2:0/2686692442 conn(0x55ceb6747f20 msgr2=0x55ceb674dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 shutdown_connections 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 1 -- 172.21.15.2:0/2686692442 wait complete. 2024-09-10T23:26:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.557+0000 7f54cb22a740 20 client.16056 trim_cache size 0 max 16384 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.570+0000 7f54cb22a740 1 Processor -- start 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.570+0000 7f54cb22a740 1 -- start start 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb67430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6755400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb67508d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54cb22a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41ac130 con 0x55ceb674a0f0 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54cb22a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41adc70 con 0x55ceb674aa10 2024-09-10T23:26:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54cb22a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41ac800 con 0x55ceb67569a0 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb67430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb67430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36218/0 (socket says 172.21.15.2:36218) 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 -- 172.21.15.2:0/4219187064 learned_addr learned my addr 172.21.15.2:0/4219187064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54bbfff640 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6755400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb67508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 -- 172.21.15.2:0/4219187064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 msgr2=0x55ceb67508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb67508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 -- 172.21.15.2:0/4219187064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 msgr2=0x55ceb6755400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6755400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 -- 172.21.15.2:0/4219187064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb674e3a0 con 0x55ceb674a0f0 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.571+0000 7f54c259c640 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb67430b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f54b40039c0 tx=0x7f54b401fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b3feaab559dade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54abfff640 1 -- 172.21.15.2:0/4219187064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4036030 con 0x55ceb674a0f0 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54abfff640 1 -- 172.21.15.2:0/4219187064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b4005670 con 0x55ceb674a0f0 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54abfff640 1 -- 172.21.15.2:0/4219187064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4004990 con 0x55ceb674a0f0 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 -- 172.21.15.2:0/4219187064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 msgr2=0x55ceb67430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb67430b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f54b40039c0 tx=0x7f54b401fdd0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 -- 172.21.15.2:0/4219187064 shutdown_connections 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb67569a0 0x55ceb67508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb674aa10 0x55ceb6755400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 --2- 172.21.15.2:0/4219187064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674a0f0 0x55ceb67430b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 -- 172.21.15.2:0/4219187064 >> 172.21.15.2:0/4219187064 conn(0x55ceb6747f20 msgr2=0x55ceb6754cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 -- 172.21.15.2:0/4219187064 shutdown_connections 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.572+0000 7f54cb22a740 1 -- 172.21.15.2:0/4219187064 wait complete. 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 -- start start 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 Processor -- start 2024-09-10T23:26:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb674a0f0 0x55ceb675f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 0x55ceb675f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb67569a0 0x55ceb67d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41ad5a0 con 0x55ceb674aa10 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41aced0 con 0x55ceb67569a0 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41aa110 con 0x55ceb674a0f0 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54cb22a740 10 client.0 _ll_register_callbacks cb 0x7f54b4004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 0x55ceb675f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 0x55ceb675f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36226/0 (socket says 172.21.15.2:36226) 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54bbfff640 1 -- 172.21.15.2:0/1300514011 learned_addr learned my addr 172.21.15.2:0/1300514011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.573+0000 7f54c259c640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb674a0f0 0x55ceb675f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb67569a0 0x55ceb67d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54bbfff640 1 -- 172.21.15.2:0/1300514011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb674a0f0 msgr2=0x55ceb675f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54bbfff640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb674a0f0 0x55ceb675f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54bbfff640 1 -- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb67569a0 msgr2=0x55ceb67d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54bbfff640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb67569a0 0x55ceb67d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54bbfff640 1 -- 172.21.15.2:0/1300514011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb67d6d50 con 0x55ceb674aa10 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54c2d9d640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb67569a0 0x55ceb67d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54c259c640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb674a0f0 0x55ceb675f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54bbfff640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 0x55ceb675f630 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0058c0 tx=0x7f54ac0e7e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e0723365547319 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54a9ffb640 1 -- 172.21.15.2:0/1300514011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac01d040 con 0x55ceb674aa10 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54a9ffb640 1 -- 172.21.15.2:0/1300514011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f54ac0a83a0 con 0x55ceb674aa10 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b4005670 con 0x55ceb674aa10 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54a9ffb640 1 -- 172.21.15.2:0/1300514011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54ac0ab8a0 con 0x55ceb674aa10 2024-09-10T23:26:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54cb22a740 10 client.16062 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ceb67d7fb0 con 0x55ceb674aa10 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.574+0000 7f54a9ffb640 1 -- 172.21.15.2:0/1300514011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b4005670 con 0x55ceb674aa10 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54a9ffb640 1 -- 172.21.15.2:0/1300514011 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f54ac0cdb10 con 0x55ceb674aa10 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54cb22a740 10 client.16062 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54cb22a740 10 client.16062 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54cb22a740 20 client.16062 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54cb22a740 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb67d86e0 0x55ceb67dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54cb22a740 4 client.16062 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ceb66be8a0 con 0x55ceb67d86e0 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54c259c640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb67d86e0 0x55ceb67dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54c259c640 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb67d86e0 0x55ceb67dab00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9db95d56f25aed7a server_cookie=bd66a56fc656f1d8 in_seq=0 out_seq=0 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.575+0000 7f54a9ffb640 10 client.16062 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54a9ffb640 1 -- 172.21.15.2:0/1300514011 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ceb66be8a0 con 0x55ceb67d86e0 2024-09-10T23:26:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54a9ffb640 10 client.16062 handle_command_reply: tid=0 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 client.16062 shutdown 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 msgr2=0x55ceb675f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 0x55ceb675f630 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0058c0 tx=0x7f54ac0e7e70 comp rx=0 tx=0).stop 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 shutdown_connections 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceb67569a0 0x55ceb67d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55ceb67d86e0 0x55ceb67dab00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb674aa10 0x55ceb675f630 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 --2- 172.21.15.2:0/1300514011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceb674a0f0 0x55ceb675f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54a9ffb640 0 client.16062 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 >> 172.21.15.2:0/1300514011 conn(0x55ceb6747f20 msgr2=0x55ceb6755510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 shutdown_connections 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 1 -- 172.21.15.2:0/1300514011 wait complete. 2024-09-10T23:26:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.576+0000 7f54cb22a740 20 client.16062 trim_cache size 0 max 16384 2024-09-10T23:26:16.584 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54b00b52e0 msgr2=0x7f54b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54b00b52e0 0x7f54b00b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55ceb6748e00 tx=0x7f54b400b390 comp rx=0 tx=0).stop 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 msgr2=0x7f54c4199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 0x7f54c4199710 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c890 tx=0x7f54ac00cd50 comp rx=0 tx=0).stop 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 shutdown_connections 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f54b00b52e0 0x7f54b00b77a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54c4109120 0x7f54c419eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54c41087a0 0x7f54c4199710 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 --2- 172.21.15.2:0/2288194968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4102d90 0x7f54c41991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 >> 172.21.15.2:0/2288194968 conn(0x7f54c40fe820 msgr2=0x7f54c4100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 shutdown_connections 2024-09-10T23:26:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:16.577+0000 7f54c8e55640 1 -- 172.21.15.2:0/2288194968 wait complete. 2024-09-10T23:26:17.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:26:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:17.887 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:17 smithi002 ceph-mon[31150]: pgmap v410: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:26:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 -- 172.21.15.2:0/1687689314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 msgr2=0x7f37b4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/1687689314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b4109cf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009cd0 tx=0x7f37ac02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 -- 172.21.15.2:0/1687689314 shutdown_connections 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/1687689314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b4109cf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/1687689314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b41029b0 0x7f37b4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/1687689314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b4101860 0x7f37b4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 -- 172.21.15.2:0/1687689314 >> 172.21.15.2:0/1687689314 conn(0x7f37b40fd140 msgr2=0x7f37b40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 -- 172.21.15.2:0/1687689314 shutdown_connections 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.950+0000 7f37bb9e8640 1 -- 172.21.15.2:0/1687689314 wait complete. 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 Processor -- start 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 -- start start 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4101860 0x7f37b406b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b41029b0 0x7f37b419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b41a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37b410d4d0 con 0x7f37b4103370 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37b410d350 con 0x7f37b4101860 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37bb9e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37b410d650 con 0x7f37b41029b0 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b41a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b41a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36252/0 (socket says 172.21.15.2:36252) 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 -- 172.21.15.2:0/101394332 learned_addr learned my addr 172.21.15.2:0/101394332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9784640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4101860 0x7f37b406b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b8f83640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b41029b0 0x7f37b419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 -- 172.21.15.2:0/101394332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b41029b0 msgr2=0x7f37b419da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b41029b0 0x7f37b419da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 -- 172.21.15.2:0/101394332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4101860 msgr2=0x7f37b406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4101860 0x7f37b406b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.951+0000 7f37b9f85640 1 -- 172.21.15.2:0/101394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b41a08e0 con 0x7f37b4103370 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.952+0000 7f37b9f85640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b41a0020 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f37ac033040 tx=0x7f37ac003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.952+0000 7f37aa7fc640 1 -- 172.21.15.2:0/101394332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac004240 con 0x7f37b4103370 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.952+0000 7f37aa7fc640 1 -- 172.21.15.2:0/101394332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37ac0305a0 con 0x7f37b4103370 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.952+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b41a0b70 con 0x7f37b4103370 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.952+0000 7f37aa7fc640 1 -- 172.21.15.2:0/101394332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0466e0 con 0x7f37b4103370 2024-09-10T23:26:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.952+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b41a10c0 con 0x7f37b4103370 2024-09-10T23:26:18.223 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:17 smithi177 ceph-mon[35760]: pgmap v410: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:26:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.954+0000 7f37be890740 1 Processor -- start 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37aa7fc640 1 -- 172.21.15.2:0/101394332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f37ac04e070 con 0x7f37b4103370 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 -- start start 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb3b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb3e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56347baa46f0 con 0x56347bb395a0 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56347ba93b20 con 0x56347bb3bfe0 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37be890740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56347ba97930 con 0x56347bb36c70 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b9784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb3b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b9784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb3b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36262/0 (socket says 172.21.15.2:36262) 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b9784640 1 -- 172.21.15.2:0/3171659371 learned_addr learned my addr 172.21.15.2:0/3171659371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b8f83640 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b8f83640 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb3e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b9784640 1 -- 172.21.15.2:0/3171659371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 msgr2=0x56347bb39060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b9784640 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb39060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.955+0000 7f37b9784640 1 -- 172.21.15.2:0/3171659371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 msgr2=0x56347bb3e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37b9784640 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb3e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37b9784640 1 -- 172.21.15.2:0/3171659371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56347ba59530 con 0x56347bb395a0 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37b8f83640 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb3e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37aa7fc640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37a00b52e0 0x7f37a00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37b9784640 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb3b990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009c90 tx=0x7f37b00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21563015bd858c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37b8f83640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37a00b52e0 0x7f37a00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f37aa7fc640 1 -- 172.21.15.2:0/101394332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f37ac02e030 con 0x7f37b4103370 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f379f7fe640 1 -- 172.21.15.2:0/3171659371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0012450 con 0x56347bb395a0 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f379f7fe640 1 -- 172.21.15.2:0/3171659371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37b0012aa0 con 0x56347bb395a0 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.956+0000 7f379f7fe640 1 -- 172.21.15.2:0/3171659371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b000fb40 con 0x56347bb395a0 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 -- 172.21.15.2:0/3171659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 msgr2=0x56347bb3b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb3b990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009c90 tx=0x7f37b00117b0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37b8f83640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37a00b52e0 0x7f37a00b77a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f37a400efd0 tx=0x7f37a4005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 -- 172.21.15.2:0/3171659371 shutdown_connections 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb3e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb3b990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 --2- 172.21.15.2:0/3171659371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 -- 172.21.15.2:0/3171659371 >> 172.21.15.2:0/3171659371 conn(0x56347bb2d9b0 msgr2=0x56347bb2e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 -- 172.21.15.2:0/3171659371 shutdown_connections 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 -- 172.21.15.2:0/3171659371 wait complete. 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 -- start start 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.957+0000 7f37be890740 1 Processor -- start 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb40300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb41570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56347b9cbab0 con 0x56347bb395a0 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56347ba39730 con 0x56347bb3bfe0 2024-09-10T23:26:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56347bb3efc0 con 0x56347bb36c70 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37be890740 10 client.0 _ll_register_callbacks cb 0x56347ba8d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36270/0 (socket says 172.21.15.2:36270) 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 -- 172.21.15.2:0/1825549133 learned_addr learned my addr 172.21.15.2:0/1825549133 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b9784640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb40300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b9f85640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb41570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 -- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 msgr2=0x56347bb40300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb40300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 -- 172.21.15.2:0/1825549133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 msgr2=0x56347bb41570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb41570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 -- 172.21.15.2:0/1825549133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56347b7f5790 con 0x56347bb395a0 2024-09-10T23:26:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f37b8f83640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb409a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f37a4010e30 tx=0x7f37a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed11ff063cb78f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.958+0000 7f379cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f379cff9640 1 -- 172.21.15.2:0/1825549133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4023030 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f379cff9640 1 -- 172.21.15.2:0/1825549133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f37a4005020 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37b0012aa0 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f379cff9640 1 -- 172.21.15.2:0/1825549133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37a402f050 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56347b86e620 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f379cff9640 1 -- 172.21.15.2:0/1825549133 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37b0012aa0 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f379cff9640 1 -- 172.21.15.2:0/1825549133 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f37a401c050 con 0x56347bb395a0 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 20 client.16074 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bb4bc20 0x56347bb4e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 4 client.16074 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.959+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56347baa6640 con 0x56347bb4bc20 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.960+0000 7f37b9784640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bb4bc20 0x56347bb4e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.960+0000 7f37b9784640 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bb4bc20 0x56347bb4e030 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c5e1d985c9d27 server_cookie=e0a7d0d750641bb9 in_seq=0 out_seq=0 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.960+0000 7f379cff9640 10 client.16074 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f379cff9640 1 -- 172.21.15.2:0/1825549133 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56347baa6640 con 0x56347bb4bc20 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f379cff9640 10 client.16074 handle_command_reply: tid=0 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 client.16074 shutdown 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 msgr2=0x56347bb409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb409a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f37a4010e30 tx=0x7f37a40046c0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 shutdown_connections 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bb4bc20 0x56347bb4e030 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb41570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb395a0 0x56347bb409a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f379cff9640 0 client.16074 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 --2- 172.21.15.2:0/1825549133 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb36c70 0x56347bb40300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 >> 172.21.15.2:0/1825549133 conn(0x56347bb2d9b0 msgr2=0x56347bb2cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 shutdown_connections 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 1 -- 172.21.15.2:0/1825549133 wait complete. 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.961+0000 7f37be890740 20 client.16074 trim_cache size 0 max 16384 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.976+0000 7f37be890740 1 Processor -- start 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 -- start start 2024-09-10T23:26:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb41e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb395a0 0x56347bb30a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb3bfe0 0x56347bb30f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37b41a7b10 con 0x56347bb36c70 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37b41a9650 con 0x56347bb395a0 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37be890740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37b41a81e0 con 0x56347bb3bfe0 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb41e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb41e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36306/0 (socket says 172.21.15.2:36306) 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 -- 172.21.15.2:0/3342585355 learned_addr learned my addr 172.21.15.2:0/3342585355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b8f83640 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb395a0 0x56347bb30a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9f85640 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb3bfe0 0x56347bb30f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 -- 172.21.15.2:0/3342585355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb3bfe0 msgr2=0x56347bb30f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb3bfe0 0x56347bb30f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 -- 172.21.15.2:0/3342585355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb395a0 msgr2=0x56347bb30a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f37b9784640 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb395a0 0x56347bb30a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f37b9784640 1 -- 172.21.15.2:0/3342585355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56347bb3bd00 con 0x56347bb36c70 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f37b9784640 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb41e40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f37b001c040 tx=0x7f37b0009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddebed3fe0d08f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f379effd640 1 -- 172.21.15.2:0/3342585355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0005040 con 0x56347bb36c70 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f379effd640 1 -- 172.21.15.2:0/3342585355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37b0005690 con 0x56347bb36c70 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f379effd640 1 -- 172.21.15.2:0/3342585355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0012570 con 0x56347bb36c70 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 -- 172.21.15.2:0/3342585355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 msgr2=0x56347bb41e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb41e40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f37b001c040 tx=0x7f37b0009550 comp rx=0 tx=0).stop 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 -- 172.21.15.2:0/3342585355 shutdown_connections 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb3bfe0 0x56347bb30f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb395a0 0x56347bb30a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 --2- 172.21.15.2:0/3342585355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb41e40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 -- 172.21.15.2:0/3342585355 >> 172.21.15.2:0/3342585355 conn(0x56347bb2d9b0 msgr2=0x56347bb2e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 -- 172.21.15.2:0/3342585355 shutdown_connections 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 -- 172.21.15.2:0/3342585355 wait complete. 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.979+0000 7f37be890740 1 -- start start 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 Processor -- start 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb45210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb395a0 0x56347bb458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb46480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37b41a8f80 con 0x56347bb36c70 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37b41a88b0 con 0x56347bb3bfe0 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37b41a5af0 con 0x56347bb395a0 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37be890740 10 client.0 _ll_register_callbacks cb 0x7f37a400e810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37b9784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb45210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37b9784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb45210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36308/0 (socket says 172.21.15.2:36308) 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37b9784640 1 -- 172.21.15.2:0/2720123018 learned_addr learned my addr 172.21.15.2:0/2720123018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37b9f85640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb46480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37b8f83640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb395a0 0x56347bb458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.980+0000 7f37b9784640 1 -- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb395a0 msgr2=0x56347bb458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37b9784640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb395a0 0x56347bb458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37b9784640 1 -- 172.21.15.2:0/2720123018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 msgr2=0x56347bb46480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37b9784640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb46480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37b9784640 1 -- 172.21.15.2:0/2720123018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56347bb46cb0 con 0x56347bb36c70 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37b8f83640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb395a0 0x56347bb458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37b9784640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb45210 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f37b00095c0 tx=0x7f37b0003750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8196051839fb1167 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f379cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f379cff9640 1 -- 172.21.15.2:0/2720123018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b00052c0 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f379cff9640 1 -- 172.21.15.2:0/2720123018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f37b0005460 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37b0005690 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f379cff9640 1 -- 172.21.15.2:0/2720123018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37b0012570 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37be890740 10 client.16086 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56347bb48020 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f379cff9640 1 -- 172.21.15.2:0/2720123018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37b003c070 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f379cff9640 1 -- 172.21.15.2:0/2720123018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f37b003f020 con 0x56347bb36c70 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37be890740 10 client.16086 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37be890740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37be890740 20 client.16086 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37be890740 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bbb8dc0 0x56347bbbb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37be890740 4 client.16086 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f37b0005690 con 0x56347bbb8dc0 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f37b8f83640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bbb8dc0 0x56347bbbb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f37b8f83640 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bbb8dc0 0x56347bbbb1b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b96cadce365db495 server_cookie=15f3ecd92ab61b8b in_seq=0 out_seq=0 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f379cff9640 10 client.16086 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f379cff9640 1 -- 172.21.15.2:0/2720123018 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f37b0005690 con 0x56347bbb8dc0 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f379cff9640 10 client.16086 handle_command_reply: tid=0 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 client.16086 shutdown 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 msgr2=0x56347bb45210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb45210 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f37b00095c0 tx=0x7f37b0003750 comp rx=0 tx=0).stop 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 shutdown_connections 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56347bbb8dc0 0x56347bbbb1b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56347bb3bfe0 0x56347bb46480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f379cff9640 0 client.16086 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56347bb395a0 0x56347bb458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 --2- 172.21.15.2:0/2720123018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56347bb36c70 0x56347bb45210 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 >> 172.21.15.2:0/2720123018 conn(0x56347bb2d9b0 msgr2=0x56347bb31c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 shutdown_connections 2024-09-10T23:26:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 1 -- 172.21.15.2:0/2720123018 wait complete. 2024-09-10T23:26:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 -- 172.21.15.2:0/925399718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10104530 msgr2=0x7f6c1010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 --2- 172.21.15.2:0/925399718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10104530 0x7f6c1010cb10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009900 tx=0x7f6c0402a410 comp rx=0 tx=0).stop 2024-09-10T23:26:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 -- 172.21.15.2:0/925399718 shutdown_connections 2024-09-10T23:26:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 --2- 172.21.15.2:0/925399718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1010d0e0 0x7f6c1010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 --2- 172.21.15.2:0/925399718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10104530 0x7f6c1010cb10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 --2- 172.21.15.2:0/925399718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c10103b30 0x7f6c10103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 -- 172.21.15.2:0/925399718 >> 172.21.15.2:0/925399718 conn(0x7f6c100fd700 msgr2=0x7f6c100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 -- 172.21.15.2:0/925399718 shutdown_connections 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.975+0000 7f6c15921640 1 -- 172.21.15.2:0/925399718 wait complete. 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.976+0000 7f6c15921640 1 Processor -- start 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.976+0000 7f6c15921640 1 -- start start 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.976+0000 7f6c15921640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 0x7f6c101992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c15921640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c10104530 0x7f6c10199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.995+0000 7f37be890740 20 client.16086 trim_cache size 0 max 16384 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c15921640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1010d0e0 0x7f6c1019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c15921640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10112d60 con 0x7f6c10103b30 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c15921640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10112be0 con 0x7f6c10104530 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c15921640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10112ee0 con 0x7f6c1010d0e0 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 0x7f6c101992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 0x7f6c101992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36292/0 (socket says 172.21.15.2:36292) 2024-09-10T23:26:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 -- 172.21.15.2:0/1073974567 learned_addr learned my addr 172.21.15.2:0/1073974567 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1010d0e0 0x7f6c1019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c10104530 0x7f6c10199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 -- 172.21.15.2:0/1073974567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1010d0e0 msgr2=0x7f6c1019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1010d0e0 0x7f6c1019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 -- 172.21.15.2:0/1073974567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c10104530 msgr2=0x7f6c10199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c10104530 0x7f6c10199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0effd640 1 -- 172.21.15.2:0/1073974567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1019f380 con 0x7f6c10103b30 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.977+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1010d0e0 0x7f6c1019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f6c0effd640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 0x7f6c101992d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e9f0 tx=0x7f6c0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f6c1491f640 1 -- 172.21.15.2:0/1073974567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000cd80 con 0x7f6c10103b30 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1019f670 con 0x7f6c10103b30 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f6c1491f640 1 -- 172.21.15.2:0/1073974567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c000054d0 con 0x7f6c10103b30 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f6c1491f640 1 -- 172.21.15.2:0/1073974567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00010690 con 0x7f6c10103b30 2024-09-10T23:26:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.978+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c101a5d30 con 0x7f6c10103b30 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f6c1491f640 1 -- 172.21.15.2:0/1073974567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6c00004e90 con 0x7f6c10103b30 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f6c17cf6740 1 Processor -- start 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.981+0000 7f6c17cf6740 1 -- start start 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df57e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df58a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df58cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d2df4f4ea0 con 0x55d2df57ea10 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d2df4e42d0 con 0x55d2df58a9a0 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d2df4e80e0 con 0x55d2df57e0f0 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df58a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df57e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df58cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df57e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:42722/0 (socket says 172.21.15.2:42722) 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 -- 172.21.15.2:0/2006406180 learned_addr learned my addr 172.21.15.2:0/2006406180 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c1491f640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6bf80b5360 0x7f6bf80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 -- 172.21.15.2:0/2006406180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 msgr2=0x55d2df58cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df58cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 -- 172.21.15.2:0/2006406180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 msgr2=0x55d2df58a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df58a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.982+0000 7f6c0f7fe640 1 -- 172.21.15.2:0/2006406180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2df242650 con 0x55d2df57e0f0 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6c0effd640 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df58a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6bf80b5360 0x7f6bf80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6c1491f640 1 -- 172.21.15.2:0/1073974567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6c000e5f50 con 0x7f6c10103b30 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df57e4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c08010710 tx=0x7f6c08010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f111cf17cc2b64c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/2006406180 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08012be0 con 0x55d2df57e0f0 2024-09-10T23:26:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/2006406180 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c08012d80 con 0x55d2df57e0f0 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.983+0000 7f6bf5ffb640 1 -- 172.21.15.2:0/2006406180 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08011640 con 0x55d2df57e0f0 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 -- 172.21.15.2:0/2006406180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 msgr2=0x55d2df57e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6bf80b5360 0x7f6bf80b7820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c0801f000 tx=0x7f6c08022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df57e4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c08010710 tx=0x7f6c08010bd0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 -- 172.21.15.2:0/2006406180 shutdown_connections 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df58cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df58a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/2006406180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df57e4d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 -- 172.21.15.2:0/2006406180 >> 172.21.15.2:0/2006406180 conn(0x55d2df57bf20 msgr2=0x55d2df57d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 -- 172.21.15.2:0/2006406180 shutdown_connections 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 -- 172.21.15.2:0/2006406180 wait complete. 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.984+0000 7f6c17cf6740 1 -- start start 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 Processor -- start 2024-09-10T23:26:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df58a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:26:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:26:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:26:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:26:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 0x55d2df587620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df587b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d2df345700 con 0x55d2df57e0f0 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d2df47f160 con 0x55d2df58a9a0 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d2df58d620 con 0x55d2df57ea10 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c17cf6740 10 client.0 _ll_register_callbacks cb 0x55d2df4989e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df58a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c0e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 0x55d2df587620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c0e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 0x55d2df587620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:42734/0 (socket says 172.21.15.2:42734) 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c0e7fc640 1 -- 172.21.15.2:0/3252431253 learned_addr learned my addr 172.21.15.2:0/3252431253 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.985+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df587b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0effd640 1 -- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 msgr2=0x55d2df587620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0effd640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 0x55d2df587620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0effd640 1 -- 172.21.15.2:0/3252431253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 msgr2=0x55d2df587b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0effd640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df587b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0effd640 1 -- 172.21.15.2:0/3252431253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2df4acc90 con 0x55d2df57e0f0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df587b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 0x55d2df587620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c0effd640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df58a1d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6c000e3ab0 tx=0x7f6c000a8680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40fc6157eeef831 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6beeffd640 1 -- 172.21.15.2:0/3252431253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c000ac230 con 0x55d2df57e0f0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6beeffd640 1 -- 172.21.15.2:0/3252431253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6c000e96c0 con 0x55d2df57e0f0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c08012d80 con 0x55d2df57e0f0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6beeffd640 1 -- 172.21.15.2:0/3252431253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c00005680 con 0x55d2df57e0f0 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c17cf6740 10 client.16092 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.986+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2df598ec0 con 0x55d2df57e0f0 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6beeffd640 1 -- 172.21.15.2:0/3252431253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c08012d80 con 0x55d2df57e0f0 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6beeffd640 1 -- 172.21.15.2:0/3252431253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c000a8990 con 0x55d2df57e0f0 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6c17cf6740 10 client.16092 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6c17cf6740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6c17cf6740 20 client.16092 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df59a210 0x55d2df59c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6c17cf6740 4 client.16092 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.987+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2df4f6df0 con 0x55d2df59a210 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.988+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df59a210 0x55d2df59c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.989+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df59a210 0x55d2df59c660 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bd9305f308a3eeb server_cookie=27c17744fdf57506 in_seq=0 out_seq=0 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.989+0000 7f6beeffd640 10 client.16092 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6beeffd640 1 -- 172.21.15.2:0/3252431253 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2df4f6df0 con 0x55d2df59a210 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6beeffd640 10 client.16092 handle_command_reply: tid=0 2024-09-10T23:26:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 client.16092 shutdown 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 msgr2=0x55d2df58a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df58a1d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6c000e3ab0 tx=0x7f6c000a8680 comp rx=0 tx=0).stop 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 shutdown_connections 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df59a210 0x55d2df59c660 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df587b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57ea10 0x55d2df587620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/3252431253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df58a1d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6beeffd640 0 client.16092 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 >> 172.21.15.2:0/3252431253 conn(0x55d2df57bf20 msgr2=0x55d2df581ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 shutdown_connections 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 1 -- 172.21.15.2:0/3252431253 wait complete. 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:17.990+0000 7f6c17cf6740 20 client.16092 trim_cache size 0 max 16384 2024-09-10T23:26:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37a00b52e0 msgr2=0x7f37a00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37a00b52e0 0x7f37a00b77a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f37a400efd0 tx=0x7f37a4005d20 comp rx=0 tx=0).stop 2024-09-10T23:26:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 msgr2=0x7f37b41a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b41a0020 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f37ac033040 tx=0x7f37ac003b80 comp rx=0 tx=0).stop 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 shutdown_connections 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37a00b52e0 0x7f37a00b77a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37b4103370 0x7f37b41a0020 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b41029b0 0x7f37b419da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 --2- 172.21.15.2:0/101394332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4101860 0x7f37b406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 >> 172.21.15.2:0/101394332 conn(0x7f37b40fd140 msgr2=0x7f37b4105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 shutdown_connections 2024-09-10T23:26:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:17.996+0000 7f37bb9e8640 1 -- 172.21.15.2:0/101394332 wait complete. 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 Processor -- start 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 -- start start 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df5770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df584830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df584d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c101ae2a0 con 0x55d2df57ea10 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c101afde0 con 0x55d2df58a9a0 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c101ae970 con 0x55d2df57e0f0 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df584830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df584830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36342/0 (socket says 172.21.15.2:36342) 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 -- 172.21.15.2:0/1183313687 learned_addr learned my addr 172.21.15.2:0/1183313687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0effd640 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df5770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df584d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 -- 172.21.15.2:0/1183313687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 msgr2=0x55d2df5770b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df5770b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 -- 172.21.15.2:0/1183313687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 msgr2=0x55d2df584d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.004+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df584d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.005+0000 7f6c0e7fc640 1 -- 172.21.15.2:0/1183313687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2df57cc00 con 0x55d2df57ea10 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.005+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df584830 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6c04031440 tx=0x7f6c04005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be4afa7b5ff33d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.005+0000 7f6bf57fa640 1 -- 172.21.15.2:0/1183313687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04035040 con 0x55d2df57ea10 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.005+0000 7f6bf57fa640 1 -- 172.21.15.2:0/1183313687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c040054f0 con 0x55d2df57ea10 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.005+0000 7f6bf57fa640 1 -- 172.21.15.2:0/1183313687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c040035f0 con 0x55d2df57ea10 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 -- 172.21.15.2:0/1183313687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 msgr2=0x55d2df584830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df584830 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6c04031440 tx=0x7f6c04005e60 comp rx=0 tx=0).stop 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 -- 172.21.15.2:0/1183313687 shutdown_connections 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df58a9a0 0x55d2df584d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57ea10 0x55d2df584830 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/1183313687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df57e0f0 0x55d2df5770b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 -- 172.21.15.2:0/1183313687 >> 172.21.15.2:0/1183313687 conn(0x55d2df57bf20 msgr2=0x55d2df582870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 -- 172.21.15.2:0/1183313687 shutdown_connections 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 -- 172.21.15.2:0/1183313687 wait complete. 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 -- start start 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.006+0000 7f6c17cf6740 1 Processor -- start 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df5931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df57ea10 0x55d2df58e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df58a9a0 0x55d2df58ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c101af710 con 0x55d2df57e0f0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c101af040 con 0x55d2df57ea10 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c101ac260 con 0x55d2df58a9a0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c17cf6740 10 client.0 _ll_register_callbacks cb 0x7f6c000a8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df5931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df5931a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36352/0 (socket says 172.21.15.2:36352) 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 -- 172.21.15.2:0/455732669 learned_addr learned my addr 172.21.15.2:0/455732669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df57ea10 0x55d2df58e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df58a9a0 0x55d2df58ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 -- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df58a9a0 msgr2=0x55d2df58ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df58a9a0 0x55d2df58ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 -- 172.21.15.2:0/455732669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df57ea10 msgr2=0x55d2df58e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df57ea10 0x55d2df58e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 -- 172.21.15.2:0/455732669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2df6060d0 con 0x55d2df57e0f0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0f7fe640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df58a9a0 0x55d2df58ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6c0effd640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df5931a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6c000a9990 tx=0x7f6c000048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202652cb677273f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.007+0000 7f6beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6beeffd640 1 -- 172.21.15.2:0/455732669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c000abb80 con 0x55d2df57e0f0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6beeffd640 1 -- 172.21.15.2:0/455732669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6c000a8070 con 0x55d2df57e0f0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c040054f0 con 0x55d2df57e0f0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6beeffd640 1 -- 172.21.15.2:0/455732669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c000ac230 con 0x55d2df57e0f0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 10 client.16098 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2df607240 con 0x55d2df57e0f0 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6beeffd640 1 -- 172.21.15.2:0/455732669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c040054f0 con 0x55d2df57e0f0 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6beeffd640 1 -- 172.21.15.2:0/455732669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c000e9aa0 con 0x55d2df57e0f0 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 20 client.16098 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df6079f0 0x55d2df609e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 4 client.16098 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.008+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2df4f28a0 con 0x55d2df6079f0 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.009+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df6079f0 0x55d2df609e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.009+0000 7f6beeffd640 10 client.16098 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.009+0000 7f6c0e7fc640 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df6079f0 0x55d2df609e10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15dbce5ecc249c89 server_cookie=5f52aecc5d5a94fd in_seq=0 out_seq=0 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.009+0000 7f6beeffd640 1 -- 172.21.15.2:0/455732669 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2df4f28a0 con 0x55d2df6079f0 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.009+0000 7f6beeffd640 10 client.16098 handle_command_reply: tid=0 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.009+0000 7f6c17cf6740 1 client.16098 shutdown 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 msgr2=0x55d2df5931a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df5931a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6c000a9990 tx=0x7f6c000048d0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 shutdown_connections 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d2df6079f0 0x55d2df609e10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d2df58a9a0 0x55d2df58ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6beeffd640 0 client.16098 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2df57ea10 0x55d2df58e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 --2- 172.21.15.2:0/455732669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2df57e0f0 0x55d2df5931a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 >> 172.21.15.2:0/455732669 conn(0x55d2df57bf20 msgr2=0x55d2df588c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 shutdown_connections 2024-09-10T23:26:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 1 -- 172.21.15.2:0/455732669 wait complete. 2024-09-10T23:26:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c17cf6740 20 client.16098 trim_cache size 0 max 16384 2024-09-10T23:26:18.274 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6bf80b5360 msgr2=0x7f6bf80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c15921640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6bf80b5360 0x7f6bf80b7820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c0801f000 tx=0x7f6c08022000 comp rx=0 tx=0).stop 2024-09-10T23:26:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 msgr2=0x7f6c101992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.010+0000 7f6c15921640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 0x7f6c101992d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e9f0 tx=0x7f6c0000edf0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 shutdown_connections 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6bf80b5360 0x7f6bf80b7820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1010d0e0 0x7f6c1019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c10104530 0x7f6c10199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 --2- 172.21.15.2:0/1073974567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c10103b30 0x7f6c101992d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 >> 172.21.15.2:0/1073974567 conn(0x7f6c100fd700 msgr2=0x7f6c100fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 shutdown_connections 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:18.011+0000 7f6c15921640 1 -- 172.21.15.2:0/1073974567 wait complete. 2024-09-10T23:26:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:17 smithi154 ceph-mon[35136]: pgmap v410: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/600: open fd = 3 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:2/600: open fd = 3 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:3/600: open fd = 3 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.945 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:4/600: open fd = 3 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:5/600: open fd = 3 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:6/600: open fd = 3 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:7/600: open fd = 3 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:8/600: open fd = 3 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:9/600: open fd = 3 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:10/600: open fd = 3 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.947 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:11/600: open fd = 3 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:12/600: open fd = 3 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.948 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:13/600: open fd = 3 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:14/600: open fd = 3 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:15/600: open fd = 3 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:16/600: open fd = 3 2024-09-10T23:26:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:17/600: open fd = 3 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:18/600: open fd = 3 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:19/600: open fd = 3 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.950 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:20/600: open fd = 3 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:21/600: open fd = 3 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:22/600: open fd = 3 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.951 INFO:tasks.workunit.client.0.smithi002.stdout:23/600: open fd = 3 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:24/600: open fd = 3 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:25/600: open fd = 3 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:26/600: open fd = 3 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.952 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:27/600: open fd = 3 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:28/600: open fd = 3 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:29/600: open fd = 3 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.953 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:30/600: open fd = 3 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:31/600: open fd = 3 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:32/600: open fd = 3 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.954 INFO:tasks.workunit.client.0.smithi002.stdout:33/600: open fd = 3 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:34/600: open fd = 3 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:35/600: open fd = 3 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:36/600: open fd = 3 2024-09-10T23:26:18.955 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:37/600: open fd = 3 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:38/600: open fd = 3 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:39/600: open fd = 3 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.956 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:40/600: open fd = 3 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:41/600: open fd = 3 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:42/600: open fd = 3 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:43/600: open fd = 3 2024-09-10T23:26:18.957 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:44/600: open fd = 3 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:45/600: open fd = 3 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:46/600: open fd = 3 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.958 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:47/600: open fd = 3 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:48/600: open fd = 3 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:49/600: open fd = 3 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.959 INFO:tasks.workunit.client.0.smithi002.stdout:50/600: open fd = 3 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:51/600: open fd = 3 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:52/600: open fd = 3 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:53/600: open fd = 3 2024-09-10T23:26:18.960 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:54/600: open fd = 3 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:55/600: open fd = 3 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:56/600: open fd = 3 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.961 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:57/600: open fd = 3 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:58/600: open fd = 3 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:59/600: open fd = 3 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.962 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:60/600: open fd = 3 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:61/600: open fd = 3 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:62/600: open fd = 3 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:18.963 INFO:tasks.workunit.client.0.smithi002.stdout:63/600: open fd = 3 2024-09-10T23:26:18.964 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.964 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:26:18.964 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:26:19.752 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:26:19.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:26:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:20.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:19 smithi002 ceph-mon[31150]: pgmap v411: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:26:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:19 smithi177 ceph-mon[35760]: pgmap v411: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:26:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:19 smithi154 ceph-mon[35136]: pgmap v411: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 -- 172.21.15.2:0/3707676913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0588108020 msgr2=0x7f058810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 --2- 172.21.15.2:0/3707676913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0588108020 0x7f058810e820 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0580009900 tx=0x7f058002a410 comp rx=0 tx=0).stop 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 -- 172.21.15.2:0/3707676913 shutdown_connections 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 --2- 172.21.15.2:0/3707676913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0588108020 0x7f058810e820 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 --2- 172.21.15.2:0/3707676913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05881076a0 0x7f0588107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 --2- 172.21.15.2:0/3707676913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0588101c90 0x7f0588102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 -- 172.21.15.2:0/3707676913 >> 172.21.15.2:0/3707676913 conn(0x7f05880fd700 msgr2=0x7f05880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 -- 172.21.15.2:0/3707676913 shutdown_connections 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 -- 172.21.15.2:0/3707676913 wait complete. 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.510+0000 7f058cd30640 1 Processor -- start 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 -- start start 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0588101c90 0x7f05881992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 0x7f0588199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0588108020 0x7f058819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0588111ce0 con 0x7f05881076a0 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0588111b60 con 0x7f0588108020 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058cd30640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0588111e60 con 0x7f0588101c90 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 0x7f0588199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 0x7f0588199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36380/0 (socket says 172.21.15.2:36380) 2024-09-10T23:26:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 -- 172.21.15.2:0/1637848920 learned_addr learned my addr 172.21.15.2:0/1637848920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f058659c640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0588101c90 0x7f05881992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0586d9d640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0588108020 0x7f058819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 -- 172.21.15.2:0/1637848920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0588101c90 msgr2=0x7f05881992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0588101c90 0x7f05881992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 -- 172.21.15.2:0/1637848920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0588108020 msgr2=0x7f058819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0588108020 0x7f058819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 -- 172.21.15.2:0/1637848920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058819f390 con 0x7f05881076a0 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0586d9d640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0588108020 0x7f058819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.511+0000 7f0585d9b640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 0x7f0588199820 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c920 tx=0x7f057c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.512+0000 7f05777fe640 1 -- 172.21.15.2:0/1637848920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c007c70 con 0x7f05881076a0 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.512+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058819f680 con 0x7f05881076a0 2024-09-10T23:26:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.512+0000 7f05777fe640 1 -- 172.21.15.2:0/1637848920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f057c007e10 con 0x7f05881076a0 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.512+0000 7f05777fe640 1 -- 172.21.15.2:0/1637848920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c018820 con 0x7f05881076a0 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.512+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05881a5d40 con 0x7f05881076a0 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.514+0000 7f058f105740 1 Processor -- start 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.514+0000 7f05777fe640 1 -- 172.21.15.2:0/1637848920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f057c00f450 con 0x7f05881076a0 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 -- start start 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93da1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564d93d09e60 con 0x564d93d92ee0 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564d93cf9290 con 0x564d93d9f790 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058f105740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564d93cfd0a0 con 0x564d93d93800 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d932c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36390/0 (socket says 172.21.15.2:36390) 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 -- 172.21.15.2:0/2240038530 learned_addr learned my addr 172.21.15.2:0/2240038530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f058659c640 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0585d9b640 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93da1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 -- 172.21.15.2:0/2240038530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 msgr2=0x564d93d9f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 -- 172.21.15.2:0/2240038530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 msgr2=0x564d93da1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93da1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.515+0000 7f0586d9d640 1 -- 172.21.15.2:0/2240038530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d93a57930 con 0x564d93d92ee0 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f05777fe640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05700b52e0 0x7f05700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f0586d9d640 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d932c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0580033000 tx=0x7f0580031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765b0d874e400151 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f058659c640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05700b52e0 0x7f05700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f05777fe640 1 -- 172.21.15.2:0/1637848920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f057c0e5d40 con 0x7f05881076a0 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f0574ff9640 1 -- 172.21.15.2:0/2240038530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058003f070 con 0x564d93d92ee0 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f0574ff9640 1 -- 172.21.15.2:0/2240038530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05800316a0 con 0x564d93d92ee0 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.516+0000 7f0574ff9640 1 -- 172.21.15.2:0/2240038530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580035070 con 0x564d93d92ee0 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 -- 172.21.15.2:0/2240038530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 msgr2=0x564d93d932c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d932c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0580033000 tx=0x7f0580031e60 comp rx=0 tx=0).stop 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058659c640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05700b52e0 0x7f05700b77a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x564d93d96060 tx=0x7f057800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 -- 172.21.15.2:0/2240038530 shutdown_connections 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93da1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 --2- 172.21.15.2:0/2240038530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d932c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 -- 172.21.15.2:0/2240038530 >> 172.21.15.2:0/2240038530 conn(0x564d93d90d10 msgr2=0x564d93d91eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 -- 172.21.15.2:0/2240038530 shutdown_connections 2024-09-10T23:26:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 -- 172.21.15.2:0/2240038530 wait complete. 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 -- start start 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 Processor -- start 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.517+0000 7f058f105740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d9d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564d93b5a890 con 0x564d93d92ee0 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564d93c93d40 con 0x564d93d9f790 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564d93da23e0 con 0x564d93d93800 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 10 client.0 _ll_register_callbacks cb 0x564d93cf7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36400/0 (socket says 172.21.15.2:36400) 2024-09-10T23:26:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 -- 172.21.15.2:0/3605040843 learned_addr learned my addr 172.21.15.2:0/3605040843 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f0585d9b640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f0586d9d640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d9d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 -- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 msgr2=0x564d93d9cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 -- 172.21.15.2:0/3605040843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 msgr2=0x564d93d9d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d9d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 -- 172.21.15.2:0/3605040843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d93dab840 con 0x564d93d92ee0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058659c640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c7c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0578018f50 tx=0x7f0578004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8457d92bb5885c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f056dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f056dffb640 1 -- 172.21.15.2:0/3605040843 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578028060 con 0x564d93d92ee0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f056dffb640 1 -- 172.21.15.2:0/3605040843 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0578023670 con 0x564d93d92ee0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.518+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05800316a0 con 0x564d93d92ee0 2024-09-10T23:26:20.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f056dffb640 1 -- 172.21.15.2:0/3605040843 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0578023870 con 0x564d93d92ee0 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d93dae230 con 0x564d93d92ee0 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f056dffb640 1 -- 172.21.15.2:0/3605040843 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05800316a0 con 0x564d93d92ee0 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f056dffb640 1 -- 172.21.15.2:0/3605040843 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0578017470 con 0x564d93d92ee0 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 20 client.16110 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93daf740 0x564d93db1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 4 client.16110 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d93d0bdb0 con 0x564d93daf740 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.519+0000 7f0585d9b640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93daf740 0x564d93db1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.520+0000 7f0585d9b640 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93daf740 0x564d93db1ba0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64413780da427bb9 server_cookie=482d3712004171d6 in_seq=0 out_seq=0 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.520+0000 7f056dffb640 10 client.16110 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f056dffb640 1 -- 172.21.15.2:0/3605040843 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d93d0bdb0 con 0x564d93daf740 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f056dffb640 10 client.16110 handle_command_reply: tid=0 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 client.16110 shutdown 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 msgr2=0x564d93d9c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c7c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0578018f50 tx=0x7f0578004a40 comp rx=0 tx=0).stop 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 shutdown_connections 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93daf740 0x564d93db1ba0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d9d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d9cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f056dffb640 0 client.16110 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:20.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 --2- 172.21.15.2:0/3605040843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c7c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 >> 172.21.15.2:0/3605040843 conn(0x564d93d90d10 msgr2=0x564d93d8ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 shutdown_connections 2024-09-10T23:26:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 1 -- 172.21.15.2:0/3605040843 wait complete. 2024-09-10T23:26:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.521+0000 7f058f105740 20 client.16110 trim_cache size 0 max 16384 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 Processor -- start 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 -- start start 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d999d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d99f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f05881ae3a0 con 0x564d93d92ee0 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05881afee0 con 0x564d93d9f790 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058f105740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05881aea70 con 0x564d93d93800 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.539+0000 7f058659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36406/0 (socket says 172.21.15.2:36406) 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 -- 172.21.15.2:0/3080464867 learned_addr learned my addr 172.21.15.2:0/3080464867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f0586d9d640 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d99f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 -- 172.21.15.2:0/3080464867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 msgr2=0x564d93d999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 -- 172.21.15.2:0/3080464867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 msgr2=0x564d93d99f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d99f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 -- 172.21.15.2:0/3080464867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d93d90b40 con 0x564d93d92ee0 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f0586d9d640 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d99f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f058659c640 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c050 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0578000f80 tx=0x7f0578017c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8008a56d85bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f056ffff640 1 -- 172.21.15.2:0/3080464867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578033040 con 0x564d93d92ee0 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f056ffff640 1 -- 172.21.15.2:0/3080464867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f057801f040 con 0x564d93d92ee0 2024-09-10T23:26:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.540+0000 7f056ffff640 1 -- 172.21.15.2:0/3080464867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578017620 con 0x564d93d92ee0 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 -- 172.21.15.2:0/3080464867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 msgr2=0x564d93d9c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c050 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0578000f80 tx=0x7f0578017c90 comp rx=0 tx=0).stop 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 -- 172.21.15.2:0/3080464867 shutdown_connections 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d9f790 0x564d93d99f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d93800 0x564d93d999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 --2- 172.21.15.2:0/3080464867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93d9c050 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 -- 172.21.15.2:0/3080464867 >> 172.21.15.2:0/3080464867 conn(0x564d93d90d10 msgr2=0x564d93d968b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 -- 172.21.15.2:0/3080464867 shutdown_connections 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 -- 172.21.15.2:0/3080464867 wait complete. 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 -- start start 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.541+0000 7f058f105740 1 Processor -- start 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93da46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d93800 0x564d93da4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d9f790 0x564d93da5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f05881af810 con 0x564d93d92ee0 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05881af140 con 0x564d93d93800 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05881ac380 con 0x564d93d9f790 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058f105740 10 client.0 _ll_register_callbacks cb 0x7f0578009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93da46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93da46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36420/0 (socket says 172.21.15.2:36420) 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 -- 172.21.15.2:0/12746058 learned_addr learned my addr 172.21.15.2:0/12746058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f0586d9d640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d9f790 0x564d93da5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f0585d9b640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d93800 0x564d93da4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 -- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d9f790 msgr2=0x564d93da5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d9f790 0x564d93da5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 -- 172.21.15.2:0/12746058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d93800 msgr2=0x564d93da4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d93800 0x564d93da4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 -- 172.21.15.2:0/12746058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d93dabf10 con 0x564d93d92ee0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f0585d9b640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d93800 0x564d93da4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f058659c640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93da46a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f057800c010 tx=0x7f0578016fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d93e01038689cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.542+0000 7f056dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f056dffb640 1 -- 172.21.15.2:0/12746058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578033040 con 0x564d93d92ee0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f056dffb640 1 -- 172.21.15.2:0/12746058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f05780173c0 con 0x564d93d92ee0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f057801f040 con 0x564d93d92ee0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f056dffb640 1 -- 172.21.15.2:0/12746058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0578028040 con 0x564d93d92ee0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 10 client.16116 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d93e21d00 con 0x564d93d92ee0 2024-09-10T23:26:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f056dffb640 1 -- 172.21.15.2:0/12746058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f057801f040 con 0x564d93d92ee0 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f056dffb640 1 -- 172.21.15.2:0/12746058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f057802f720 con 0x564d93d92ee0 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 10 client.16116 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 20 client.16116 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93e22300 0x564d93e246f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 4 client.16116 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564d93d07860 con 0x564d93e22300 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.543+0000 7f0585d9b640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93e22300 0x564d93e246f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.544+0000 7f056dffb640 10 client.16116 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.544+0000 7f0585d9b640 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93e22300 0x564d93e246f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26f9d84b9de7d39a server_cookie=252a9b5e0bd2ac98 in_seq=0 out_seq=0 2024-09-10T23:26:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.545+0000 7f056dffb640 1 -- 172.21.15.2:0/12746058 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564d93d07860 con 0x564d93e22300 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.545+0000 7f056dffb640 10 client.16116 handle_command_reply: tid=0 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.545+0000 7f058f105740 1 client.16116 shutdown 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 msgr2=0x564d93da46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93da46a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f057800c010 tx=0x7f0578016fd0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 shutdown_connections 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564d93e22300 0x564d93e246f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564d93d9f790 0x564d93da5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564d93d93800 0x564d93da4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 --2- 172.21.15.2:0/12746058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d93d92ee0 0x564d93da46a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f056dffb640 0 client.16116 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 >> 172.21.15.2:0/12746058 conn(0x564d93d90d10 msgr2=0x564d93d8f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 shutdown_connections 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 1 -- 172.21.15.2:0/12746058 wait complete. 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.546+0000 7f058f105740 20 client.16116 trim_cache size 0 max 16384 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "0a539842-3f91-48e1-8a14-92a99f499a19", 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:26:20.554 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05700b52e0 msgr2=0x7f05700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05700b52e0 0x7f05700b77a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x564d93d96060 tx=0x7f057800d040 comp rx=0 tx=0).stop 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 msgr2=0x7f0588199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 0x7f0588199820 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c920 tx=0x7f057c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 shutdown_connections 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05700b52e0 0x7f05700b77a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0588108020 0x7f058819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05881076a0 0x7f0588199820 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 --2- 172.21.15.2:0/1637848920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0588101c90 0x7f05881992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 >> 172.21.15.2:0/1637848920 conn(0x7f05880fd700 msgr2=0x7f0588100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 shutdown_connections 2024-09-10T23:26:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:20.547+0000 7f058cd30640 1 -- 172.21.15.2:0/1637848920 wait complete. 2024-09-10T23:26:21.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:26:21.615 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:21.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:21 smithi002 ceph-mon[31150]: pgmap v412: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:26:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:26:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:26:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:26:21.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.111+0000 7f84c745e640 1 -- 172.21.15.2:0/3833962746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 msgr2=0x7f84c0115f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.111+0000 7f84c745e640 1 --2- 172.21.15.2:0/3833962746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c0115f10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009900 tx=0x7f84b802a410 comp rx=0 tx=0).stop 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.111+0000 7f84c745e640 1 -- 172.21.15.2:0/3833962746 shutdown_connections 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.111+0000 7f84c745e640 1 --2- 172.21.15.2:0/3833962746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c0115f10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.111+0000 7f84c745e640 1 --2- 172.21.15.2:0/3833962746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0075e60 0x7f84c01135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.111+0000 7f84c745e640 1 --2- 172.21.15.2:0/3833962746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84c0075540 0x7f84c0075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 -- 172.21.15.2:0/3833962746 >> 172.21.15.2:0/3833962746 conn(0x7f84c00fe830 msgr2=0x7f84c0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 -- 172.21.15.2:0/3833962746 shutdown_connections 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 -- 172.21.15.2:0/3833962746 wait complete. 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 Processor -- start 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 -- start start 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0075540 0x7f84c019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.112+0000 7f84c745e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84c0075e60 0x7f84c019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c745e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c01a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c745e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0119390 con 0x7f84c0113b20 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c745e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0119210 con 0x7f84c0075540 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c745e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0119510 con 0x7f84c0075e60 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c01a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c01a5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33356/0 (socket says 172.21.15.2:33356) 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 -- 172.21.15.2:0/1997678986 learned_addr learned my addr 172.21.15.2:0/1997678986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c51fa640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0075540 0x7f84c019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c49f9640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84c0075e60 0x7f84c019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 -- 172.21.15.2:0/1997678986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84c0075e60 msgr2=0x7f84c019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84c0075e60 0x7f84c019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 -- 172.21.15.2:0/1997678986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0075540 msgr2=0x7f84c019f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0075540 0x7f84c019f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 -- 172.21.15.2:0/1997678986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c01a59d0 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c59fb640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c01a5200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f84b8005940 tx=0x7f84b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84be7fc640 1 -- 172.21.15.2:0/1997678986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b803f030 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c01a5c60 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84be7fc640 1 -- 172.21.15.2:0/1997678986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84b8003cb0 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84be7fc640 1 -- 172.21.15.2:0/1997678986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8035070 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.113+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01ac380 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.116+0000 7f84be7fc640 1 -- 172.21.15.2:0/1997678986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f84b803bbb0 con 0x7f84c0113b20 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.116+0000 7f84c9833740 1 Processor -- start 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.116+0000 7f84c9833740 1 -- start start 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c9833740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b693860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c9833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b69f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c9833740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 0x56510b6a2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c9833740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56510b609e50 con 0x56510b69fd30 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c9833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56510b5f9280 con 0x56510b693da0 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c9833740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56510b5fd090 con 0x56510b693480 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 0x56510b6a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 0x56510b6a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33362/0 (socket says 172.21.15.2:33362) 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 -- 172.21.15.2:0/3094782167 learned_addr learned my addr 172.21.15.2:0/3094782167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b693860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c51fa640 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b69f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 -- 172.21.15.2:0/3094782167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 msgr2=0x56510b693860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b693860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 -- 172.21.15.2:0/3094782167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 msgr2=0x56510b69f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b69f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 -- 172.21.15.2:0/3094782167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510b357650 con 0x56510b69fd30 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c51fa640 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b69f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84be7fc640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84a80b52e0 0x7f84a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 0x56510b6a2120 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f84b4014950 tx=0x7f84b400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4c2b97e85736de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.117+0000 7f84c51fa640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84a80b52e0 0x7f84a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84be7fc640 1 -- 172.21.15.2:0/1997678986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f84b81067e0 con 0x7f84c0113b20 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84a77fe640 1 -- 172.21.15.2:0/3094782167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b40142d0 con 0x56510b69fd30 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84a77fe640 1 -- 172.21.15.2:0/3094782167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84b400fc10 con 0x56510b69fd30 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84a77fe640 1 -- 172.21.15.2:0/3094782167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4012a40 con 0x56510b69fd30 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84c9833740 1 -- 172.21.15.2:0/3094782167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 msgr2=0x56510b6a2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84c51fa640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84a80b52e0 0x7f84a80b77a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x56510b692190 tx=0x7f84b000a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.118+0000 7f84c9833740 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 0x56510b6a2120 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f84b4014950 tx=0x7f84b400c450 comp rx=0 tx=0).stop 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- 172.21.15.2:0/3094782167 shutdown_connections 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b69fd30 0x56510b6a2120 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b69f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 --2- 172.21.15.2:0/3094782167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b693860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- 172.21.15.2:0/3094782167 >> 172.21.15.2:0/3094782167 conn(0x56510b6912b0 msgr2=0x56510b692450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- 172.21.15.2:0/3094782167 shutdown_connections 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- 172.21.15.2:0/3094782167 wait complete. 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- start start 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 Processor -- start 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693480 0x56510b69f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b69cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b69d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56510b45a700 con 0x56510b693da0 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56510b594110 con 0x56510b693480 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.119+0000 7f84c9833740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56510b6a29b0 con 0x56510b69fd30 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c9833740 10 client.0 _ll_register_callbacks cb 0x56510b5ad990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b69cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b69cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33366/0 (socket says 172.21.15.2:33366) 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 -- 172.21.15.2:0/2330875098 learned_addr learned my addr 172.21.15.2:0/2330875098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c51fa640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693480 0x56510b69f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c59fb640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b69d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 -- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 msgr2=0x56510b69d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b69d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 -- 172.21.15.2:0/2330875098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693480 msgr2=0x56510b69f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693480 0x56510b69f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 -- 172.21.15.2:0/2330875098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510b5c1c40 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c49f9640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b69cab0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ce60 tx=0x7f84b400cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd98c7c73c7b85a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84a4ff9640 1 -- 172.21.15.2:0/2330875098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b40142d0 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b400fc10 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.120+0000 7f84a4ff9640 1 -- 172.21.15.2:0/2330875098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f84b400f760 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84a4ff9640 1 -- 172.21.15.2:0/2330875098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f84b400f960 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56510b6ae380 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84a4ff9640 1 -- 172.21.15.2:0/2330875098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84b400fc10 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84a4ff9640 1 -- 172.21.15.2:0/2330875098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f84b4027020 con 0x56510b693da0 2024-09-10T23:26:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 20 client.16128 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b6af720 0x56510b6b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 4 client.16128 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56510b60bda0 con 0x56510b6af720 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.121+0000 7f84c51fa640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b6af720 0x56510b6b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.122+0000 7f84c51fa640 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b6af720 0x56510b6b1b10 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3274bc8c5273c98 server_cookie=21afe15fbd2ba9f5 in_seq=0 out_seq=0 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.122+0000 7f84a4ff9640 10 client.16128 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.122+0000 7f84a4ff9640 1 -- 172.21.15.2:0/2330875098 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56510b60bda0 con 0x56510b6af720 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.122+0000 7f84a4ff9640 10 client.16128 handle_command_reply: tid=0 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 client.16128 shutdown 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 msgr2=0x56510b69cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b69cab0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ce60 tx=0x7f84b400cfc0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 shutdown_connections 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b6af720 0x56510b6b1b10 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b69d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84a4ff9640 0 client.16128 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b69cab0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 --2- 172.21.15.2:0/2330875098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693480 0x56510b69f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 >> 172.21.15.2:0/2330875098 conn(0x56510b6912b0 msgr2=0x56510b696e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 shutdown_connections 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 1 -- 172.21.15.2:0/2330875098 wait complete. 2024-09-10T23:26:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.123+0000 7f84c9833740 20 client.16128 trim_cache size 0 max 16384 2024-09-10T23:26:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 Processor -- start 2024-09-10T23:26:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 -- start start 2024-09-10T23:26:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 0x56510b690bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b6a1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b6a1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01b4990 con 0x56510b693480 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01b64d0 con 0x56510b693da0 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c9833740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01b5060 con 0x56510b69fd30 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c51fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 0x56510b690bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c51fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 0x56510b690bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33378/0 (socket says 172.21.15.2:33378) 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.141+0000 7f84c51fa640 1 -- 172.21.15.2:0/2977715484 learned_addr learned my addr 172.21.15.2:0/2977715484 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c59fb640 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b6a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c51fa640 1 -- 172.21.15.2:0/2977715484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 msgr2=0x56510b6a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c51fa640 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b6a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c49f9640 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b6a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c51fa640 1 -- 172.21.15.2:0/2977715484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 msgr2=0x56510b6a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c51fa640 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b6a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c51fa640 1 -- 172.21.15.2:0/2977715484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510b693bd0 con 0x56510b693480 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c59fb640 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b6a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84c51fa640 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 0x56510b690bc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x56510b6b22b0 tx=0x7f84b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add16799668e3e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84a6ffd640 1 -- 172.21.15.2:0/2977715484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b001b850 con 0x56510b693480 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84a6ffd640 1 -- 172.21.15.2:0/2977715484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84b0028460 con 0x56510b693480 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.142+0000 7f84a6ffd640 1 -- 172.21.15.2:0/2977715484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b001a5d0 con 0x56510b693480 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 -- 172.21.15.2:0/2977715484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 msgr2=0x56510b690bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 0x56510b690bc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x56510b6b22b0 tx=0x7f84b0014000 comp rx=0 tx=0).stop 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 -- 172.21.15.2:0/2977715484 shutdown_connections 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b69fd30 0x56510b6a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b693da0 0x56510b6a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 --2- 172.21.15.2:0/2977715484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693480 0x56510b690bc0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 -- 172.21.15.2:0/2977715484 >> 172.21.15.2:0/2977715484 conn(0x56510b6912b0 msgr2=0x56510b69e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 -- 172.21.15.2:0/2977715484 shutdown_connections 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 -- 172.21.15.2:0/2977715484 wait complete. 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 -- start start 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.143+0000 7f84c9833740 1 Processor -- start 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b6a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b6a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b69fd30 0x56510b698cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01b5e00 con 0x56510b693da0 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01b5730 con 0x56510b69fd30 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01b2970 con 0x56510b693480 2024-09-10T23:26:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c9833740 10 client.0 _ll_register_callbacks cb 0x7f84b400ce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b6a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b6a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33388/0 (socket says 172.21.15.2:33388) 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 -- 172.21.15.2:0/3587453087 learned_addr learned my addr 172.21.15.2:0/3587453087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c51fa640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b6a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c59fb640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b69fd30 0x56510b698cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 -- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 msgr2=0x56510b6a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b6a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 -- 172.21.15.2:0/3587453087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b69fd30 msgr2=0x56510b698cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b69fd30 0x56510b698cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 -- 172.21.15.2:0/3587453087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510b69d4a0 con 0x56510b693da0 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84c49f9640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b6a8420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f84b4005710 tx=0x7f84b4005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891d1927064a9276 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.144+0000 7f84a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84a4ff9640 1 -- 172.21.15.2:0/3587453087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b400c910 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84a4ff9640 1 -- 172.21.15.2:0/3587453087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f84b4029440 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b0028460 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84a4ff9640 1 -- 172.21.15.2:0/3587453087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f84b4029640 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 10 client.16134 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56510b69a5d0 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84a4ff9640 1 -- 172.21.15.2:0/3587453087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84b0028460 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84a4ff9640 1 -- 172.21.15.2:0/3587453087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f84b4027040 con 0x56510b693da0 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 10 client.16134 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 20 client.16134 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b71d550 0x56510b71f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 4 client.16134 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:26:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.145+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56510b607850 con 0x56510b71d550 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84c51fa640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b71d550 0x56510b71f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84c51fa640 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b71d550 0x56510b71f940 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614c8f95cd9cadc3 server_cookie=1ef2a0c59a682ca2 in_seq=0 out_seq=0 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84a4ff9640 10 client.16134 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84a4ff9640 1 -- 172.21.15.2:0/3587453087 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x56510b607850 con 0x56510b71d550 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84a4ff9640 10 client.16134 handle_command_reply: tid=0 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84c9833740 1 client.16134 shutdown 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 msgr2=0x56510b6a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.146+0000 7f84c9833740 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b6a8420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f84b4005710 tx=0x7f84b4005b90 comp rx=0 tx=0).stop 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 shutdown_connections 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56510b71d550 0x56510b71f940 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b69fd30 0x56510b698cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56510b693da0 0x56510b6a8420 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 --2- 172.21.15.2:0/3587453087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56510b693480 0x56510b6a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 >> 172.21.15.2:0/3587453087 conn(0x56510b6912b0 msgr2=0x56510b696570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84a4ff9640 0 client.16134 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 shutdown_connections 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 1 -- 172.21.15.2:0/3587453087 wait complete. 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c9833740 20 client.16134 trim_cache size 0 max 16384 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:26:22.155 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "0a539842-3f91-48e1-8a14-92a99f499a19", 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:22.157 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:22.158 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:22.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:22.159 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:26:22.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84a80b52e0 msgr2=0x7f84a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84a80b52e0 0x7f84a80b77a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x56510b692190 tx=0x7f84b000a570 comp rx=0 tx=0).stop 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 msgr2=0x7f84c01a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c01a5200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f84b8005940 tx=0x7f84b80042f0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 shutdown_connections 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f84a80b52e0 0x7f84a80b77a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c0113b20 0x7f84c01a5200 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84c0075e60 0x7f84c019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 --2- 172.21.15.2:0/1997678986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0075540 0x7f84c019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.147+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 >> 172.21.15.2:0/1997678986 conn(0x7f84c00fe830 msgr2=0x7f84c00ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.148+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 shutdown_connections 2024-09-10T23:26:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:22.148+0000 7f84c745e640 1 -- 172.21.15.2:0/1997678986 wait complete. 2024-09-10T23:26:22.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:21 smithi177 ceph-mon[35760]: pgmap v412: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:26:22.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:26:22.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:26:22.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:26:22.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:26:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:21 smithi154 ceph-mon[35136]: pgmap v412: 97 pgs: 97 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:26:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:26:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:26:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:26:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:26:22.879 INFO:tasks.cephfs.filesystem:scrub status for tag:0a539842-3f91-48e1-8a14-92a99f499a19 - {'path': '/', 'tag': '0a539842-3f91-48e1-8a14-92a99f499a19', 'options': 'recursive,force'} 2024-09-10T23:26:24.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:23 smithi177 ceph-mon[35760]: pgmap v413: 97 pgs: 97 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:26:24.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:23 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:26:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:23 smithi002 ceph-mon[31150]: pgmap v413: 97 pgs: 97 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:26:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:23 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:26:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:23 smithi154 ceph-mon[35136]: pgmap v413: 97 pgs: 97 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:26:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:23 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:26:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:25 smithi177 ceph-mon[35760]: pgmap v414: 97 pgs: 97 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:26:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:25 smithi002 ceph-mon[31150]: pgmap v414: 97 pgs: 97 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:26:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:25 smithi154 ceph-mon[35136]: pgmap v414: 97 pgs: 97 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:26:28.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:27 smithi177 ceph-mon[35760]: pgmap v415: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:26:28.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:27 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:26:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:27 smithi002 ceph-mon[31150]: pgmap v415: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:26:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:27 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:26:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:27 smithi154 ceph-mon[35136]: pgmap v415: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:26:28.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:27 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:26:29.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:29.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:29.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:26:29.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:29.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:29.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:26:29.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:29.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:29.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:26:30.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:29 smithi177 ceph-mon[35760]: pgmap v416: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:29 smithi002 ceph-mon[31150]: pgmap v416: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:29 smithi154 ceph-mon[35136]: pgmap v416: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 -- 172.21.15.2:0/651550790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1033c0 msgr2=0x7fe6bc109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/651550790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1033c0 0x7fe6bc109d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009cd0 tx=0x7fe6b402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 -- 172.21.15.2:0/651550790 shutdown_connections 2024-09-10T23:26:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/651550790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1033c0 0x7fe6bc109d40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/651550790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6bc102a00 0x7fe6bc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/651550790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6bc1018b0 0x7fe6bc101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 -- 172.21.15.2:0/651550790 >> 172.21.15.2:0/651550790 conn(0x7fe6bc0fd150 msgr2=0x7fe6bc0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 -- 172.21.15.2:0/651550790 shutdown_connections 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.098+0000 7fe6c23bc640 1 -- 172.21.15.2:0/651550790 wait complete. 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 Processor -- start 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 -- start start 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6bc1018b0 0x7fe6bc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 0x7fe6bc1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6bc1033c0 0x7fe6bc199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc10e650 con 0x7fe6bc102a00 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc10e4d0 con 0x7fe6bc1018b0 2024-09-10T23:26:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6c23bc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc10e7d0 con 0x7fe6bc1033c0 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.099+0000 7fe6bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 0x7fe6bc1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 0x7fe6bc1993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59964/0 (socket says 172.21.15.2:59964) 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/2068617501 learned_addr learned my addr 172.21.15.2:0/2068617501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6bc1018b0 0x7fe6bc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6c0959640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6bc1033c0 0x7fe6bc199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/2068617501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6bc1033c0 msgr2=0x7fe6bc199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6bc1033c0 0x7fe6bc199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/2068617501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6bc1018b0 msgr2=0x7fe6bc198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6bc1018b0 0x7fe6bc198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/2068617501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc19a890 con 0x7fe6bc102a00 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 0x7fe6bc1993a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000d770 tx=0x7fe6b000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6b97fa640 1 -- 172.21.15.2:0/2068617501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0017070 con 0x7fe6bc102a00 2024-09-10T23:26:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6b97fa640 1 -- 172.21.15.2:0/2068617501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b0009820 con 0x7fe6bc102a00 2024-09-10T23:26:31.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6b97fa640 1 -- 172.21.15.2:0/2068617501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0004bc0 con 0x7fe6bc102a00 2024-09-10T23:26:31.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc19ab80 con 0x7fe6bc102a00 2024-09-10T23:26:31.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.100+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1a1250 con 0x7fe6bc102a00 2024-09-10T23:26:31.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6b97fa640 1 -- 172.21.15.2:0/2068617501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe6b0005220 con 0x7fe6bc102a00 2024-09-10T23:26:31.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 Processor -- start 2024-09-10T23:26:31.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 -- start start 2024-09-10T23:26:31.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 0x5646b2dbac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dbd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5646b2d2a6f0 con 0x5646b2db8860 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5646b2d19b20 con 0x5646b2dbb190 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c5264740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5646b2d1d930 con 0x5646b2dbdbd0 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c0959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 0x5646b2dbac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c0959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 0x5646b2dbac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59974/0 (socket says 172.21.15.2:59974) 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.103+0000 7fe6c0959640 1 -- 172.21.15.2:0/3609248223 learned_addr learned my addr 172.21.15.2:0/3609248223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dbd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6c0959640 1 -- 172.21.15.2:0/3609248223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 msgr2=0x5646b2dc0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6c0959640 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6c0959640 1 -- 172.21.15.2:0/3609248223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 msgr2=0x5646b2dbd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6c0959640 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dbd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6c0959640 1 -- 172.21.15.2:0/3609248223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646b2cdf530 con 0x5646b2db8860 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6b97fa640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6a40b52e0 0x7fe6a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6a40b52e0 0x7fe6a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6c0959640 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 0x5646b2dbac50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009cd0 tx=0x7fe6b4031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d6824ff6b35fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6b97fa640 1 -- 172.21.15.2:0/2068617501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe6b00e5620 con 0x7fe6bc102a00 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6a27fc640 1 -- 172.21.15.2:0/3609248223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4031950 con 0x5646b2db8860 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6a27fc640 1 -- 172.21.15.2:0/3609248223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b4036040 con 0x5646b2db8860 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.104+0000 7fe6a27fc640 1 -- 172.21.15.2:0/3609248223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40046a0 con 0x5646b2db8860 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 -- 172.21.15.2:0/3609248223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 msgr2=0x5646b2dbac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 0x5646b2dbac50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009cd0 tx=0x7fe6b4031430 comp rx=0 tx=0).stop 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6a40b52e0 0x7fe6a40b77a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00ac80 tx=0x7fe6ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 -- 172.21.15.2:0/3609248223 shutdown_connections 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dbd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 --2- 172.21.15.2:0/3609248223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2db8860 0x5646b2dbac50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 -- 172.21.15.2:0/3609248223 >> 172.21.15.2:0/3609248223 conn(0x5646b2db39b0 msgr2=0x5646b2db4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 -- 172.21.15.2:0/3609248223 shutdown_connections 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 -- 172.21.15.2:0/3609248223 wait complete. 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.105+0000 7fe6c5264740 1 -- start start 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 Processor -- start 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5646b2c51ab0 con 0x5646b2dbb190 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5646b2cbf730 con 0x5646b2db8860 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5646b2dc0af0 con 0x5646b2dbdbd0 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6c5264740 10 client.0 _ll_register_callbacks cb 0x5646b2d136b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59990/0 (socket says 172.21.15.2:59990) 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/188304908 learned_addr learned my addr 172.21.15.2:0/188304908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.106+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 msgr2=0x5646b2dc3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6c0959640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/188304908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 msgr2=0x5646b2dc1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/188304908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646b2a7b790 con 0x5646b2dbb190 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6c0959640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc25a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00abd80 tx=0x7fe6b00abc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f3d13fbe932f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe69b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe69b7fe640 1 -- 172.21.15.2:0/188304908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00af060 con 0x5646b2dbb190 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe69b7fe640 1 -- 172.21.15.2:0/188304908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe6b00a8060 con 0x5646b2dbb190 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b4036040 con 0x5646b2dbb190 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe69b7fe640 1 -- 172.21.15.2:0/188304908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6b0020050 con 0x5646b2dbb190 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6c5264740 10 client.16146 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:31.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646b2af4620 con 0x5646b2dbb190 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe69b7fe640 1 -- 172.21.15.2:0/188304908 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b4036040 con 0x5646b2dbb190 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.107+0000 7fe69b7fe640 1 -- 172.21.15.2:0/188304908 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6b00930e0 con 0x5646b2dbb190 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6c5264740 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6c5264740 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6c5264740 20 client.16146 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6c5264740 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2dcd850 0x5646b2dcfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6c5264740 4 client.16146 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646b2d2c640 con 0x5646b2dcd850 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2dcd850 0x5646b2dcfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe69b7fe640 10 client.16146 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.108+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2dcd850 0x5646b2dcfc60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c3b1523a5190ff server_cookie=f4f7877c79e5ace6 in_seq=0 out_seq=0 2024-09-10T23:26:31.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe69b7fe640 1 -- 172.21.15.2:0/188304908 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646b2d2c640 con 0x5646b2dcd850 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe69b7fe640 10 client.16146 handle_command_reply: tid=0 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 client.16146 shutdown 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 msgr2=0x5646b2dc25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc25a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00abd80 tx=0x7fe6b00abc80 comp rx=0 tx=0).stop 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 shutdown_connections 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2dcd850 0x5646b2dcfc60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc25a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 --2- 172.21.15.2:0/188304908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe69b7fe640 0 client.16146 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 >> 172.21.15.2:0/188304908 conn(0x5646b2db39b0 msgr2=0x5646b2db2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 shutdown_connections 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.109+0000 7fe6c5264740 1 -- 172.21.15.2:0/188304908 wait complete. 2024-09-10T23:26:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.110+0000 7fe6c5264740 20 client.16146 trim_cache size 0 max 16384 2024-09-10T23:26:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 Processor -- start 2024-09-10T23:26:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 -- start start 2024-09-10T23:26:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2db8860 0x5646b2dc3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dc3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 0x5646b2db4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1a9d60 con 0x5646b2dbdbd0 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1ab8a0 con 0x5646b2dbb190 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.124+0000 7fe6c5264740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1aa430 con 0x5646b2db8860 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 0x5646b2db4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 0x5646b2db4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59992/0 (socket says 172.21.15.2:59992) 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 -- 172.21.15.2:0/1889352237 learned_addr learned my addr 172.21.15.2:0/1889352237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2db8860 0x5646b2dc3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dc3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 -- 172.21.15.2:0/1889352237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2db8860 msgr2=0x5646b2dc3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2db8860 0x5646b2dc3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 -- 172.21.15.2:0/1889352237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 msgr2=0x5646b2dc3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dc3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 -- 172.21.15.2:0/1889352237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646b2dd02e0 con 0x5646b2dbdbd0 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2db8860 0x5646b2dc3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6c0959640 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 0x5646b2db4210 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009a60 tx=0x7fe6b4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f6649e26b9471e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6a1ffb640 1 -- 172.21.15.2:0/1889352237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4051070 con 0x5646b2dbdbd0 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6a1ffb640 1 -- 172.21.15.2:0/1889352237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b4036040 con 0x5646b2dbdbd0 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.125+0000 7fe6a1ffb640 1 -- 172.21.15.2:0/1889352237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40044c0 con 0x5646b2dbdbd0 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 -- 172.21.15.2:0/1889352237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 msgr2=0x5646b2db4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 0x5646b2db4210 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009a60 tx=0x7fe6b4000f40 comp rx=0 tx=0).stop 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 -- 172.21.15.2:0/1889352237 shutdown_connections 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbdbd0 0x5646b2db4210 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2dbb190 0x5646b2dc3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 --2- 172.21.15.2:0/1889352237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2db8860 0x5646b2dc3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 -- 172.21.15.2:0/1889352237 >> 172.21.15.2:0/1889352237 conn(0x5646b2db39b0 msgr2=0x5646b2db7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 -- 172.21.15.2:0/1889352237 shutdown_connections 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 -- 172.21.15.2:0/1889352237 wait complete. 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.126+0000 7fe6c5264740 1 -- start start 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 Processor -- start 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1ab1d0 con 0x5646b2dbb190 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1aab00 con 0x5646b2db8860 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1a7d40 con 0x5646b2dbdbd0 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c5264740 10 client.0 _ll_register_callbacks cb 0x7fe6b00a7c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60004/0 (socket says 172.21.15.2:60004) 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/786311996 learned_addr learned my addr 172.21.15.2:0/786311996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6c0959640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 msgr2=0x5646b2dc8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/786311996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 msgr2=0x5646b2dc96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 -- 172.21.15.2:0/786311996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646b2dc8e90 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe6bb7fe640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc8410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe6b001d040 tx=0x7fe6b00a8270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c73d441df324f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.127+0000 7fe69b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe69b7fe640 1 -- 172.21.15.2:0/786311996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00af070 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe69b7fe640 1 -- 172.21.15.2:0/786311996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe6b00ab250 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b4036040 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe69b7fe640 1 -- 172.21.15.2:0/786311996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6b00a8440 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 10 client.16152 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646b2dc7f60 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe69b7fe640 1 -- 172.21.15.2:0/786311996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b4036040 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe69b7fe640 1 -- 172.21.15.2:0/786311996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6b00e50d0 con 0x5646b2dbb190 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 10 client.16152 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 10 client.16152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 20 client.16152 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2e3af10 0x5646b2e3d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 4 client.16152 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5646b2d280f0 con 0x5646b2e3af10 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.128+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2e3af10 0x5646b2e3d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.129+0000 7fe69b7fe640 10 client.16152 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.129+0000 7fe6bbfff640 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2e3af10 0x5646b2e3d330 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ccdec8953916d81 server_cookie=3b14af13a99297af in_seq=0 out_seq=0 2024-09-10T23:26:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe69b7fe640 1 -- 172.21.15.2:0/786311996 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5646b2d280f0 con 0x5646b2e3af10 2024-09-10T23:26:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe69b7fe640 10 client.16152 handle_command_reply: tid=0 2024-09-10T23:26:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 client.16152 shutdown 2024-09-10T23:26:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 msgr2=0x5646b2dc8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc8410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe6b001d040 tx=0x7fe6b00a8270 comp rx=0 tx=0).stop 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 shutdown_connections 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5646b2e3af10 0x5646b2e3d330 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5646b2dbdbd0 0x5646b2dc8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe69b7fe640 0 client.16152 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646b2dbb190 0x5646b2dc8410 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 --2- 172.21.15.2:0/786311996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646b2db8860 0x5646b2dc96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 >> 172.21.15.2:0/786311996 conn(0x5646b2db39b0 msgr2=0x5646b2dbdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 shutdown_connections 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.142+0000 7fe6c5264740 1 -- 172.21.15.2:0/786311996 wait complete. 2024-09-10T23:26:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c5264740 20 client.16152 trim_cache size 0 max 16384 2024-09-10T23:26:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:26:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:26:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:26:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6a40b52e0 msgr2=0x7fe6a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6a40b52e0 0x7fe6a40b77a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00ac80 tx=0x7fe6ac00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 msgr2=0x7fe6bc1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 0x7fe6bc1993a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000d770 tx=0x7fe6b000db70 comp rx=0 tx=0).stop 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 shutdown_connections 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6a40b52e0 0x7fe6a40b77a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6bc1033c0 0x7fe6bc199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102a00 0x7fe6bc1993a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 --2- 172.21.15.2:0/2068617501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6bc1018b0 0x7fe6bc198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 >> 172.21.15.2:0/2068617501 conn(0x7fe6bc0fd150 msgr2=0x7fe6bc105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 shutdown_connections 2024-09-10T23:26:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:31.143+0000 7fe6c23bc640 1 -- 172.21.15.2:0/2068617501 wait complete. 2024-09-10T23:26:32.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:31 smithi177 ceph-mon[35760]: pgmap v417: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:31 smithi002 ceph-mon[31150]: pgmap v417: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:31 smithi154 ceph-mon[35136]: pgmap v417: 97 pgs: 97 active+clean; 1.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:26:34.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:33 smithi177 ceph-mon[35760]: pgmap v418: 97 pgs: 97 active+clean; 1.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:33 smithi002 ceph-mon[31150]: pgmap v418: 97 pgs: 97 active+clean; 1.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:33 smithi154 ceph-mon[35136]: pgmap v418: 97 pgs: 97 active+clean; 1.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:36.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:35 smithi177 ceph-mon[35760]: pgmap v419: 97 pgs: 97 active+clean; 1.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:26:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:35 smithi002 ceph-mon[31150]: pgmap v419: 97 pgs: 97 active+clean; 1.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:26:36.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:35 smithi154 ceph-mon[35136]: pgmap v419: 97 pgs: 97 active+clean; 1.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:26:38.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:37 smithi177 ceph-mon[35760]: pgmap v420: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:37 smithi002 ceph-mon[31150]: pgmap v420: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:38.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:37 smithi154 ceph-mon[35136]: pgmap v420: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:39 smithi177 ceph-mon[35760]: pgmap v421: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:40.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:39 smithi002 ceph-mon[31150]: pgmap v421: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:40.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:39 smithi154 ceph-mon[35136]: pgmap v421: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:41 smithi177 ceph-mon[35760]: pgmap v422: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:42.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:41 smithi002 ceph-mon[31150]: pgmap v422: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:42.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:41 smithi154 ceph-mon[35136]: pgmap v422: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:26:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:43 smithi177 ceph-mon[35760]: pgmap v423: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:44.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:43 smithi002 ceph-mon[31150]: pgmap v423: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.243+0000 7f5dbd552640 1 -- 172.21.15.2:0/962801305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db8103b00 msgr2=0x7f5db8103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.243+0000 7f5dbd552640 1 --2- 172.21.15.2:0/962801305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db8103b00 0x7f5db8103f80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009930 tx=0x7f5dac02a420 comp rx=0 tx=0).stop 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 -- 172.21.15.2:0/962801305 shutdown_connections 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 --2- 172.21.15.2:0/962801305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 0x7f5db810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 --2- 172.21.15.2:0/962801305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db8103b00 0x7f5db8103f80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 --2- 172.21.15.2:0/962801305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5db81029b0 0x7f5db8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 -- 172.21.15.2:0/962801305 >> 172.21.15.2:0/962801305 conn(0x7f5db80fe270 msgr2=0x7f5db8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 -- 172.21.15.2:0/962801305 shutdown_connections 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 -- 172.21.15.2:0/962801305 wait complete. 2024-09-10T23:26:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 Processor -- start 2024-09-10T23:26:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.244+0000 7f5dbd552640 1 -- start start 2024-09-10T23:26:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5dbd552640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 0x7f5db8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5dbd552640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5db8103b00 0x7f5db8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5dbd552640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 0x7f5db819a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5dbd552640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5db810e600 con 0x7f5db81029b0 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5dbd552640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5db810e480 con 0x7f5db8103b00 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5dbd552640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5db810e780 con 0x7f5db81044c0 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 0x7f5db8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 0x7f5db8198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45126/0 (socket says 172.21.15.2:45126) 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 -- 172.21.15.2:0/1179053039 learned_addr learned my addr 172.21.15.2:0/1179053039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db77fe640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 0x7f5db819a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db67fc640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5db8103b00 0x7f5db8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 -- 172.21.15.2:0/1179053039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 msgr2=0x7f5db819a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 0x7f5db819a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 -- 172.21.15.2:0/1179053039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5db8103b00 msgr2=0x7f5db8199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5db8103b00 0x7f5db8199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 -- 172.21.15.2:0/1179053039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db819a920 con 0x7f5db81029b0 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db77fe640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 0x7f5db819a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.245+0000 7f5db6ffd640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 0x7f5db8198de0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5da800d950 tx=0x7f5da800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.246+0000 7f5d9ffff640 1 -- 172.21.15.2:0/1179053039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8017070 con 0x7f5db81029b0 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.246+0000 7f5d9ffff640 1 -- 172.21.15.2:0/1179053039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5da8009c30 con 0x7f5db81029b0 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.246+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db819ac10 con 0x7f5db81029b0 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.246+0000 7f5d9ffff640 1 -- 172.21.15.2:0/1179053039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da800f620 con 0x7f5db81029b0 2024-09-10T23:26:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.246+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db81a12e0 con 0x7f5db81029b0 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.248+0000 7f5dc03fe740 1 Processor -- start 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.248+0000 7f5d9ffff640 1 -- 172.21.15.2:0/1179053039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5da8010460 con 0x7f5db81029b0 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.248+0000 7f5dc03fe740 1 -- start start 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd115060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd117990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562bbd0806f0 con 0x562bbd1155a0 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bbd06fb20 con 0x562bbd112c70 2024-09-10T23:26:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562bbd073930 con 0x562bbd117fe0 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd117990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd117990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45140/0 (socket says 172.21.15.2:45140) 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd115060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db6ffd640 1 -- 172.21.15.2:0/2760182220 learned_addr learned my addr 172.21.15.2:0/2760182220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db67fc640 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 -- 172.21.15.2:0/2760182220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 msgr2=0x562bbd11a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 -- 172.21.15.2:0/2760182220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 msgr2=0x562bbd117990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd117990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 -- 172.21.15.2:0/2760182220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bbd035530 con 0x562bbd112c70 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db6ffd640 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd117990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5d9ffff640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5da00b52e0 0x7f5da00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.249+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd115060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5db0005fd0 tx=0x7f5db000f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3132522c78993c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5db6ffd640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5da00b52e0 0x7f5da00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5d9d7fa640 1 -- 172.21.15.2:0/2760182220 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0015070 con 0x562bbd112c70 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5d9d7fa640 1 -- 172.21.15.2:0/2760182220 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5db001ab10 con 0x562bbd112c70 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5d9d7fa640 1 -- 172.21.15.2:0/2760182220 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0011b80 con 0x562bbd112c70 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5d9ffff640 1 -- 172.21.15.2:0/1179053039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5da80e5910 con 0x7f5db81029b0 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2760182220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 msgr2=0x562bbd115060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5db6ffd640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5da00b52e0 0x7f5da00b77a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5da8063a80 tx=0x7f5da80b5040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd115060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5db0005fd0 tx=0x7f5db000f7f0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2760182220 shutdown_connections 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd117990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2760182220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd115060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2760182220 >> 172.21.15.2:0/2760182220 conn(0x562bbd1099b0 msgr2=0x562bbd10a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2760182220 shutdown_connections 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.250+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2760182220 wait complete. 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 -- start start 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 Processor -- start 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd11c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd11c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562bbcfa7ab0 con 0x562bbd1155a0 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bbd015730 con 0x562bbd112c70 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562bbd11afc0 con 0x562bbd117fe0 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5dc03fe740 10 client.0 _ll_register_callbacks cb 0x562bbd0696b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5db67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd11c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5db67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd11c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45142/0 (socket says 172.21.15.2:45142) 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5db67fc640 1 -- 172.21.15.2:0/2943909814 learned_addr learned my addr 172.21.15.2:0/2943909814 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd11c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.251+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db67fc640 1 -- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 msgr2=0x562bbd11d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db67fc640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db67fc640 1 -- 172.21.15.2:0/2943909814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 msgr2=0x562bbd11c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db67fc640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd11c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db67fc640 1 -- 172.21.15.2:0/2943909814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bbcdd1790 con 0x562bbd1155a0 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd11c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5db67fc640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd11c980 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5dac02a940 tx=0x7f5dac031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728489c06ccf10db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5d9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5d9aff5640 1 -- 172.21.15.2:0/2943909814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac035070 con 0x562bbd1155a0 2024-09-10T23:26:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5db001ab10 con 0x562bbd1155a0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5d9aff5640 1 -- 172.21.15.2:0/2943909814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5dac004240 con 0x562bbd1155a0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5d9aff5640 1 -- 172.21.15.2:0/2943909814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5dac004440 con 0x562bbd1155a0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5dc03fe740 10 client.16164 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562bbce4a620 con 0x562bbd1155a0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.252+0000 7f5d9aff5640 1 -- 172.21.15.2:0/2943909814 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5db001ab10 con 0x562bbd1155a0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5d9aff5640 1 -- 172.21.15.2:0/2943909814 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5dac004c00 con 0x562bbd1155a0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5dc03fe740 10 client.16164 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5dc03fe740 10 client.16164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5dc03fe740 20 client.16164 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd127c10 0x562bbd12a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5dc03fe740 4 client.16164 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bbd082640 con 0x562bbd127c10 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd127c10 0x562bbd12a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5db77fe640 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd127c10 0x562bbd12a050 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36911093016abec3 server_cookie=2ed1cf75e5d00d6f in_seq=0 out_seq=0 2024-09-10T23:26:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.253+0000 7f5d9aff5640 10 client.16164 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5d9aff5640 1 -- 172.21.15.2:0/2943909814 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bbd082640 con 0x562bbd127c10 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5d9aff5640 10 client.16164 handle_command_reply: tid=0 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 client.16164 shutdown 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 msgr2=0x562bbd11c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd11c980 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5dac02a940 tx=0x7f5dac031850 comp rx=0 tx=0).stop 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 shutdown_connections 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd127c10 0x562bbd12a050 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd11d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd1155a0 0x562bbd11c980 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5d9aff5640 0 client.16164 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/2943909814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd112c70 0x562bbd11c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 >> 172.21.15.2:0/2943909814 conn(0x562bbd1099b0 msgr2=0x562bbd108bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 shutdown_connections 2024-09-10T23:26:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.254+0000 7f5dc03fe740 1 -- 172.21.15.2:0/2943909814 wait complete. 2024-09-10T23:26:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.255+0000 7f5dc03fe740 20 client.16164 trim_cache size 0 max 16384 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.269+0000 7f5dc03fe740 1 Processor -- start 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.269+0000 7f5dc03fe740 1 -- start start 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd1183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd1155a0 0x562bbd118900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd117fe0 0x562bbd11c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81a7cc0 con 0x562bbd112c70 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81a9800 con 0x562bbd117fe0 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81a8390 con 0x562bbd1155a0 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd1183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd1183c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45146/0 (socket says 172.21.15.2:45146) 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 -- 172.21.15.2:0/3169144197 learned_addr learned my addr 172.21.15.2:0/3169144197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db67fc640 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd1155a0 0x562bbd118900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 -- 172.21.15.2:0/3169144197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd1155a0 msgr2=0x562bbd118900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd1155a0 0x562bbd118900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 -- 172.21.15.2:0/3169144197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd117fe0 msgr2=0x562bbd11c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd117fe0 0x562bbd11c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 -- 172.21.15.2:0/3169144197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bbd10ac10 con 0x562bbd112c70 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd1183c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5db001c010 tx=0x7f5db00098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dda350faa3f329 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5d9cff9640 1 -- 172.21.15.2:0/3169144197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0015040 con 0x562bbd112c70 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5d9cff9640 1 -- 172.21.15.2:0/3169144197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5db0022050 con 0x562bbd112c70 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.270+0000 7f5d9cff9640 1 -- 172.21.15.2:0/3169144197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00119b0 con 0x562bbd112c70 2024-09-10T23:26:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3169144197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 msgr2=0x562bbd1183c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd1183c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5db001c010 tx=0x7f5db00098a0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3169144197 shutdown_connections 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd117fe0 0x562bbd11c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd1155a0 0x562bbd118900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3169144197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd1183c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3169144197 >> 172.21.15.2:0/3169144197 conn(0x562bbd1099b0 msgr2=0x562bbd10dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3169144197 shutdown_connections 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3169144197 wait complete. 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 -- start start 2024-09-10T23:26:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.271+0000 7f5dc03fe740 1 Processor -- start 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd123940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd1155a0 0x562bbd123fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd1226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81a9130 con 0x562bbd112c70 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81a8a60 con 0x562bbd1155a0 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81a5ca0 con 0x562bbd117fe0 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5dc03fe740 10 client.0 _ll_register_callbacks cb 0x7f5dac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd123940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd123940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45162/0 (socket says 172.21.15.2:45162) 2024-09-10T23:26:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 -- 172.21.15.2:0/3747458421 learned_addr learned my addr 172.21.15.2:0/3747458421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db67fc640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd1155a0 0x562bbd123fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd1226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 -- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 msgr2=0x562bbd1226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd1226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 -- 172.21.15.2:0/3747458421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd1155a0 msgr2=0x562bbd123fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd1155a0 0x562bbd123fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 -- 172.21.15.2:0/3747458421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bbd122f10 con 0x562bbd112c70 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5db77fe640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd123940 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5db0005d70 tx=0x7f5db0004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa14f3eb62e2c03a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.272+0000 7f5d9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5d9aff5640 1 -- 172.21.15.2:0/3747458421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0015070 con 0x562bbd112c70 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5db0022050 con 0x562bbd112c70 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5d9aff5640 1 -- 172.21.15.2:0/3747458421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5db001a460 con 0x562bbd112c70 2024-09-10T23:26:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5d9aff5640 1 -- 172.21.15.2:0/3747458421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5db0043050 con 0x562bbd112c70 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562bbd121d80 con 0x562bbd112c70 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5d9aff5640 1 -- 172.21.15.2:0/3747458421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5db0022050 con 0x562bbd112c70 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5d9aff5640 1 -- 172.21.15.2:0/3747458421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5db002e070 con 0x562bbd112c70 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 10 client.16170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 20 client.16170 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd194eb0 0x562bbd1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 4 client.16170 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.273+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562bbd07e0f0 con 0x562bbd194eb0 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.274+0000 7f5db67fc640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd194eb0 0x562bbd1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.274+0000 7f5db67fc640 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd194eb0 0x562bbd1972d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3858111f5a6eea9 server_cookie=38ae5aa71aca66b6 in_seq=0 out_seq=0 2024-09-10T23:26:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.274+0000 7f5d9aff5640 10 client.16170 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:44.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:43 smithi154 ceph-mon[35136]: pgmap v423: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:26:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5d9aff5640 1 -- 172.21.15.2:0/3747458421 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562bbd07e0f0 con 0x562bbd194eb0 2024-09-10T23:26:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5d9aff5640 10 client.16170 handle_command_reply: tid=0 2024-09-10T23:26:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 client.16170 shutdown 2024-09-10T23:26:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 msgr2=0x562bbd123940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd123940 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5db0005d70 tx=0x7f5db0004bf0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 shutdown_connections 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562bbd194eb0 0x562bbd1972d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bbd117fe0 0x562bbd1226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bbd1155a0 0x562bbd123fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5d9aff5640 0 client.16170 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 --2- 172.21.15.2:0/3747458421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562bbd112c70 0x562bbd123940 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 >> 172.21.15.2:0/3747458421 conn(0x562bbd1099b0 msgr2=0x562bbd1183c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 shutdown_connections 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 1 -- 172.21.15.2:0/3747458421 wait complete. 2024-09-10T23:26:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.288+0000 7f5dc03fe740 20 client.16170 trim_cache size 0 max 16384 2024-09-10T23:26:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:26:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:26:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:26:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:26:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5da00b52e0 msgr2=0x7f5da00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5da00b52e0 0x7f5da00b77a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5da8063a80 tx=0x7f5da80b5040 comp rx=0 tx=0).stop 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 msgr2=0x7f5db8198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 0x7f5db8198de0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5da800d950 tx=0x7f5da800de10 comp rx=0 tx=0).stop 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 shutdown_connections 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5da00b52e0 0x7f5da00b77a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db81044c0 0x7f5db819a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5db8103b00 0x7f5db8199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 --2- 172.21.15.2:0/1179053039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5db81029b0 0x7f5db8198de0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 >> 172.21.15.2:0/1179053039 conn(0x7f5db80fe270 msgr2=0x7f5db8106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 shutdown_connections 2024-09-10T23:26:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:44.289+0000 7f5dbd552640 1 -- 172.21.15.2:0/1179053039 wait complete. 2024-09-10T23:26:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:45 smithi177 ceph-mon[35760]: pgmap v424: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:46.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:45 smithi002 ceph-mon[31150]: pgmap v424: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:46.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:45 smithi154 ceph-mon[35136]: pgmap v424: 97 pgs: 97 active+clean; 1.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:47 smithi177 ceph-mon[35760]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:26:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:47 smithi002 ceph-mon[31150]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:26:48.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:47 smithi154 ceph-mon[35136]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:26:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:49 smithi177 ceph-mon[35760]: pgmap v426: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:50.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:49 smithi002 ceph-mon[31150]: pgmap v426: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:50.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:49 smithi154 ceph-mon[35136]: pgmap v426: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:51 smithi177 ceph-mon[35760]: pgmap v427: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:51 smithi002 ceph-mon[31150]: pgmap v427: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:51 smithi154 ceph-mon[35136]: pgmap v427: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:26:52.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:26:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 -- 172.21.15.2:0/1677986966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1087d0 msgr2=0x7fa07c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 --2- 172.21.15.2:0/1677986966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1087d0 0x7fa07c108c10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009900 tx=0x7fa06c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 -- 172.21.15.2:0/1677986966 shutdown_connections 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 --2- 172.21.15.2:0/1677986966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c109150 0x7fa07c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 --2- 172.21.15.2:0/1677986966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1087d0 0x7fa07c108c10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 --2- 172.21.15.2:0/1677986966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa07c102dc0 0x7fa07c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 -- 172.21.15.2:0/1677986966 >> 172.21.15.2:0/1677986966 conn(0x7fa07c0fe830 msgr2=0x7fa07c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 -- 172.21.15.2:0/1677986966 shutdown_connections 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 -- 172.21.15.2:0/1677986966 wait complete. 2024-09-10T23:26:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 Processor -- start 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.700+0000 7fa083550640 1 -- start start 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa083550640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa07c102dc0 0x7fa07c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa083550640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c1087d0 0x7fa07c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa083550640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 0x7fa07c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa083550640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c112da0 con 0x7fa07c109150 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa083550640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c112c20 con 0x7fa07c1087d0 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa083550640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c112f20 con 0x7fa07c102dc0 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 0x7fa07c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 0x7fa07c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53046/0 (socket says 172.21.15.2:53046) 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 -- 172.21.15.2:0/3232009614 learned_addr learned my addr 172.21.15.2:0/3232009614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa080aeb640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c1087d0 0x7fa07c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa0812ec640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa07c102dc0 0x7fa07c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 -- 172.21.15.2:0/3232009614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa07c102dc0 msgr2=0x7fa07c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa07c102dc0 0x7fa07c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 -- 172.21.15.2:0/3232009614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c1087d0 msgr2=0x7fa07c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c1087d0 0x7fa07c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 -- 172.21.15.2:0/3232009614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c1a7670 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa081aed640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 0x7fa07c075f20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa07400eaa0 tx=0x7fa07400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.701+0000 7fa0727fc640 1 -- 172.21.15.2:0/3232009614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07400cdb0 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.702+0000 7fa0727fc640 1 -- 172.21.15.2:0/3232009614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa074005020 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.702+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c1a7960 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.702+0000 7fa0727fc640 1 -- 172.21.15.2:0/3232009614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0740116d0 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.702+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c1a7e70 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.704+0000 7fa085925740 1 Processor -- start 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa0727fc640 1 -- 172.21.15.2:0/3232009614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa07400f040 con 0x7fa07c109150 2024-09-10T23:26:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 -- start start 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b932480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b93e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b940d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55853b8a8e50 con 0x55853b93e950 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55853b898280 con 0x55853b9329c0 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa085925740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55853b89c090 con 0x55853b9320a0 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa080aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b940d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa080aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b940d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53056/0 (socket says 172.21.15.2:53056) 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa080aeb640 1 -- 172.21.15.2:0/2807453157 learned_addr learned my addr 172.21.15.2:0/2807453157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b932480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa0812ec640 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b93e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa080aeb640 1 -- 172.21.15.2:0/2807453157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 msgr2=0x55853b932480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.705+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b932480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa080aeb640 1 -- 172.21.15.2:0/2807453157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 msgr2=0x55853b93e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b93e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa080aeb640 1 -- 172.21.15.2:0/2807453157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853b5f6650 con 0x55853b93e950 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa0727fc640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa0680b5360 0x7fa0680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa0812ec640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa0680b5360 0x7fa0680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b940d40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa06c02a910 tx=0x7fa06c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffe4d66e1218b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa0727fc640 1 -- 172.21.15.2:0/3232009614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa0740e5960 con 0x7fa07c109150 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa0677fe640 1 -- 172.21.15.2:0/2807453157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c035070 con 0x55853b93e950 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa0677fe640 1 -- 172.21.15.2:0/2807453157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa06c0035f0 con 0x55853b93e950 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.706+0000 7fa0677fe640 1 -- 172.21.15.2:0/2807453157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0044e0 con 0x55853b93e950 2024-09-10T23:26:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 -- 172.21.15.2:0/2807453157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 msgr2=0x55853b940d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa0812ec640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa0680b5360 0x7fa0680b7820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55853b930db0 tx=0x7fa07800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b940d40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa06c02a910 tx=0x7fa06c005db0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 -- 172.21.15.2:0/2807453157 shutdown_connections 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b940d40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b93e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 --2- 172.21.15.2:0/2807453157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b932480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 -- 172.21.15.2:0/2807453157 >> 172.21.15.2:0/2807453157 conn(0x55853b92fed0 msgr2=0x55853b931070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 -- 172.21.15.2:0/2807453157 shutdown_connections 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 -- 172.21.15.2:0/2807453157 wait complete. 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 -- start start 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.707+0000 7fa085925740 1 Processor -- start 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b93e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b93b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b93bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55853b6f9700 con 0x55853b9320a0 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55853b833110 con 0x55853b93e950 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55853b941570 con 0x55853b9329c0 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b93e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa085925740 10 client.0 _ll_register_callbacks cb 0x55853b84c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b93e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53062/0 (socket says 172.21.15.2:53062) 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 -- 172.21.15.2:0/4194488585 learned_addr learned my addr 172.21.15.2:0/4194488585 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa081aed640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b93bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa080aeb640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b93b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 -- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 msgr2=0x55853b93b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b93b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 -- 172.21.15.2:0/4194488585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 msgr2=0x55853b93bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b93bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa0812ec640 1 -- 172.21.15.2:0/4194488585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55853b860c40 con 0x55853b9320a0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.708+0000 7fa081aed640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b93bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa0812ec640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b93e2a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa07801cbe0 tx=0x7fa078004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a39de1c716388c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa064ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa064ff9640 1 -- 172.21.15.2:0/4194488585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07802c060 con 0x55853b9320a0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa064ff9640 1 -- 172.21.15.2:0/4194488585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa078016030 con 0x55853b9320a0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa06c0035f0 con 0x55853b9320a0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa064ff9640 1 -- 172.21.15.2:0/4194488585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa07800adf0 con 0x55853b9320a0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa085925740 10 client.16182 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55853b94cf60 con 0x55853b9320a0 2024-09-10T23:26:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.709+0000 7fa064ff9640 1 -- 172.21.15.2:0/4194488585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa06c0035f0 con 0x55853b9320a0 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa064ff9640 1 -- 172.21.15.2:0/4194488585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa078032700 con 0x55853b9320a0 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa085925740 10 client.16182 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa085925740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa085925740 20 client.16182 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa085925740 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b94e470 0x55853b9508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa085925740 4 client.16182 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55853b8aada0 con 0x55853b94e470 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa080aeb640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b94e470 0x55853b9508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa064ff9640 10 client.16182 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.710+0000 7fa080aeb640 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b94e470 0x55853b9508b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2e1415cd9970f8 server_cookie=e99fd22f50c4905c in_seq=0 out_seq=0 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa064ff9640 1 -- 172.21.15.2:0/4194488585 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55853b8aada0 con 0x55853b94e470 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa064ff9640 10 client.16182 handle_command_reply: tid=0 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 client.16182 shutdown 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 msgr2=0x55853b93e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b93e2a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa07801cbe0 tx=0x7fa078004730 comp rx=0 tx=0).stop 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 shutdown_connections 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b94e470 0x55853b9508b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b93bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b93b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 --2- 172.21.15.2:0/4194488585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b93e2a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 >> 172.21.15.2:0/4194488585 conn(0x55853b92fed0 msgr2=0x55853b935a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.711+0000 7fa064ff9640 0 client.16182 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.712+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 shutdown_connections 2024-09-10T23:26:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.712+0000 7fa085925740 1 -- 172.21.15.2:0/4194488585 wait complete. 2024-09-10T23:26:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.712+0000 7fa085925740 20 client.16182 trim_cache size 0 max 16384 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.729+0000 7fa085925740 1 Processor -- start 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.729+0000 7fa085925740 1 -- start start 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa085925740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b94a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa085925740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b936900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa085925740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b936e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa085925740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1b0500 con 0x55853b93e950 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa085925740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1b2040 con 0x55853b9329c0 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa085925740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1b0bd0 con 0x55853b9320a0 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b936e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b936e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53074/0 (socket says 172.21.15.2:53074) 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 -- 172.21.15.2:0/2959735375 learned_addr learned my addr 172.21.15.2:0/2959735375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 -- 172.21.15.2:0/2959735375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 msgr2=0x55853b94a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa0812ec640 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b94a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b936900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b94a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 -- 172.21.15.2:0/2959735375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 msgr2=0x55853b936900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b936900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 -- 172.21.15.2:0/2959735375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853b930950 con 0x55853b93e950 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b936900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa081aed640 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b936e40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa07400cfd0 tx=0x7fa0740abc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccab37a6c72f377 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa066ffd640 1 -- 172.21.15.2:0/2959735375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401f040 con 0x55853b93e950 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa066ffd640 1 -- 172.21.15.2:0/2959735375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0740b5660 con 0x55853b93e950 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.730+0000 7fa066ffd640 1 -- 172.21.15.2:0/2959735375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0740a7dc0 con 0x55853b93e950 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 -- 172.21.15.2:0/2959735375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 msgr2=0x55853b936e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b936e40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa07400cfd0 tx=0x7fa0740abc00 comp rx=0 tx=0).stop 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 -- 172.21.15.2:0/2959735375 shutdown_connections 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b93e950 0x55853b936e40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b9329c0 0x55853b936900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 --2- 172.21.15.2:0/2959735375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9320a0 0x55853b94a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 -- 172.21.15.2:0/2959735375 >> 172.21.15.2:0/2959735375 conn(0x55853b92fed0 msgr2=0x55853b950480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 -- 172.21.15.2:0/2959735375 shutdown_connections 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 -- 172.21.15.2:0/2959735375 wait complete. 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 -- start start 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.731+0000 7fa085925740 1 Processor -- start 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b947080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b955e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b9564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1b1970 con 0x55853b9320a0 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1b12a0 con 0x55853b93e950 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1ae4e0 con 0x55853b9329c0 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa085925740 10 client.0 _ll_register_callbacks cb 0x7fa07800a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b947080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b947080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53086/0 (socket says 172.21.15.2:53086) 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 -- 172.21.15.2:0/2898405511 learned_addr learned my addr 172.21.15.2:0/2898405511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b955e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa081aed640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b9564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 -- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 msgr2=0x55853b955e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b955e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 -- 172.21.15.2:0/2898405511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 msgr2=0x55853b9564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b9564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa0812ec640 1 -- 172.21.15.2:0/2898405511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55853b945ce0 con 0x55853b9320a0 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.732+0000 7fa081aed640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b9564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa0812ec640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b947080 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa078017040 tx=0x7fa07801c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23fc134a652952 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa064ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa064ff9640 1 -- 172.21.15.2:0/2898405511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078037030 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa064ff9640 1 -- 172.21.15.2:0/2898405511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa078022040 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0740b5660 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa064ff9640 1 -- 172.21.15.2:0/2898405511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa0780323d0 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa085925740 10 client.16188 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55853b9bb470 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa064ff9640 1 -- 172.21.15.2:0/2898405511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0740b5660 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.733+0000 7fa064ff9640 1 -- 172.21.15.2:0/2898405511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa078033450 con 0x55853b9320a0 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 10 client.16188 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 20 client.16188 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b9bbc20 0x55853b9be040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 4 client.16188 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55853b8a6850 con 0x55853b9bbc20 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b9bbc20 0x55853b9be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa064ff9640 10 client.16188 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa080aeb640 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b9bbc20 0x55853b9be040 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d7182c238baca95 server_cookie=dc31021cba45f99 in_seq=0 out_seq=0 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa064ff9640 1 -- 172.21.15.2:0/2898405511 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55853b8a6850 con 0x55853b9bbc20 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa064ff9640 10 client.16188 handle_command_reply: tid=0 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.734+0000 7fa085925740 1 client.16188 shutdown 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 msgr2=0x55853b947080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b947080 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa078017040 tx=0x7fa07801c840 comp rx=0 tx=0).stop 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 shutdown_connections 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55853b9bbc20 0x55853b9be040 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55853b93e950 0x55853b9564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55853b9329c0 0x55853b955e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 --2- 172.21.15.2:0/2898405511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55853b9320a0 0x55853b947080 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 >> 172.21.15.2:0/2898405511 conn(0x55853b92fed0 msgr2=0x55853b936900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa064ff9640 0 client.16188 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 shutdown_connections 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 1 -- 172.21.15.2:0/2898405511 wait complete. 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.735+0000 7fa085925740 20 client.16188 trim_cache size 0 max 16384 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa0680b5360 msgr2=0x7fa0680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa0680b5360 0x7fa0680b7820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55853b930db0 tx=0x7fa07800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 msgr2=0x7fa07c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 0x7fa07c075f20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa07400eaa0 tx=0x7fa07400ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 shutdown_connections 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa0680b5360 0x7fa0680b7820 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c109150 0x7fa07c075f20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c1087d0 0x7fa07c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 --2- 172.21.15.2:0/3232009614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa07c102dc0 0x7fa07c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 >> 172.21.15.2:0/3232009614 conn(0x7fa07c0fe830 msgr2=0x7fa07c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 shutdown_connections 2024-09-10T23:26:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:53.736+0000 7fa083550640 1 -- 172.21.15.2:0/3232009614 wait complete. 2024-09-10T23:26:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:53 smithi177 ceph-mon[35760]: pgmap v428: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:26:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:53 smithi002 ceph-mon[31150]: pgmap v428: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:26:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:53 smithi154 ceph-mon[35136]: pgmap v428: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:26:54.521 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:26:54.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:54.781 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 -- 172.21.15.2:0/598397477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc10d100 msgr2=0x7fa9bc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/598397477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc10d100 0x7fa9bc10f560 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4009900 tx=0x7fa9b402a410 comp rx=0 tx=0).stop 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 -- 172.21.15.2:0/598397477 shutdown_connections 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/598397477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc10d100 0x7fa9bc10f560 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/598397477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc1045c0 0x7fa9bc10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/598397477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 -- 172.21.15.2:0/598397477 >> 172.21.15.2:0/598397477 conn(0x7fa9bc0fd700 msgr2=0x7fa9bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 -- 172.21.15.2:0/598397477 shutdown_connections 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 -- 172.21.15.2:0/598397477 wait complete. 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 Processor -- start 2024-09-10T23:26:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.267+0000 7fa9c36f7640 1 -- start start 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c36f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c36f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc1045c0 0x7fa9bc1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c36f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc10d100 0x7fa9bc19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c36f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc112d70 con 0x7fa9bc103ca0 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c36f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc112bf0 con 0x7fa9bc10d100 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c36f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc112ef0 con 0x7fa9bc1045c0 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53112/0 (socket says 172.21.15.2:53112) 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 -- 172.21.15.2:0/4076072886 learned_addr learned my addr 172.21.15.2:0/4076072886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c0c92640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc1045c0 0x7fa9bc1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1c94640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc10d100 0x7fa9bc19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 -- 172.21.15.2:0/4076072886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc1045c0 msgr2=0x7fa9bc1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc1045c0 0x7fa9bc1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 -- 172.21.15.2:0/4076072886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc10d100 msgr2=0x7fa9bc19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc10d100 0x7fa9bc19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 -- 172.21.15.2:0/4076072886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc19f310 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.268+0000 7fa9c1493640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc199260 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00eab0 tx=0x7fa9ac00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.269+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00ce40 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.269+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9ac011920 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.269+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc19f600 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.269+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac010a30 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.269+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc1a5e90 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.270+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc104080 con 0x7fa9bc103ca0 2024-09-10T23:26:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.271+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa9ac00f040 con 0x7fa9bc103ca0 2024-09-10T23:26:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.272+0000 7fa9ba7fc640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9a40b5360 0x7fa9a40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.272+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa9ac0e5d70 con 0x7fa9bc103ca0 2024-09-10T23:26:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.272+0000 7fa9c0c92640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9a40b5360 0x7fa9a40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.272+0000 7fa9c0c92640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9a40b5360 0x7fa9a40b7820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc1012c0 tx=0x7fa9b000b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.275+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa9ac016030 con 0x7fa9bc103ca0 2024-09-10T23:26:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.497+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9bc19a390 con 0x7fa9bc103ca0 2024-09-10T23:26:55.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.498+0000 7fa9ba7fc640 1 -- 172.21.15.2:0/4076072886 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fa9ac0accc0 con 0x7fa9bc103ca0 2024-09-10T23:26:55.500 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:26:55.500 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:26:55.500 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9a40b5360 msgr2=0x7fa9a40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9a40b5360 0x7fa9a40b7820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc1012c0 tx=0x7fa9b000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 msgr2=0x7fa9bc199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc199260 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00eab0 tx=0x7fa9ac00ef70 comp rx=0 tx=0).stop 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 shutdown_connections 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa9a40b5360 0x7fa9a40b7820 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc10d100 0x7fa9bc19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9bc1045c0 0x7fa9bc1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 --2- 172.21.15.2:0/4076072886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9bc103ca0 0x7fa9bc199260 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 >> 172.21.15.2:0/4076072886 conn(0x7fa9bc0fd700 msgr2=0x7fa9bc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 shutdown_connections 2024-09-10T23:26:55.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:55.500+0000 7fa9c36f7640 1 -- 172.21.15.2:0/4076072886 wait complete. 2024-09-10T23:26:56.142 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:55 smithi002 ceph-mon[31150]: pgmap v429: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:56.142 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:55 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4076072886' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:56.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:26:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:55 smithi177 ceph-mon[35760]: pgmap v429: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:55 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4076072886' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:55 smithi154 ceph-mon[35136]: pgmap v429: 97 pgs: 97 active+clean; 1.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:26:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:55 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4076072886' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/2958422952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 msgr2=0x7f5b5810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/2958422952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b5810e820 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009ca0 tx=0x7f5b5002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/2958422952 shutdown_connections 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/2958422952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b5810e820 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/2958422952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 0x7f5b58107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/2958422952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58101c90 0x7f5b58102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/2958422952 >> 172.21.15.2:0/2958422952 conn(0x7f5b580fd700 msgr2=0x7f5b580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/2958422952 shutdown_connections 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.903+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/2958422952 wait complete. 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 Processor -- start 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 -- start start 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58101c90 0x7f5b580fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 0x7f5b580fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b580fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111d30 con 0x7f5b58108020 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111bb0 con 0x7f5b58101c90 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b5d8c0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111eb0 con 0x7f5b581076a0 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b580fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b580fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53124/0 (socket says 172.21.15.2:53124) 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b577fe640 1 -- 172.21.15.2:0/3367953051 learned_addr learned my addr 172.21.15.2:0/3367953051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b567fc640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 0x7f5b580fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58101c90 0x7f5b580fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b577fe640 1 -- 172.21.15.2:0/3367953051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 msgr2=0x7f5b580fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.904+0000 7f5b577fe640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 0x7f5b580fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b577fe640 1 -- 172.21.15.2:0/3367953051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58101c90 msgr2=0x7f5b580fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b577fe640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58101c90 0x7f5b580fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b577fe640 1 -- 172.21.15.2:0/3367953051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b581a76f0 con 0x7f5b58108020 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b567fc640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 0x7f5b580fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:56.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b577fe640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b580fe680 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5b50031a20 tx=0x7f5b50031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b5c8be640 1 -- 172.21.15.2:0/3367953051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50003d30 con 0x7f5b58108020 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b5c8be640 1 -- 172.21.15.2:0/3367953051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b500044f0 con 0x7f5b58108020 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b581a7980 con 0x7f5b58108020 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b5c8be640 1 -- 172.21.15.2:0/3367953051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5002fd90 con 0x7f5b58108020 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.905+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b581a7f40 con 0x7f5b58108020 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 Processor -- start 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5c8be640 1 -- 172.21.15.2:0/3367953051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5b50004040 con 0x7f5b58108020 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 -- start start 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c3792d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37939460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558c378a3ea0 con 0x558c3792d0f0 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558c378932d0 con 0x558c379399a0 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558c378970e0 con 0x558c3792da10 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c3792d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c3792d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53140/0 (socket says 172.21.15.2:53140) 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 -- 172.21.15.2:0/2520395154 learned_addr learned my addr 172.21.15.2:0/2520395154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37939460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 -- 172.21.15.2:0/2520395154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 msgr2=0x558c37939460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37939460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.908+0000 7f5b567fc640 1 -- 172.21.15.2:0/2520395154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 msgr2=0x558c3793bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b567fc640 1 -- 172.21.15.2:0/2520395154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c375f1650 con 0x558c3792d0f0 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37939460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c3792d4d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c005d70 tx=0x7f5b4c00a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c09311dcf018a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b5c8be640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b400b52e0 0x7f5b400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b3dffb640 1 -- 172.21.15.2:0/2520395154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c004220 con 0x558c3792d0f0 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b400b52e0 0x7f5b400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b3dffb640 1 -- 172.21.15.2:0/2520395154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b4c016070 con 0x558c3792d0f0 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b3dffb640 1 -- 172.21.15.2:0/2520395154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c004a80 con 0x558c3792d0f0 2024-09-10T23:26:56.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.909+0000 7f5b5c8be640 1 -- 172.21.15.2:0/3367953051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b50107090 con 0x7f5b58108020 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2520395154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 msgr2=0x558c3792d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b400b52e0 0x7f5b400b77a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x558c3792be00 tx=0x7f5b48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c3792d4d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c005d70 tx=0x7f5b4c00a670 comp rx=0 tx=0).stop 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2520395154 shutdown_connections 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37939460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2520395154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c3792d4d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2520395154 >> 172.21.15.2:0/2520395154 conn(0x558c3792af20 msgr2=0x558c3792c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2520395154 shutdown_connections 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2520395154 wait complete. 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 -- start start 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.910+0000 7f5b5fc95740 1 Processor -- start 2024-09-10T23:26:56.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c379391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37936600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37936b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558c376f4700 con 0x558c3792da10 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558c3782e160 con 0x558c379399a0 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558c3793c620 con 0x558c3792d0f0 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b5fc95740 10 client.0 _ll_register_callbacks cb 0x558c378479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37936600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37936600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53146/0 (socket says 172.21.15.2:53146) 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 -- 172.21.15.2:0/1757706515 learned_addr learned my addr 172.21.15.2:0/1757706515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:56.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c379391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b577fe640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37936b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 -- 172.21.15.2:0/1757706515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 msgr2=0x558c379391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c379391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 -- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 msgr2=0x558c37936b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37936b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 -- 172.21.15.2:0/1757706515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3785bc90 con 0x558c3792da10 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b577fe640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37936b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b567fc640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37936600 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004ab0 tx=0x7f5b4c004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6b6e02045995e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.911+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1757706515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c028060 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1757706515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b4c010e40 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4c016070 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1757706515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b4c00aa30 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 10 client.16206 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c37947ea0 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1757706515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b4c016070 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1757706515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b4c00f040 con 0x558c3792da10 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 10 client.16206 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 10 client.16206 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 20 client.16206 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379492a0 0x558c3794b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 4 client.16206 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.912+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c378a5df0 con 0x558c379492a0 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.913+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379492a0 0x558c3794b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.913+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379492a0 0x558c3794b690 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4265955f2cce152a server_cookie=77ebf5d1e90147f5 in_seq=0 out_seq=0 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.913+0000 7f5b36ffd640 10 client.16206 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1757706515 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c378a5df0 con 0x558c379492a0 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b36ffd640 10 client.16206 handle_command_reply: tid=0 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 client.16206 shutdown 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 msgr2=0x558c37936600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37936600 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004ab0 tx=0x7f5b4c004ae0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 shutdown_connections 2024-09-10T23:26:56.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379492a0 0x558c3794b690 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37936b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37936600 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b36ffd640 0 client.16206 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1757706515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c379391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 >> 172.21.15.2:0/1757706515 conn(0x558c3792af20 msgr2=0x558c37930a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 shutdown_connections 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1757706515 wait complete. 2024-09-10T23:26:56.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.914+0000 7f5b5fc95740 20 client.16206 trim_cache size 0 max 16384 2024-09-10T23:26:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.927+0000 7f5b5fc95740 1 Processor -- start 2024-09-10T23:26:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.927+0000 7f5b5fc95740 1 -- start start 2024-09-10T23:26:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c3792c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37933830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37933d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b0570 con 0x558c3792da10 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b20b0 con 0x558c379399a0 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b0c40 con 0x558c3792d0f0 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37933830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37933830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53158/0 (socket says 172.21.15.2:53158) 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37933d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 -- 172.21.15.2:0/2318580886 learned_addr learned my addr 172.21.15.2:0/2318580886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c3792c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 -- 172.21.15.2:0/2318580886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 msgr2=0x558c3792c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c3792c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 -- 172.21.15.2:0/2318580886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 msgr2=0x558c37933d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37933d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 -- 172.21.15.2:0/2318580886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c37931160 con 0x558c3792da10 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b567fc640 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37933830 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0058c0 tx=0x7f5b4c00a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4bfee5bb6a81e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.928+0000 7f5b3d7fa640 1 -- 172.21.15.2:0/2318580886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c032070 con 0x558c3792da10 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b3d7fa640 1 -- 172.21.15.2:0/2318580886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b4c016070 con 0x558c3792da10 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b3d7fa640 1 -- 172.21.15.2:0/2318580886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c028040 con 0x558c3792da10 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2318580886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 msgr2=0x558c37933830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37933830 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0058c0 tx=0x7f5b4c00a510 comp rx=0 tx=0).stop 2024-09-10T23:26:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2318580886 shutdown_connections 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c37933d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792da10 0x558c37933830 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/2318580886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792d0f0 0x558c3792c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2318580886 >> 172.21.15.2:0/2318580886 conn(0x558c3792af20 msgr2=0x558c3792bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2318580886 shutdown_connections 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.929+0000 7f5b5fc95740 1 -- 172.21.15.2:0/2318580886 wait complete. 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 -- start start 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 Processor -- start 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c379418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37941e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b19e0 con 0x558c3792d0f0 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b1310 con 0x558c379399a0 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581ae550 con 0x558c3792da10 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b5fc95740 10 client.0 _ll_register_callbacks cb 0x7f5b4c00ad60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c379418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c379418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53170/0 (socket says 172.21.15.2:53170) 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b56ffd640 1 -- 172.21.15.2:0/1911399954 learned_addr learned my addr 172.21.15.2:0/1911399954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:56.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.930+0000 7f5b567fc640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37941e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b577fe640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b56ffd640 1 -- 172.21.15.2:0/1911399954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 msgr2=0x558c37941e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37941e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b56ffd640 1 -- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 msgr2=0x558c3793e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:56.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b56ffd640 1 -- 172.21.15.2:0/1911399954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c37942460 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b577fe640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b56ffd640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c379418e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x558c3794bc00 tx=0x7f5b48012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcee560bd30ba55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1911399954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4801b040 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1911399954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b48031630 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4c016070 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1911399954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b48031830 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b5fc95740 10 client.16212 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.931+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c379b6340 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1911399954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b4c016070 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1911399954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b48022a10 con 0x558c3792d0f0 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b5fc95740 10 client.16212 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b5fc95740 10 client.16212 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b5fc95740 20 client.16212 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379b6af0 0x558c379b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b5fc95740 4 client.16212 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c378a18a0 con 0x558c379b6af0 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.932+0000 7f5b567fc640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379b6af0 0x558c379b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b567fc640 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379b6af0 0x558c379b8f10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=66e5766aa9ee6c13 server_cookie=f5b2b4c2f82bd787 in_seq=0 out_seq=0 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b36ffd640 10 client.16212 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b36ffd640 1 -- 172.21.15.2:0/1911399954 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c378a18a0 con 0x558c379b6af0 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b36ffd640 10 client.16212 handle_command_reply: tid=0 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 client.16212 shutdown 2024-09-10T23:26:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 msgr2=0x558c379418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c379418e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x558c3794bc00 tx=0x7f5b48012000 comp rx=0 tx=0).stop 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 shutdown_connections 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558c379b6af0 0x558c379b8f10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c379399a0 0x558c3793e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558c3792da10 0x558c37941e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 --2- 172.21.15.2:0/1911399954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c3792d0f0 0x558c379418e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 >> 172.21.15.2:0/1911399954 conn(0x558c3792af20 msgr2=0x558c37937c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b36ffd640 0 client.16212 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 shutdown_connections 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 1 -- 172.21.15.2:0/1911399954 wait complete. 2024-09-10T23:26:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.933+0000 7f5b5fc95740 20 client.16212 trim_cache size 0 max 16384 2024-09-10T23:26:56.946 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b400b52e0 msgr2=0x7f5b400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b400b52e0 0x7f5b400b77a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x558c3792be00 tx=0x7f5b48008040 comp rx=0 tx=0).stop 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 msgr2=0x7f5b580fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b580fe680 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5b50031a20 tx=0x7f5b50031a50 comp rx=0 tx=0).stop 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 shutdown_connections 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b400b52e0 0x7f5b400b77a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58108020 0x7f5b580fe680 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076a0 0x7f5b580fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 --2- 172.21.15.2:0/3367953051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58101c90 0x7f5b580fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 >> 172.21.15.2:0/3367953051 conn(0x7f5b580fd700 msgr2=0x7f5b5806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 shutdown_connections 2024-09-10T23:26:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:56.934+0000 7f5b5d8c0640 1 -- 172.21.15.2:0/3367953051 wait complete. 2024-09-10T23:26:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 -- 172.21.15.2:0/3450272313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1033a0 msgr2=0x7f27bc109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 --2- 172.21.15.2:0/3450272313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1033a0 0x7f27bc109d20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009cd0 tx=0x7f27b402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 -- 172.21.15.2:0/3450272313 shutdown_connections 2024-09-10T23:26:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 --2- 172.21.15.2:0/3450272313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1033a0 0x7f27bc109d20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 --2- 172.21.15.2:0/3450272313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc1029e0 0x7f27bc102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 --2- 172.21.15.2:0/3450272313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc101890 0x7f27bc101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 -- 172.21.15.2:0/3450272313 >> 172.21.15.2:0/3450272313 conn(0x7f27bc0fd170 msgr2=0x7f27bc0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 -- 172.21.15.2:0/3450272313 shutdown_connections 2024-09-10T23:26:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.380+0000 7f27c41fb640 1 -- 172.21.15.2:0/3450272313 wait complete. 2024-09-10T23:26:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 Processor -- start 2024-09-10T23:26:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 -- start start 2024-09-10T23:26:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc101890 0x7f27bc198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 0x7f27bc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc1033a0 0x7f27bc199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc10d500 con 0x7f27bc1029e0 2024-09-10T23:26:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc10d380 con 0x7f27bc101890 2024-09-10T23:26:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c41fb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc10d680 con 0x7f27bc1033a0 2024-09-10T23:26:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c1796640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 0x7f27bc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c1796640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 0x7f27bc199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53184/0 (socket says 172.21.15.2:53184) 2024-09-10T23:26:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.381+0000 7f27c1796640 1 -- 172.21.15.2:0/1364258514 learned_addr learned my addr 172.21.15.2:0/1364258514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1f97640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc101890 0x7f27bc198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c2798640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc1033a0 0x7f27bc199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1796640 1 -- 172.21.15.2:0/1364258514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc1033a0 msgr2=0x7f27bc199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1796640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc1033a0 0x7f27bc199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1796640 1 -- 172.21.15.2:0/1364258514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc101890 msgr2=0x7f27bc198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1796640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc101890 0x7f27bc198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1796640 1 -- 172.21.15.2:0/1364258514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc19a840 con 0x7f27bc1029e0 2024-09-10T23:26:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c2798640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc1033a0 0x7f27bc199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c1796640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 0x7f27bc199350 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00d950 tx=0x7f27ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27b2ffd640 1 -- 172.21.15.2:0/1364258514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac017070 con 0x7f27bc1029e0 2024-09-10T23:26:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27b2ffd640 1 -- 172.21.15.2:0/1364258514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27ac009c30 con 0x7f27bc1029e0 2024-09-10T23:26:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc19ab30 con 0x7f27bc1029e0 2024-09-10T23:26:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27b2ffd640 1 -- 172.21.15.2:0/1364258514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00f620 con 0x7f27bc1029e0 2024-09-10T23:26:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.382+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc1a1200 con 0x7f27bc1029e0 2024-09-10T23:26:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 Processor -- start 2024-09-10T23:26:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 -- start start 2024-09-10T23:26:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 0x5649270ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270edfe0 0x5649270f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649270566f0 con 0x5649270eb5a0 2024-09-10T23:26:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564927045b20 con 0x5649270edfe0 2024-09-10T23:26:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564927049930 con 0x5649270e8c70 2024-09-10T23:26:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27b2ffd640 1 -- 172.21.15.2:0/1364258514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f27ac010460 con 0x7f27bc1029e0 2024-09-10T23:26:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 0x5649270ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 0x5649270ed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53194/0 (socket says 172.21.15.2:53194) 2024-09-10T23:26:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 -- 172.21.15.2:0/32689699 learned_addr learned my addr 172.21.15.2:0/32689699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c2798640 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 -- 172.21.15.2:0/32689699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 msgr2=0x5649270eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 -- 172.21.15.2:0/32689699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270edfe0 msgr2=0x5649270f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270edfe0 0x5649270f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c1f97640 1 -- 172.21.15.2:0/32689699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492700b530 con 0x5649270eb5a0 2024-09-10T23:26:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.385+0000 7f27c2798640 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27c1f97640 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 0x5649270ed990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f27b800bcf0 tx=0x7f27b800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0be80c472f93d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27a7fff640 1 -- 172.21.15.2:0/32689699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8015070 con 0x5649270eb5a0 2024-09-10T23:26:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27a7fff640 1 -- 172.21.15.2:0/32689699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b80118f0 con 0x5649270eb5a0 2024-09-10T23:26:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27a7fff640 1 -- 172.21.15.2:0/32689699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8010850 con 0x5649270eb5a0 2024-09-10T23:26:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27b2ffd640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27a80b52e0 0x7f27a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27c2798640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27a80b52e0 0x7f27a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.386+0000 7f27b2ffd640 1 -- 172.21.15.2:0/1364258514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f27ac0e5910 con 0x7f27bc1029e0 2024-09-10T23:26:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 -- 172.21.15.2:0/32689699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 msgr2=0x5649270ed990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c2798640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27a80b52e0 0x7f27a80b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005cc0 tx=0x7f27b4005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 0x5649270ed990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f27b800bcf0 tx=0x7f27b800f730 comp rx=0 tx=0).stop 2024-09-10T23:26:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 -- 172.21.15.2:0/32689699 shutdown_connections 2024-09-10T23:26:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270edfe0 0x5649270f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270eb5a0 0x5649270ed990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/32689699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 -- 172.21.15.2:0/32689699 >> 172.21.15.2:0/32689699 conn(0x5649270df9b0 msgr2=0x5649270e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 -- 172.21.15.2:0/32689699 shutdown_connections 2024-09-10T23:26:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 -- 172.21.15.2:0/32689699 wait complete. 2024-09-10T23:26:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 -- start start 2024-09-10T23:26:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.387+0000 7f27c6fc8740 1 Processor -- start 2024-09-10T23:26:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 0x5649270f2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270edfe0 0x5649270f3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564926f7dab0 con 0x5649270e8c70 2024-09-10T23:26:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564926feb730 con 0x5649270eb5a0 2024-09-10T23:26:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5649270f0fc0 con 0x5649270edfe0 2024-09-10T23:26:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 10 client.0 _ll_register_callbacks cb 0x56492703f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 0x5649270f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 0x5649270f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53198/0 (socket says 172.21.15.2:53198) 2024-09-10T23:26:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 -- 172.21.15.2:0/2172655865 learned_addr learned my addr 172.21.15.2:0/2172655865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c2798640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270edfe0 0x5649270f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1796640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 -- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270edfe0 msgr2=0x5649270f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270edfe0 0x5649270f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 -- 172.21.15.2:0/2172655865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 msgr2=0x5649270f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 -- 172.21.15.2:0/2172655865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564926da7790 con 0x5649270e8c70 2024-09-10T23:26:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1796640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c1f97640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 0x5649270f2390 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f27b800ba80 tx=0x7f27b8011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6ee9a36da19800 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27a57fa640 1 -- 172.21.15.2:0/2172655865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8028060 con 0x5649270e8c70 2024-09-10T23:26:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b80118f0 con 0x5649270e8c70 2024-09-10T23:26:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.388+0000 7f27a57fa640 1 -- 172.21.15.2:0/2172655865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f27b8011cb0 con 0x5649270e8c70 2024-09-10T23:26:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27a57fa640 1 -- 172.21.15.2:0/2172655865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27b8015070 con 0x5649270e8c70 2024-09-10T23:26:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 10 client.16224 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564926e20620 con 0x5649270e8c70 2024-09-10T23:26:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27a57fa640 1 -- 172.21.15.2:0/2172655865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b80118f0 con 0x5649270e8c70 2024-09-10T23:26:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27a57fa640 1 -- 172.21.15.2:0/2172655865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f27b8004b50 con 0x5649270e8c70 2024-09-10T23:26:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 10 client.16224 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 20 client.16224 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5649270fd8b0 0x5649270ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 4 client.16224 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564927058640 con 0x5649270fd8b0 2024-09-10T23:26:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.389+0000 7f27c1796640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5649270fd8b0 0x5649270ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.390+0000 7f27a57fa640 10 client.16224 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.390+0000 7f27c1796640 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5649270fd8b0 0x5649270ffca0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b60e7d780ab464 server_cookie=7c3f66cb5befa104 in_seq=0 out_seq=0 2024-09-10T23:26:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27a57fa640 1 -- 172.21.15.2:0/2172655865 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564927058640 con 0x5649270fd8b0 2024-09-10T23:26:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27a57fa640 10 client.16224 handle_command_reply: tid=0 2024-09-10T23:26:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 client.16224 shutdown 2024-09-10T23:26:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 msgr2=0x5649270f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 0x5649270f2390 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f27b800ba80 tx=0x7f27b8011670 comp rx=0 tx=0).stop 2024-09-10T23:26:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 shutdown_connections 2024-09-10T23:26:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5649270fd8b0 0x5649270ffca0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270edfe0 0x5649270f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27a57fa640 0 client.16224 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2172655865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270e8c70 0x5649270f2390 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 >> 172.21.15.2:0/2172655865 conn(0x5649270df9b0 msgr2=0x5649270debf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 shutdown_connections 2024-09-10T23:26:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2172655865 wait complete. 2024-09-10T23:26:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.391+0000 7f27c6fc8740 20 client.16224 trim_cache size 0 max 16384 2024-09-10T23:26:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.406+0000 7f27c6fc8740 1 Processor -- start 2024-09-10T23:26:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 -- start start 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270e8c70 0x5649270e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270eb5a0 0x5649270ef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270ef580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc1a7ca0 con 0x5649270edfe0 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc1a97e0 con 0x5649270e8c70 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc1a8370 con 0x5649270eb5a0 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270ef580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53214/0 (socket says 172.21.15.2:53214) 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 -- 172.21.15.2:0/1246818434 learned_addr learned my addr 172.21.15.2:0/1246818434 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c1796640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270eb5a0 0x5649270ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c1f97640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270e8c70 0x5649270e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 -- 172.21.15.2:0/1246818434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270eb5a0 msgr2=0x5649270ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270eb5a0 0x5649270ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 -- 172.21.15.2:0/1246818434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270e8c70 msgr2=0x5649270e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270e8c70 0x5649270e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 -- 172.21.15.2:0/1246818434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649270f13c0 con 0x5649270edfe0 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c1f97640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270e8c70 0x5649270e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c1796640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270eb5a0 0x5649270ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.407+0000 7f27c2798640 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270ef580 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f27b4035000 tx=0x7f27b403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff33153ce8e068c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27a77fe640 1 -- 172.21.15.2:0/1246818434 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4041070 con 0x5649270edfe0 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27a77fe640 1 -- 172.21.15.2:0/1246818434 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b4036040 con 0x5649270edfe0 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27a77fe640 1 -- 172.21.15.2:0/1246818434 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4030ea0 con 0x5649270edfe0 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 -- 172.21.15.2:0/1246818434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 msgr2=0x5649270ef580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270ef580 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f27b4035000 tx=0x7f27b403d000 comp rx=0 tx=0).stop 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 -- 172.21.15.2:0/1246818434 shutdown_connections 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270ef580 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270eb5a0 0x5649270ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/1246818434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270e8c70 0x5649270e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 -- 172.21.15.2:0/1246818434 >> 172.21.15.2:0/1246818434 conn(0x5649270df9b0 msgr2=0x5649270ee470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 -- 172.21.15.2:0/1246818434 shutdown_connections 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.408+0000 7f27c6fc8740 1 -- 172.21.15.2:0/1246818434 wait complete. 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 -- start start 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 Processor -- start 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc1a9110 con 0x5649270edfe0 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc1a8a40 con 0x5649270eb5a0 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc1a5c80 con 0x5649270e8c70 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c6fc8740 10 client.0 _ll_register_callbacks cb 0x7f27b800bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270f9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53220/0 (socket says 172.21.15.2:53220) 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 -- 172.21.15.2:0/2272149323 learned_addr learned my addr 172.21.15.2:0/2272149323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c1f97640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c1796640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 -- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 msgr2=0x5649270f9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270f9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 -- 172.21.15.2:0/2272149323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 msgr2=0x5649270f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.409+0000 7f27c2798640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c2798640 1 -- 172.21.15.2:0/2272149323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649270f7820 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c2798640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270f9310 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f27b4030980 tx=0x7f27b4030e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624ca6d8a38ab128 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27a57fa640 1 -- 172.21.15.2:0/2272149323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4059070 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27a57fa640 1 -- 172.21.15.2:0/2272149323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f27b4004510 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b4036040 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27a57fa640 1 -- 172.21.15.2:0/2272149323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27b4065050 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 10 client.16230 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56492716a840 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27a57fa640 1 -- 172.21.15.2:0/2272149323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b4036040 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27a57fa640 1 -- 172.21.15.2:0/2272149323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f27b4030070 con 0x5649270edfe0 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 10 client.16230 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 20 client.16230 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56492716b1d0 0x56492716d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 4 client.16230 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.410+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649270540f0 con 0x56492716b1d0 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.411+0000 7f27c1f97640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56492716b1d0 0x56492716d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.411+0000 7f27c1f97640 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56492716b1d0 0x56492716d5f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4702e62502d3a5f server_cookie=d24f67996cfae716 in_seq=0 out_seq=0 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.411+0000 7f27a57fa640 10 client.16230 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27a57fa640 1 -- 172.21.15.2:0/2272149323 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5649270540f0 con 0x56492716b1d0 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27a57fa640 10 client.16230 handle_command_reply: tid=0 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 client.16230 shutdown 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 msgr2=0x5649270f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270f9310 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f27b4030980 tx=0x7f27b4030e50 comp rx=0 tx=0).stop 2024-09-10T23:26:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 shutdown_connections 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56492716b1d0 0x56492716d5f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649270edfe0 0x5649270f9310 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5649270eb5a0 0x5649270f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27a57fa640 0 client.16230 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 --2- 172.21.15.2:0/2272149323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5649270e8c70 0x5649270f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 >> 172.21.15.2:0/2272149323 conn(0x5649270df9b0 msgr2=0x5649270debf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 shutdown_connections 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 1 -- 172.21.15.2:0/2272149323 wait complete. 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c6fc8740 20 client.16230 trim_cache size 0 max 16384 2024-09-10T23:26:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:26:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:26:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:26:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:26:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27a80b52e0 msgr2=0x7f27a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27a80b52e0 0x7f27a80b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005cc0 tx=0x7f27b4005f80 comp rx=0 tx=0).stop 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 msgr2=0x7f27bc199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 0x7f27bc199350 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00d950 tx=0x7f27ac00de10 comp rx=0 tx=0).stop 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 shutdown_connections 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f27a80b52e0 0x7f27a80b77a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27bc1033a0 0x7f27bc199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc1029e0 0x7f27bc199350 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 --2- 172.21.15.2:0/1364258514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc101890 0x7f27bc198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 >> 172.21.15.2:0/1364258514 conn(0x7f27bc0fd170 msgr2=0x7f27bc0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 shutdown_connections 2024-09-10T23:26:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:26:57.426+0000 7f27c41fb640 1 -- 172.21.15.2:0/1364258514 wait complete. 2024-09-10T23:26:57.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:26:58.181 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:57 smithi177 ceph-mon[35760]: pgmap v430: 97 pgs: 97 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:26:58.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:57 smithi002 ceph-mon[31150]: pgmap v430: 97 pgs: 97 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:26:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:57 smithi154 ceph-mon[35136]: pgmap v430: 97 pgs: 97 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 -- 172.21.15.2:0/1389356304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 msgr2=0x7f417c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 --2- 172.21.15.2:0/1389356304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c104080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f416c009900 tx=0x7f416c02a410 comp rx=0 tx=0).stop 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 -- 172.21.15.2:0/1389356304 shutdown_connections 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 --2- 172.21.15.2:0/1389356304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417c10d100 0x7f417c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 --2- 172.21.15.2:0/1389356304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f417c1045c0 0x7f417c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 --2- 172.21.15.2:0/1389356304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c104080 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 -- 172.21.15.2:0/1389356304 >> 172.21.15.2:0/1389356304 conn(0x7f417c0fd700 msgr2=0x7f417c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 -- 172.21.15.2:0/1389356304 shutdown_connections 2024-09-10T23:26:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.714+0000 7f4180981640 1 -- 172.21.15.2:0/1389356304 wait complete. 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 Processor -- start 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 -- start start 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417c1045c0 0x7f417c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f417c10d100 0x7f417c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f417c112e20 con 0x7f417c103ca0 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f417c112ca0 con 0x7f417c1045c0 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f4180981640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f417c112fa0 con 0x7f417c10d100 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f417a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f417a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53250/0 (socket says 172.21.15.2:53250) 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.715+0000 7f417a59c640 1 -- 172.21.15.2:0/320288655 learned_addr learned my addr 172.21.15.2:0/320288655 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417ad9d640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f417c10d100 0x7f417c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f4179d9b640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417c1045c0 0x7f417c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417a59c640 1 -- 172.21.15.2:0/320288655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f417c10d100 msgr2=0x7f417c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417a59c640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f417c10d100 0x7f417c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417a59c640 1 -- 172.21.15.2:0/320288655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417c1045c0 msgr2=0x7f417c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417a59c640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417c1045c0 0x7f417c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417a59c640 1 -- 172.21.15.2:0/320288655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c19f360 con 0x7f417c103ca0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f417a59c640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c1992b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f416c005ab0 tx=0x7f416c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f41737fe640 1 -- 172.21.15.2:0/320288655 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c03f070 con 0x7f417c103ca0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c19f5f0 con 0x7f417c103ca0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f41737fe640 1 -- 172.21.15.2:0/320288655 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f416c031d60 con 0x7f417c103ca0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f41737fe640 1 -- 172.21.15.2:0/320288655 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c035030 con 0x7f417c103ca0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.716+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c1a5d10 con 0x7f417c103ca0 2024-09-10T23:26:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 Processor -- start 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f41737fe640 1 -- 172.21.15.2:0/320288655 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f416c03b560 con 0x7f417c103ca0 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 -- start start 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1cab86ea0 con 0x55b1cac104d0 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b1cab762d0 con 0x55b1cac10df0 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.719+0000 7f4182d56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b1cab7a0e0 con 0x55b1cac1cd80 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac108b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53262/0 (socket says 172.21.15.2:53262) 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 -- 172.21.15.2:0/3515388598 learned_addr learned my addr 172.21.15.2:0/3515388598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417a59c640 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f4179d9b640 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 -- 172.21.15.2:0/3515388598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 msgr2=0x55b1cac1f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 -- 172.21.15.2:0/3515388598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 msgr2=0x55b1cac1c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 -- 172.21.15.2:0/3515388598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca8d4650 con 0x55b1cac104d0 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f41737fe640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41680b52e0 0x7f41680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac108b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4174007e50 tx=0x7f417400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7aad3dd81cf66b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f417a59c640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41680b52e0 0x7f41680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f41737fe640 1 -- 172.21.15.2:0/320288655 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f416c106a30 con 0x7f417c103ca0 2024-09-10T23:26:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.720+0000 7f4170ff9640 1 -- 172.21.15.2:0/3515388598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174014070 con 0x55b1cac104d0 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4170ff9640 1 -- 172.21.15.2:0/3515388598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f417400ee90 con 0x55b1cac104d0 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4170ff9640 1 -- 172.21.15.2:0/3515388598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174005380 con 0x55b1cac104d0 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 -- 172.21.15.2:0/3515388598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 msgr2=0x55b1cac108b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac108b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4174007e50 tx=0x7f417400e720 comp rx=0 tx=0).stop 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f417a59c640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41680b52e0 0x7f41680b77a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c10c4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 -- 172.21.15.2:0/3515388598 shutdown_connections 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 --2- 172.21.15.2:0/3515388598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac108b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 -- 172.21.15.2:0/3515388598 >> 172.21.15.2:0/3515388598 conn(0x55b1cac0e300 msgr2=0x55b1cac0f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 -- 172.21.15.2:0/3515388598 shutdown_connections 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.721+0000 7f4182d56740 1 -- 172.21.15.2:0/3515388598 wait complete. 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 -- start start 2024-09-10T23:26:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 Processor -- start 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac1c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac10df0 0x55b1cac19ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac1cd80 0x55b1cac1a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1ca9d7700 con 0x55b1cac104d0 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b1cab11160 con 0x55b1cac1cd80 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b1cac1fa00 con 0x55b1cac10df0 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4182d56740 10 client.0 _ll_register_callbacks cb 0x55b1cab2a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac1c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac1c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53274/0 (socket says 172.21.15.2:53274) 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f417ad9d640 1 -- 172.21.15.2:0/2073868288 learned_addr learned my addr 172.21.15.2:0/2073868288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.722+0000 7f4179d9b640 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac10df0 0x55b1cac19ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f417ad9d640 1 -- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac10df0 msgr2=0x55b1cac19ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac10df0 0x55b1cac19ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f417ad9d640 1 -- 172.21.15.2:0/2073868288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac1cd80 msgr2=0x55b1cac1a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac1cd80 0x55b1cac1a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f417ad9d640 1 -- 172.21.15.2:0/2073868288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1cab3ec90 con 0x55b1cac104d0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac1c690 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4174007bc0 tx=0x7f4174004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3771790497bb04f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4161ffb640 1 -- 172.21.15.2:0/2073868288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174014070 con 0x55b1cac104d0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417400ee90 con 0x55b1cac104d0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4161ffb640 1 -- 172.21.15.2:0/2073868288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4174010b10 con 0x55b1cac104d0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4161ffb640 1 -- 172.21.15.2:0/2073868288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4174005100 con 0x55b1cac104d0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4182d56740 10 client.16242 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1cac2b390 con 0x55b1cac104d0 2024-09-10T23:26:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4161ffb640 1 -- 172.21.15.2:0/2073868288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f417400ee90 con 0x55b1cac104d0 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.723+0000 7f4161ffb640 1 -- 172.21.15.2:0/2073868288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4174025800 con 0x55b1cac104d0 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4182d56740 10 client.16242 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4182d56740 10 client.16242 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4182d56740 20 client.16242 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4182d56740 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac2c790 0x55b1cac2eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4182d56740 4 client.16242 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1cab88df0 con 0x55b1cac2c790 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4179d9b640 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac2c790 0x55b1cac2eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4179d9b640 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac2c790 0x55b1cac2eb80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bef9f0281a26f64b server_cookie=96469ae891b02665 in_seq=0 out_seq=0 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.724+0000 7f4161ffb640 10 client.16242 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4161ffb640 1 -- 172.21.15.2:0/2073868288 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1cab88df0 con 0x55b1cac2c790 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4161ffb640 10 client.16242 handle_command_reply: tid=0 2024-09-10T23:26:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 client.16242 shutdown 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 msgr2=0x55b1cac1c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac1c690 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4174007bc0 tx=0x7f4174004f90 comp rx=0 tx=0).stop 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 shutdown_connections 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac2c790 0x55b1cac2eb80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac1cd80 0x55b1cac1a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac10df0 0x55b1cac19ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 --2- 172.21.15.2:0/2073868288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac1c690 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 >> 172.21.15.2:0/2073868288 conn(0x55b1cac0e300 msgr2=0x55b1cac13e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4161ffb640 0 client.16242 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 shutdown_connections 2024-09-10T23:26:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 1 -- 172.21.15.2:0/2073868288 wait complete. 2024-09-10T23:26:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.725+0000 7f4182d56740 20 client.16242 trim_cache size 0 max 16384 2024-09-10T23:26:58.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 Processor -- start 2024-09-10T23:26:58.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 -- start start 2024-09-10T23:26:58.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac0dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1ae3a0 con 0x55b1cac104d0 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1afee0 con 0x55b1cac10df0 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4182d56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1aea70 con 0x55b1cac1cd80 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac0dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac0dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53284/0 (socket says 172.21.15.2:53284) 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 -- 172.21.15.2:0/2981241480 learned_addr learned my addr 172.21.15.2:0/2981241480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f4179d9b640 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 -- 172.21.15.2:0/2981241480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 msgr2=0x55b1cac1e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 -- 172.21.15.2:0/2981241480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 msgr2=0x55b1cac1b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 -- 172.21.15.2:0/2981241480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1cac19890 con 0x55b1cac104d0 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.739+0000 7f417ad9d640 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac0dc10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4174013040 tx=0x7f41740021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfa05d9bb44afd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4163fff640 1 -- 172.21.15.2:0/2981241480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174014070 con 0x55b1cac104d0 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4163fff640 1 -- 172.21.15.2:0/2981241480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f417402b020 con 0x55b1cac104d0 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4163fff640 1 -- 172.21.15.2:0/2981241480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41740256b0 con 0x55b1cac104d0 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 -- 172.21.15.2:0/2981241480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 msgr2=0x55b1cac0dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac0dc10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4174013040 tx=0x7f41740021f0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 -- 172.21.15.2:0/2981241480 shutdown_connections 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac1cd80 0x55b1cac1e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac1b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 --2- 172.21.15.2:0/2981241480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac104d0 0x55b1cac0dc10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 -- 172.21.15.2:0/2981241480 >> 172.21.15.2:0/2981241480 conn(0x55b1cac0e300 msgr2=0x55b1cac1b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 -- 172.21.15.2:0/2981241480 shutdown_connections 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.740+0000 7f4182d56740 1 -- 172.21.15.2:0/2981241480 wait complete. 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 -- start start 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 Processor -- start 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac104d0 0x55b1cac24cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac25210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 0x55b1cac1fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1af810 con 0x55b1cac1cd80 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1af140 con 0x55b1cac10df0 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1ac380 con 0x55b1cac104d0 2024-09-10T23:26:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4182d56740 10 client.0 _ll_register_callbacks cb 0x7f416c10c3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 0x55b1cac1fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 0x55b1cac1fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53294/0 (socket says 172.21.15.2:53294) 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 -- 172.21.15.2:0/1508645656 learned_addr learned my addr 172.21.15.2:0/1508645656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac104d0 0x55b1cac24cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f4179d9b640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac25210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 -- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac104d0 msgr2=0x55b1cac24cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac104d0 0x55b1cac24cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 -- 172.21.15.2:0/1508645656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 msgr2=0x55b1cac25210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac25210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.741+0000 7f417ad9d640 1 -- 172.21.15.2:0/1508645656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1cac25a60 con 0x55b1cac1cd80 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f417ad9d640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 0x55b1cac1fc80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4174005c90 tx=0x7f4174027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6780cb46d341884a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4161ffb640 1 -- 172.21.15.2:0/1508645656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174014030 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4161ffb640 1 -- 172.21.15.2:0/1508645656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4174010910 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417402b020 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4161ffb640 1 -- 172.21.15.2:0/1508645656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4174010b10 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 10 client.16248 fetch_fsmap learned FSMap version 28 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1cac99920 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4161ffb640 1 -- 172.21.15.2:0/1508645656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f417402b020 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4161ffb640 1 -- 172.21.15.2:0/1508645656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f417400f6e0 con 0x55b1cac1cd80 2024-09-10T23:26:58.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 10 client.16248 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 10 client.16248 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 20 client.16248 populate_metadata read hostname 'smithi002' 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac99f20 0x55b1cac9c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 4 client.16248 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.742+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1cab848a0 con 0x55b1cac99f20 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4179d9b640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac99f20 0x55b1cac9c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4179d9b640 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac99f20 0x55b1cac9c310 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7f577b101344cf23 server_cookie=2307a1cf08025a2 in_seq=0 out_seq=0 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4161ffb640 10 client.16248 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4161ffb640 1 -- 172.21.15.2:0/1508645656 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1cab848a0 con 0x55b1cac99f20 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4161ffb640 10 client.16248 handle_command_reply: tid=0 2024-09-10T23:26:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4182d56740 1 client.16248 shutdown 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 msgr2=0x55b1cac1fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.743+0000 7f4182d56740 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 0x55b1cac1fc80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4174005c90 tx=0x7f4174027040 comp rx=0 tx=0).stop 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 shutdown_connections 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b1cac99f20 0x55b1cac9c310 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1cac1cd80 0x55b1cac1fc80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1cac10df0 0x55b1cac25210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 --2- 172.21.15.2:0/1508645656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1cac104d0 0x55b1cac24cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4161ffb640 0 client.16248 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 >> 172.21.15.2:0/1508645656 conn(0x55b1cac0e300 msgr2=0x55b1cac1b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 shutdown_connections 2024-09-10T23:26:58.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 1 -- 172.21.15.2:0/1508645656 wait complete. 2024-09-10T23:26:58.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4182d56740 20 client.16248 trim_cache size 0 max 16384 2024-09-10T23:26:58.754 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:26:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41680b52e0 msgr2=0x7f41680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41680b52e0 0x7f41680b77a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c10c4d0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 msgr2=0x7f417c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c1992b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f416c005ab0 tx=0x7f416c003d50 comp rx=0 tx=0).stop 2024-09-10T23:26:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 shutdown_connections 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41680b52e0 0x7f41680b77a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f417c10d100 0x7f417c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417c1045c0 0x7f417c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 --2- 172.21.15.2:0/320288655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c103ca0 0x7f417c1992b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 >> 172.21.15.2:0/320288655 conn(0x7f417c0fd700 msgr2=0x7f417c10f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 shutdown_connections 2024-09-10T23:26:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:26:58.744+0000 7f4180981640 1 -- 172.21.15.2:0/320288655 wait complete. 2024-09-10T23:26:59.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:26:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:00.200 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:26:59 smithi002 ceph-mon[31150]: pgmap v431: 97 pgs: 97 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:26:59 smithi177 ceph-mon[35760]: pgmap v431: 97 pgs: 97 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:26:59 smithi154 ceph-mon[35136]: pgmap v431: 97 pgs: 97 active+clean; 1.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:00.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 -- 172.21.15.2:0/4171238290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 msgr2=0x7f5e4010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 --2- 172.21.15.2:0/4171238290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e4010f590 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009900 tx=0x7f5e3802a410 comp rx=0 tx=0).stop 2024-09-10T23:27:00.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 -- 172.21.15.2:0/4171238290 shutdown_connections 2024-09-10T23:27:00.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 --2- 172.21.15.2:0/4171238290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e4010f590 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 --2- 172.21.15.2:0/4171238290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401045b0 0x7f5e4010cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 --2- 172.21.15.2:0/4171238290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e40103bb0 0x7f5e40103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 -- 172.21.15.2:0/4171238290 >> 172.21.15.2:0/4171238290 conn(0x7f5e400fd720 msgr2=0x7f5e400ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 -- 172.21.15.2:0/4171238290 shutdown_connections 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.284+0000 7f5e45685640 1 -- 172.21.15.2:0/4171238290 wait complete. 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 Processor -- start 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 -- start start 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e40103bb0 0x7f5e40101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e401045b0 0x7f5e40101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e401024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40112da0 con 0x7f5e4010d160 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40112c20 con 0x7f5e401045b0 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e45685640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40112f20 con 0x7f5e40103bb0 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e401024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e401024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53308/0 (socket says 172.21.15.2:53308) 2024-09-10T23:27:00.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e3f7fe640 1 -- 172.21.15.2:0/2244739224 learned_addr learned my addr 172.21.15.2:0/2244739224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e3effd640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e40103bb0 0x7f5e40101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.285+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e401045b0 0x7f5e40101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e3f7fe640 1 -- 172.21.15.2:0/2244739224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e40103bb0 msgr2=0x7f5e40101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e40103bb0 0x7f5e40101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e3f7fe640 1 -- 172.21.15.2:0/2244739224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e401045b0 msgr2=0x7f5e40101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e401045b0 0x7f5e40101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e3f7fe640 1 -- 172.21.15.2:0/2244739224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e401a7650 con 0x7f5e4010d160 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e401024b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5e38004770 tx=0x7f5e38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e27fff640 1 -- 172.21.15.2:0/2244739224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3803f030 con 0x7f5e4010d160 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e27fff640 1 -- 172.21.15.2:0/2244739224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e38003aa0 con 0x7f5e4010d160 2024-09-10T23:27:00.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e401a78e0 con 0x7f5e4010d160 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e27fff640 1 -- 172.21.15.2:0/2244739224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38035070 con 0x7f5e4010d160 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.286+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e401a7dc0 con 0x7f5e4010d160 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.288+0000 7f5e47a5a740 1 Processor -- start 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.288+0000 7f5e27fff640 1 -- 172.21.15.2:0/2244739224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5e380035f0 con 0x7f5e4010d160 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 -- start start 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b05df0 0x55dbe8b11840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8a7bea0 con 0x55dbe8b11d80 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8a6b2d0 con 0x55dbe8b05df0 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8a6f0e0 con 0x55dbe8b054d0 2024-09-10T23:27:00.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53320/0 (socket says 172.21.15.2:53320) 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/100559270 learned_addr learned my addr 172.21.15.2:0/100559270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3effd640 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b05df0 0x55dbe8b11840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/100559270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 msgr2=0x55dbe8b058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/100559270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b05df0 msgr2=0x55dbe8b11840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b05df0 0x55dbe8b11840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.289+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/100559270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe87c9650 con 0x55dbe8b11d80 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e27fff640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5e280b52e0 0x7f5e280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14170 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5e340149c0 tx=0x7f5e3400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fbcd4c12d7973f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e3effd640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5e280b52e0 0x7f5e280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e27fff640 1 -- 172.21.15.2:0/2244739224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5e38106450 con 0x7f5e4010d160 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e257fa640 1 -- 172.21.15.2:0/100559270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e340142d0 con 0x55dbe8b11d80 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e257fa640 1 -- 172.21.15.2:0/100559270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e340054d0 con 0x55dbe8b11d80 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.290+0000 7f5e257fa640 1 -- 172.21.15.2:0/100559270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004e50 con 0x55dbe8b11d80 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 -- 172.21.15.2:0/100559270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 msgr2=0x55dbe8b14170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e3effd640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5e280b52e0 0x7f5e280b77a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55dbe8b041e0 tx=0x7f5e30009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14170 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5e340149c0 tx=0x7f5e3400c4d0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 -- 172.21.15.2:0/100559270 shutdown_connections 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14170 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b05df0 0x55dbe8b11840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/100559270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 -- 172.21.15.2:0/100559270 >> 172.21.15.2:0/100559270 conn(0x55dbe8b03300 msgr2=0x55dbe8b044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 -- 172.21.15.2:0/100559270 shutdown_connections 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 -- 172.21.15.2:0/100559270 wait complete. 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 -- start start 2024-09-10T23:27:00.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 Processor -- start 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 0x55dbe8b116f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.291+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b05df0 0x55dbe8b0eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b0f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dbe88cc700 con 0x55dbe8b054d0 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8a06160 con 0x55dbe8b11d80 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8b14a00 con 0x55dbe8b05df0 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e47a5a740 10 client.0 _ll_register_callbacks cb 0x55dbe8a1f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 0x55dbe8b116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 0x55dbe8b116f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53332/0 (socket says 172.21.15.2:53332) 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 -- 172.21.15.2:0/2307289524 learned_addr learned my addr 172.21.15.2:0/2307289524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b05df0 0x55dbe8b0eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b0f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 -- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b05df0 msgr2=0x55dbe8b0eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b05df0 0x55dbe8b0eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 -- 172.21.15.2:0/2307289524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 msgr2=0x55dbe8b0f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b0f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 -- 172.21.15.2:0/2307289524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe8a33c90 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b0f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e3effd640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 0x55dbe8b116f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5e30013c20 tx=0x7f5e30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d04a0bb0198f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e22ff5640 1 -- 172.21.15.2:0/2307289524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3002b060 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e340054d0 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.292+0000 7f5e22ff5640 1 -- 172.21.15.2:0/2307289524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5e30013c50 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e22ff5640 1 -- 172.21.15.2:0/2307289524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e30013e50 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 10 client.16260 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dbe8b20440 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e22ff5640 1 -- 172.21.15.2:0/2307289524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e340054d0 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e22ff5640 1 -- 172.21.15.2:0/2307289524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e3001a040 con 0x55dbe8b054d0 2024-09-10T23:27:00.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 10 client.16260 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 10 client.16260 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 20 client.16260 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b21950 0x55dbe8b23d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 4 client.16260 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbe8a7ddf0 con 0x55dbe8b21950 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.293+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b21950 0x55dbe8b23d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.294+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b21950 0x55dbe8b23d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da93e998df4e41ec server_cookie=9d75532b8d7bfbc7 in_seq=0 out_seq=0 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.294+0000 7f5e22ff5640 10 client.16260 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.294+0000 7f5e22ff5640 1 -- 172.21.15.2:0/2307289524 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbe8a7ddf0 con 0x55dbe8b21950 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.294+0000 7f5e22ff5640 10 client.16260 handle_command_reply: tid=0 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.294+0000 7f5e47a5a740 1 client.16260 shutdown 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 msgr2=0x55dbe8b116f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 0x55dbe8b116f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5e30013c20 tx=0x7f5e30004a40 comp rx=0 tx=0).stop 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 shutdown_connections 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b21950 0x55dbe8b23d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b0f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b05df0 0x55dbe8b0eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/2307289524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b054d0 0x55dbe8b116f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e22ff5640 0 client.16260 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 >> 172.21.15.2:0/2307289524 conn(0x55dbe8b03300 msgr2=0x55dbe8b08e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 shutdown_connections 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 1 -- 172.21.15.2:0/2307289524 wait complete. 2024-09-10T23:27:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.295+0000 7f5e47a5a740 20 client.16260 trim_cache size 0 max 16384 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 Processor -- start 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 -- start start 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b04ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b02c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b13170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401b04e0 con 0x55dbe8b05df0 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401b2020 con 0x55dbe8b11d80 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401b0bb0 con 0x55dbe8b054d0 2024-09-10T23:27:00.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.308+0000 7f5e3e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b02c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b02c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53346/0 (socket says 172.21.15.2:53346) 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1338293840 learned_addr learned my addr 172.21.15.2:0/1338293840 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3effd640 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b04ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b13170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1338293840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 msgr2=0x55dbe8b04ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b04ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1338293840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 msgr2=0x55dbe8b13170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b13170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1338293840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe8b05c20 con 0x55dbe8b05df0 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3effd640 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b04ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b02c10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5e34014990 tx=0x7f5e34004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0f1f0de545dfad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e24ff9640 1 -- 172.21.15.2:0/1338293840 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004680 con 0x55dbe8b05df0 2024-09-10T23:27:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e24ff9640 1 -- 172.21.15.2:0/1338293840 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e340140c0 con 0x55dbe8b05df0 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.309+0000 7f5e24ff9640 1 -- 172.21.15.2:0/1338293840 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e340126b0 con 0x55dbe8b05df0 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1338293840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 msgr2=0x55dbe8b02c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b02c10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5e34014990 tx=0x7f5e34004990 comp rx=0 tx=0).stop 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1338293840 shutdown_connections 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b11d80 0x55dbe8b13170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b02c10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1338293840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b054d0 0x55dbe8b04ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1338293840 >> 172.21.15.2:0/1338293840 conn(0x55dbe8b03300 msgr2=0x55dbe8b043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1338293840 shutdown_connections 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1338293840 wait complete. 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.310+0000 7f5e47a5a740 1 -- start start 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 Processor -- start 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b054d0 0x55dbe8b19eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b1a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401b1950 con 0x55dbe8b05df0 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401b1280 con 0x55dbe8b054d0 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401ae4c0 con 0x55dbe8b11d80 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b1a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e47a5a740 10 client.0 _ll_register_callbacks cb 0x7f5e300138d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b1a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53352/0 (socket says 172.21.15.2:53352) 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1307334412 learned_addr learned my addr 172.21.15.2:0/1307334412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3effd640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b054d0 0x55dbe8b19eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3f7fe640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b11d80 msgr2=0x55dbe8b14c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1307334412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b054d0 msgr2=0x55dbe8b19eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b054d0 0x55dbe8b19eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 -- 172.21.15.2:0/1307334412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe8b152c0 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3effd640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b054d0 0x55dbe8b19eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e3e7fc640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b1a3f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c610 tx=0x7f5e3400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7849864064f8245 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.311+0000 7f5e22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e22ff5640 1 -- 172.21.15.2:0/1307334412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400f730 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e22ff5640 1 -- 172.21.15.2:0/1307334412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5e3400f8d0 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e340140c0 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e22ff5640 1 -- 172.21.15.2:0/1307334412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e3400fad0 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 10 client.16266 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dbe8b8f180 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e22ff5640 1 -- 172.21.15.2:0/1307334412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e340140c0 con 0x55dbe8b05df0 2024-09-10T23:27:00.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e22ff5640 1 -- 172.21.15.2:0/1307334412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e34032070 con 0x55dbe8b05df0 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 10 client.16266 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 10 client.16266 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 20 client.16266 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b8f700 0x55dbe8b91b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 4 client.16266 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.312+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dbe8a798a0 con 0x55dbe8b8f700 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e3effd640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b8f700 0x55dbe8b91b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e22ff5640 10 client.16266 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e3effd640 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b8f700 0x55dbe8b91b20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dec4849e74aee64f server_cookie=ca45ddff38cf08ae in_seq=0 out_seq=0 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e22ff5640 1 -- 172.21.15.2:0/1307334412 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dbe8a798a0 con 0x55dbe8b8f700 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e22ff5640 10 client.16266 handle_command_reply: tid=0 2024-09-10T23:27:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 client.16266 shutdown 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 msgr2=0x55dbe8b1a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b1a3f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c610 tx=0x7f5e3400cd90 comp rx=0 tx=0).stop 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 shutdown_connections 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55dbe8b8f700 0x55dbe8b91b20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dbe8b11d80 0x55dbe8b14c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe8b05df0 0x55dbe8b1a3f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 --2- 172.21.15.2:0/1307334412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dbe8b054d0 0x55dbe8b19eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 >> 172.21.15.2:0/1307334412 conn(0x55dbe8b03300 msgr2=0x55dbe8b10170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e22ff5640 0 client.16266 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.313+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 shutdown_connections 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e47a5a740 1 -- 172.21.15.2:0/1307334412 wait complete. 2024-09-10T23:27:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e47a5a740 20 client.16266 trim_cache size 0 max 16384 2024-09-10T23:27:00.322 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5e280b52e0 msgr2=0x7f5e280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5e280b52e0 0x7f5e280b77a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55dbe8b041e0 tx=0x7f5e30009680 comp rx=0 tx=0).stop 2024-09-10T23:27:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 msgr2=0x7f5e401024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e401024b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5e38004770 tx=0x7f5e38004270 comp rx=0 tx=0).stop 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 shutdown_connections 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5e280b52e0 0x7f5e280b77a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e4010d160 0x7f5e401024b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e401045b0 0x7f5e40101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 --2- 172.21.15.2:0/2244739224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e40103bb0 0x7f5e40101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 >> 172.21.15.2:0/2244739224 conn(0x7f5e400fd720 msgr2=0x7f5e400fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 shutdown_connections 2024-09-10T23:27:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:00.314+0000 7f5e45685640 1 -- 172.21.15.2:0/2244739224 wait complete. 2024-09-10T23:27:01.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:27:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 -- 172.21.15.2:0/875262250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a81087d0 msgr2=0x7fc8a8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/875262250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a81087d0 0x7fc8a8108c10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc890009900 tx=0x7fc89002a410 comp rx=0 tx=0).stop 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 -- 172.21.15.2:0/875262250 shutdown_connections 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/875262250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a8109150 0x7fc8a810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/875262250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a81087d0 0x7fc8a8108c10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/875262250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 0x7fc8a81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 -- 172.21.15.2:0/875262250 >> 172.21.15.2:0/875262250 conn(0x7fc8a80fe830 msgr2=0x7fc8a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 -- 172.21.15.2:0/875262250 shutdown_connections 2024-09-10T23:27:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.921+0000 7fc8aeb97640 1 -- 172.21.15.2:0/875262250 wait complete. 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 Processor -- start 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 -- start start 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 0x7fc8a8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a81087d0 0x7fc8a8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 0x7fc8a819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8112e10 con 0x7fc8a8109150 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8112c90 con 0x7fc8a8102dc0 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8aeb97640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8112f90 con 0x7fc8a81087d0 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 0x7fc8a819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 0x7fc8a819ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49342/0 (socket says 172.21.15.2:49342) 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 -- 172.21.15.2:0/3566528829 learned_addr learned my addr 172.21.15.2:0/3566528829 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a81087d0 0x7fc8a8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ac933640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 0x7fc8a8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 -- 172.21.15.2:0/3566528829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a81087d0 msgr2=0x7fc8a8199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a81087d0 0x7fc8a8199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 -- 172.21.15.2:0/3566528829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 msgr2=0x7fc8a8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 0x7fc8a8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ad134640 1 -- 172.21.15.2:0/3566528829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a819f3b0 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8ac933640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 0x7fc8a8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.922+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a81087d0 0x7fc8a8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.923+0000 7fc8ad134640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 0x7fc8a819ebe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000cad0 tx=0x7fc8a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.923+0000 7fc8a5ffb640 1 -- 172.21.15.2:0/3566528829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000ae20 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.923+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a819f6a0 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.923+0000 7fc8a5ffb640 1 -- 172.21.15.2:0/3566528829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a0005020 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.923+0000 7fc8a5ffb640 1 -- 172.21.15.2:0/3566528829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000f6b0 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.923+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a81a5d60 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.925+0000 7fc8a5ffb640 1 -- 172.21.15.2:0/3566528829 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc8a00054f0 con 0x7fc8a8109150 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.926+0000 7fc8b0f6c740 1 Processor -- start 2024-09-10T23:27:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.926+0000 7fc8b0f6c740 1 -- start start 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a5ffb640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8940b52e0 0x7fc8940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c438d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4399460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c439bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626c4303ea0 con 0x5626c438da10 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5626c42f32d0 con 0x5626c438d0f0 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5626c42f70e0 con 0x5626c43999a0 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a5ffb640 1 -- 172.21.15.2:0/3566528829 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc8a00e5d20 con 0x7fc8a8109150 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4399460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8940b52e0 0x7fc8940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4399460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49352/0 (socket says 172.21.15.2:49352) 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ad134640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c439bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a7fff640 1 -- 172.21.15.2:0/4162499819 learned_addr learned my addr 172.21.15.2:0/4162499819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ac933640 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c438d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ad134640 1 -- 172.21.15.2:0/4162499819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 msgr2=0x5626c438d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ad134640 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c438d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ad134640 1 -- 172.21.15.2:0/4162499819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 msgr2=0x5626c4399460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ad134640 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4399460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8ad134640 1 -- 172.21.15.2:0/4162499819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c4051650 con 0x5626c43999a0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.927+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4399460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.928+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8940b52e0 0x7fc8940b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc890032fd0 tx=0x7fc890005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.928+0000 7fc8ad134640 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c439bd90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000caa0 tx=0x7fc8a00abc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbf355de595df92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.928+0000 7fc89effd640 1 -- 172.21.15.2:0/4162499819 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00acb90 con 0x5626c43999a0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.928+0000 7fc89effd640 1 -- 172.21.15.2:0/4162499819 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a00ac490 con 0x5626c43999a0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.928+0000 7fc89effd640 1 -- 172.21.15.2:0/4162499819 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00a6b90 con 0x5626c43999a0 2024-09-10T23:27:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/4162499819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 msgr2=0x5626c439bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c439bd90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000caa0 tx=0x7fc8a00abc00 comp rx=0 tx=0).stop 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/4162499819 shutdown_connections 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c439bd90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4399460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/4162499819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c438d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/4162499819 >> 172.21.15.2:0/4162499819 conn(0x5626c438af20 msgr2=0x5626c438c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/4162499819 shutdown_connections 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/4162499819 wait complete. 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 -- start start 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.929+0000 7fc8b0f6c740 1 Processor -- start 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 0x5626c43992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438da10 0x5626c4396720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4396da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626c4154700 con 0x5626c438d0f0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5626c428e160 con 0x5626c438da10 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5626c439c5c0 con 0x5626c43999a0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 10 client.0 _ll_register_callbacks cb 0x5626c42a79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 0x5626c43992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 0x5626c43992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49360/0 (socket says 172.21.15.2:49360) 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 -- 172.21.15.2:0/3351371467 learned_addr learned my addr 172.21.15.2:0/3351371467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ad134640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4396da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438da10 0x5626c4396720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 -- 172.21.15.2:0/3351371467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 msgr2=0x5626c4396da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4396da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 -- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438da10 msgr2=0x5626c4396720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438da10 0x5626c4396720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 -- 172.21.15.2:0/3351371467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626c42bbc90 con 0x5626c438d0f0 2024-09-10T23:27:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8ac933640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 0x5626c43992d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc898010500 tx=0x7fc898010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63907657b452aa2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc887fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc887fff640 1 -- 172.21.15.2:0/3351371467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898018070 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc887fff640 1 -- 172.21.15.2:0/3351371467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc898014640 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.930+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a00ac490 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.931+0000 7fc887fff640 1 -- 172.21.15.2:0/3351371467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc898024050 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.931+0000 7fc8b0f6c740 10 client.16278 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.931+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626c43a7f90 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.934+0000 7fc887fff640 1 -- 172.21.15.2:0/3351371467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a00ac490 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.934+0000 7fc887fff640 1 -- 172.21.15.2:0/3351371467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc898013920 con 0x5626c438d0f0 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.934+0000 7fc8b0f6c740 10 client.16278 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.934+0000 7fc8b0f6c740 10 client.16278 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.934+0000 7fc8b0f6c740 20 client.16278 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.934+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c43a93f0 0x5626c43ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.935+0000 7fc8b0f6c740 4 client.16278 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.935+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626c4305df0 con 0x5626c43a93f0 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.935+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c43a93f0 0x5626c43ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.935+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c43a93f0 0x5626c43ab860 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd387f46db7992ee server_cookie=ba8efafb97c64d66 in_seq=0 out_seq=0 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.935+0000 7fc887fff640 10 client.16278 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc887fff640 1 -- 172.21.15.2:0/3351371467 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626c4305df0 con 0x5626c43a93f0 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc887fff640 10 client.16278 handle_command_reply: tid=0 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 client.16278 shutdown 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 msgr2=0x5626c43992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 0x5626c43992d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc898010500 tx=0x7fc898010900 comp rx=0 tx=0).stop 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 shutdown_connections 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4396da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438da10 0x5626c4396720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c43a93f0 0x5626c43ab860 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/3351371467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438d0f0 0x5626c43992d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc887fff640 0 client.16278 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 >> 172.21.15.2:0/3351371467 conn(0x5626c438af20 msgr2=0x5626c4390ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 shutdown_connections 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/3351371467 wait complete. 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.936+0000 7fc8b0f6c740 20 client.16278 trim_cache size 0 max 16384 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.949+0000 7fc8b0f6c740 1 Processor -- start 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.949+0000 7fc8b0f6c740 1 -- start start 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4398460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c43a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c43a2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81ae460 con 0x5626c438da10 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81affa0 con 0x5626c438d0f0 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81aeb30 con 0x5626c43999a0 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c43a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c43a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49370/0 (socket says 172.21.15.2:49370) 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 -- 172.21.15.2:0/108474353 learned_addr learned my addr 172.21.15.2:0/108474353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8ad134640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c43a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8ac933640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4398460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 -- 172.21.15.2:0/108474353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 msgr2=0x5626c43a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c43a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 -- 172.21.15.2:0/108474353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 msgr2=0x5626c4398460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4398460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 -- 172.21.15.2:0/108474353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c438d840 con 0x5626c438da10 2024-09-10T23:27:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8ac933640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4398460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8ad134640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c43a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c43a1c30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc890031a90 tx=0x7fc89002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b1c745925ded9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc89e7fc640 1 -- 172.21.15.2:0/108474353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890035040 con 0x5626c438da10 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.950+0000 7fc89e7fc640 1 -- 172.21.15.2:0/108474353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc890003ca0 con 0x5626c438da10 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc89e7fc640 1 -- 172.21.15.2:0/108474353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89003db30 con 0x5626c438da10 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/108474353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 msgr2=0x5626c43a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c43a1c30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc890031a90 tx=0x7fc89002a410 comp rx=0 tx=0).stop 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/108474353 shutdown_connections 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c43a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c43a1c30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/108474353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4398460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/108474353 >> 172.21.15.2:0/108474353 conn(0x5626c438af20 msgr2=0x5626c4397d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/108474353 shutdown_connections 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/108474353 wait complete. 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.951+0000 7fc8b0f6c740 1 -- start start 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 Processor -- start 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4393970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4393eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4394410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81af8d0 con 0x5626c438da10 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81af200 con 0x5626c438d0f0 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81ac440 con 0x5626c43999a0 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8b0f6c740 10 client.0 _ll_register_callbacks cb 0x7fc898007440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4393eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4393eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49372/0 (socket says 172.21.15.2:49372) 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 -- 172.21.15.2:0/1390227376 learned_addr learned my addr 172.21.15.2:0/1390227376 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8ad134640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4394410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8ac933640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4393970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 -- 172.21.15.2:0/1390227376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 msgr2=0x5626c4394410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4394410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 -- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 msgr2=0x5626c4393970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4393970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8a7fff640 1 -- 172.21.15.2:0/1390227376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626c43b0840 con 0x5626c438da10 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8ad134640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4394410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.952+0000 7fc8ac933640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4393970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8a7fff640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4393eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc890006010 tx=0x7fc890032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7c4cbeb7360636 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc887fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc887fff640 1 -- 172.21.15.2:0/1390227376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890035070 con 0x5626c438da10 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc887fff640 1 -- 172.21.15.2:0/1390227376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc890003a00 con 0x5626c438da10 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc890003ca0 con 0x5626c438da10 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc887fff640 1 -- 172.21.15.2:0/1390227376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc89003d480 con 0x5626c438da10 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 10 client.16284 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626c441b960 con 0x5626c438da10 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc887fff640 1 -- 172.21.15.2:0/1390227376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc890003ca0 con 0x5626c438da10 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc887fff640 1 -- 172.21.15.2:0/1390227376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc89004a590 con 0x5626c438da10 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 10 client.16284 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 10 client.16284 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 20 client.16284 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c441c0a0 0x5626c441e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 4 client.16284 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.953+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5626c43018a0 con 0x5626c441c0a0 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8ac933640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c441c0a0 0x5626c441e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8ac933640 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c441c0a0 0x5626c441e4c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a8a02074aefd023 server_cookie=edcdb391005ce0fa in_seq=0 out_seq=0 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc887fff640 10 client.16284 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc887fff640 1 -- 172.21.15.2:0/1390227376 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5626c43018a0 con 0x5626c441c0a0 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc887fff640 10 client.16284 handle_command_reply: tid=0 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 client.16284 shutdown 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 msgr2=0x5626c4393eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4393eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc890006010 tx=0x7fc890032f30 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 shutdown_connections 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626c43999a0 0x5626c4394410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5626c441c0a0 0x5626c441e4c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626c438da10 0x5626c4393eb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 --2- 172.21.15.2:0/1390227376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626c438d0f0 0x5626c4393970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc887fff640 0 client.16284 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.954+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 >> 172.21.15.2:0/1390227376 conn(0x5626c438af20 msgr2=0x5626c4398570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 shutdown_connections 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8b0f6c740 1 -- 172.21.15.2:0/1390227376 wait complete. 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8b0f6c740 20 client.16284 trim_cache size 0 max 16384 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8940b52e0 msgr2=0x7fc8940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8940b52e0 0x7fc8940b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc890032fd0 tx=0x7fc890005b50 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 msgr2=0x7fc8a819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 0x7fc8a819ebe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000cad0 tx=0x7fc8a000cf90 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 shutdown_connections 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc8940b52e0 0x7fc8940b77a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a8109150 0x7fc8a819ebe0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8a81087d0 0x7fc8a8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 --2- 172.21.15.2:0/3566528829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a8102dc0 0x7fc8a8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 >> 172.21.15.2:0/3566528829 conn(0x7fc8a80fe830 msgr2=0x7fc8a8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 shutdown_connections 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:01.955+0000 7fc8aeb97640 1 -- 172.21.15.2:0/3566528829 wait complete. 2024-09-10T23:27:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:01 smithi177 ceph-mon[35760]: pgmap v432: 97 pgs: 97 active+clean; 1.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:02.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:01 smithi002 ceph-mon[31150]: pgmap v432: 97 pgs: 97 active+clean; 1.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:01 smithi154 ceph-mon[35136]: pgmap v432: 97 pgs: 97 active+clean; 1.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:02.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:27:03.027 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.534+0000 7f64879d7640 1 -- 172.21.15.2:0/1707683141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 msgr2=0x7f64801117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 --2- 172.21.15.2:0/1707683141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801117d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6478009ca0 tx=0x7f647802a950 comp rx=0 tx=0).stop 2024-09-10T23:27:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 -- 172.21.15.2:0/1707683141 shutdown_connections 2024-09-10T23:27:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 --2- 172.21.15.2:0/1707683141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801117d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 --2- 172.21.15.2:0/1707683141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6480102150 0x7f648010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 --2- 172.21.15.2:0/1707683141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6480101830 0x7f6480101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 -- 172.21.15.2:0/1707683141 >> 172.21.15.2:0/1707683141 conn(0x7f64800fd700 msgr2=0x7f64800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 -- 172.21.15.2:0/1707683141 shutdown_connections 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 -- 172.21.15.2:0/1707683141 wait complete. 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 Processor -- start 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.535+0000 7f64879d7640 1 -- start start 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f64879d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6480101830 0x7f648019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f64879d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6480102150 0x7f648019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f64879d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f64879d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6480114f20 con 0x7f648010f3e0 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f64879d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6480114da0 con 0x7f6480101830 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f64879d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f64801150a0 con 0x7f6480102150 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49392/0 (socket says 172.21.15.2:49392) 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 -- 172.21.15.2:0/1493607939 learned_addr learned my addr 172.21.15.2:0/1493607939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6484f72640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6480102150 0x7f648019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485773640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6480101830 0x7f648019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 -- 172.21.15.2:0/1493607939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6480102150 msgr2=0x7f648019b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6480102150 0x7f648019b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 -- 172.21.15.2:0/1493607939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6480101830 msgr2=0x7f648019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6480101830 0x7f648019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 -- 172.21.15.2:0/1493607939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64801a1460 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.536+0000 7f6485f74640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801a0c90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f647802ae70 tx=0x7f647802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.537+0000 7f64767fc640 1 -- 172.21.15.2:0/1493607939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478034040 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.537+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64801a16f0 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.537+0000 7f64767fc640 1 -- 172.21.15.2:0/1493607939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64780308f0 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.537+0000 7f64767fc640 1 -- 172.21.15.2:0/1493607939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64780047f0 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.537+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64801a7e10 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.539+0000 7f64767fc640 1 -- 172.21.15.2:0/1493607939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f647804d030 con 0x7f648010f3e0 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 Processor -- start 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 -- start start 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c74d0 0x55e0941c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 0x55e0941d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941d6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e09413dea0 con 0x55e0941c7df0 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e09412d2d0 con 0x55e0941c74d0 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6489dac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0941310e0 con 0x55e0941d3d80 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 0x55e0941d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 0x55e0941d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49394/0 (socket says 172.21.15.2:49394) 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 -- 172.21.15.2:0/2121854508 learned_addr learned my addr 172.21.15.2:0/2121854508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6484f72640 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941d6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6484f72640 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c74d0 0x55e0941c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 -- 172.21.15.2:0/2121854508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 msgr2=0x55e0941d6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941d6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 -- 172.21.15.2:0/2121854508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c74d0 msgr2=0x55e0941c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.540+0000 7f6485773640 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c74d0 0x55e0941c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f6485773640 1 -- 172.21.15.2:0/2121854508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e093e8b650 con 0x55e0941c7df0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f6484f72640 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c74d0 0x55e0941c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f64767fc640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f646c0b52e0 0x7f646c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f6485773640 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 0x55e0941d3840 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f647c00bcb0 tx=0x7f647c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18077165412e1224 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f6484f72640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f646c0b52e0 0x7f646c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f646b7fe640 1 -- 172.21.15.2:0/2121854508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c015070 con 0x55e0941c7df0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f64767fc640 1 -- 172.21.15.2:0/1493607939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6478106b10 con 0x7f648010f3e0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f646b7fe640 1 -- 172.21.15.2:0/2121854508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c01a910 con 0x55e0941c7df0 2024-09-10T23:27:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.541+0000 7f646b7fe640 1 -- 172.21.15.2:0/2121854508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c011980 con 0x55e0941c7df0 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 -- 172.21.15.2:0/2121854508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 msgr2=0x55e0941d3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 0x55e0941d3840 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f647c00bcb0 tx=0x7f647c00f730 comp rx=0 tx=0).stop 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6484f72640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f646c0b52e0 0x7f646c0b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6470005fd0 tx=0x7f647000d920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 -- 172.21.15.2:0/2121854508 shutdown_connections 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941d6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c7df0 0x55e0941d3840 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 --2- 172.21.15.2:0/2121854508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c74d0 0x55e0941c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 -- 172.21.15.2:0/2121854508 >> 172.21.15.2:0/2121854508 conn(0x55e0941c5300 msgr2=0x55e0941c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 -- 172.21.15.2:0/2121854508 shutdown_connections 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 -- 172.21.15.2:0/2121854508 wait complete. 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 -- start start 2024-09-10T23:27:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.542+0000 7f6489dac740 1 Processor -- start 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941c74d0 0x55e0941d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 0x55e0941d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e093f8e700 con 0x55e0941d3d80 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e0940c8160 con 0x55e0941c7df0 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0941d6a00 con 0x55e0941c74d0 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6489dac740 10 client.0 _ll_register_callbacks cb 0x55e0940e19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 0x55e0941d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 0x55e0941d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49398/0 (socket says 172.21.15.2:49398) 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 -- 172.21.15.2:0/1887823793 learned_addr learned my addr 172.21.15.2:0/1887823793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485773640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941c74d0 0x55e0941d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6484f72640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 -- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941c74d0 msgr2=0x55e0941d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941c74d0 0x55e0941d3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 -- 172.21.15.2:0/1887823793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 msgr2=0x55e0941d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 -- 172.21.15.2:0/1887823793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0940f5c90 con 0x55e0941d3d80 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6485f74640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 0x55e0941d1000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6478006010 tx=0x7f64780c9180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca20bf712f72902 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.543+0000 7f6468ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6468ff9640 1 -- 172.21.15.2:0/1887823793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647802c040 con 0x55e0941d3d80 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6468ff9640 1 -- 172.21.15.2:0/1887823793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f64780d65e0 con 0x55e0941d3d80 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f647c01a910 con 0x55e0941d3d80 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6468ff9640 1 -- 172.21.15.2:0/1887823793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f64780cca50 con 0x55e0941d3d80 2024-09-10T23:27:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 10 client.16296 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0941e2270 con 0x55e0941d3d80 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6468ff9640 1 -- 172.21.15.2:0/1887823793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c01a910 con 0x55e0941d3d80 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6468ff9640 1 -- 172.21.15.2:0/1887823793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64780f40e0 con 0x55e0941d3d80 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 10 client.16296 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 20 client.16296 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e0941e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 4 client.16296 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.544+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e09413fdf0 con 0x55e0941e3720 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.545+0000 7f6485773640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e0941e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.545+0000 7f6485773640 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e0941e5b50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f2ac951e7659683 server_cookie=80242a938c40181f in_seq=0 out_seq=0 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.545+0000 7f6468ff9640 10 client.16296 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6468ff9640 1 -- 172.21.15.2:0/1887823793 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e09413fdf0 con 0x55e0941e3720 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6468ff9640 10 client.16296 handle_command_reply: tid=0 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 client.16296 shutdown 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 msgr2=0x55e0941d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 0x55e0941d1000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6478006010 tx=0x7f64780c9180 comp rx=0 tx=0).stop 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 shutdown_connections 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e0941e5b50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6468ff9640 0 client.16296 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941d3d80 0x55e0941d1000 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 --2- 172.21.15.2:0/1887823793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941c74d0 0x55e0941d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 >> 172.21.15.2:0/1887823793 conn(0x55e0941c5300 msgr2=0x55e0941caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 shutdown_connections 2024-09-10T23:27:03.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 1 -- 172.21.15.2:0/1887823793 wait complete. 2024-09-10T23:27:03.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.546+0000 7f6489dac740 20 client.16296 trim_cache size 0 max 16384 2024-09-10T23:27:03.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.560+0000 7f6489dac740 1 Processor -- start 2024-09-10T23:27:03.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 -- start start 2024-09-10T23:27:03.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64801b0330 con 0x55e0941c74d0 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64801b1e70 con 0x55e0941c7df0 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6489dac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f64801b0a00 con 0x55e0941d3d80 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49406/0 (socket says 172.21.15.2:49406) 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 -- 172.21.15.2:0/2245314788 learned_addr learned my addr 172.21.15.2:0/2245314788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6484f72640 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485f74640 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 -- 172.21.15.2:0/2245314788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 msgr2=0x55e0941ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 -- 172.21.15.2:0/2245314788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 msgr2=0x55e0941cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.561+0000 7f6485773640 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.562+0000 7f6485773640 1 -- 172.21.15.2:0/2245314788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0941cb780 con 0x55e0941c74d0 2024-09-10T23:27:03.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.562+0000 7f6485773640 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941c4c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f647c00bcb0 tx=0x7f647c0114e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190fa0103d6d11a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.562+0000 7f646affd640 1 -- 172.21.15.2:0/2245314788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c031070 con 0x55e0941c74d0 2024-09-10T23:27:03.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.562+0000 7f646affd640 1 -- 172.21.15.2:0/2245314788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c005040 con 0x55e0941c74d0 2024-09-10T23:27:03.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.562+0000 7f646affd640 1 -- 172.21.15.2:0/2245314788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c015040 con 0x55e0941c74d0 2024-09-10T23:27:03.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 -- 172.21.15.2:0/2245314788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 msgr2=0x55e0941c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941c4c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f647c00bcb0 tx=0x7f647c0114e0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 -- 172.21.15.2:0/2245314788 shutdown_connections 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e0941ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 --2- 172.21.15.2:0/2245314788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941c4c10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 -- 172.21.15.2:0/2245314788 >> 172.21.15.2:0/2245314788 conn(0x55e0941c5300 msgr2=0x55e0941d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 -- 172.21.15.2:0/2245314788 shutdown_connections 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.563+0000 7f6489dac740 1 -- 172.21.15.2:0/2245314788 wait complete. 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 -- start start 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 Processor -- start 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e094257e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64801b17a0 con 0x55e0941c74d0 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64801b10d0 con 0x55e0941c7df0 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f64801ae310 con 0x55e0941d3d80 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6489dac740 10 client.0 _ll_register_callbacks cb 0x7f6478005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6485773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6485773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941d7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49416/0 (socket says 172.21.15.2:49416) 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.564+0000 7f6485773640 1 -- 172.21.15.2:0/2657593088 learned_addr learned my addr 172.21.15.2:0/2657593088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6484f72640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485f74640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e094257e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485773640 1 -- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 msgr2=0x55e094257e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485773640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e094257e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485773640 1 -- 172.21.15.2:0/2657593088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 msgr2=0x55e0941d8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485773640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485773640 1 -- 172.21.15.2:0/2657593088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e094258370 con 0x55e0941c74d0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6485773640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941d7fd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f647c004630 tx=0x7f647c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846649d89d5d756f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6468ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6468ff9640 1 -- 172.21.15.2:0/2657593088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c03a060 con 0x55e0941c74d0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f647c005040 con 0x55e0941c74d0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.565+0000 7f6468ff9640 1 -- 172.21.15.2:0/2657593088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f647c0051f0 con 0x55e0941c74d0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6468ff9640 1 -- 172.21.15.2:0/2657593088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f647c031040 con 0x55e0941c74d0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 10 client.16302 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e094259530 con 0x55e0941c74d0 2024-09-10T23:27:03.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6468ff9640 1 -- 172.21.15.2:0/2657593088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c005040 con 0x55e0941c74d0 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6468ff9640 1 -- 172.21.15.2:0/2657593088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f647c004680 con 0x55e0941c74d0 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 10 client.16302 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 20 client.16302 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e09425bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 4 client.16302 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.566+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e09413b8a0 con 0x55e0941e3720 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.567+0000 7f6484f72640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e09425bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.567+0000 7f6468ff9640 10 client.16302 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.567+0000 7f6484f72640 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e09425bab0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1019cc11db16941 server_cookie=de098ea892c72c19 in_seq=0 out_seq=0 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.567+0000 7f6468ff9640 1 -- 172.21.15.2:0/2657593088 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e09413b8a0 con 0x55e0941e3720 2024-09-10T23:27:03.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.567+0000 7f6468ff9640 10 client.16302 handle_command_reply: tid=0 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.567+0000 7f6489dac740 1 client.16302 shutdown 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 msgr2=0x55e0941d7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941d7fd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f647c004630 tx=0x7f647c00bf00 comp rx=0 tx=0).stop 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 shutdown_connections 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0941e3720 0x55e09425bab0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0941d3d80 0x55e094257e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0941c7df0 0x55e0941d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 --2- 172.21.15.2:0/2657593088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0941c74d0 0x55e0941d7fd0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 >> 172.21.15.2:0/2657593088 conn(0x55e0941c5300 msgr2=0x55e0941ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6468ff9640 0 client.16302 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 shutdown_connections 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 1 -- 172.21.15.2:0/2657593088 wait complete. 2024-09-10T23:27:03.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.568+0000 7f6489dac740 20 client.16302 trim_cache size 0 max 16384 2024-09-10T23:27:03.573 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:03.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f646c0b52e0 msgr2=0x7f646c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f646c0b52e0 0x7f646c0b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6470005fd0 tx=0x7f647000d920 comp rx=0 tx=0).stop 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 msgr2=0x7f64801a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801a0c90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f647802ae70 tx=0x7f647802f5d0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 shutdown_connections 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f646c0b52e0 0x7f646c0b77a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f648010f3e0 0x7f64801a0c90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6480102150 0x7f648019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 --2- 172.21.15.2:0/1493607939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6480101830 0x7f648019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 >> 172.21.15.2:0/1493607939 conn(0x7f64800fd700 msgr2=0x7f6480111530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 shutdown_connections 2024-09-10T23:27:03.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:03.569+0000 7f64879d7640 1 -- 172.21.15.2:0/1493607939 wait complete. 2024-09-10T23:27:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:03 smithi177 ceph-mon[35760]: pgmap v433: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:27:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:03 smithi002 ceph-mon[31150]: pgmap v433: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:27:04.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:03 smithi154 ceph-mon[35136]: pgmap v433: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:27:05.400 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:27:05.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:27:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:05 smithi177 ceph-mon[35760]: pgmap v434: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:06.217 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:05 smithi002 ceph-mon[31150]: pgmap v434: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:05 smithi154 ceph-mon[35136]: pgmap v434: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:06.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.305+0000 7f421f3cc640 1 -- 172.21.15.2:0/162018943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42181087d0 msgr2=0x7f4218108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.305+0000 7f421f3cc640 1 --2- 172.21.15.2:0/162018943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42181087d0 0x7f4218108c10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f420c009900 tx=0x7f420c02a410 comp rx=0 tx=0).stop 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 -- 172.21.15.2:0/162018943 shutdown_connections 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 --2- 172.21.15.2:0/162018943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4218109150 0x7f421810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 --2- 172.21.15.2:0/162018943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42181087d0 0x7f4218108c10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 --2- 172.21.15.2:0/162018943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218102dc0 0x7f42181031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 -- 172.21.15.2:0/162018943 >> 172.21.15.2:0/162018943 conn(0x7f42180fe830 msgr2=0x7f4218100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 -- 172.21.15.2:0/162018943 shutdown_connections 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 -- 172.21.15.2:0/162018943 wait complete. 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 Processor -- start 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 -- start start 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.306+0000 7f421f3cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 0x7f4218199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42181087d0 0x7f4218199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218109150 0x7f421819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4218112dd0 con 0x7f4218102dc0 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4218112c50 con 0x7f42181087d0 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4218112f50 con 0x7f4218109150 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 0x7f4218199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 0x7f4218199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49436/0 (socket says 172.21.15.2:49436) 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 -- 172.21.15.2:0/2300299667 learned_addr learned my addr 172.21.15.2:0/2300299667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d969640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218109150 0x7f421819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421c967640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42181087d0 0x7f4218199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 -- 172.21.15.2:0/2300299667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218109150 msgr2=0x7f421819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218109150 0x7f421819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 -- 172.21.15.2:0/2300299667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42181087d0 msgr2=0x7f4218199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42181087d0 0x7f4218199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 -- 172.21.15.2:0/2300299667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421819f3f0 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d969640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218109150 0x7f421819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421c967640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42181087d0 0x7f4218199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421d168640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 0x7f4218199340 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f421000c970 tx=0x7f421000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f42167fc640 1 -- 172.21.15.2:0/2300299667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210007bb0 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421819f6e0 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f42167fc640 1 -- 172.21.15.2:0/2300299667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4210007d50 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f42167fc640 1 -- 172.21.15.2:0/2300299667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421000f450 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.307+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42181a5da0 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.310+0000 7f42217a1740 1 Processor -- start 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.310+0000 7f42167fc640 1 -- 172.21.15.2:0/2300299667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f4210004f20 con 0x7f4218102dc0 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.310+0000 7f42217a1740 1 -- start start 2024-09-10T23:27:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42217a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42217a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c49660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42217a1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c4bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42217a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590a3bafe60 con 0x5590a3c39800 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42217a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590a3b9f290 con 0x5590a3c38ee0 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42217a1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5590a3ba30a0 con 0x5590a3c49ba0 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c49660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c49660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49442/0 (socket says 172.21.15.2:49442) 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 -- 172.21.15.2:0/1294507286 learned_addr learned my addr 172.21.15.2:0/1294507286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d969640 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421c967640 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c4bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 -- 172.21.15.2:0/1294507286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 msgr2=0x5590a3c4bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c4bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 -- 172.21.15.2:0/1294507286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 msgr2=0x5590a3c392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f421d168640 1 -- 172.21.15.2:0/1294507286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a38fd930 con 0x5590a3c39800 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.311+0000 7f42167fc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f42000b52e0 0x7f42000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f421d168640 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c49660 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f42100ebbc0 tx=0x7f42100ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3928d5fe6b9d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f421d969640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f42000b52e0 0x7f42000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f42167fc640 1 -- 172.21.15.2:0/2300299667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f42100e59c0 con 0x7f4218102dc0 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f41ff7fe640 1 -- 172.21.15.2:0/1294507286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421001d020 con 0x5590a3c39800 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f421d969640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f42000b52e0 0x7f42000b77a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4208005fd0 tx=0x7f4208009780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f41ff7fe640 1 -- 172.21.15.2:0/1294507286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42100055f0 con 0x5590a3c39800 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.312+0000 7f41ff7fe640 1 -- 172.21.15.2:0/1294507286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210070070 con 0x5590a3c39800 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 -- 172.21.15.2:0/1294507286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 msgr2=0x5590a3c49660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c49660 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f42100ebbc0 tx=0x7f42100ed690 comp rx=0 tx=0).stop 2024-09-10T23:27:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 -- 172.21.15.2:0/1294507286 shutdown_connections 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c4bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c49660 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 --2- 172.21.15.2:0/1294507286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 -- 172.21.15.2:0/1294507286 >> 172.21.15.2:0/1294507286 conn(0x5590a3c36d10 msgr2=0x5590a3c37eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 -- 172.21.15.2:0/1294507286 shutdown_connections 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 -- 172.21.15.2:0/1294507286 wait complete. 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 -- start start 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.313+0000 7f42217a1740 1 Processor -- start 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 0x5590a3c46bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c39800 0x5590a3c47130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c49ba0 0x5590a3c47670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a00890 con 0x5590a3c38ee0 2024-09-10T23:27:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590a3b39d40 con 0x5590a3c49ba0 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5590a3c4c850 con 0x5590a3c39800 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f42217a1740 10 client.0 _ll_register_callbacks cb 0x5590a3b9dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 0x5590a3c46bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 0x5590a3c46bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49444/0 (socket says 172.21.15.2:49444) 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 -- 172.21.15.2:0/2232046417 learned_addr learned my addr 172.21.15.2:0/2232046417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421c967640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c39800 0x5590a3c47130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d969640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c49ba0 0x5590a3c47670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 -- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c39800 msgr2=0x5590a3c47130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c39800 0x5590a3c47130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 -- 172.21.15.2:0/2232046417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c49ba0 msgr2=0x5590a3c47670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c49ba0 0x5590a3c47670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d168640 1 -- 172.21.15.2:0/2232046417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a3c55cb0 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.314+0000 7f421d969640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c49ba0 0x5590a3c47670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f421d168640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 0x5590a3c46bf0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f42100e3520 tx=0x7f4210007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeaab5a858787dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f41fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f41fcff9640 1 -- 172.21.15.2:0/2232046417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421001d040 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f41fcff9640 1 -- 172.21.15.2:0/2232046417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4210005240 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5590a3bb1db0 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f41fcff9640 1 -- 172.21.15.2:0/2232046417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42100a8030 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 10 client.16314 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590a3c58660 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f41fcff9640 1 -- 172.21.15.2:0/2232046417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5590a3bb1db0 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f41fcff9640 1 -- 172.21.15.2:0/2232046417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42100ebcb0 con 0x5590a3c38ee0 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 10 client.16314 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 20 client.16314 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3c599b0 0x5590a3c5bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 4 client.16314 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.315+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590a3bad860 con 0x5590a3c599b0 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.316+0000 7f421c967640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3c599b0 0x5590a3c5bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.316+0000 7f421c967640 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3c599b0 0x5590a3c5bda0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f0d498e667ce8d9 server_cookie=53722822898a9daa in_seq=0 out_seq=0 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.316+0000 7f41fcff9640 10 client.16314 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f41fcff9640 1 -- 172.21.15.2:0/2232046417 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590a3bad860 con 0x5590a3c599b0 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f41fcff9640 10 client.16314 handle_command_reply: tid=0 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 client.16314 shutdown 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 msgr2=0x5590a3c46bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 0x5590a3c46bf0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f42100e3520 tx=0x7f4210007f90 comp rx=0 tx=0).stop 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 shutdown_connections 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3c599b0 0x5590a3c5bda0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c49ba0 0x5590a3c47670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c39800 0x5590a3c47130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 --2- 172.21.15.2:0/2232046417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c38ee0 0x5590a3c46bf0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f41fcff9640 0 client.16314 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 >> 172.21.15.2:0/2232046417 conn(0x5590a3c36d10 msgr2=0x5590a3c35f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 shutdown_connections 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 1 -- 172.21.15.2:0/2232046417 wait complete. 2024-09-10T23:27:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.317+0000 7f42217a1740 20 client.16314 trim_cache size 0 max 16384 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 Processor -- start 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 -- start start 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c38ee0 0x5590a3c48930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c39800 0x5590a3c470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 0x5590a3c47630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42181ac240 con 0x5590a3c49ba0 2024-09-10T23:27:06.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42181add80 con 0x5590a3c39800 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.335+0000 7f42217a1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f42181ac910 con 0x5590a3c38ee0 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 0x5590a3c47630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 0x5590a3c47630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49450/0 (socket says 172.21.15.2:49450) 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 -- 172.21.15.2:0/2009237316 learned_addr learned my addr 172.21.15.2:0/2009237316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d168640 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c38ee0 0x5590a3c48930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421c967640 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c39800 0x5590a3c470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 -- 172.21.15.2:0/2009237316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c38ee0 msgr2=0x5590a3c48930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c38ee0 0x5590a3c48930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 -- 172.21.15.2:0/2009237316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c39800 msgr2=0x5590a3c470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c39800 0x5590a3c470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 -- 172.21.15.2:0/2009237316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a3c39630 con 0x5590a3c49ba0 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d168640 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c38ee0 0x5590a3c48930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:06.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f421d969640 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 0x5590a3c47630 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4208005c40 tx=0x7f4208016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783cf6ddf3f4b9c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f41feffd640 1 -- 172.21.15.2:0/2009237316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080206d0 con 0x5590a3c49ba0 2024-09-10T23:27:06.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f41feffd640 1 -- 172.21.15.2:0/2009237316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4208020d20 con 0x5590a3c49ba0 2024-09-10T23:27:06.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.336+0000 7f41feffd640 1 -- 172.21.15.2:0/2009237316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080293d0 con 0x5590a3c49ba0 2024-09-10T23:27:06.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 -- 172.21.15.2:0/2009237316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 msgr2=0x5590a3c47630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 0x5590a3c47630 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4208005c40 tx=0x7f4208016000 comp rx=0 tx=0).stop 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 -- 172.21.15.2:0/2009237316 shutdown_connections 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c49ba0 0x5590a3c47630 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c39800 0x5590a3c470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 --2- 172.21.15.2:0/2009237316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c38ee0 0x5590a3c48930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 -- 172.21.15.2:0/2009237316 >> 172.21.15.2:0/2009237316 conn(0x5590a3c36d10 msgr2=0x5590a3c48220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 -- 172.21.15.2:0/2009237316 shutdown_connections 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 -- 172.21.15.2:0/2009237316 wait complete. 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.337+0000 7f42217a1740 1 -- start start 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 Processor -- start 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c5ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c5f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c59d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42181ad6b0 con 0x5590a3c39800 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42181acfe0 con 0x5590a3c38ee0 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f42181aa220 con 0x5590a3c49ba0 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f42217a1740 10 client.0 _ll_register_callbacks cb 0x7f4208009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c5f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c5f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49460/0 (socket says 172.21.15.2:49460) 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 -- 172.21.15.2:0/2171649608 learned_addr learned my addr 172.21.15.2:0/2171649608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421d168640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c5ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421d969640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c59d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 -- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 msgr2=0x5590a3c59d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c59d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 -- 172.21.15.2:0/2171649608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 msgr2=0x5590a3c5ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c5ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.338+0000 7f421c967640 1 -- 172.21.15.2:0/2171649608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a3c5a2d0 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f421d969640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c59d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f421c967640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c5f320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f420c02a930 tx=0x7f420c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119e76edaeaa3ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f41fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f41fcff9640 1 -- 172.21.15.2:0/2171649608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c035040 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4208020d20 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f41fcff9640 1 -- 172.21.15.2:0/2171649608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f420c005240 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f41fcff9640 1 -- 172.21.15.2:0/2171649608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f420c005440 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f42217a1740 10 client.16320 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590a3ccb480 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f41fcff9640 1 -- 172.21.15.2:0/2171649608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4208020d20 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f41fcff9640 1 -- 172.21.15.2:0/2171649608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f420c0037b0 con 0x5590a3c39800 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f42217a1740 10 client.16320 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:06.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.339+0000 7f42217a1740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f42217a1740 20 client.16320 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f42217a1740 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3ccbc30 0x5590a3cce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f42217a1740 4 client.16320 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5590a3baac90 con 0x5590a3ccbc30 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f421d168640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3ccbc30 0x5590a3cce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f421d168640 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3ccbc30 0x5590a3cce050 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82884a89f98c7b54 server_cookie=4fe168edefdb7755 in_seq=0 out_seq=0 2024-09-10T23:27:06.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.340+0000 7f41fcff9640 10 client.16320 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:06.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f41fcff9640 1 -- 172.21.15.2:0/2171649608 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5590a3baac90 con 0x5590a3ccbc30 2024-09-10T23:27:06.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f41fcff9640 10 client.16320 handle_command_reply: tid=0 2024-09-10T23:27:06.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 client.16320 shutdown 2024-09-10T23:27:06.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 msgr2=0x5590a3c5f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c5f320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f420c02a930 tx=0x7f420c004270 comp rx=0 tx=0).stop 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 shutdown_connections 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5590a3ccbc30 0x5590a3cce050 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590a3c49ba0 0x5590a3c59d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590a3c39800 0x5590a3c5f320 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 --2- 172.21.15.2:0/2171649608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590a3c38ee0 0x5590a3c5ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 >> 172.21.15.2:0/2171649608 conn(0x5590a3c36d10 msgr2=0x5590a3c48a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f41fcff9640 0 client.16320 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 shutdown_connections 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 1 -- 172.21.15.2:0/2171649608 wait complete. 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.342+0000 7f42217a1740 20 client.16320 trim_cache size 0 max 16384 2024-09-10T23:27:06.347 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:27:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:27:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "9b301a8d-b45f-42a9-a43f-b6395c81e299", 2024-09-10T23:27:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:27:06.348 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f42000b52e0 msgr2=0x7f42000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f42000b52e0 0x7f42000b77a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4208005fd0 tx=0x7f4208009780 comp rx=0 tx=0).stop 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 msgr2=0x7f4218199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 0x7f4218199340 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f421000c970 tx=0x7f421000ce30 comp rx=0 tx=0).stop 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 shutdown_connections 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f42000b52e0 0x7f42000b77a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4218109150 0x7f421819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42181087d0 0x7f4218199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 --2- 172.21.15.2:0/2300299667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4218102dc0 0x7f4218199340 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 >> 172.21.15.2:0/2300299667 conn(0x7f42180fe830 msgr2=0x7f4218100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 shutdown_connections 2024-09-10T23:27:06.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:06.343+0000 7f421f3cc640 1 -- 172.21.15.2:0/2300299667 wait complete. 2024-09-10T23:27:07.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:27:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:07.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 -- 172.21.15.2:0/258204566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb441023f0 msgr2=0x7ffb441068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 --2- 172.21.15.2:0/258204566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb441023f0 0x7ffb441068c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009900 tx=0x7ffb3402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 -- 172.21.15.2:0/258204566 shutdown_connections 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 --2- 172.21.15.2:0/258204566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb44106f10 0x7ffb44107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 --2- 172.21.15.2:0/258204566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb441023f0 0x7ffb441068c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 --2- 172.21.15.2:0/258204566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb44101ad0 0x7ffb44101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 -- 172.21.15.2:0/258204566 >> 172.21.15.2:0/258204566 conn(0x7ffb440fd700 msgr2=0x7ffb440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 -- 172.21.15.2:0/258204566 shutdown_connections 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.911+0000 7ffb4c092640 1 -- 172.21.15.2:0/258204566 wait complete. 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 Processor -- start 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 -- start start 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 0x7ffb4419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb441023f0 0x7ffb4419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb44106f10 0x7ffb441a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb44119380 con 0x7ffb44101ad0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb44119200 con 0x7ffb44106f10 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4c092640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffb44119500 con 0x7ffb441023f0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb49e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 0x7ffb4419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb49e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 0x7ffb4419f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49468/0 (socket says 172.21.15.2:49468) 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4962d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb441023f0 0x7ffb4419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb49e2e640 1 -- 172.21.15.2:0/1087984179 learned_addr learned my addr 172.21.15.2:0/1087984179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.912+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb44106f10 0x7ffb441a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb49e2e640 1 -- 172.21.15.2:0/1087984179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb441023f0 msgr2=0x7ffb4419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb441023f0 0x7ffb4419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb49e2e640 1 -- 172.21.15.2:0/1087984179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb44106f10 msgr2=0x7ffb441a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb44106f10 0x7ffb441a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb49e2e640 1 -- 172.21.15.2:0/1087984179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb441a5880 con 0x7ffb44101ad0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 0x7ffb4419f7d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c920 tx=0x7ffb4000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb3affd640 1 -- 172.21.15.2:0/1087984179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40007c70 con 0x7ffb44101ad0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb441a5b70 con 0x7ffb44101ad0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb3affd640 1 -- 172.21.15.2:0/1087984179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb40007e10 con 0x7ffb44101ad0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb3affd640 1 -- 172.21.15.2:0/1087984179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40018820 con 0x7ffb44101ad0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.913+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb441ac400 con 0x7ffb44101ad0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb3affd640 1 -- 172.21.15.2:0/1087984179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ffb4000f450 con 0x7ffb44101ad0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 Processor -- start 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 -- start start 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b446ed860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b446fc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b44663e50 con 0x558b446edda0 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b44653280 con 0x558b446ed480 2024-09-10T23:27:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4e467740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558b44657090 con 0x558b446f9d30 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb49e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb49e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446f97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49474/0 (socket says 172.21.15.2:49474) 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2608448594 learned_addr learned my addr 172.21.15.2:0/2608448594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b446ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.916+0000 7ffb4962d640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b446fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2608448594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 msgr2=0x558b446fc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b446fc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2608448594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 msgr2=0x558b446ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b446ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb3affd640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffb300b52e0 0x7ffb300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2608448594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b443b1650 con 0x558b446edda0 2024-09-10T23:27:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b446ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb4962d640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b446fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb4962d640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffb300b52e0 0x7ffb300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446f97f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffb400b26c0 tx=0x7ffb400a8b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f46b5ded98369d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb3affd640 1 -- 172.21.15.2:0/1087984179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffb400e5d40 con 0x7ffb44101ad0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb2ffff640 1 -- 172.21.15.2:0/2608448594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400ac2e0 con 0x558b446edda0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb2ffff640 1 -- 172.21.15.2:0/2608448594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb400b53f0 con 0x558b446edda0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.917+0000 7ffb2ffff640 1 -- 172.21.15.2:0/2608448594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400abc80 con 0x558b446edda0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 -- 172.21.15.2:0/2608448594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 msgr2=0x558b446f97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446f97f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffb400b26c0 tx=0x7ffb400a8b60 comp rx=0 tx=0).stop 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4962d640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffb300b52e0 0x7ffb300b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffb34000c00 tx=0x7ffb34005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 -- 172.21.15.2:0/2608448594 shutdown_connections 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b446fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446f97f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2608448594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b446ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 -- 172.21.15.2:0/2608448594 >> 172.21.15.2:0/2608448594 conn(0x558b446eb2b0 msgr2=0x558b446ec450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 -- 172.21.15.2:0/2608448594 shutdown_connections 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.918+0000 7ffb4e467740 1 -- 172.21.15.2:0/2608448594 wait complete. 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 -- start start 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 Processor -- start 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 0x558b446f9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446edda0 0x558b446f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b444b4700 con 0x558b446ed480 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b445ee110 con 0x558b446f9d30 2024-09-10T23:27:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558b446fc9b0 con 0x558b446edda0 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4e467740 10 client.0 _ll_register_callbacks cb 0x558b44607990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 0x558b446f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 0x558b446f9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49476/0 (socket says 172.21.15.2:49476) 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2071186957 learned_addr learned my addr 172.21.15.2:0/2071186957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446edda0 msgr2=0x558b446f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446edda0 0x558b446f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2071186957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 msgr2=0x558b446f70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446f70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.919+0000 7ffb49e2e640 1 -- 172.21.15.2:0/2071186957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b4461bc40 con 0x558b446ed480 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:07.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 0x558b446f9650 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffb400a8cd0 tx=0x7ffb400ac020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12148e413ebcf7a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/2071186957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400abe60 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/2071186957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffb4000fa90 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb400b53f0 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/2071186957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb400abc80 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 10 client.16332 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b44708310 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/2071186957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb400b53f0 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/2071186957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb400a8780 con 0x558b446ed480 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 10 client.16332 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 20 client.16332 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44709660 0x558b4470ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 4 client.16332 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.920+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b44665da0 con 0x558b44709660 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.921+0000 7ffb4962d640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44709660 0x558b4470ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.921+0000 7ffb4962d640 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44709660 0x558b4470ba50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efc685c165d87685 server_cookie=287ee245a277a56d in_seq=0 out_seq=0 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.921+0000 7ffb2d7fa640 10 client.16332 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/2071186957 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b44665da0 con 0x558b44709660 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb2d7fa640 10 client.16332 handle_command_reply: tid=0 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 client.16332 shutdown 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 msgr2=0x558b446f9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 0x558b446f9650 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffb400a8cd0 tx=0x7ffb400ac020 comp rx=0 tx=0).stop 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 shutdown_connections 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44709660 0x558b4470ba50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446edda0 0x558b446f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 --2- 172.21.15.2:0/2071186957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446ed480 0x558b446f9650 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 >> 172.21.15.2:0/2071186957 conn(0x558b446eb2b0 msgr2=0x558b446f0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb2d7fa640 0 client.16332 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 shutdown_connections 2024-09-10T23:27:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 1 -- 172.21.15.2:0/2071186957 wait complete. 2024-09-10T23:27:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.922+0000 7ffb4e467740 20 client.16332 trim_cache size 0 max 16384 2024-09-10T23:27:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 Processor -- start 2024-09-10T23:27:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 -- start start 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446ed480 0x558b44705c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446fb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb441b48c0 con 0x558b446edda0 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb441b6400 con 0x558b446f9d30 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4e467740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffb441b4f90 con 0x558b446ed480 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4962d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4962d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446ea2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49484/0 (socket says 172.21.15.2:49484) 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.942+0000 7ffb4962d640 1 -- 172.21.15.2:0/3084867772 learned_addr learned my addr 172.21.15.2:0/3084867772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446ed480 0x558b44705c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446fb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4962d640 1 -- 172.21.15.2:0/3084867772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446ed480 msgr2=0x558b44705c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4962d640 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446ed480 0x558b44705c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4962d640 1 -- 172.21.15.2:0/3084867772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 msgr2=0x558b446fb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4962d640 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446fb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4962d640 1 -- 172.21.15.2:0/3084867772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b446f7440 con 0x558b446edda0 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb4962d640 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446ea2c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ffb4406c330 tx=0x7ffb3403e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2e3dd98f06fb96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb2f7fe640 1 -- 172.21.15.2:0/3084867772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34055070 con 0x558b446edda0 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb2f7fe640 1 -- 172.21.15.2:0/3084867772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb34004490 con 0x558b446edda0 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.943+0000 7ffb2f7fe640 1 -- 172.21.15.2:0/3084867772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34042070 con 0x558b446edda0 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 -- 172.21.15.2:0/3084867772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 msgr2=0x558b446ea2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446ea2c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ffb4406c330 tx=0x7ffb3403e070 comp rx=0 tx=0).stop 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 -- 172.21.15.2:0/3084867772 shutdown_connections 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446f9d30 0x558b446fb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b446ea2c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 --2- 172.21.15.2:0/3084867772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446ed480 0x558b44705c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 -- 172.21.15.2:0/3084867772 >> 172.21.15.2:0/3084867772 conn(0x558b446eb2b0 msgr2=0x558b446e9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 -- 172.21.15.2:0/3084867772 shutdown_connections 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 -- 172.21.15.2:0/3084867772 wait complete. 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.944+0000 7ffb4e467740 1 -- start start 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 Processor -- start 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b4470af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b4470b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b447751c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb441b5d30 con 0x558b446edda0 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb441b5660 con 0x558b446ed480 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffb441b28a0 con 0x558b446f9d30 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4e467740 10 client.0 _ll_register_callbacks cb 0x7ffb400e9d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b4470b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b4470b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49492/0 (socket says 172.21.15.2:49492) 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 -- 172.21.15.2:0/1125965051 learned_addr learned my addr 172.21.15.2:0/1125965051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b4470af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4a62f640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b447751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 -- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 msgr2=0x558b447751c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b447751c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 -- 172.21.15.2:0/1125965051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 msgr2=0x558b4470af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.945+0000 7ffb4962d640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b4470af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4962d640 1 -- 172.21.15.2:0/1125965051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b44775700 con 0x558b446edda0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4962d640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b4470b4a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009a20 tx=0x7ffb3402aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb34255ccc3537b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/1125965051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34055070 con 0x558b446edda0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/1125965051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffb34003800 con 0x558b446edda0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb34004490 con 0x558b446edda0 2024-09-10T23:27:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/1125965051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb34042040 con 0x558b446edda0 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4e467740 10 client.16338 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b447769e0 con 0x558b446edda0 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/1125965051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb34004490 con 0x558b446edda0 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/1125965051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb34048420 con 0x558b446edda0 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4e467740 10 client.16338 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4e467740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.946+0000 7ffb4e467740 20 client.16338 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb4e467740 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44777100 0x558b44779520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb4e467740 4 client.16338 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b44661850 con 0x558b44777100 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44777100 0x558b44779520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb2d7fa640 10 client.16338 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb49e2e640 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44777100 0x558b44779520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2396190c18350945 server_cookie=e293f187335fa092 in_seq=0 out_seq=0 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb2d7fa640 1 -- 172.21.15.2:0/1125965051 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x558b44661850 con 0x558b44777100 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb2d7fa640 10 client.16338 handle_command_reply: tid=0 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.947+0000 7ffb4e467740 1 client.16338 shutdown 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 msgr2=0x558b4470b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b4470b4a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009a20 tx=0x7ffb3402aba0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 shutdown_connections 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558b44777100 0x558b44779520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b446f9d30 0x558b447751c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b446edda0 0x558b4470b4a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 --2- 172.21.15.2:0/1125965051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b446ed480 0x558b4470af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb2d7fa640 0 client.16338 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 >> 172.21.15.2:0/1125965051 conn(0x558b446eb2b0 msgr2=0x558b446f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 shutdown_connections 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 1 -- 172.21.15.2:0/1125965051 wait complete. 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4e467740 20 client.16338 trim_cache size 0 max 16384 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:27:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "9b301a8d-b45f-42a9-a43f-b6395c81e299", 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffb300b52e0 msgr2=0x7ffb300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.948+0000 7ffb4c092640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffb300b52e0 0x7ffb300b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffb34000c00 tx=0x7ffb34005e80 comp rx=0 tx=0).stop 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 msgr2=0x7ffb4419f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 0x7ffb4419f7d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c920 tx=0x7ffb4000cde0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 shutdown_connections 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffb300b52e0 0x7ffb300b77a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb44106f10 0x7ffb441a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb441023f0 0x7ffb4419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 --2- 172.21.15.2:0/1087984179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb44101ad0 0x7ffb4419f7d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 >> 172.21.15.2:0/1087984179 conn(0x7ffb440fd700 msgr2=0x7ffb44104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 shutdown_connections 2024-09-10T23:27:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:07.949+0000 7ffb4c092640 1 -- 172.21.15.2:0/1087984179 wait complete. 2024-09-10T23:27:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:07 smithi177 ceph-mon[35760]: pgmap v435: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:07 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:27:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:07 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:27:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:07 smithi002 ceph-mon[31150]: pgmap v435: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:07 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:27:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:07 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:27:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:07 smithi154 ceph-mon[35136]: pgmap v435: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:07 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:27:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:07 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:27:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:08.706 INFO:tasks.cephfs.filesystem:scrub status for tag:9b301a8d-b45f-42a9-a43f-b6395c81e299 - {'path': '/', 'tag': '9b301a8d-b45f-42a9-a43f-b6395c81e299', 'options': 'recursive,force'} 2024-09-10T23:27:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:08 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:27:09.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:08 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:27:09.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:08 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:27:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:09 smithi177 ceph-mon[35760]: pgmap v436: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:27:10.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:09 smithi002 ceph-mon[31150]: pgmap v436: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:27:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:09 smithi154 ceph-mon[35136]: pgmap v436: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:27:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 -- 172.21.15.2:0/2588197679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff2806b410 msgr2=0x7eff28105590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/2588197679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff2806b410 0x7eff28105590 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7eff18009ca0 tx=0x7eff1802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 -- 172.21.15.2:0/2588197679 shutdown_connections 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/2588197679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 0x7eff2810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/2588197679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff28105ad0 0x7eff28107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/2588197679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff2806b410 0x7eff28105590 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 -- 172.21.15.2:0/2588197679 >> 172.21.15.2:0/2588197679 conn(0x7eff280fd140 msgr2=0x7eff280ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 -- 172.21.15.2:0/2588197679 shutdown_connections 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.527+0000 7eff2e1ad640 1 -- 172.21.15.2:0/2588197679 wait complete. 2024-09-10T23:27:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.528+0000 7eff2e1ad640 1 Processor -- start 2024-09-10T23:27:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.528+0000 7eff2e1ad640 1 -- start start 2024-09-10T23:27:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.528+0000 7eff2e1ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2806b410 0x7eff28198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.528+0000 7eff2e1ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 0x7eff281993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff2e1ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 0x7eff28199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff2e1ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff2810e600 con 0x7eff28105ad0 2024-09-10T23:27:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff2e1ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff2810e480 con 0x7eff28108680 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff2e1ad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff2810e780 con 0x7eff2806b410 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 0x7eff281993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 0x7eff281993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49510/0 (socket says 172.21.15.2:49510) 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 -- 172.21.15.2:0/1265252189 learned_addr learned my addr 172.21.15.2:0/1265252189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff27fff640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 0x7eff28199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff277fe640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2806b410 0x7eff28198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 -- 172.21.15.2:0/1265252189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2806b410 msgr2=0x7eff28198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2806b410 0x7eff28198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 -- 172.21.15.2:0/1265252189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 msgr2=0x7eff28199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 0x7eff28199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 -- 172.21.15.2:0/1265252189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2819a890 con 0x7eff28105ad0 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff277fe640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2806b410 0x7eff28198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff27fff640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 0x7eff28199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff26ffd640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 0x7eff281993a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff1000e9f0 tx=0x7eff1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff24ff9640 1 -- 172.21.15.2:0/1265252189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1000ccc0 con 0x7eff28105ad0 2024-09-10T23:27:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff24ff9640 1 -- 172.21.15.2:0/1265252189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff100054d0 con 0x7eff28105ad0 2024-09-10T23:27:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2819ab80 con 0x7eff28105ad0 2024-09-10T23:27:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff24ff9640 1 -- 172.21.15.2:0/1265252189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10010430 con 0x7eff28105ad0 2024-09-10T23:27:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.529+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff281a1250 con 0x7eff28105ad0 2024-09-10T23:27:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.532+0000 7eff31059740 1 Processor -- start 2024-09-10T23:27:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.532+0000 7eff31059740 1 -- start start 2024-09-10T23:27:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.532+0000 7eff24ff9640 1 -- 172.21.15.2:0/1265252189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7eff100046c0 con 0x7eff28105ad0 2024-09-10T23:27:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff31059740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a397ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff31059740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a397d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff31059740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3980090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff31059740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596a38ea6f0 con 0x5596a397dbd0 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff31059740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5596a38d9b20 con 0x5596a3978860 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff31059740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596a38dd930 con 0x5596a397b190 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3980090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff27fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a397ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff27fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a397ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:37740/0 (socket says 172.21.15.2:37740) 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3980090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49526/0 (socket says 172.21.15.2:49526) 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff27fff640 1 -- 172.21.15.2:0/1063391101 learned_addr learned my addr 172.21.15.2:0/1063391101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a397d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 -- 172.21.15.2:0/1063391101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 msgr2=0x5596a397ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a397ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 -- 172.21.15.2:0/1063391101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 msgr2=0x5596a3980090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3980090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 -- 172.21.15.2:0/1063391101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a389f530 con 0x5596a397b190 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff27fff640 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a397ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff24ff9640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7eff140b5360 0x7eff140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.533+0000 7eff277fe640 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a397d580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff18006010 tx=0x7eff1802f400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a097f5d5aebc0222 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff27fff640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7eff140b5360 0x7eff140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff24ff9640 1 -- 172.21.15.2:0/1265252189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7eff100e5fa0 con 0x7eff28105ad0 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff1dffb640 1 -- 172.21.15.2:0/1063391101 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18031810 con 0x5596a397b190 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff1dffb640 1 -- 172.21.15.2:0/1063391101 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff18036040 con 0x5596a397b190 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff1dffb640 1 -- 172.21.15.2:0/1063391101 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1802f660 con 0x5596a397b190 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff31059740 1 -- 172.21.15.2:0/1063391101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 msgr2=0x5596a397d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff27fff640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7eff140b5360 0x7eff140b7820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7eff20011440 tx=0x7eff2000c550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.534+0000 7eff31059740 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a397d580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff18006010 tx=0x7eff1802f400 comp rx=0 tx=0).stop 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- 172.21.15.2:0/1063391101 shutdown_connections 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3980090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a397d580 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 --2- 172.21.15.2:0/1063391101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a397ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- 172.21.15.2:0/1063391101 >> 172.21.15.2:0/1063391101 conn(0x5596a39739b0 msgr2=0x5596a3974740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- 172.21.15.2:0/1063391101 shutdown_connections 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- 172.21.15.2:0/1063391101 wait complete. 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- start start 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 Processor -- start 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a3978860 0x5596a3981e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39824e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a39830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596a3811ab0 con 0x5596a397dbd0 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5596a387f730 con 0x5596a397b190 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.535+0000 7eff31059740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596a3980b50 con 0x5596a3978860 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff31059740 10 client.0 _ll_register_callbacks cb 0x5596a38d36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a39830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff277fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a3978860 0x5596a3981e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a39830b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49542/0 (socket says 172.21.15.2:49542) 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 -- 172.21.15.2:0/3581072728 learned_addr learned my addr 172.21.15.2:0/3581072728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff26ffd640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39824e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 -- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a3978860 msgr2=0x5596a3981e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a3978860 0x5596a3981e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 -- 172.21.15.2:0/3581072728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 msgr2=0x5596a39824e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39824e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 -- 172.21.15.2:0/3581072728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a363b790 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff277fe640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a3978860 0x5596a3981e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff27fff640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a39830b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff2000fda0 tx=0x7eff200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5054a5f2096426f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff06ffd640 1 -- 172.21.15.2:0/3581072728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2001cd30 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff06ffd640 1 -- 172.21.15.2:0/3581072728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7eff20004020 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.536+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff18036040 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff06ffd640 1 -- 172.21.15.2:0/3581072728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff2000cc40 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 10 client.16350 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5596a36b4620 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff06ffd640 1 -- 172.21.15.2:0/3581072728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff18036040 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff06ffd640 1 -- 172.21.15.2:0/3581072728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff20027430 con 0x5596a397dbd0 2024-09-10T23:27:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 10 client.16350 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 10 client.16350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 20 client.16350 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a398d730 0x5596a398fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 4 client.16350 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596a38ec640 con 0x5596a398d730 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.537+0000 7eff277fe640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a398d730 0x5596a398fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.538+0000 7eff277fe640 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a398d730 0x5596a398fbd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e56204eb76ed924 server_cookie=bc55bcb7d05d8390 in_seq=0 out_seq=0 2024-09-10T23:27:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.538+0000 7eff06ffd640 10 client.16350 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff06ffd640 1 -- 172.21.15.2:0/3581072728 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596a38ec640 con 0x5596a398d730 2024-09-10T23:27:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff06ffd640 10 client.16350 handle_command_reply: tid=0 2024-09-10T23:27:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 client.16350 shutdown 2024-09-10T23:27:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 msgr2=0x5596a39830b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a39830b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff2000fda0 tx=0x7eff200046c0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 shutdown_connections 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a398d730 0x5596a398fbd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a39830b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39824e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff06ffd640 0 client.16350 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 --2- 172.21.15.2:0/3581072728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a3978860 0x5596a3981e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 >> 172.21.15.2:0/3581072728 conn(0x5596a39739b0 msgr2=0x5596a3972bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 shutdown_connections 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 1 -- 172.21.15.2:0/3581072728 wait complete. 2024-09-10T23:27:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.539+0000 7eff31059740 20 client.16350 trim_cache size 0 max 16384 2024-09-10T23:27:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 Processor -- start 2024-09-10T23:27:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 -- start start 2024-09-10T23:27:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a3983090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a3976a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3976f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff281a7c40 con 0x5596a397dbd0 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff281a9780 con 0x5596a3978860 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff31059740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff281a8310 con 0x5596a397b190 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff27fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3976f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff27fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3976f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49546/0 (socket says 172.21.15.2:49546) 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff27fff640 1 -- 172.21.15.2:0/2957133782 learned_addr learned my addr 172.21.15.2:0/2957133782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.554+0000 7eff277fe640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a3983090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff26ffd640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a3976a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff27fff640 1 -- 172.21.15.2:0/2957133782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 msgr2=0x5596a3976a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff27fff640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a3976a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff27fff640 1 -- 172.21.15.2:0/2957133782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 msgr2=0x5596a3983090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff27fff640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a3983090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff27fff640 1 -- 172.21.15.2:0/2957133782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a398c0a0 con 0x5596a397dbd0 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff26ffd640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a3976a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff277fe640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a3983090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff27fff640 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3976f40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff20011d70 tx=0x7eff2000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc240317700a46e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff1d7fa640 1 -- 172.21.15.2:0/2957133782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20027630 con 0x5596a397dbd0 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff1d7fa640 1 -- 172.21.15.2:0/2957133782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff20036070 con 0x5596a397dbd0 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.555+0000 7eff1d7fa640 1 -- 172.21.15.2:0/2957133782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff200055d0 con 0x5596a397dbd0 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 -- 172.21.15.2:0/2957133782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 msgr2=0x5596a3976f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3976f40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff20011d70 tx=0x7eff2000ffd0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 -- 172.21.15.2:0/2957133782 shutdown_connections 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a397dbd0 0x5596a3976f40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397b190 0x5596a3976a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 --2- 172.21.15.2:0/2957133782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a3978860 0x5596a3983090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 -- 172.21.15.2:0/2957133782 >> 172.21.15.2:0/2957133782 conn(0x5596a39739b0 msgr2=0x5596a3977d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 -- 172.21.15.2:0/2957133782 shutdown_connections 2024-09-10T23:27:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 -- 172.21.15.2:0/2957133782 wait complete. 2024-09-10T23:27:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 -- start start 2024-09-10T23:27:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 Processor -- start 2024-09-10T23:27:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 0x5596a39899e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.556+0000 7eff31059740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39886e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397dbd0 0x5596a3988cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff281a90b0 con 0x5596a3978860 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff281a89e0 con 0x5596a397b190 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff281a5c20 con 0x5596a397dbd0 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 10 client.0 _ll_register_callbacks cb 0x7eff2000c790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 0x5596a39899e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 0x5596a39899e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49548/0 (socket says 172.21.15.2:49548) 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 -- 172.21.15.2:0/928146649 learned_addr learned my addr 172.21.15.2:0/928146649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff26ffd640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff27fff640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397dbd0 0x5596a3988cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 -- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397dbd0 msgr2=0x5596a3988cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397dbd0 0x5596a3988cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 -- 172.21.15.2:0/928146649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 msgr2=0x5596a39886e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39886e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 -- 172.21.15.2:0/928146649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a39894f0 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff277fe640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 0x5596a39899e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7eff18005cc0 tx=0x7eff1802ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd7d4e11e5462e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff06ffd640 1 -- 172.21.15.2:0/928146649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18003b70 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff06ffd640 1 -- 172.21.15.2:0/928146649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7eff18003d10 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff20036070 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff06ffd640 1 -- 172.21.15.2:0/928146649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff18031610 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.557+0000 7eff31059740 10 client.16356 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5596a39fa7c0 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff06ffd640 1 -- 172.21.15.2:0/928146649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff20036070 con 0x5596a3978860 2024-09-10T23:27:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff06ffd640 1 -- 172.21.15.2:0/928146649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff1802f7d0 con 0x5596a3978860 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 10 client.16356 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 20 client.16356 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a39fad10 0x5596a39fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 4 client.16356 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596a38e80f0 con 0x5596a39fad10 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.558+0000 7eff26ffd640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a39fad10 0x5596a39fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.559+0000 7eff06ffd640 10 client.16356 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.559+0000 7eff26ffd640 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a39fad10 0x5596a39fd130 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a281e0696f76474 server_cookie=782dd9ccb3b69fc7 in_seq=0 out_seq=0 2024-09-10T23:27:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff06ffd640 1 -- 172.21.15.2:0/928146649 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596a38e80f0 con 0x5596a39fad10 2024-09-10T23:27:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff06ffd640 10 client.16356 handle_command_reply: tid=0 2024-09-10T23:27:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 client.16356 shutdown 2024-09-10T23:27:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 msgr2=0x5596a39899e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 0x5596a39899e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7eff18005cc0 tx=0x7eff1802ae60 comp rx=0 tx=0).stop 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 shutdown_connections 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5596a39fad10 0x5596a39fd130 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596a397dbd0 0x5596a3988cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596a397b190 0x5596a39886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff06ffd640 0 client.16356 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 --2- 172.21.15.2:0/928146649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596a3978860 0x5596a39899e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 >> 172.21.15.2:0/928146649 conn(0x5596a39739b0 msgr2=0x5596a3977d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 shutdown_connections 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.571+0000 7eff31059740 1 -- 172.21.15.2:0/928146649 wait complete. 2024-09-10T23:27:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff31059740 20 client.16356 trim_cache size 0 max 16384 2024-09-10T23:27:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:27:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:27:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:27:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7eff140b5360 msgr2=0x7eff140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7eff140b5360 0x7eff140b7820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7eff20011440 tx=0x7eff2000c550 comp rx=0 tx=0).stop 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 msgr2=0x7eff281993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 0x7eff281993a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff1000e9f0 tx=0x7eff1000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 shutdown_connections 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7eff140b5360 0x7eff140b7820 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff28108680 0x7eff28199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff28105ad0 0x7eff281993a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 --2- 172.21.15.2:0/1265252189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2806b410 0x7eff28198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 >> 172.21.15.2:0/1265252189 conn(0x7eff280fd140 msgr2=0x7eff28103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 shutdown_connections 2024-09-10T23:27:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:10.572+0000 7eff2e1ad640 1 -- 172.21.15.2:0/1265252189 wait complete. 2024-09-10T23:27:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:11 smithi177 ceph-mon[35760]: pgmap v437: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:11 smithi002 ceph-mon[31150]: pgmap v437: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:11 smithi154 ceph-mon[35136]: pgmap v437: 97 pgs: 97 active+clean; 2.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:13 smithi177 ceph-mon[35760]: pgmap v438: 97 pgs: 97 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:27:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:13 smithi002 ceph-mon[31150]: pgmap v438: 97 pgs: 97 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:27:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:13 smithi154 ceph-mon[35136]: pgmap v438: 97 pgs: 97 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:27:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:15 smithi177 ceph-mon[35760]: pgmap v439: 97 pgs: 97 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:16.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:15 smithi002 ceph-mon[31150]: pgmap v439: 97 pgs: 97 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:15 smithi154 ceph-mon[35136]: pgmap v439: 97 pgs: 97 active+clean; 2.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:17 smithi177 ceph-mon[35760]: pgmap v440: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:27:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:17 smithi002 ceph-mon[31150]: pgmap v440: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:27:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:17 smithi154 ceph-mon[35136]: pgmap v440: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:27:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:19 smithi177 ceph-mon[35760]: pgmap v441: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:20.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:19 smithi002 ceph-mon[31150]: pgmap v441: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:19 smithi154 ceph-mon[35136]: pgmap v441: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:21 smithi002 ceph-mon[31150]: pgmap v442: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:21 smithi154 ceph-mon[35136]: pgmap v442: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:64/600: open fd = 3 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:65/600: open fd = 3 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:66/600: open fd = 3 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:67/600: open fd = 3 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:68/600: open fd = 3 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:69/600: open fd = 3 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:70/600: open fd = 3 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:71/600: open fd = 3 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:72/600: open fd = 3 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:73/600: open fd = 3 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:74/600: open fd = 3 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.410 INFO:tasks.workunit.client.0.smithi002.stdout:75/600: open fd = 3 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:76/600: open fd = 3 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:77/600: open fd = 3 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.411 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:78/600: open fd = 3 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:79/600: open fd = 3 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:80/600: open fd = 3 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:81/600: open fd = 3 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:82/600: open fd = 3 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:83/600: open fd = 3 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:84/600: open fd = 3 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:85/600: open fd = 3 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:86/600: open fd = 3 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.414 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:87/600: open fd = 3 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:88/600: open fd = 3 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:89/600: open fd = 3 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.415 INFO:tasks.workunit.client.0.smithi002.stdout:90/600: open fd = 3 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:91/600: open fd = 3 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:92/600: open fd = 3 2024-09-10T23:27:22.416 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:93/600: open fd = 3 2024-09-10T23:27:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.418 INFO:tasks.workunit.client.0.smithi002.stdout:94/600: open fd = 3 2024-09-10T23:27:22.418 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.418 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.418 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.418 INFO:tasks.workunit.client.0.smithi002.stdout:95/600: open fd = 3 2024-09-10T23:27:22.418 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.419 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.419 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.419 INFO:tasks.workunit.client.0.smithi002.stdout:96/600: open fd = 3 2024-09-10T23:27:22.419 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.419 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.419 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:97/600: open fd = 3 2024-09-10T23:27:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:98/600: open fd = 3 2024-09-10T23:27:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.421 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.421 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.421 INFO:tasks.workunit.client.0.smithi002.stdout:99/600: open fd = 3 2024-09-10T23:27:22.421 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.421 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.421 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.422 INFO:tasks.workunit.client.0.smithi002.stdout:100/600: open fd = 3 2024-09-10T23:27:22.422 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.422 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.422 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.422 INFO:tasks.workunit.client.0.smithi002.stdout:101/600: open fd = 3 2024-09-10T23:27:22.423 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.423 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.423 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.423 INFO:tasks.workunit.client.0.smithi002.stdout:102/600: open fd = 3 2024-09-10T23:27:22.423 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.423 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.424 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.424 INFO:tasks.workunit.client.0.smithi002.stdout:103/600: open fd = 3 2024-09-10T23:27:22.424 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.424 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.424 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.424 INFO:tasks.workunit.client.0.smithi002.stdout:104/600: open fd = 3 2024-09-10T23:27:22.425 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.425 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.425 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.425 INFO:tasks.workunit.client.0.smithi002.stdout:105/600: open fd = 3 2024-09-10T23:27:22.425 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.426 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.426 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.427 INFO:tasks.workunit.client.0.smithi002.stdout:106/600: open fd = 3 2024-09-10T23:27:22.427 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.427 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.427 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.427 INFO:tasks.workunit.client.0.smithi002.stdout:107/600: open fd = 3 2024-09-10T23:27:22.427 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.428 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.428 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.428 INFO:tasks.workunit.client.0.smithi002.stdout:108/600: open fd = 3 2024-09-10T23:27:22.429 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.429 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.429 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.429 INFO:tasks.workunit.client.0.smithi002.stdout:109/600: open fd = 3 2024-09-10T23:27:22.429 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.429 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.430 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.430 INFO:tasks.workunit.client.0.smithi002.stdout:110/600: open fd = 3 2024-09-10T23:27:22.430 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.430 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.430 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.430 INFO:tasks.workunit.client.0.smithi002.stdout:111/600: open fd = 3 2024-09-10T23:27:22.431 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.431 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.431 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.431 INFO:tasks.workunit.client.0.smithi002.stdout:112/600: open fd = 3 2024-09-10T23:27:22.431 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:113/600: open fd = 3 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.432 INFO:tasks.workunit.client.0.smithi002.stdout:114/600: open fd = 3 2024-09-10T23:27:22.433 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.433 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.433 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.433 INFO:tasks.workunit.client.0.smithi002.stdout:115/600: open fd = 3 2024-09-10T23:27:22.433 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:116/600: open fd = 3 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.434 INFO:tasks.workunit.client.0.smithi002.stdout:117/600: open fd = 3 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:118/600: open fd = 3 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:119/600: open fd = 3 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.435 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:120/600: open fd = 3 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:121/600: open fd = 3 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:122/600: open fd = 3 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.436 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:123/600: open fd = 3 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:124/600: open fd = 3 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:125/600: open fd = 3 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.437 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:27:22.438 INFO:tasks.workunit.client.0.smithi002.stdout:126/600: open fd = 3 2024-09-10T23:27:22.438 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:27:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:21 smithi177 ceph-mon[35760]: pgmap v442: 97 pgs: 97 active+clean; 2.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 -- 172.21.15.2:0/224564675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581018b0 msgr2=0x7f6c58101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/224564675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581018b0 0x7f6c58101cb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009930 tx=0x7f6c5402a420 comp rx=0 tx=0).stop 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 -- 172.21.15.2:0/224564675 shutdown_connections 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/224564675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c581033c0 0x7f6c58109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/224564675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c58102a00 0x7f6c58102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/224564675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581018b0 0x7f6c58101cb0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 -- 172.21.15.2:0/224564675 >> 172.21.15.2:0/224564675 conn(0x7f6c580fd150 msgr2=0x7f6c580ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 -- 172.21.15.2:0/224564675 shutdown_connections 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.675+0000 7f6c5f73d640 1 -- 172.21.15.2:0/224564675 wait complete. 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 Processor -- start 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 -- start start 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c581018b0 0x7f6c58198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c58102a00 0x7f6c58199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 0x7f6c5819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5810d570 con 0x7f6c581033c0 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5810d3f0 con 0x7f6c58102a00 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5f73d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5810d6f0 con 0x7f6c581018b0 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 0x7f6c5819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 0x7f6c5819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33392/0 (socket says 172.21.15.2:33392) 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 -- 172.21.15.2:0/1838837497 learned_addr learned my addr 172.21.15.2:0/1838837497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c581018b0 0x7f6c58198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c58102a00 0x7f6c58199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 -- 172.21.15.2:0/1838837497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c581018b0 msgr2=0x7f6c58198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c581018b0 0x7f6c58198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 -- 172.21.15.2:0/1838837497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c58102a00 msgr2=0x7f6c58199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c58102a00 0x7f6c58199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5dcda640 1 -- 172.21.15.2:0/1838837497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5819a980 con 0x7f6c581033c0 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.676+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c58102a00 0x7f6c58199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.677+0000 7f6c5dcda640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 0x7f6c5819a0c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000eaa0 tx=0x7f6c5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.677+0000 7f6c4e7fc640 1 -- 172.21.15.2:0/1838837497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000cdb0 con 0x7f6c581033c0 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.677+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5819ac70 con 0x7f6c581033c0 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.677+0000 7f6c4e7fc640 1 -- 172.21.15.2:0/1838837497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c50005020 con 0x7f6c581033c0 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.677+0000 7f6c4e7fc640 1 -- 172.21.15.2:0/1838837497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c500116d0 con 0x7f6c581033c0 2024-09-10T23:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.677+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c581a1340 con 0x7f6c581033c0 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.680+0000 7f6c625e8740 1 Processor -- start 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.680+0000 7f6c4e7fc640 1 -- 172.21.15.2:0/1838837497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6c5000f040 con 0x7f6c581033c0 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 -- start start 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 0x55d93d807c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d80a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d80d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d93d7776f0 con 0x55d93d805860 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d93d766b20 con 0x55d93d80abd0 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c625e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d93d76a930 con 0x55d93d808190 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 0x55d93d807c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 0x55d93d807c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33394/0 (socket says 172.21.15.2:33394) 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/2594830661 learned_addr learned my addr 172.21.15.2:0/2594830661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d80a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d80d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c4e7fc640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6c440b52e0 0x7f6c440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/2594830661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 msgr2=0x55d93d80a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d80a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/2594830661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 msgr2=0x55d93d80d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d80d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/2594830661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d93d72c530 con 0x55d93d805860 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.681+0000 7f6c5dcda640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6c440b52e0 0x7f6c440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.682+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 0x55d93d807c50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800beb0 tx=0x7f6c4800b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4318c7df139dc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.682+0000 7f6c4e7fc640 1 -- 172.21.15.2:0/1838837497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6c500e5a70 con 0x7f6c581033c0 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.682+0000 7f6c437fe640 1 -- 172.21.15.2:0/2594830661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48019030 con 0x55d93d805860 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.682+0000 7f6c437fe640 1 -- 172.21.15.2:0/2594830661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c48011d30 con 0x55d93d805860 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.682+0000 7f6c437fe640 1 -- 172.21.15.2:0/2594830661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c480054e0 con 0x55d93d805860 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 -- 172.21.15.2:0/2594830661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 msgr2=0x55d93d807c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c5dcda640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6c440b52e0 0x7f6c440b77a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c500abf40 tx=0x7f6c500cf040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 0x55d93d807c50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800beb0 tx=0x7f6c4800b750 comp rx=0 tx=0).stop 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 -- 172.21.15.2:0/2594830661 shutdown_connections 2024-09-10T23:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d80d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d80a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2594830661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d805860 0x55d93d807c50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 -- 172.21.15.2:0/2594830661 >> 172.21.15.2:0/2594830661 conn(0x55d93d8009b0 msgr2=0x55d93d801740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 -- 172.21.15.2:0/2594830661 shutdown_connections 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 -- 172.21.15.2:0/2594830661 wait complete. 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 -- start start 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.683+0000 7f6c625e8740 1 Processor -- start 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d80ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d80f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d80abd0 0x55d93d8101a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d93d69eab0 con 0x55d93d808190 2024-09-10T23:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d93d70c730 con 0x55d93d805860 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d93d80dbb0 con 0x55d93d80abd0 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c625e8740 10 client.0 _ll_register_callbacks cb 0x55d93d7606b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d80f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5ccd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d80abd0 0x55d93d8101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d80f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33408/0 (socket says 172.21.15.2:33408) 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2341622226 learned_addr learned my addr 172.21.15.2:0/2341622226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d80ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d80abd0 msgr2=0x55d93d8101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d80abd0 0x55d93d8101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2341622226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 msgr2=0x55d93d80ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d80ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.684+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2341622226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d93d4c8790 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d80f5d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6c54000c00 tx=0x7f6c54004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b980f9369ed1fa5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2341622226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54035040 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c48011d30 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2341622226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6c540054d0 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2341622226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c54004770 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c625e8740 10 client.16368 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d93d541620 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.685+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2341622226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c48011d30 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2341622226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c54003bf0 con 0x55d93d808190 2024-09-10T23:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c625e8740 10 client.16368 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c625e8740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c625e8740 20 client.16368 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d81a810 0x55d93d81cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c625e8740 4 client.16368 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d93d779640 con 0x55d93d81a810 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d81a810 0x55d93d81cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d81a810 0x55d93d81cc50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631f644c37678fe3 server_cookie=8b58621201bde9ae in_seq=0 out_seq=0 2024-09-10T23:27:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.686+0000 7f6c40ff9640 10 client.16368 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2341622226 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d93d779640 con 0x55d93d81a810 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c40ff9640 10 client.16368 handle_command_reply: tid=0 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 client.16368 shutdown 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 msgr2=0x55d93d80f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d80f5d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6c54000c00 tx=0x7f6c54004580 comp rx=0 tx=0).stop 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 shutdown_connections 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d81a810 0x55d93d81cc50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d80abd0 0x55d93d8101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d80f5d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2341622226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d80ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c40ff9640 0 client.16368 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.687+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 >> 172.21.15.2:0/2341622226 conn(0x55d93d8009b0 msgr2=0x55d93d7ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.688+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 shutdown_connections 2024-09-10T23:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.688+0000 7f6c625e8740 1 -- 172.21.15.2:0/2341622226 wait complete. 2024-09-10T23:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.688+0000 7f6c625e8740 20 client.16368 trim_cache size 0 max 16384 2024-09-10T23:27:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.702+0000 7f6c625e8740 1 Processor -- start 2024-09-10T23:27:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.702+0000 7f6c625e8740 1 -- start start 2024-09-10T23:27:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d801210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d801750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 0x55d93d815600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c625e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c581a9f00 con 0x55d93d80abd0 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c625e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c581aba40 con 0x55d93d805860 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c625e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c581aa5d0 con 0x55d93d808190 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 0x55d93d815600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 0x55d93d815600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33420/0 (socket says 172.21.15.2:33420) 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/4614906 learned_addr learned my addr 172.21.15.2:0/4614906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d801210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d801750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/4614906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 msgr2=0x55d93d801750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d801750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/4614906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 msgr2=0x55d93d801210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d801210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 -- 172.21.15.2:0/4614906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d93d810510 con 0x55d93d80abd0 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d801750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 0x55d93d815600 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6c48013fd0 tx=0x7f6c48015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902f3da9da383095 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.703+0000 7f6c42ffd640 1 -- 172.21.15.2:0/4614906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48019070 con 0x55d93d80abd0 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c42ffd640 1 -- 172.21.15.2:0/4614906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c4801a040 con 0x55d93d80abd0 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c42ffd640 1 -- 172.21.15.2:0/4614906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48004680 con 0x55d93d80abd0 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 -- 172.21.15.2:0/4614906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 msgr2=0x55d93d815600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 0x55d93d815600 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6c48013fd0 tx=0x7f6c48015040 comp rx=0 tx=0).stop 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 -- 172.21.15.2:0/4614906 shutdown_connections 2024-09-10T23:27:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d80abd0 0x55d93d815600 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d808190 0x55d93d801750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 --2- 172.21.15.2:0/4614906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d805860 0x55d93d801210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 -- 172.21.15.2:0/4614906 >> 172.21.15.2:0/4614906 conn(0x55d93d8009b0 msgr2=0x55d93d803a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 -- 172.21.15.2:0/4614906 shutdown_connections 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 -- 172.21.15.2:0/4614906 wait complete. 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.704+0000 7f6c625e8740 1 -- start start 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 Processor -- start 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d805860 0x55d93d882e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d883530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d884090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c581ab370 con 0x55d93d808190 2024-09-10T23:27:23.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c581aaca0 con 0x55d93d80abd0 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c581a7ee0 con 0x55d93d805860 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c625e8740 10 client.0 _ll_register_callbacks cb 0x7f6c54009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d883530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d883530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33428/0 (socket says 172.21.15.2:33428) 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2102336178 learned_addr learned my addr 172.21.15.2:0/2102336178 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d805860 0x55d93d882e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d805860 msgr2=0x55d93d882e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d805860 0x55d93d882e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2102336178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 msgr2=0x55d93d884090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d884090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5d4d9640 1 -- 172.21.15.2:0/2102336178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d93d8848c0 con 0x55d93d808190 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.705+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d805860 0x55d93d882e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:23.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c5d4d9640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d883530 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6c54031500 tx=0x7f6c54005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586ff234d94e83a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2102336178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54035050 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2102336178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6c540054d0 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c4801a040 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2102336178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c54031bb0 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 10 client.16374 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d93d88bc00 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2102336178 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c4801a040 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2102336178 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c540038d0 con 0x55d93d808190 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 10 client.16374 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 20 client.16374 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:23.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d88c5b0 0x55d93d88e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:23.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 4 client.16374 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:27:23.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.706+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d93d7750f0 con 0x55d93d88c5b0 2024-09-10T23:27:23.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.707+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d88c5b0 0x55d93d88e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:23.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.707+0000 7f6c5ccd8640 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d88c5b0 0x55d93d88e9d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c974ae8bf10f779a server_cookie=967a544d18822b27 in_seq=0 out_seq=0 2024-09-10T23:27:23.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.707+0000 7f6c40ff9640 10 client.16374 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c40ff9640 1 -- 172.21.15.2:0/2102336178 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d93d7750f0 con 0x55d93d88c5b0 2024-09-10T23:27:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c40ff9640 10 client.16374 handle_command_reply: tid=0 2024-09-10T23:27:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 client.16374 shutdown 2024-09-10T23:27:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 msgr2=0x55d93d883530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d883530 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6c54031500 tx=0x7f6c54005b50 comp rx=0 tx=0).stop 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 shutdown_connections 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d93d88c5b0 0x55d93d88e9d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d93d80abd0 0x55d93d884090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c40ff9640 0 client.16374 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d93d808190 0x55d93d883530 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 --2- 172.21.15.2:0/2102336178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d93d805860 0x55d93d882e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 >> 172.21.15.2:0/2102336178 conn(0x55d93d8009b0 msgr2=0x55d93d801210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.721+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 shutdown_connections 2024-09-10T23:27:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c625e8740 1 -- 172.21.15.2:0/2102336178 wait complete. 2024-09-10T23:27:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c625e8740 20 client.16374 trim_cache size 0 max 16384 2024-09-10T23:27:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:27:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:27:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:27:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6c440b52e0 msgr2=0x7f6c440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6c440b52e0 0x7f6c440b77a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c500abf40 tx=0x7f6c500cf040 comp rx=0 tx=0).stop 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 msgr2=0x7f6c5819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 0x7f6c5819a0c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000eaa0 tx=0x7f6c5000ef60 comp rx=0 tx=0).stop 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 shutdown_connections 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6c440b52e0 0x7f6c440b77a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c581033c0 0x7f6c5819a0c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c58102a00 0x7f6c58199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 --2- 172.21.15.2:0/1838837497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c581018b0 0x7f6c58198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 >> 172.21.15.2:0/1838837497 conn(0x7f6c580fd150 msgr2=0x7f6c580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 shutdown_connections 2024-09-10T23:27:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:23.722+0000 7f6c5f73d640 1 -- 172.21.15.2:0/1838837497 wait complete. 2024-09-10T23:27:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:23 smithi002 ceph-mon[31150]: pgmap v443: 97 pgs: 97 active+clean; 2.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:27:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:23 smithi154 ceph-mon[35136]: pgmap v443: 97 pgs: 97 active+clean; 2.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:27:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:23 smithi177 ceph-mon[35760]: pgmap v443: 97 pgs: 97 active+clean; 2.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:27:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:25 smithi002 ceph-mon[31150]: pgmap v444: 97 pgs: 97 active+clean; 2.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:25 smithi154 ceph-mon[35136]: pgmap v444: 97 pgs: 97 active+clean; 2.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:25 smithi177 ceph-mon[35760]: pgmap v444: 97 pgs: 97 active+clean; 2.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:27:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:27 smithi002 ceph-mon[31150]: pgmap v445: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:27 smithi154 ceph-mon[35136]: pgmap v445: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:27 smithi177 ceph-mon[35760]: pgmap v445: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:29.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:29.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:29.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:29.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:28 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:27:29.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:29.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:29.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:29.280 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:28 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:27:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:29.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:28 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:27:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:29 smithi002 ceph-mon[31150]: pgmap v446: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:29 smithi154 ceph-mon[35136]: pgmap v446: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:29 smithi177 ceph-mon[35760]: pgmap v446: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:31 smithi002 ceph-mon[31150]: pgmap v447: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:31 smithi154 ceph-mon[35136]: pgmap v447: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:31 smithi177 ceph-mon[35760]: pgmap v447: 97 pgs: 97 active+clean; 2.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:33 smithi002 ceph-mon[31150]: pgmap v448: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:33 smithi154 ceph-mon[35136]: pgmap v448: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:33 smithi177 ceph-mon[35760]: pgmap v448: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:36.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:35 smithi154 ceph-mon[35136]: pgmap v449: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:27:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:35 smithi177 ceph-mon[35760]: pgmap v449: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:27:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:35 smithi002 ceph-mon[31150]: pgmap v449: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 -- 172.21.15.2:0/43914655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc441086c0 msgr2=0x7fdc4410ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 --2- 172.21.15.2:0/43914655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc441086c0 0x7fdc4410ab80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009ca0 tx=0x7fdc3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 -- 172.21.15.2:0/43914655 shutdown_connections 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 --2- 172.21.15.2:0/43914655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc441086c0 0x7fdc4410ab80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 --2- 172.21.15.2:0/43914655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc44105b10 0x7fdc44107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 --2- 172.21.15.2:0/43914655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4406bff0 0x7fdc44105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 -- 172.21.15.2:0/43914655 >> 172.21.15.2:0/43914655 conn(0x7fdc440fd150 msgr2=0x7fdc440ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 -- 172.21.15.2:0/43914655 shutdown_connections 2024-09-10T23:27:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.821+0000 7fdc48e79640 1 -- 172.21.15.2:0/43914655 wait complete. 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 Processor -- start 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 -- start start 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4406bff0 0x7fdc44198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 0x7fdc441993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc441086c0 0x7fdc44199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4410e610 con 0x7fdc44105b10 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4410e490 con 0x7fdc441086c0 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc48e79640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4410e790 con 0x7fdc4406bff0 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc41d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 0x7fdc441993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc41d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 0x7fdc441993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47542/0 (socket says 172.21.15.2:47542) 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1040038154 learned_addr learned my addr 172.21.15.2:0/1040038154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc441086c0 0x7fdc44199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.822+0000 7fdc4259c640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4406bff0 0x7fdc44198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1040038154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4406bff0 msgr2=0x7fdc44198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4406bff0 0x7fdc44198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1040038154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc441086c0 msgr2=0x7fdc44199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc441086c0 0x7fdc44199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1040038154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4419a8a0 con 0x7fdc44105b10 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 0x7fdc441993b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800d950 tx=0x7fdc3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc337fe640 1 -- 172.21.15.2:0/1040038154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38017070 con 0x7fdc44105b10 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc337fe640 1 -- 172.21.15.2:0/1040038154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc38009c30 con 0x7fdc44105b10 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4419ab90 con 0x7fdc44105b10 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc337fe640 1 -- 172.21.15.2:0/1040038154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800f620 con 0x7fdc44105b10 2024-09-10T23:27:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.823+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc441a1260 con 0x7fdc44105b10 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 Processor -- start 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 -- start start 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc337fe640 1 -- 172.21.15.2:0/1040038154 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdc38010460 con 0x7fdc44105b10 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478b9c70 0x55f9478bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478bc5a0 0x55f9478be990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 0x55f9478c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f9478276f0 con 0x55f9478befe0 2024-09-10T23:27:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f947816b20 con 0x55f9478bc5a0 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f94781a930 con 0x55f9478b9c70 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc41d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 0x55f9478c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc41d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 0x55f9478c14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47550/0 (socket says 172.21.15.2:47550) 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1265900780 learned_addr learned my addr 172.21.15.2:0/1265900780 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.826+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478b9c70 0x55f9478bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc4259c640 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478bc5a0 0x55f9478be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1265900780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478b9c70 msgr2=0x55f9478bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478b9c70 0x55f9478bc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1265900780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478bc5a0 msgr2=0x55f9478be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478bc5a0 0x55f9478be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc41d9b640 1 -- 172.21.15.2:0/1265900780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9477dc530 con 0x55f9478befe0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 0x55f9478c14a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdc380ebc10 tx=0x7fdc380ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812b46c5fbbc1746 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc337fe640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc2c0b52e0 0x7fdc2c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc30ff9640 1 -- 172.21.15.2:0/1265900780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380f4070 con 0x55f9478befe0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc30ff9640 1 -- 172.21.15.2:0/1265900780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc380e8e50 con 0x55f9478befe0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc30ff9640 1 -- 172.21.15.2:0/1265900780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380ab980 con 0x55f9478befe0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc2c0b52e0 0x7fdc2c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.827+0000 7fdc337fe640 1 -- 172.21.15.2:0/1040038154 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdc380e5860 con 0x7fdc44105b10 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 -- 172.21.15.2:0/1265900780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 msgr2=0x55f9478c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc2c0b52e0 0x7fdc2c0b77a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc44199ae0 tx=0x7fdc3c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 0x55f9478c14a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdc380ebc10 tx=0x7fdc380ed690 comp rx=0 tx=0).stop 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 -- 172.21.15.2:0/1265900780 shutdown_connections 2024-09-10T23:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478befe0 0x55f9478c14a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478bc5a0 0x55f9478be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/1265900780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478b9c70 0x55f9478bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 -- 172.21.15.2:0/1265900780 >> 172.21.15.2:0/1265900780 conn(0x55f9478b09b0 msgr2=0x55f9478b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 -- 172.21.15.2:0/1265900780 shutdown_connections 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.828+0000 7fdc4bc49740 1 -- 172.21.15.2:0/1265900780 wait complete. 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 -- start start 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 Processor -- start 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478c3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f94774eab0 con 0x55f9478b9c70 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f9477bc730 con 0x55f9478befe0 2024-09-10T23:27:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f9478c1fc0 con 0x55f9478bc5a0 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4bc49740 10 client.0 _ll_register_callbacks cb 0x55f9478106b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47566/0 (socket says 172.21.15.2:47566) 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc4259c640 1 -- 172.21.15.2:0/2636322301 learned_addr learned my addr 172.21.15.2:0/2636322301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.829+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4259c640 1 -- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 msgr2=0x55f9478c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4259c640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4259c640 1 -- 172.21.15.2:0/2636322301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 msgr2=0x55f9478c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4259c640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4259c640 1 -- 172.21.15.2:0/2636322301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f947578790 con 0x55f9478b9c70 2024-09-10T23:27:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4259c640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478c3360 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fdc34012700 tx=0x7fdc34012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acda9363d09d8567 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc29ffb640 1 -- 172.21.15.2:0/2636322301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34004260 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc29ffb640 1 -- 172.21.15.2:0/2636322301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdc34004400 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc380e8e50 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc29ffb640 1 -- 172.21.15.2:0/2636322301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc340119a0 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4bc49740 10 client.16386 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9475f1620 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.830+0000 7fdc29ffb640 1 -- 172.21.15.2:0/2636322301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc380e8e50 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc29ffb640 1 -- 172.21.15.2:0/2636322301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdc3400f440 con 0x55f9478b9c70 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc4bc49740 10 client.16386 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc4bc49740 10 client.16386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc4bc49740 20 client.16386 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f9478cec30 0x55f9478d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc4bc49740 4 client.16386 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f947829640 con 0x55f9478cec30 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f9478cec30 0x55f9478d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f9478cec30 0x55f9478d10b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=895d067acf36e75a server_cookie=31f84bbb00874b9c in_seq=0 out_seq=0 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.831+0000 7fdc29ffb640 10 client.16386 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc29ffb640 1 -- 172.21.15.2:0/2636322301 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f947829640 con 0x55f9478cec30 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc29ffb640 10 client.16386 handle_command_reply: tid=0 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 client.16386 shutdown 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 msgr2=0x55f9478c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478c3360 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fdc34012700 tx=0x7fdc34012bc0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 shutdown_connections 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f9478cec30 0x55f9478d10b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/2636322301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478c3360 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc29ffb640 0 client.16386 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.832+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 >> 172.21.15.2:0/2636322301 conn(0x55f9478b09b0 msgr2=0x55f9478afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.833+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 shutdown_connections 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.833+0000 7fdc4bc49740 1 -- 172.21.15.2:0/2636322301 wait complete. 2024-09-10T23:27:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.833+0000 7fdc4bc49740 20 client.16386 trim_cache size 0 max 16384 2024-09-10T23:27:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.847+0000 7fdc4bc49740 1 Processor -- start 2024-09-10T23:27:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 -- start start 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441a7d40 con 0x55f9478b9c70 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441a9880 con 0x55f9478befe0 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441a8410 con 0x55f9478bc5a0 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47578/0 (socket says 172.21.15.2:47578) 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 -- 172.21.15.2:0/693586830 learned_addr learned my addr 172.21.15.2:0/693586830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 -- 172.21.15.2:0/693586830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 msgr2=0x55f9478af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 -- 172.21.15.2:0/693586830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 msgr2=0x55f9478b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 -- 172.21.15.2:0/693586830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9478cd550 con 0x55f9478b9c70 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.848+0000 7fdc4259c640 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478af3d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400a010 tx=0x7fdc34009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16d10bd991b990e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc2bfff640 1 -- 172.21.15.2:0/693586830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3400f440 con 0x55f9478b9c70 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc2bfff640 1 -- 172.21.15.2:0/693586830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3400f5e0 con 0x55f9478b9c70 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc2bfff640 1 -- 172.21.15.2:0/693586830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34005430 con 0x55f9478b9c70 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 -- 172.21.15.2:0/693586830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 msgr2=0x55f9478af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478af3d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400a010 tx=0x7fdc34009240 comp rx=0 tx=0).stop 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 -- 172.21.15.2:0/693586830 shutdown_connections 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478befe0 0x55f9478b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478bc5a0 0x55f9478af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/693586830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478b9c70 0x55f9478af3d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 -- 172.21.15.2:0/693586830 >> 172.21.15.2:0/693586830 conn(0x55f9478b09b0 msgr2=0x55f9478b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 -- 172.21.15.2:0/693586830 shutdown_connections 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 -- 172.21.15.2:0/693586830 wait complete. 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.849+0000 7fdc4bc49740 1 -- start start 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 Processor -- start 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478b9c70 0x55f9478cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 0x55f9478c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478befe0 0x55f9478ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441a91b0 con 0x55f9478bc5a0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441a8ae0 con 0x55f9478b9c70 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc441a5d20 con 0x55f9478befe0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4bc49740 10 client.0 _ll_register_callbacks cb 0x7fdc340096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 0x55f9478c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 0x55f9478c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47586/0 (socket says 172.21.15.2:47586) 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 -- 172.21.15.2:0/3524388088 learned_addr learned my addr 172.21.15.2:0/3524388088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc42d9d640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478befe0 0x55f9478ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4259c640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478b9c70 0x55f9478cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 -- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478befe0 msgr2=0x55f9478ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478befe0 0x55f9478ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 -- 172.21.15.2:0/3524388088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478b9c70 msgr2=0x55f9478cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478b9c70 0x55f9478cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 -- 172.21.15.2:0/3524388088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9478c88b0 con 0x55f9478bc5a0 2024-09-10T23:27:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc4259c640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478b9c70 0x55f9478cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc41d9b640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 0x55f9478c9e80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800df60 tx=0x7fdc380ebf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62734ea676959cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.850+0000 7fdc29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc29ffb640 1 -- 172.21.15.2:0/3524388088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380d0d90 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc29ffb640 1 -- 172.21.15.2:0/3524388088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdc380b1150 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc3400f5e0 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc29ffb640 1 -- 172.21.15.2:0/3524388088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc380cda40 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 10 client.16392 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f94793be80 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc29ffb640 1 -- 172.21.15.2:0/3524388088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3400f5e0 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc29ffb640 1 -- 172.21.15.2:0/3524388088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdc380a82a0 con 0x55f9478bc5a0 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 10 client.16392 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 20 client.16392 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:36.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f94793c370 0x55f94793e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 4 client.16392 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:27:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.851+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9478250f0 con 0x55f94793c370 2024-09-10T23:27:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.852+0000 7fdc4259c640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f94793c370 0x55f94793e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.852+0000 7fdc4259c640 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f94793c370 0x55f94793e790 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8775cce471be4a server_cookie=b7806f9a443f1b94 in_seq=0 out_seq=0 2024-09-10T23:27:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.852+0000 7fdc29ffb640 10 client.16392 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc29ffb640 1 -- 172.21.15.2:0/3524388088 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9478250f0 con 0x55f94793c370 2024-09-10T23:27:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc29ffb640 10 client.16392 handle_command_reply: tid=0 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 client.16392 shutdown 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 msgr2=0x55f9478c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 0x55f9478c9e80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800df60 tx=0x7fdc380ebf10 comp rx=0 tx=0).stop 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 shutdown_connections 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f94793c370 0x55f94793e790 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f9478befe0 0x55f9478ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f9478bc5a0 0x55f9478c9e80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 --2- 172.21.15.2:0/3524388088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9478b9c70 0x55f9478cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc29ffb640 0 client.16392 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 >> 172.21.15.2:0/3524388088 conn(0x55f9478b09b0 msgr2=0x55f9478af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 shutdown_connections 2024-09-10T23:27:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 1 -- 172.21.15.2:0/3524388088 wait complete. 2024-09-10T23:27:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc4bc49740 20 client.16392 trim_cache size 0 max 16384 2024-09-10T23:27:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:27:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:27:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:27:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc2c0b52e0 msgr2=0x7fdc2c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc2c0b52e0 0x7fdc2c0b77a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc44199ae0 tx=0x7fdc3c009360 comp rx=0 tx=0).stop 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 msgr2=0x7fdc441993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 0x7fdc441993b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800d950 tx=0x7fdc3800de10 comp rx=0 tx=0).stop 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 shutdown_connections 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdc2c0b52e0 0x7fdc2c0b77a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc441086c0 0x7fdc44199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc44105b10 0x7fdc441993b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 --2- 172.21.15.2:0/1040038154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4406bff0 0x7fdc44198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 >> 172.21.15.2:0/1040038154 conn(0x7fdc440fd150 msgr2=0x7fdc44103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 shutdown_connections 2024-09-10T23:27:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:36.868+0000 7fdc48e79640 1 -- 172.21.15.2:0/1040038154 wait complete. 2024-09-10T23:27:38.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:37 smithi154 ceph-mon[35136]: pgmap v450: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:27:38.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:37 smithi177 ceph-mon[35760]: pgmap v450: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:27:38.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:37 smithi002 ceph-mon[31150]: pgmap v450: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:27:38.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:27:38.984 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 -- 172.21.15.2:0/2799562273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c108020 msgr2=0x7f477c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 --2- 172.21.15.2:0/2799562273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c108020 0x7f477c10e820 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4774009900 tx=0x7f477402a410 comp rx=0 tx=0).stop 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 -- 172.21.15.2:0/2799562273 shutdown_connections 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 --2- 172.21.15.2:0/2799562273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c108020 0x7f477c10e820 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 --2- 172.21.15.2:0/2799562273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 0x7f477c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 --2- 172.21.15.2:0/2799562273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f477c101c90 0x7f477c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 -- 172.21.15.2:0/2799562273 >> 172.21.15.2:0/2799562273 conn(0x7f477c0fd700 msgr2=0x7f477c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 -- 172.21.15.2:0/2799562273 shutdown_connections 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.506+0000 7f47809af640 1 -- 172.21.15.2:0/2799562273 wait complete. 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 Processor -- start 2024-09-10T23:27:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 -- start start 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 0x7f477c199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 0x7f477c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f477c108020 0x7f477c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f477c111ca0 con 0x7f477c101c90 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f477c111b20 con 0x7f477c1076a0 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.507+0000 7f47809af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f477c111e20 con 0x7f477c108020 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 0x7f477c199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 0x7f477c199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47596/0 (socket says 172.21.15.2:47596) 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 -- 172.21.15.2:0/4259675620 learned_addr learned my addr 172.21.15.2:0/4259675620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f4779d9b640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 0x7f477c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477ad9d640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f477c108020 0x7f477c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 -- 172.21.15.2:0/4259675620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f477c108020 msgr2=0x7f477c19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f477c108020 0x7f477c19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 -- 172.21.15.2:0/4259675620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 msgr2=0x7f477c199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 0x7f477c199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 -- 172.21.15.2:0/4259675620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c19f2d0 con 0x7f477c101c90 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f4779d9b640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 0x7f477c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f477a59c640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 0x7f477c199220 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d950 tx=0x7f476c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f476b7fe640 1 -- 172.21.15.2:0/4259675620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c017030 con 0x7f477c101c90 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f476b7fe640 1 -- 172.21.15.2:0/4259675620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f476c004020 con 0x7f477c101c90 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f476b7fe640 1 -- 172.21.15.2:0/4259675620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c0047a0 con 0x7f477c101c90 2024-09-10T23:27:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c19f5c0 con 0x7f477c101c90 2024-09-10T23:27:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.508+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c0fdd30 con 0x7f477c101c90 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.511+0000 7f4782d84740 1 Processor -- start 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.511+0000 7f4782d84740 1 -- start start 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.511+0000 7f476b7fe640 1 -- 172.21.15.2:0/4259675620 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f476c009a30 con 0x7f477c101c90 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4782d84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983480 0x560ef3983860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4782d84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4782d84740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef398fd30 0x560ef3992120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4782d84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ef38f9e50 con 0x560ef3983da0 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4782d84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560ef38e9280 con 0x560ef3983480 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4782d84740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560ef38ed090 con 0x560ef398fd30 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47600/0 (socket says 172.21.15.2:47600) 2024-09-10T23:27:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477a59c640 1 -- 172.21.15.2:0/1934151375 learned_addr learned my addr 172.21.15.2:0/1934151375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983480 0x560ef3983860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4779d9b640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef398fd30 0x560ef3992120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477ad9d640 1 -- 172.21.15.2:0/1934151375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef398fd30 msgr2=0x560ef3992120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef398fd30 0x560ef3992120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477ad9d640 1 -- 172.21.15.2:0/1934151375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 msgr2=0x560ef398f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477ad9d640 1 -- 172.21.15.2:0/1934151375 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ef3647650 con 0x560ef3983480 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f477a59c640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.512+0000 7f4779d9b640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef398fd30 0x560ef3992120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983480 0x560ef3983860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4774006010 tx=0x7f4774032e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e524bc700916f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f476b7fe640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47640b52e0 0x7f47640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f477a59c640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47640b52e0 0x7f47640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f4768ff9640 1 -- 172.21.15.2:0/1934151375 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477403f070 con 0x560ef3983480 2024-09-10T23:27:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f4768ff9640 1 -- 172.21.15.2:0/1934151375 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47740316a0 con 0x560ef3983480 2024-09-10T23:27:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f4768ff9640 1 -- 172.21.15.2:0/1934151375 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774035070 con 0x560ef3983480 2024-09-10T23:27:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.513+0000 7f476b7fe640 1 -- 172.21.15.2:0/4259675620 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f476c0e5750 con 0x7f477c101c90 2024-09-10T23:27:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 -- 172.21.15.2:0/1934151375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983480 msgr2=0x560ef3983860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f477a59c640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47640b52e0 0x7f47640b77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f476c005fd0 tx=0x7f476c0eb550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983480 0x560ef3983860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4774006010 tx=0x7f4774032e70 comp rx=0 tx=0).stop 2024-09-10T23:27:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 -- 172.21.15.2:0/1934151375 shutdown_connections 2024-09-10T23:27:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef398fd30 0x560ef3992120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 --2- 172.21.15.2:0/1934151375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983480 0x560ef3983860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 -- 172.21.15.2:0/1934151375 >> 172.21.15.2:0/1934151375 conn(0x560ef39812b0 msgr2=0x560ef3982450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 -- 172.21.15.2:0/1934151375 shutdown_connections 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 -- 172.21.15.2:0/1934151375 wait complete. 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 -- start start 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.514+0000 7f4782d84740 1 Processor -- start 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef398f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ef374a700 con 0x560ef3983da0 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560ef3884110 con 0x560ef398fd30 2024-09-10T23:27:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560ef3992950 con 0x560ef3983480 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4782d84740 10 client.0 _ll_register_callbacks cb 0x560ef389d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47602/0 (socket says 172.21.15.2:47602) 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef398f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 -- 172.21.15.2:0/2571390112 learned_addr learned my addr 172.21.15.2:0/2571390112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 -- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 msgr2=0x560ef398f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef398f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 -- 172.21.15.2:0/2571390112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 msgr2=0x560ef398d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 -- 172.21.15.2:0/2571390112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ef38b1c40 con 0x560ef3983da0 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef398f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4779d9b640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398ca90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4770012840 tx=0x7f4770012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755103375e121520 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.515+0000 7f4761ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4761ffb640 1 -- 172.21.15.2:0/2571390112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770004d20 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4761ffb640 1 -- 172.21.15.2:0/2571390112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4770010b60 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47740316a0 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4761ffb640 1 -- 172.21.15.2:0/2571390112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4770010da0 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 10 client.16404 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560ef399e2f0 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4761ffb640 1 -- 172.21.15.2:0/2571390112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47740316a0 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4761ffb640 1 -- 172.21.15.2:0/2571390112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4770019070 con 0x560ef3983da0 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 10 client.16404 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 20 client.16404 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef399f7f0 0x560ef39a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 4 client.16404 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.516+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ef38fbda0 con 0x560ef399f7f0 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.517+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef399f7f0 0x560ef39a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.517+0000 7f4761ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.517+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef399f7f0 0x560ef39a1c10 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=facf6d18a4cd27a2 server_cookie=dbd24076a1c6f95f in_seq=0 out_seq=0 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4761ffb640 1 -- 172.21.15.2:0/2571390112 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ef38fbda0 con 0x560ef399f7f0 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4761ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 client.16404 shutdown 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 msgr2=0x560ef398ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398ca90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4770012840 tx=0x7f4770012d00 comp rx=0 tx=0).stop 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 shutdown_connections 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef399f7f0 0x560ef39a1c10 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4761ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef398ca90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 --2- 172.21.15.2:0/2571390112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef398f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 >> 172.21.15.2:0/2571390112 conn(0x560ef39812b0 msgr2=0x560ef3986e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 shutdown_connections 2024-09-10T23:27:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 1 -- 172.21.15.2:0/2571390112 wait complete. 2024-09-10T23:27:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.518+0000 7f4782d84740 20 client.16404 trim_cache size 0 max 16384 2024-09-10T23:27:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 Processor -- start 2024-09-10T23:27:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 -- start start 2024-09-10T23:27:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef39829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef3980bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b05b0 con 0x560ef3983da0 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b20f0 con 0x560ef398fd30 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4782d84740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b0c80 con 0x560ef3983480 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4779d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef3980bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef39829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4779d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef3980bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47604/0 (socket says 172.21.15.2:47604) 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f4779d9b640 1 -- 172.21.15.2:0/1145147046 learned_addr learned my addr 172.21.15.2:0/1145147046 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f477ad9d640 1 -- 172.21.15.2:0/1145147046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 msgr2=0x560ef398e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.536+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f477ad9d640 1 -- 172.21.15.2:0/1145147046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 msgr2=0x560ef3980bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef3980bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f477ad9d640 1 -- 172.21.15.2:0/1145147046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ef398f270 con 0x560ef3983480 2024-09-10T23:27:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f4779d9b640 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef3980bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f477ad9d640 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef39829e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4774005ab0 tx=0x7f477403d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a5882a808aeaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:39.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f4763fff640 1 -- 172.21.15.2:0/1145147046 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477403f070 con 0x560ef3983480 2024-09-10T23:27:39.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f4763fff640 1 -- 172.21.15.2:0/1145147046 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4774031660 con 0x560ef3983480 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.537+0000 7f4763fff640 1 -- 172.21.15.2:0/1145147046 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774035040 con 0x560ef3983480 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 -- 172.21.15.2:0/1145147046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 msgr2=0x560ef39829e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef39829e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4774005ab0 tx=0x7f477403d040 comp rx=0 tx=0).stop 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 -- 172.21.15.2:0/1145147046 shutdown_connections 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef398fd30 0x560ef398e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef3983da0 0x560ef3980bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 --2- 172.21.15.2:0/1145147046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef39829e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 -- 172.21.15.2:0/1145147046 >> 172.21.15.2:0/1145147046 conn(0x560ef39812b0 msgr2=0x560ef398e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 -- 172.21.15.2:0/1145147046 shutdown_connections 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 -- 172.21.15.2:0/1145147046 wait complete. 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 -- start start 2024-09-10T23:27:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.538+0000 7f4782d84740 1 Processor -- start 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef3997dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983da0 0x560ef3998310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef398fd30 0x560ef3992ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b1a20 con 0x560ef398fd30 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b1350 con 0x560ef3983da0 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1ae590 con 0x560ef3983480 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4782d84740 10 client.0 _ll_register_callbacks cb 0x7f477000aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef398fd30 0x560ef3992ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef3997dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4779d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983da0 0x560ef3998310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef3997dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:49208/0 (socket says 172.21.15.2:49208) 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 -- 172.21.15.2:0/2881626691 learned_addr learned my addr 172.21.15.2:0/2881626691 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 -- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 msgr2=0x560ef3997dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef3997dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 -- 172.21.15.2:0/2881626691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983da0 msgr2=0x560ef3998310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983da0 0x560ef3998310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 -- 172.21.15.2:0/2881626691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ef3993310 con 0x560ef398fd30 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4779d9b640 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983da0 0x560ef3998310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f477ad9d640 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef398fd30 0x560ef3992ba0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4774009900 tx=0x7f4774000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6f455e7cac3958 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.539+0000 7f4761ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4761ffb640 1 -- 172.21.15.2:0/2881626691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774035070 con 0x560ef398fd30 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4761ffb640 1 -- 172.21.15.2:0/2881626691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f47740049d0 con 0x560ef398fd30 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4774031660 con 0x560ef398fd30 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4761ffb640 1 -- 172.21.15.2:0/2881626691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f477406c050 con 0x560ef398fd30 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 10 client.16410 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560ef3a0d150 con 0x560ef398fd30 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4761ffb640 1 -- 172.21.15.2:0/2881626691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4774031660 con 0x560ef398fd30 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4761ffb640 1 -- 172.21.15.2:0/2881626691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4774052040 con 0x560ef398fd30 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 10 client.16410 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 20 client.16410 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef3a0d3d0 0x560ef3a0f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 4 client.16410 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.540+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560ef38f7850 con 0x560ef3a0d3d0 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4779d9b640 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef3a0d3d0 0x560ef3a0f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4761ffb640 10 client.16410 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4779d9b640 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef3a0d3d0 0x560ef3a0f7c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef8acf6f4649cc94 server_cookie=574918e6a2e0c7e8 in_seq=0 out_seq=0 2024-09-10T23:27:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4761ffb640 1 -- 172.21.15.2:0/2881626691 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x560ef38f7850 con 0x560ef3a0d3d0 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4761ffb640 10 client.16410 handle_command_reply: tid=0 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4782d84740 1 client.16410 shutdown 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef398fd30 msgr2=0x560ef3992ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.541+0000 7f4782d84740 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef398fd30 0x560ef3992ba0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4774009900 tx=0x7f4774000bc0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 shutdown_connections 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560ef3a0d3d0 0x560ef3a0f7c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ef398fd30 0x560ef3992ba0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ef3983da0 0x560ef3998310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 --2- 172.21.15.2:0/2881626691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560ef3983480 0x560ef3997dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 >> 172.21.15.2:0/2881626691 conn(0x560ef39812b0 msgr2=0x560ef398e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4761ffb640 0 client.16410 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 shutdown_connections 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 1 -- 172.21.15.2:0/2881626691 wait complete. 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f4782d84740 20 client.16410 trim_cache size 0 max 16384 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:39.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:27:39.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:27:39.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47640b52e0 msgr2=0x7f47640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f47809af640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47640b52e0 0x7f47640b77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f476c005fd0 tx=0x7f476c0eb550 comp rx=0 tx=0).stop 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 msgr2=0x7f477c199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f47809af640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 0x7f477c199220 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d950 tx=0x7f476c00de10 comp rx=0 tx=0).stop 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 shutdown_connections 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.542+0000 7f47809af640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47640b52e0 0x7f47640b77a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.543+0000 7f47809af640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f477c108020 0x7f477c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.543+0000 7f47809af640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c1076a0 0x7f477c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.543+0000 7f47809af640 1 --2- 172.21.15.2:0/4259675620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f477c101c90 0x7f477c199220 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.543+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 >> 172.21.15.2:0/4259675620 conn(0x7f477c0fd700 msgr2=0x7f477c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.543+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 shutdown_connections 2024-09-10T23:27:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:39.543+0000 7f47809af640 1 -- 172.21.15.2:0/4259675620 wait complete. 2024-09-10T23:27:40.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:39 smithi154 ceph-mon[35136]: pgmap v451: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T23:27:40.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:39 smithi002 ceph-mon[31150]: pgmap v451: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T23:27:40.314 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:27:40.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:27:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:39 smithi177 ceph-mon[35760]: pgmap v451: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T23:27:40.581 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:41.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 -- 172.21.15.2:0/680726215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 msgr2=0x7fca7c10eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:41.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 --2- 172.21.15.2:0/680726215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c10eee0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fca70009900 tx=0x7fca7002a410 comp rx=0 tx=0).stop 2024-09-10T23:27:41.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 -- 172.21.15.2:0/680726215 shutdown_connections 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 --2- 172.21.15.2:0/680726215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7c10f420 0x7fca7c111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 --2- 172.21.15.2:0/680726215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c10eee0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 --2- 172.21.15.2:0/680726215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca7c101870 0x7fca7c101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.064+0000 7fca83496640 1 -- 172.21.15.2:0/680726215 >> 172.21.15.2:0/680726215 conn(0x7fca7c0fd700 msgr2=0x7fca7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 -- 172.21.15.2:0/680726215 shutdown_connections 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 -- 172.21.15.2:0/680726215 wait complete. 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 Processor -- start 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 -- start start 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7c101870 0x7fca7c19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca7c10f420 0x7fca7c1a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c114f90 con 0x7fca7c102190 2024-09-10T23:27:41.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c114e10 con 0x7fca7c101870 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.065+0000 7fca83496640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c115110 con 0x7fca7c10f420 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48464/0 (socket says 172.21.15.2:48464) 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 -- 172.21.15.2:0/1599584322 learned_addr learned my addr 172.21.15.2:0/1599584322 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca81232640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7c101870 0x7fca7c19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca81a33640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca7c10f420 0x7fca7c1a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 -- 172.21.15.2:0/1599584322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca7c10f420 msgr2=0x7fca7c1a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca7c10f420 0x7fca7c1a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 -- 172.21.15.2:0/1599584322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7c101870 msgr2=0x7fca7c19b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7c101870 0x7fca7c19b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 -- 172.21.15.2:0/1599584322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c1a15b0 con 0x7fca7c102190 2024-09-10T23:27:41.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca80a31640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c19ba40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fca70005940 tx=0x7fca700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7003f030 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca70003cb0 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70035070 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c1a1840 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.066+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c1a7f60 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.068+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7c101c50 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.070+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fca7003bbf0 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.070+0000 7fca6e7fc640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca680b5360 0x7fca680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.071+0000 7fca81232640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca680b5360 0x7fca680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.071+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fca70106940 con 0x7fca7c102190 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.071+0000 7fca81232640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca680b5360 0x7fca680b7820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fca78005fd0 tx=0x7fca7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:41.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.074+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca700cd160 con 0x7fca7c102190 2024-09-10T23:27:41.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.298+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca7c1a8160 con 0x7fca7c102190 2024-09-10T23:27:41.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.298+0000 7fca6e7fc640 1 -- 172.21.15.2:0/1599584322 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fca700d1b90 con 0x7fca7c102190 2024-09-10T23:27:41.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:27:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:27:41.299 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:27:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca680b5360 msgr2=0x7fca680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca680b5360 0x7fca680b7820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fca78005fd0 tx=0x7fca7800b390 comp rx=0 tx=0).stop 2024-09-10T23:27:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 msgr2=0x7fca7c19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c19ba40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fca70005940 tx=0x7fca700042f0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 shutdown_connections 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca680b5360 0x7fca680b7820 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca7c10f420 0x7fca7c1a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7c102190 0x7fca7c19ba40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 --2- 172.21.15.2:0/1599584322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7c101870 0x7fca7c19b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 >> 172.21.15.2:0/1599584322 conn(0x7fca7c0fd700 msgr2=0x7fca7c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 shutdown_connections 2024-09-10T23:27:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:41.300+0000 7fca83496640 1 -- 172.21.15.2:0/1599584322 wait complete. 2024-09-10T23:27:42.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:27:42.266 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:41 smithi177 ceph-mon[35760]: pgmap v452: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:27:42.266 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:41 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1599584322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:42.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:41 smithi154 ceph-mon[35136]: pgmap v452: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:27:42.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:41 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1599584322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:42.333 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:42.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:41 smithi002 ceph-mon[31150]: pgmap v452: 97 pgs: 97 active+clean; 2.4 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:27:42.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:41 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1599584322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 -- 172.21.15.2:0/3283637887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 msgr2=0x7f6d6010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 --2- 172.21.15.2:0/3283637887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d6010f950 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009ca0 tx=0x7f6d5802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 -- 172.21.15.2:0/3283637887 shutdown_connections 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 --2- 172.21.15.2:0/3283637887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d6010f950 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 --2- 172.21.15.2:0/3283637887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 0x7f6d60108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 --2- 172.21.15.2:0/3283637887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d60102dc0 0x7f6d601031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 -- 172.21.15.2:0/3283637887 >> 172.21.15.2:0/3283637887 conn(0x7f6d600fe830 msgr2=0x7f6d60100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 -- 172.21.15.2:0/3283637887 shutdown_connections 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.850+0000 7f6d65356640 1 -- 172.21.15.2:0/3283637887 wait complete. 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 Processor -- start 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 -- start start 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d60102dc0 0x7f6d6019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 0x7f6d6019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d601a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60112e60 con 0x7f6d60109150 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60112ce0 con 0x7f6d601087d0 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d65356640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60112fe0 con 0x7f6d60102dc0 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d601a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d601a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48482/0 (socket says 172.21.15.2:48482) 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/2720420617 learned_addr learned my addr 172.21.15.2:0/2720420617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5effd640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d60102dc0 0x7f6d6019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 0x7f6d6019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/2720420617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d60102dc0 msgr2=0x7f6d6019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d60102dc0 0x7f6d6019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/2720420617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 msgr2=0x7f6d6019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 0x7f6d6019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/2720420617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601a14b0 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.851+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 0x7f6d6019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.852+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d601a0ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009430 tx=0x7f6d580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.852+0000 7f6d5cff9640 1 -- 172.21.15.2:0/2720420617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58003c30 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.852+0000 7f6d5cff9640 1 -- 172.21.15.2:0/2720420617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d58003dd0 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.852+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601a1740 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.852+0000 7f6d5cff9640 1 -- 172.21.15.2:0/2720420617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5802faa0 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.852+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601a7e60 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 Processor -- start 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d5cff9640 1 -- 172.21.15.2:0/2720420617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6d5802fc40 con 0x7f6d60109150 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 -- start start 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x5585006f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f8df0 0x558500704840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500707170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55850066eea0 con 0x558500704d80 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55850065e2d0 con 0x5585006f8df0 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d6772b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5585006620e0 con 0x5585006f84d0 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500707170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500707170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48492/0 (socket says 172.21.15.2:48492) 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d567fc640 1 -- 172.21.15.2:0/740604219 learned_addr learned my addr 172.21.15.2:0/740604219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.855+0000 7f6d5effd640 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f8df0 0x558500704840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d567fc640 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x5585006f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5effd640 1 -- 172.21.15.2:0/740604219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 msgr2=0x5585006f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5effd640 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x5585006f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5effd640 1 -- 172.21.15.2:0/740604219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 msgr2=0x558500707170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5effd640 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500707170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5effd640 1 -- 172.21.15.2:0/740604219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585003bc650 con 0x5585006f8df0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d567fc640 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500707170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5cff9640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6d4c0b5360 0x7f6d4c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5effd640 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f8df0 0x558500704840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000dc60 tx=0x7f6d5000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47643a816cea7dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6d4c0b5360 0x7f6d4c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d5cff9640 1 -- 172.21.15.2:0/2720420617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6d58106fe0 con 0x7f6d60109150 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d557fa640 1 -- 172.21.15.2:0/740604219 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50015070 con 0x5585006f8df0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d557fa640 1 -- 172.21.15.2:0/740604219 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d500054d0 con 0x5585006f8df0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.856+0000 7f6d557fa640 1 -- 172.21.15.2:0/740604219 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50011440 con 0x5585006f8df0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 -- 172.21.15.2:0/740604219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f8df0 msgr2=0x558500704840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6d4c0b5360 0x7f6d4c0b7820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d48005fd0 tx=0x7f6d4800d3e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f8df0 0x558500704840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000dc60 tx=0x7f6d5000f730 comp rx=0 tx=0).stop 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 -- 172.21.15.2:0/740604219 shutdown_connections 2024-09-10T23:27:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500707170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f8df0 0x558500704840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 --2- 172.21.15.2:0/740604219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x5585006f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 -- 172.21.15.2:0/740604219 >> 172.21.15.2:0/740604219 conn(0x5585006f6300 msgr2=0x5585006f74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 -- 172.21.15.2:0/740604219 shutdown_connections 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 -- 172.21.15.2:0/740604219 wait complete. 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.857+0000 7f6d6772b740 1 -- start start 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 Processor -- start 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x558500704630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f8df0 0x558500701a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500702040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5585004bf700 con 0x558500704d80 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5585005f9160 con 0x5585006f84d0 2024-09-10T23:27:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558500707a00 con 0x5585006f8df0 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d6772b740 10 client.0 _ll_register_callbacks cb 0x5585006129e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500702040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500702040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48504/0 (socket says 172.21.15.2:48504) 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/4161869358 learned_addr learned my addr 172.21.15.2:0/4161869358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5effd640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x558500704630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/4161869358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f8df0 msgr2=0x558500701a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d567fc640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f8df0 0x558500701a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f8df0 0x558500701a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 msgr2=0x558500704630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x558500704630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5f7fe640 1 -- 172.21.15.2:0/4161869358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558500626c90 con 0x558500704d80 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d5effd640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x558500704630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.858+0000 7f6d567fc640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f8df0 0x558500701a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500702040 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6d580c9d80 tx=0x7f6d580ccf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f312e606ef38d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d467fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d467fc640 1 -- 172.21.15.2:0/4161869358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d580cdc10 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d467fc640 1 -- 172.21.15.2:0/4161869358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6d580d68b0 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d500054d0 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d467fc640 1 -- 172.21.15.2:0/4161869358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d580d6b30 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 10 client.16428 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558500713350 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d467fc640 1 -- 172.21.15.2:0/4161869358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d500054d0 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d467fc640 1 -- 172.21.15.2:0/4161869358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d580cca10 con 0x558500704d80 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 10 client.16428 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 10 client.16428 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 20 client.16428 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500714850 0x558500716cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 4 client.16428 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.859+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558500670df0 con 0x558500714850 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.860+0000 7f6d5effd640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500714850 0x558500716cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.860+0000 7f6d467fc640 10 client.16428 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.860+0000 7f6d5effd640 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500714850 0x558500716cf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7538110a92ef0d04 server_cookie=7aec0ccfd2cbea75 in_seq=0 out_seq=0 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d467fc640 1 -- 172.21.15.2:0/4161869358 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558500670df0 con 0x558500714850 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d467fc640 10 client.16428 handle_command_reply: tid=0 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 client.16428 shutdown 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 msgr2=0x558500702040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500702040 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6d580c9d80 tx=0x7f6d580ccf20 comp rx=0 tx=0).stop 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 shutdown_connections 2024-09-10T23:27:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500714850 0x558500716cf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558500704d80 0x558500702040 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f8df0 0x558500701a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 --2- 172.21.15.2:0/4161869358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x558500704630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 >> 172.21.15.2:0/4161869358 conn(0x5585006f6300 msgr2=0x5585006fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d467fc640 0 client.16428 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 shutdown_connections 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 1 -- 172.21.15.2:0/4161869358 wait complete. 2024-09-10T23:27:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.861+0000 7f6d6772b740 20 client.16428 trim_cache size 0 max 16384 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.874+0000 7f6d6772b740 1 Processor -- start 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.874+0000 7f6d6772b740 1 -- start start 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x558500710c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558500704d80 0x5585006ff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d6772b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601b0410 con 0x5585006f8df0 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d6772b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601b1f50 con 0x558500704d80 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d6772b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601b0ae0 con 0x5585006f84d0 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48506/0 (socket says 172.21.15.2:48506) 2024-09-10T23:27:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 -- 172.21.15.2:0/2400805604 learned_addr learned my addr 172.21.15.2:0/2400805604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d5effd640 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x558500710c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 -- 172.21.15.2:0/2400805604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 msgr2=0x558500710c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558500704d80 0x5585006ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x558500710c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 -- 172.21.15.2:0/2400805604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558500704d80 msgr2=0x5585006ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558500704d80 0x5585006ff1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.875+0000 7f6d567fc640 1 -- 172.21.15.2:0/2400805604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585007049a0 con 0x5585006f8df0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.876+0000 7f6d567fc640 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fecb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6d48012630 tx=0x7f6d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a8786cf854fb90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.876+0000 7f6d54ff9640 1 -- 172.21.15.2:0/2400805604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48021da0 con 0x5585006f8df0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.876+0000 7f6d54ff9640 1 -- 172.21.15.2:0/2400805604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d480054d0 con 0x5585006f8df0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.876+0000 7f6d54ff9640 1 -- 172.21.15.2:0/2400805604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4801f470 con 0x5585006f8df0 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.876+0000 7f6d6772b740 1 -- 172.21.15.2:0/2400805604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 msgr2=0x5585006fecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.876+0000 7f6d6772b740 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fecb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6d48012630 tx=0x7f6d480046c0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 -- 172.21.15.2:0/2400805604 shutdown_connections 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558500704d80 0x5585006ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fecb0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 --2- 172.21.15.2:0/2400805604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5585006f84d0 0x558500710c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 -- 172.21.15.2:0/2400805604 >> 172.21.15.2:0/2400805604 conn(0x5585006f6300 msgr2=0x558500701a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 -- 172.21.15.2:0/2400805604 shutdown_connections 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 -- 172.21.15.2:0/2400805604 wait complete. 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 -- start start 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 Processor -- start 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x55850070d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.877+0000 7f6d6772b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558500704d80 0x5585006fef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d6772b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601b1880 con 0x5585006f8df0 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d6772b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601b11b0 con 0x5585006f84d0 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d6772b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601ae3f0 con 0x558500704d80 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d6772b740 10 client.0 _ll_register_callbacks cb 0x7f6d580cd580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48508/0 (socket says 172.21.15.2:48508) 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 -- 172.21.15.2:0/3444524086 learned_addr learned my addr 172.21.15.2:0/3444524086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d5effd640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x55850070d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d5f7fe640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558500704d80 0x5585006fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 -- 172.21.15.2:0/3444524086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558500704d80 msgr2=0x5585006fef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558500704d80 0x5585006fef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 -- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 msgr2=0x55850070d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x55850070d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 -- 172.21.15.2:0/3444524086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585006ff7b0 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d5effd640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x55850070d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d567fc640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fe9e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d480049d0 tx=0x7f6d48005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e395c2e86c0acaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d467fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.878+0000 7f6d467fc640 1 -- 172.21.15.2:0/3444524086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48036020 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d467fc640 1 -- 172.21.15.2:0/3444524086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6d48021da0 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d480054d0 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d467fc640 1 -- 172.21.15.2:0/3444524086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d4802e040 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 10 client.16434 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558500781890 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d467fc640 1 -- 172.21.15.2:0/3444524086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d480054d0 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d467fc640 1 -- 172.21.15.2:0/3444524086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d48031030 con 0x5585006f8df0 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 10 client.16434 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:42.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 10 client.16434 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 20 client.16434 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500781f50 0x558500784370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 4 client.16434 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55850066c8a0 con 0x558500781f50 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.879+0000 7f6d5effd640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500781f50 0x558500784370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d5effd640 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500781f50 0x558500784370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e4aeedad9e4e618 server_cookie=820f3980e2d5b198 in_seq=0 out_seq=0 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d467fc640 10 client.16434 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d467fc640 1 -- 172.21.15.2:0/3444524086 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55850066c8a0 con 0x558500781f50 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d467fc640 10 client.16434 handle_command_reply: tid=0 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 client.16434 shutdown 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 msgr2=0x5585006fe9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fe9e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d480049d0 tx=0x7f6d48005f40 comp rx=0 tx=0).stop 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 shutdown_connections 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x558500781f50 0x558500784370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558500704d80 0x5585006fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585006f8df0 0x5585006fe9e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d467fc640 0 client.16434 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 --2- 172.21.15.2:0/3444524086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585006f84d0 0x55850070d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 >> 172.21.15.2:0/3444524086 conn(0x5585006f6300 msgr2=0x5585007030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.880+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 shutdown_connections 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d6772b740 1 -- 172.21.15.2:0/3444524086 wait complete. 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d6772b740 20 client.16434 trim_cache size 0 max 16384 2024-09-10T23:27:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6d4c0b5360 msgr2=0x7f6d4c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6d4c0b5360 0x7f6d4c0b7820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d48005fd0 tx=0x7f6d4800d3e0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 msgr2=0x7f6d601a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d601a0ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009430 tx=0x7f6d580319f0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 shutdown_connections 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6d4c0b5360 0x7f6d4c0b7820 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60109150 0x7f6d601a0ce0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d601087d0 0x7f6d6019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 --2- 172.21.15.2:0/2720420617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d60102dc0 0x7f6d6019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 >> 172.21.15.2:0/2720420617 conn(0x7f6d600fe830 msgr2=0x7f6d60101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 shutdown_connections 2024-09-10T23:27:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:42.881+0000 7f6d65356640 1 -- 172.21.15.2:0/2720420617 wait complete. 2024-09-10T23:27:43.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:27:43.935 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:44.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:44 smithi154 ceph-mon[35136]: pgmap v453: 97 pgs: 97 active+clean; 2.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:44.353 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:44 smithi002 ceph-mon[31150]: pgmap v453: 97 pgs: 97 active+clean; 2.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 -- 172.21.15.2:0/3356345918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 msgr2=0x7fd57810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3356345918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd57810cab0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd560009900 tx=0x7fd56002a410 comp rx=0 tx=0).stop 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 -- 172.21.15.2:0/3356345918 shutdown_connections 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3356345918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd57810d100 0x7fd57810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3356345918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd57810cab0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3356345918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd578103ca0 0x7fd578104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 -- 172.21.15.2:0/3356345918 >> 172.21.15.2:0/3356345918 conn(0x7fd5780fd700 msgr2=0x7fd5780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 -- 172.21.15.2:0/3356345918 shutdown_connections 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.436+0000 7fd57ee69640 1 -- 172.21.15.2:0/3356345918 wait complete. 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 Processor -- start 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 -- start start 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd578103ca0 0x7fd578103400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd578101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd57810d100 0x7fd578101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd578112d70 con 0x7fd5781045c0 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd578112bf0 con 0x7fd57810d100 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd57ee69640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd578112ef0 con 0x7fd578103ca0 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd577fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd578101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd577fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd578101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48514/0 (socket says 172.21.15.2:48514) 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.437+0000 7fd577fff640 1 -- 172.21.15.2:0/3653107433 learned_addr learned my addr 172.21.15.2:0/3653107433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd57cc05640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd578103ca0 0x7fd578103400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd57d406640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd57810d100 0x7fd578101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd577fff640 1 -- 172.21.15.2:0/3653107433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd578103ca0 msgr2=0x7fd578103400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd577fff640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd578103ca0 0x7fd578103400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd577fff640 1 -- 172.21.15.2:0/3653107433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd57810d100 msgr2=0x7fd578101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd577fff640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd57810d100 0x7fd578101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd577fff640 1 -- 172.21.15.2:0/3653107433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5781abba0 con 0x7fd5781045c0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd577fff640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd578101950 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd560006010 tx=0x7fd560004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd575ffb640 1 -- 172.21.15.2:0/3653107433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56003f030 con 0x7fd5781045c0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5781abd70 con 0x7fd5781045c0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd575ffb640 1 -- 172.21.15.2:0/3653107433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd560003aa0 con 0x7fd5781045c0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd575ffb640 1 -- 172.21.15.2:0/3653107433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560035070 con 0x7fd5781045c0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.438+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5781ac170 con 0x7fd5781045c0 2024-09-10T23:27:44.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 Processor -- start 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 -- start start 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd575ffb640 1 -- 172.21.15.2:0/3653107433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd5600035f0 con 0x7fd5781045c0 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf40e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf41ad80 0x55f3cf41d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf384ea0 con 0x55f3cf40edf0 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf3742d0 con 0x55f3cf41ad80 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd58123e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf3780e0 con 0x55f3cf40e4d0 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd57cc05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd57cc05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48526/0 (socket says 172.21.15.2:48526) 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd57cc05640 1 -- 172.21.15.2:0/2730802006 learned_addr learned my addr 172.21.15.2:0/2730802006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:44.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd57d406640 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf40e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.441+0000 7fd577fff640 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf41ad80 0x55f3cf41d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57cc05640 1 -- 172.21.15.2:0/2730802006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 msgr2=0x55f3cf40e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57cc05640 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf40e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57cc05640 1 -- 172.21.15.2:0/2730802006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf41ad80 msgr2=0x55f3cf41d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57cc05640 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf41ad80 0x55f3cf41d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57cc05640 1 -- 172.21.15.2:0/2730802006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cf0d2650 con 0x55f3cf40edf0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd577fff640 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf41ad80 0x55f3cf41d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57cc05640 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41a840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd56800cc60 tx=0x7fd56800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbafd6433b7b47b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd575ffb640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5640b52e0 0x7fd5640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd57d406640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5640b52e0 0x7fd5640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd56effd640 1 -- 172.21.15.2:0/2730802006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568014070 con 0x55f3cf40edf0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd56effd640 1 -- 172.21.15.2:0/2730802006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5680047a0 con 0x55f3cf40edf0 2024-09-10T23:27:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd575ffb640 1 -- 172.21.15.2:0/3653107433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd5601063c0 con 0x7fd5781045c0 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.442+0000 7fd56effd640 1 -- 172.21.15.2:0/2730802006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568010690 con 0x55f3cf40edf0 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 -- 172.21.15.2:0/2730802006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 msgr2=0x55f3cf41a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd57d406640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5640b52e0 0x7fd5640b77a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd570005fd0 tx=0x7fd570009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41a840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd56800cc60 tx=0x7fd56800e720 comp rx=0 tx=0).stop 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 -- 172.21.15.2:0/2730802006 shutdown_connections 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf41ad80 0x55f3cf41d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41a840 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 --2- 172.21.15.2:0/2730802006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf40e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 -- 172.21.15.2:0/2730802006 >> 172.21.15.2:0/2730802006 conn(0x55f3cf40c300 msgr2=0x55f3cf40d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 -- 172.21.15.2:0/2730802006 shutdown_connections 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 -- 172.21.15.2:0/2730802006 wait complete. 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 -- start start 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.443+0000 7fd58123e740 1 Processor -- start 2024-09-10T23:27:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf417a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf418030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf1d5700 con 0x55f3cf40edf0 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf30f160 con 0x55f3cf40e4d0 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf41da00 con 0x55f3cf41ad80 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd58123e740 10 client.0 _ll_register_callbacks cb 0x55f3cf3289e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf417a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf417a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48530/0 (socket says 172.21.15.2:48530) 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 -- 172.21.15.2:0/703638252 learned_addr learned my addr 172.21.15.2:0/703638252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd57cc05640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd57d406640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf418030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 -- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 msgr2=0x55f3cf418030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf418030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 -- 172.21.15.2:0/703638252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 msgr2=0x55f3cf41a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd577fff640 1 -- 172.21.15.2:0/703638252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cf33cc90 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.444+0000 7fd57cc05640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd577fff640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf417a70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd5600ccb20 tx=0x7fd560000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26e2c5df490b7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd557fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd557fff640 1 -- 172.21.15.2:0/703638252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560049050 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd557fff640 1 -- 172.21.15.2:0/703638252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd5600ccdf0 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5680047a0 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd557fff640 1 -- 172.21.15.2:0/703638252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5600c8a30 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 10 client.16446 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f3cf429320 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd557fff640 1 -- 172.21.15.2:0/703638252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5680047a0 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd557fff640 1 -- 172.21.15.2:0/703638252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd5600d11e0 con 0x55f3cf40edf0 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 10 client.16446 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 10 client.16446 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 20 client.16446 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf42a670 0x55f3cf42cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 4 client.16446 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.445+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3cf386df0 con 0x55f3cf42a670 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.446+0000 7fd57cc05640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf42a670 0x55f3cf42cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.446+0000 7fd57cc05640 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf42a670 0x55f3cf42cac0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6725bd06a0a4a96d server_cookie=d9857e673048f008 in_seq=0 out_seq=0 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.446+0000 7fd557fff640 10 client.16446 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd557fff640 1 -- 172.21.15.2:0/703638252 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3cf386df0 con 0x55f3cf42a670 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd557fff640 10 client.16446 handle_command_reply: tid=0 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 client.16446 shutdown 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 msgr2=0x55f3cf417a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf417a70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd5600ccb20 tx=0x7fd560000bc0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 shutdown_connections 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf42a670 0x55f3cf42cac0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf418030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf417a70 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd557fff640 0 client.16446 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 --2- 172.21.15.2:0/703638252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 >> 172.21.15.2:0/703638252 conn(0x55f3cf40c300 msgr2=0x55f3cf411ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 shutdown_connections 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 1 -- 172.21.15.2:0/703638252 wait complete. 2024-09-10T23:27:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.447+0000 7fd58123e740 20 client.16446 trim_cache size 0 max 16384 2024-09-10T23:27:44.471 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:44 smithi177 ceph-mon[35760]: pgmap v453: 97 pgs: 97 active+clean; 2.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 Processor -- start 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 -- start start 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf426c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40edf0 0x55f3cf414c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 0x55f3cf4151c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781b48a0 con 0x55f3cf41ad80 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781b63e0 con 0x55f3cf40edf0 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd58123e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781b4f70 con 0x55f3cf40e4d0 2024-09-10T23:27:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.461+0000 7fd57d406640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 0x55f3cf4151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 0x55f3cf4151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48534/0 (socket says 172.21.15.2:48534) 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 -- 172.21.15.2:0/1288488775 learned_addr learned my addr 172.21.15.2:0/1288488775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd577fff640 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40edf0 0x55f3cf414c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57cc05640 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf426c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 -- 172.21.15.2:0/1288488775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 msgr2=0x55f3cf426c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf426c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 -- 172.21.15.2:0/1288488775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40edf0 msgr2=0x55f3cf414c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40edf0 0x55f3cf414c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 -- 172.21.15.2:0/1288488775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cf42d110 con 0x55f3cf41ad80 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd57d406640 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 0x55f3cf4151c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd5700206e0 tx=0x7fd570015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5151602027b136 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd56e7fc640 1 -- 172.21.15.2:0/1288488775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570020310 con 0x55f3cf41ad80 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd56e7fc640 1 -- 172.21.15.2:0/1288488775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd57001e5b0 con 0x55f3cf41ad80 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.462+0000 7fd56e7fc640 1 -- 172.21.15.2:0/1288488775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570005260 con 0x55f3cf41ad80 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 -- 172.21.15.2:0/1288488775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 msgr2=0x55f3cf4151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 0x55f3cf4151c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd5700206e0 tx=0x7fd570015000 comp rx=0 tx=0).stop 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 -- 172.21.15.2:0/1288488775 shutdown_connections 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf41ad80 0x55f3cf4151c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40edf0 0x55f3cf414c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 --2- 172.21.15.2:0/1288488775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf40e4d0 0x55f3cf426c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 -- 172.21.15.2:0/1288488775 >> 172.21.15.2:0/1288488775 conn(0x55f3cf40c300 msgr2=0x55f3cf4198c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 -- 172.21.15.2:0/1288488775 shutdown_connections 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 -- 172.21.15.2:0/1288488775 wait complete. 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 -- start start 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.463+0000 7fd58123e740 1 Processor -- start 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf4905a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781b5d10 con 0x55f3cf40edf0 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781b5640 con 0x55f3cf40e4d0 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781b2880 con 0x55f3cf41ad80 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd58123e740 10 client.0 _ll_register_callbacks cb 0x7fd560005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48536/0 (socket says 172.21.15.2:48536) 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 -- 172.21.15.2:0/1480306479 learned_addr learned my addr 172.21.15.2:0/1480306479 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd57cc05640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd57d406640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf4905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 -- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 msgr2=0x55f3cf4905a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf4905a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 -- 172.21.15.2:0/1480306479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 msgr2=0x55f3cf41f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 -- 172.21.15.2:0/1480306479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cf490ce0 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd57cc05640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd577fff640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41fb70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd5600d1550 tx=0x7fd5600c9030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11cff0368e3f8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.464+0000 7fd557fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd557fff640 1 -- 172.21.15.2:0/1480306479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5600f3020 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd557fff640 1 -- 172.21.15.2:0/1480306479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd5600ccdf0 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57001e5b0 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd557fff640 1 -- 172.21.15.2:0/1480306479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd560049040 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 10 client.16452 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f3cf4980c0 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd557fff640 1 -- 172.21.15.2:0/1480306479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd57001e5b0 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd557fff640 1 -- 172.21.15.2:0/1480306479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd5600cbdf0 con 0x55f3cf40edf0 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 10 client.16452 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 10 client.16452 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 20 client.16452 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf498700 0x55f3cf49ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 4 client.16452 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3cf3828a0 con 0x55f3cf498700 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.465+0000 7fd57cc05640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf498700 0x55f3cf49ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd57cc05640 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf498700 0x55f3cf49ab20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b941206ee06ef84d server_cookie=4704d15f7e89b38d in_seq=0 out_seq=0 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd557fff640 10 client.16452 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd557fff640 1 -- 172.21.15.2:0/1480306479 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3cf3828a0 con 0x55f3cf498700 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd557fff640 10 client.16452 handle_command_reply: tid=0 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 client.16452 shutdown 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 msgr2=0x55f3cf41fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41fb70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd5600d1550 tx=0x7fd5600c9030 comp rx=0 tx=0).stop 2024-09-10T23:27:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 shutdown_connections 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55f3cf498700 0x55f3cf49ab20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd557fff640 0 client.16452 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f3cf41ad80 0x55f3cf4905a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3cf40edf0 0x55f3cf41fb70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 --2- 172.21.15.2:0/1480306479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f3cf40e4d0 0x55f3cf41f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 >> 172.21.15.2:0/1480306479 conn(0x55f3cf40c300 msgr2=0x55f3cf40ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 shutdown_connections 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 1 -- 172.21.15.2:0/1480306479 wait complete. 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.466+0000 7fd58123e740 20 client.16452 trim_cache size 0 max 16384 2024-09-10T23:27:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5640b52e0 msgr2=0x7fd5640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5640b52e0 0x7fd5640b77a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd570005fd0 tx=0x7fd570009740 comp rx=0 tx=0).stop 2024-09-10T23:27:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 msgr2=0x7fd578101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd578101950 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd560006010 tx=0x7fd560004060 comp rx=0 tx=0).stop 2024-09-10T23:27:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 shutdown_connections 2024-09-10T23:27:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd5640b52e0 0x7fd5640b77a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd57810d100 0x7fd578101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5781045c0 0x7fd578101950 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 --2- 172.21.15.2:0/3653107433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd578103ca0 0x7fd578103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 >> 172.21.15.2:0/3653107433 conn(0x7fd5780fd700 msgr2=0x7fd5780fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 shutdown_connections 2024-09-10T23:27:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:44.467+0000 7fd57ee69640 1 -- 172.21.15.2:0/3653107433 wait complete. 2024-09-10T23:27:45.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:27:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.089+0000 7fae2f34f640 1 -- 172.21.15.2:0/393560615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28104600 msgr2=0x7fae2810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.089+0000 7fae2f34f640 1 --2- 172.21.15.2:0/393560615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28104600 0x7fae2810caf0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fae18009900 tx=0x7fae1802a410 comp rx=0 tx=0).stop 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 -- 172.21.15.2:0/393560615 shutdown_connections 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 --2- 172.21.15.2:0/393560615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae2810d140 0x7fae2810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 --2- 172.21.15.2:0/393560615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28104600 0x7fae2810caf0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 --2- 172.21.15.2:0/393560615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28103ce0 0x7fae281040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 -- 172.21.15.2:0/393560615 >> 172.21.15.2:0/393560615 conn(0x7fae280fd720 msgr2=0x7fae280ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 -- 172.21.15.2:0/393560615 shutdown_connections 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 -- 172.21.15.2:0/393560615 wait complete. 2024-09-10T23:27:46.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 Processor -- start 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.090+0000 7fae2f34f640 1 -- start start 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2f34f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 0x7fae281992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2f34f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28104600 0x7fae28199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2f34f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae2810d140 0x7fae2819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2f34f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae28112db0 con 0x7fae28103ce0 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2f34f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae28112c30 con 0x7fae28104600 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2f34f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae28112f30 con 0x7fae2810d140 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 0x7fae281992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 0x7fae281992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48546/0 (socket says 172.21.15.2:48546) 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 -- 172.21.15.2:0/3745849734 learned_addr learned my addr 172.21.15.2:0/3745849734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:46.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae2810d140 0x7fae2819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28104600 0x7fae28199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 -- 172.21.15.2:0/3745849734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae2810d140 msgr2=0x7fae2819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae2810d140 0x7fae2819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 -- 172.21.15.2:0/3745849734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28104600 msgr2=0x7fae28199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28104600 0x7fae28199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 -- 172.21.15.2:0/3745849734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2819f390 con 0x7fae28103ce0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28104600 0x7fae28199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.091+0000 7fae2d0eb640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 0x7fae281992e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c920 tx=0x7fae2400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.092+0000 7fae1e7fc640 1 -- 172.21.15.2:0/3745849734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24007c70 con 0x7fae28103ce0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.092+0000 7fae1e7fc640 1 -- 172.21.15.2:0/3745849734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae24007e10 con 0x7fae28103ce0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.092+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2819f680 con 0x7fae28103ce0 2024-09-10T23:27:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.092+0000 7fae1e7fc640 1 -- 172.21.15.2:0/3745849734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24018820 con 0x7fae28103ce0 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.092+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae281a5d40 con 0x7fae28103ce0 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.094+0000 7fae31724740 1 Processor -- start 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 -- start start 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae1e7fc640 1 -- 172.21.15.2:0/3745849734 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fae2400f450 con 0x7fae28103ce0 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b2a10 0x559e9e0c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559e9e028ea0 con 0x559e9e0c2db0 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e9e0182d0 con 0x559e9e0b2a10 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae31724740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559e9e01c0e0 con 0x559e9e0b20f0 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2c8ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d8ec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2c8ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48554/0 (socket says 172.21.15.2:48554) 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2c8ea640 1 -- 172.21.15.2:0/3391403822 learned_addr learned my addr 172.21.15.2:0/3391403822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d0eb640 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b2a10 0x559e9e0c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d8ec640 1 -- 172.21.15.2:0/3391403822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b2a10 msgr2=0x559e9e0c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b2a10 0x559e9e0c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d8ec640 1 -- 172.21.15.2:0/3391403822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 msgr2=0x559e9e0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.095+0000 7fae2d8ec640 1 -- 172.21.15.2:0/3391403822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9dd76650 con 0x559e9e0b20f0 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae1e7fc640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fae140b52e0 0x7fae140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b24d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae20009ee0 tx=0x7fae200107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2699f7abf240d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae2d0eb640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fae140b52e0 0x7fae140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae1e7fc640 1 -- 172.21.15.2:0/3745849734 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fae240e5d40 con 0x7fae28103ce0 2024-09-10T23:27:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae137fe640 1 -- 172.21.15.2:0/3391403822 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20003c30 con 0x559e9e0b20f0 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae137fe640 1 -- 172.21.15.2:0/3391403822 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae20015070 con 0x559e9e0b20f0 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.096+0000 7fae137fe640 1 -- 172.21.15.2:0/3391403822 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2001a7b0 con 0x559e9e0b20f0 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 -- 172.21.15.2:0/3391403822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 msgr2=0x559e9e0b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b24d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae20009ee0 tx=0x7fae200107a0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae2d0eb640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fae140b52e0 0x7fae140b77a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae240e3bc0 tx=0x7fae240e9820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 -- 172.21.15.2:0/3391403822 shutdown_connections 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b2a10 0x559e9e0c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 --2- 172.21.15.2:0/3391403822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b24d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 -- 172.21.15.2:0/3391403822 >> 172.21.15.2:0/3391403822 conn(0x559e9e0aff20 msgr2=0x559e9e0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 -- 172.21.15.2:0/3391403822 shutdown_connections 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 -- 172.21.15.2:0/3391403822 wait complete. 2024-09-10T23:27:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 -- start start 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.097+0000 7fae31724740 1 Processor -- start 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559e9de79700 con 0x559e9e0b2a10 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e9dfb3160 con 0x559e9e0c2db0 2024-09-10T23:27:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559e9e0c5a60 con 0x559e9e0b20f0 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae31724740 10 client.0 _ll_register_callbacks cb 0x559e9dfcc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0bfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48560/0 (socket says 172.21.15.2:48560) 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 -- 172.21.15.2:0/4023509837 learned_addr learned my addr 172.21.15.2:0/4023509837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 -- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 msgr2=0x559e9e0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 -- 172.21.15.2:0/4023509837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 msgr2=0x559e9e0c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0c01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 -- 172.21.15.2:0/4023509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9dfe0c90 con 0x559e9e0b2a10 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.098+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0bfb50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fae18009900 tx=0x7fae180314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d78d5ac9a732f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae10ff9640 1 -- 172.21.15.2:0/4023509837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18040070 con 0x559e9e0b2a10 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae20015070 con 0x559e9e0b2a10 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae10ff9640 1 -- 172.21.15.2:0/4023509837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fae18004240 con 0x559e9e0b2a10 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae10ff9640 1 -- 172.21.15.2:0/4023509837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae18035040 con 0x559e9e0b2a10 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 10 client.16464 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e9e0d1470 con 0x559e9e0b2a10 2024-09-10T23:27:46.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae10ff9640 1 -- 172.21.15.2:0/4023509837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae20015070 con 0x559e9e0b2a10 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae10ff9640 1 -- 172.21.15.2:0/4023509837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fae18004930 con 0x559e9e0b2a10 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 10 client.16464 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 10 client.16464 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 20 client.16464 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e0d28d0 0x559e9e0d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 4 client.16464 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.099+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e9e02adf0 con 0x559e9e0d28d0 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.100+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e0d28d0 0x559e9e0d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.100+0000 7fae10ff9640 10 client.16464 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.100+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e0d28d0 0x559e9e0d4cf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85479583a835d6c4 server_cookie=f41688e916969adc in_seq=0 out_seq=0 2024-09-10T23:27:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae10ff9640 1 -- 172.21.15.2:0/4023509837 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e9e02adf0 con 0x559e9e0d28d0 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae10ff9640 10 client.16464 handle_command_reply: tid=0 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 client.16464 shutdown 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 msgr2=0x559e9e0bfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0bfb50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fae18009900 tx=0x7fae180314a0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 shutdown_connections 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e0d28d0 0x559e9e0d4cf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0bfb50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 --2- 172.21.15.2:0/4023509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 >> 172.21.15.2:0/4023509837 conn(0x559e9e0aff20 msgr2=0x559e9e0b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae10ff9640 0 client.16464 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 shutdown_connections 2024-09-10T23:27:46.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 1 -- 172.21.15.2:0/4023509837 wait complete. 2024-09-10T23:27:46.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.101+0000 7fae31724740 20 client.16464 trim_cache size 0 max 16384 2024-09-10T23:27:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 Processor -- start 2024-09-10T23:27:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 -- start start 2024-09-10T23:27:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ac1c0 con 0x559e9e0b2a10 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae281add00 con 0x559e9e0c2db0 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae31724740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ac890 con 0x559e9e0b20f0 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48566/0 (socket says 172.21.15.2:48566) 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 -- 172.21.15.2:0/2593384347 learned_addr learned my addr 172.21.15.2:0/2593384347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 -- 172.21.15.2:0/2593384347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 msgr2=0x559e9e0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 -- 172.21.15.2:0/2593384347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 msgr2=0x559e9e0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2c8ea640 1 -- 172.21.15.2:0/2593384347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9e0c44a0 con 0x559e9e0b2a10 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.115+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0cecc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fae18006010 tx=0x7fae1802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6420a07da54545 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae12ffd640 1 -- 172.21.15.2:0/2593384347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18040070 con 0x559e9e0b2a10 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae12ffd640 1 -- 172.21.15.2:0/2593384347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae18031e10 con 0x559e9e0b2a10 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae12ffd640 1 -- 172.21.15.2:0/2593384347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18005360 con 0x559e9e0b2a10 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 -- 172.21.15.2:0/2593384347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 msgr2=0x559e9e0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0cecc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fae18006010 tx=0x7fae1802a410 comp rx=0 tx=0).stop 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 -- 172.21.15.2:0/2593384347 shutdown_connections 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0c2db0 0x559e9e0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0b2a10 0x559e9e0cecc0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 --2- 172.21.15.2:0/2593384347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b20f0 0x559e9e0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 -- 172.21.15.2:0/2593384347 >> 172.21.15.2:0/2593384347 conn(0x559e9e0aff20 msgr2=0x559e9e0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 -- 172.21.15.2:0/2593384347 shutdown_connections 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.116+0000 7fae31724740 1 -- 172.21.15.2:0/2593384347 wait complete. 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 -- start start 2024-09-10T23:27:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 Processor -- start 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b20f0 0x559e9e0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b2a10 0x559e9e0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae281ad630 con 0x559e9e0c2db0 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae281acf60 con 0x559e9e0b20f0 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae281aa1a0 con 0x559e9e0b2a10 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae31724740 10 client.0 _ll_register_callbacks cb 0x7fae18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae2d8ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae2d8ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48572/0 (socket says 172.21.15.2:48572) 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae2d8ec640 1 -- 172.21.15.2:0/1672529656 learned_addr learned my addr 172.21.15.2:0/1672529656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.117+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b2a10 0x559e9e0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b20f0 0x559e9e0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 -- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b2a10 msgr2=0x559e9e0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b2a10 0x559e9e0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 -- 172.21.15.2:0/1672529656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b20f0 msgr2=0x559e9e0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b20f0 0x559e9e0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 -- 172.21.15.2:0/1672529656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9e0c82b0 con 0x559e9e0c2db0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae2d8ec640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c7cf0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fae20009fd0 tx=0x7fae2001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79a93512c141395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae10ff9640 1 -- 172.21.15.2:0/1672529656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20023040 con 0x559e9e0c2db0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae10ff9640 1 -- 172.21.15.2:0/1672529656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fae20004c00 con 0x559e9e0c2db0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae18031e10 con 0x559e9e0c2db0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae10ff9640 1 -- 172.21.15.2:0/1672529656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae20003b50 con 0x559e9e0c2db0 2024-09-10T23:27:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae31724740 10 client.16470 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e9e13fff0 con 0x559e9e0c2db0 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.118+0000 7fae10ff9640 1 -- 172.21.15.2:0/1672529656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae18031e10 con 0x559e9e0c2db0 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae10ff9640 1 -- 172.21.15.2:0/1672529656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fae2002f070 con 0x559e9e0c2db0 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae31724740 10 client.16470 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae31724740 10 client.16470 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae31724740 20 client.16470 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae31724740 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e140610 0x559e9e142a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae31724740 4 client.16470 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e9e0268a0 con 0x559e9e140610 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e140610 0x559e9e142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae10ff9640 10 client.16470 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.119+0000 7fae2c8ea640 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e140610 0x559e9e142a30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9121e7014d04eb59 server_cookie=9606f8adef4751bb in_seq=0 out_seq=0 2024-09-10T23:27:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae10ff9640 1 -- 172.21.15.2:0/1672529656 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e9e0268a0 con 0x559e9e140610 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae10ff9640 10 client.16470 handle_command_reply: tid=0 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 client.16470 shutdown 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 msgr2=0x559e9e0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c7cf0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fae20009fd0 tx=0x7fae2001c040 comp rx=0 tx=0).stop 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 shutdown_connections 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559e9e140610 0x559e9e142a30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e9e0c2db0 0x559e9e0c7cf0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559e9e0b2a10 0x559e9e0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae10ff9640 0 client.16470 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 --2- 172.21.15.2:0/1672529656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e9e0b20f0 0x559e9e0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 >> 172.21.15.2:0/1672529656 conn(0x559e9e0aff20 msgr2=0x559e9e0c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 shutdown_connections 2024-09-10T23:27:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 1 -- 172.21.15.2:0/1672529656 wait complete. 2024-09-10T23:27:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.120+0000 7fae31724740 20 client.16470 trim_cache size 0 max 16384 2024-09-10T23:27:46.130 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fae140b52e0 msgr2=0x7fae140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fae140b52e0 0x7fae140b77a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae240e3bc0 tx=0x7fae240e9820 comp rx=0 tx=0).stop 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 msgr2=0x7fae281992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 0x7fae281992e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c920 tx=0x7fae2400cde0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 shutdown_connections 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fae140b52e0 0x7fae140b77a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae2810d140 0x7fae2819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae28104600 0x7fae28199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 --2- 172.21.15.2:0/3745849734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae28103ce0 0x7fae281992e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 >> 172.21.15.2:0/3745849734 conn(0x7fae280fd720 msgr2=0x7fae280fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 shutdown_connections 2024-09-10T23:27:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:46.121+0000 7fae2f34f640 1 -- 172.21.15.2:0/3745849734 wait complete. 2024-09-10T23:27:46.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:46 smithi154 ceph-mon[35136]: pgmap v454: 97 pgs: 97 active+clean; 2.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:46.425 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:46 smithi002 ceph-mon[31150]: pgmap v454: 97 pgs: 97 active+clean; 2.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:46.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:46 smithi177 ceph-mon[35760]: pgmap v454: 97 pgs: 97 active+clean; 2.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:46.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:27:47.233 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 -- 172.21.15.2:0/247517518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 msgr2=0x7f663c10f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 --2- 172.21.15.2:0/247517518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c10f570 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6634009ca0 tx=0x7f663402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 -- 172.21.15.2:0/247517518 shutdown_connections 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 --2- 172.21.15.2:0/247517518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c10f570 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 --2- 172.21.15.2:0/247517518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f663c104590 0x7f663c10cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 --2- 172.21.15.2:0/247517518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c103b90 0x7f663c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 -- 172.21.15.2:0/247517518 >> 172.21.15.2:0/247517518 conn(0x7f663c0fd700 msgr2=0x7f663c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 -- 172.21.15.2:0/247517518 shutdown_connections 2024-09-10T23:27:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 -- 172.21.15.2:0/247517518 wait complete. 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.708+0000 7f6643a4a640 1 Processor -- start 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 -- start start 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f663c103b90 0x7f663c101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c104590 0x7f663c101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f663c112d80 con 0x7f663c10d140 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f663c112c00 con 0x7f663c103b90 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6643a4a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f663c112f00 con 0x7f663c104590 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48594/0 (socket says 172.21.15.2:48594) 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 -- 172.21.15.2:0/770582485 learned_addr learned my addr 172.21.15.2:0/770582485 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f66417e6640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f663c103b90 0x7f663c101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6640fe5640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c104590 0x7f663c101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 -- 172.21.15.2:0/770582485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c104590 msgr2=0x7f663c101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c104590 0x7f663c101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 -- 172.21.15.2:0/770582485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f663c103b90 msgr2=0x7f663c101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f663c103b90 0x7f663c101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 -- 172.21.15.2:0/770582485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c1a75b0 con 0x7f663c10d140 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.709+0000 7f6641fe7640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c102490 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6634005cc0 tx=0x7f663402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.710+0000 7f66327fc640 1 -- 172.21.15.2:0/770582485 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634003cf0 con 0x7f663c10d140 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.710+0000 7f66327fc640 1 -- 172.21.15.2:0/770582485 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66340044f0 con 0x7f663c10d140 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.710+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c1a7840 con 0x7f663c10d140 2024-09-10T23:27:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.710+0000 7f66327fc640 1 -- 172.21.15.2:0/770582485 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663402fc30 con 0x7f663c10d140 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.710+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c1a7d80 con 0x7f663c10d140 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 Processor -- start 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f66327fc640 1 -- 172.21.15.2:0/770582485 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6634004040 con 0x7f663c10d140 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 -- start start 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb960f0 0x55881cb964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55881cb0cea0 con 0x55881cb96a10 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55881cafc2d0 con 0x55881cb960f0 2024-09-10T23:27:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6645e1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55881cb000e0 con 0x55881cba29a0 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f66417e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f66417e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48608/0 (socket says 172.21.15.2:48608) 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f66417e6640 1 -- 172.21.15.2:0/4077356662 learned_addr learned my addr 172.21.15.2:0/4077356662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6640fe5640 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.713+0000 7f6640fe5640 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb960f0 0x55881cb964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66417e6640 1 -- 172.21.15.2:0/4077356662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 msgr2=0x55881cba4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66417e6640 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66417e6640 1 -- 172.21.15.2:0/4077356662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb960f0 msgr2=0x55881cb964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66417e6640 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb960f0 0x55881cb964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66327fc640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66280b52e0 0x7f66280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66417e6640 1 -- 172.21.15.2:0/4077356662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881c85a650 con 0x55881cb96a10 2024-09-10T23:27:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f6640fe5640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66280b52e0 0x7f66280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66417e6640 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba2460 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f663800ad00 tx=0x7f663800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7bd9dc484a951f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66327fc640 1 -- 172.21.15.2:0/770582485 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f66341070b0 con 0x7f663c10d140 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66277fe640 1 -- 172.21.15.2:0/4077356662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663801d070 con 0x55881cb96a10 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66277fe640 1 -- 172.21.15.2:0/4077356662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6638018af0 con 0x55881cb96a10 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.714+0000 7f66277fe640 1 -- 172.21.15.2:0/4077356662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638010a50 con 0x55881cb96a10 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 -- 172.21.15.2:0/4077356662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 msgr2=0x55881cba2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6640fe5640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66280b52e0 0x7f66280b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f662c005d90 tx=0x7f662c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba2460 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f663800ad00 tx=0x7f663800f790 comp rx=0 tx=0).stop 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 -- 172.21.15.2:0/4077356662 shutdown_connections 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba2460 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4077356662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb960f0 0x55881cb964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 -- 172.21.15.2:0/4077356662 >> 172.21.15.2:0/4077356662 conn(0x55881cb93f20 msgr2=0x55881cb950c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 -- 172.21.15.2:0/4077356662 shutdown_connections 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 -- 172.21.15.2:0/4077356662 wait complete. 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 -- start start 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.715+0000 7f6645e1f740 1 Processor -- start 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cba2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cb9f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cb9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55881c95d700 con 0x55881cb96a10 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55881ca97160 con 0x55881cba29a0 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55881cba5620 con 0x55881cb960f0 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6645e1f740 10 client.0 _ll_register_callbacks cb 0x55881cab09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cb9f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cb9f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48624/0 (socket says 172.21.15.2:48624) 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 -- 172.21.15.2:0/4210131739 learned_addr learned my addr 172.21.15.2:0/4210131739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f66417e6640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cba2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6641fe7640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cb9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 -- 172.21.15.2:0/4210131739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 msgr2=0x55881cba2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cba2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 -- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 msgr2=0x55881cb9fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cb9fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f6640fe5640 1 -- 172.21.15.2:0/4210131739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881cac4c90 con 0x55881cb96a10 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.716+0000 7f66417e6640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cba2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6640fe5640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cb9f6a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f662c013e60 tx=0x7f662c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd8016255279540 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6624ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6624ff9640 1 -- 172.21.15.2:0/4210131739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c004220 con 0x55881cb96a10 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6638018af0 con 0x55881cb96a10 2024-09-10T23:27:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6624ff9640 1 -- 172.21.15.2:0/4210131739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f662c0043c0 con 0x55881cb96a10 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6624ff9640 1 -- 172.21.15.2:0/4210131739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f662c010e90 con 0x55881cb96a10 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 10 client.16482 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55881cbb0f70 con 0x55881cb96a10 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6624ff9640 1 -- 172.21.15.2:0/4210131739 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6638018af0 con 0x55881cb96a10 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6624ff9640 1 -- 172.21.15.2:0/4210131739 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f662c029660 con 0x55881cb96a10 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 10 client.16482 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 10 client.16482 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 20 client.16482 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cbb23d0 0x55881cbb4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 4 client.16482 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.717+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55881cb0edf0 con 0x55881cbb23d0 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.718+0000 7f66417e6640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cbb23d0 0x55881cbb4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.718+0000 7f66417e6640 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cbb23d0 0x55881cbb4870 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32c63c7a1e43313 server_cookie=8c4b5c769e1bb934 in_seq=0 out_seq=0 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.718+0000 7f6624ff9640 10 client.16482 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6624ff9640 1 -- 172.21.15.2:0/4210131739 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55881cb0edf0 con 0x55881cbb23d0 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6624ff9640 10 client.16482 handle_command_reply: tid=0 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 client.16482 shutdown 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 msgr2=0x55881cb9f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cb9f6a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f662c013e60 tx=0x7f662c004730 comp rx=0 tx=0).stop 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 shutdown_connections 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cb9fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cbb23d0 0x55881cbb4870 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cb9f6a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 --2- 172.21.15.2:0/4210131739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cba2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 >> 172.21.15.2:0/4210131739 conn(0x55881cb93f20 msgr2=0x55881cb99ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.719+0000 7f6624ff9640 0 client.16482 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.720+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 shutdown_connections 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.720+0000 7f6645e1f740 1 -- 172.21.15.2:0/4210131739 wait complete. 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.720+0000 7f6645e1f740 20 client.16482 trim_cache size 0 max 16384 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 Processor -- start 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 -- start start 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 0x55881cbb43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb96a10 0x55881cb93760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b04c0 con 0x55881cb960f0 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b2000 con 0x55881cb96a10 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6645e1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b0b90 con 0x55881cba29a0 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f66417e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 0x55881cbb43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f66417e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 0x55881cbb43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48634/0 (socket says 172.21.15.2:48634) 2024-09-10T23:27:47.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f66417e6640 1 -- 172.21.15.2:0/1710579628 learned_addr learned my addr 172.21.15.2:0/1710579628 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:47.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6640fe5640 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb96a10 0x55881cb93760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.734+0000 7f6641fe7640 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f66417e6640 1 -- 172.21.15.2:0/1710579628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 msgr2=0x55881cba13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f66417e6640 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f66417e6640 1 -- 172.21.15.2:0/1710579628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb96a10 msgr2=0x55881cb93760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f66417e6640 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb96a10 0x55881cb93760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f66417e6640 1 -- 172.21.15.2:0/1710579628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881cb949a0 con 0x55881cb960f0 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f6641fe7640 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f66417e6640 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 0x55881cbb43e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55881cb94e00 tx=0x7f66380106f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba5f955ec93800f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f6626ffd640 1 -- 172.21.15.2:0/1710579628 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638030020 con 0x55881cb960f0 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f6626ffd640 1 -- 172.21.15.2:0/1710579628 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f663800a730 con 0x55881cb960f0 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.735+0000 7f6626ffd640 1 -- 172.21.15.2:0/1710579628 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663801d040 con 0x55881cb960f0 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 -- 172.21.15.2:0/1710579628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 msgr2=0x55881cbb43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 0x55881cbb43e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55881cb94e00 tx=0x7f66380106f0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 -- 172.21.15.2:0/1710579628 shutdown_connections 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cba29a0 0x55881cba13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cb96a10 0x55881cb93760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 --2- 172.21.15.2:0/1710579628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb960f0 0x55881cbb43e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 -- 172.21.15.2:0/1710579628 >> 172.21.15.2:0/1710579628 conn(0x55881cb93f20 msgr2=0x55881cba0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 -- 172.21.15.2:0/1710579628 shutdown_connections 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.736+0000 7f6645e1f740 1 -- 172.21.15.2:0/1710579628 wait complete. 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 -- start start 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 Processor -- start 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cbab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cba6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b1930 con 0x55881cb96a10 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b1260 con 0x55881cba29a0 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1ae4a0 con 0x55881cb960f0 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6645e1f740 10 client.0 _ll_register_callbacks cb 0x7f662c010d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6640fe5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6640fe5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48636/0 (socket says 172.21.15.2:48636) 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6640fe5640 1 -- 172.21.15.2:0/3481329225 learned_addr learned my addr 172.21.15.2:0/3481329225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6641fe7640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cba6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f66417e6640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cbab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6640fe5640 1 -- 172.21.15.2:0/3481329225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 msgr2=0x55881cbab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6640fe5640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cbab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.737+0000 7f6640fe5640 1 -- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 msgr2=0x55881cba6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6640fe5640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cba6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6640fe5640 1 -- 172.21.15.2:0/3481329225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881cc1e340 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6641fe7640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cba6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6640fe5640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba6760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f662c022040 tx=0x7f662c01fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec41593dbb9208c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6624ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6624ff9640 1 -- 172.21.15.2:0/3481329225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c041060 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6624ff9640 1 -- 172.21.15.2:0/3481329225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f662c029600 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f663800a730 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6624ff9640 1 -- 172.21.15.2:0/3481329225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f662c00eab0 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6645e1f740 10 client.16488 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55881cc1f560 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6624ff9640 1 -- 172.21.15.2:0/3481329225 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f663800a730 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6624ff9640 1 -- 172.21.15.2:0/3481329225 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f662c0333f0 con 0x55881cb96a10 2024-09-10T23:27:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6645e1f740 10 client.16488 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6645e1f740 10 client.16488 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.738+0000 7f6645e1f740 20 client.16488 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6645e1f740 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cc1fc20 0x55881cc22040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6645e1f740 4 client.16488 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55881cb0a8a0 con 0x55881cc1fc20 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f66417e6640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cc1fc20 0x55881cc22040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6624ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f66417e6640 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cc1fc20 0x55881cc22040 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c295bb13de066638 server_cookie=933b31f2d9ae2bcf in_seq=0 out_seq=0 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6624ff9640 1 -- 172.21.15.2:0/3481329225 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55881cb0a8a0 con 0x55881cc1fc20 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6624ff9640 10 client.16488 handle_command_reply: tid=0 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.739+0000 7f6645e1f740 1 client.16488 shutdown 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 msgr2=0x55881cba6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba6760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f662c022040 tx=0x7f662c01fc60 comp rx=0 tx=0).stop 2024-09-10T23:27:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 shutdown_connections 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55881cba29a0 0x55881cba6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55881cc1fc20 0x55881cc22040 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55881cb96a10 0x55881cba6760 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 --2- 172.21.15.2:0/3481329225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55881cb960f0 0x55881cbab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 >> 172.21.15.2:0/3481329225 conn(0x55881cb93f20 msgr2=0x55881cba14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6624ff9640 0 client.16488 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 shutdown_connections 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 1 -- 172.21.15.2:0/3481329225 wait complete. 2024-09-10T23:27:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6645e1f740 20 client.16488 trim_cache size 0 max 16384 2024-09-10T23:27:47.756 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66280b52e0 msgr2=0x7f66280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6643a4a640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66280b52e0 0x7f66280b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f662c005d90 tx=0x7f662c005d20 comp rx=0 tx=0).stop 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 msgr2=0x7f663c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.740+0000 7f6643a4a640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c102490 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6634005cc0 tx=0x7f663402f470 comp rx=0 tx=0).stop 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 shutdown_connections 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f66280b52e0 0x7f66280b77a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f663c10d140 0x7f663c102490 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f663c104590 0x7f663c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 --2- 172.21.15.2:0/770582485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f663c103b90 0x7f663c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 >> 172.21.15.2:0/770582485 conn(0x7f663c0fd700 msgr2=0x7f663c10f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 shutdown_connections 2024-09-10T23:27:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:47.741+0000 7f6643a4a640 1 -- 172.21.15.2:0/770582485 wait complete. 2024-09-10T23:27:48.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:48 smithi154 ceph-mon[35136]: pgmap v455: 97 pgs: 97 active+clean; 2.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:27:48.375 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:48 smithi002 ceph-mon[31150]: pgmap v455: 97 pgs: 97 active+clean; 2.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:27:48.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:48 smithi177 ceph-mon[35760]: pgmap v455: 97 pgs: 97 active+clean; 2.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:27:48.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:27:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 -- 172.21.15.2:0/3589147521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 msgr2=0x7f3a481040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/3589147521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a481040a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009900 tx=0x7f3a3802a410 comp rx=0 tx=0).stop 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 -- 172.21.15.2:0/3589147521 shutdown_connections 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/3589147521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a4810d120 0x7f3a4810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/3589147521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a481045e0 0x7f3a4810cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/3589147521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a481040a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 -- 172.21.15.2:0/3589147521 >> 172.21.15.2:0/3589147521 conn(0x7f3a480fd740 msgr2=0x7f3a480ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 -- 172.21.15.2:0/3589147521 shutdown_connections 2024-09-10T23:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.319+0000 7f3a4caf7640 1 -- 172.21.15.2:0/3589147521 wait complete. 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 Processor -- start 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 -- start start 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a48199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a481045e0 0x7f3a481997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a4810d120 0x7f3a4819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48112dd0 con 0x7f3a48103cc0 2024-09-10T23:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48112c50 con 0x7f3a4810d120 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4caf7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48112f50 con 0x7f3a481045e0 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a48199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.320+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a48199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48654/0 (socket says 172.21.15.2:48654) 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 -- 172.21.15.2:0/1501201121 learned_addr learned my addr 172.21.15.2:0/1501201121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a481045e0 0x7f3a481997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a4810d120 0x7f3a4819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 -- 172.21.15.2:0/1501201121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a481045e0 msgr2=0x7f3a481997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a481045e0 0x7f3a481997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 -- 172.21.15.2:0/1501201121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a4810d120 msgr2=0x7f3a4819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a4810d120 0x7f3a4819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 -- 172.21.15.2:0/1501201121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4819f310 con 0x7f3a48103cc0 2024-09-10T23:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4659c640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a48199260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006010 tx=0x7f3a380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a3ffff640 1 -- 172.21.15.2:0/1501201121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3803f030 con 0x7f3a48103cc0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4819f5a0 con 0x7f3a48103cc0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a3ffff640 1 -- 172.21.15.2:0/1501201121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a38003800 con 0x7f3a48103cc0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a3ffff640 1 -- 172.21.15.2:0/1501201121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38035070 con 0x7f3a48103cc0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.321+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a481a5cc0 con 0x7f3a48103cc0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.324+0000 7f3a3ffff640 1 -- 172.21.15.2:0/1501201121 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3a38031b10 con 0x7f3a48103cc0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.324+0000 7f3a4eecc740 1 Processor -- start 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.324+0000 7f3a4eecc740 1 -- start start 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.324+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b84d0 0x555be61b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.324+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 0x555be61c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555be612eea0 con 0x555be61b8df0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555be611e2d0 con 0x555be61b84d0 2024-09-10T23:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555be61220e0 con 0x555be61c9190 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 0x555be61c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 0x555be61c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48664/0 (socket says 172.21.15.2:48664) 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 -- 172.21.15.2:0/2953588005 learned_addr learned my addr 172.21.15.2:0/2953588005 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b84d0 0x555be61b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a3ffff640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a340b52e0 0x7f3a340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 -- 172.21.15.2:0/2953588005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 msgr2=0x555be61cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 -- 172.21.15.2:0/2953588005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b84d0 msgr2=0x555be61b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b84d0 0x555be61b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 -- 172.21.15.2:0/2953588005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be5e7c650 con 0x555be61b8df0 2024-09-10T23:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a340b52e0 0x7f3a340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a3ffff640 1 -- 172.21.15.2:0/1501201121 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3a38106570 con 0x7f3a48103cc0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.325+0000 7f3a4659c640 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 0x555be61c8c50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3a380a13d0 tx=0x7f3a38091450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d91c9974669306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a340b52e0 0x7f3a340b77a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000a4e0 tx=0x7f3a4000c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a3cd99640 1 -- 172.21.15.2:0/2953588005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a380cc630 con 0x555be61b8df0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a3cd99640 1 -- 172.21.15.2:0/2953588005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a380a1430 con 0x555be61b8df0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a3cd99640 1 -- 172.21.15.2:0/2953588005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a380cc450 con 0x555be61b8df0 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 -- 172.21.15.2:0/2953588005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 msgr2=0x555be61c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 0x555be61c8c50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3a380a13d0 tx=0x7f3a38091450 comp rx=0 tx=0).stop 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 -- 172.21.15.2:0/2953588005 shutdown_connections 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b8df0 0x555be61c8c50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/2953588005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b84d0 0x555be61b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.326+0000 7f3a4eecc740 1 -- 172.21.15.2:0/2953588005 >> 172.21.15.2:0/2953588005 conn(0x555be61b6300 msgr2=0x555be61b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.327+0000 7f3a4eecc740 1 -- 172.21.15.2:0/2953588005 shutdown_connections 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.327+0000 7f3a4eecc740 1 -- 172.21.15.2:0/2953588005 wait complete. 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.327+0000 7f3a4eecc740 1 -- start start 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.327+0000 7f3a4eecc740 1 Processor -- start 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555be5f7f700 con 0x555be61c9190 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555be60b9160 con 0x555be61b8df0 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555be61cbc00 con 0x555be61b84d0 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4eecc740 10 client.0 _ll_register_callbacks cb 0x555be60d29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48676/0 (socket says 172.21.15.2:48676) 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 -- 172.21.15.2:0/1750909092 learned_addr learned my addr 172.21.15.2:0/1750909092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 -- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 msgr2=0x555be61c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 -- 172.21.15.2:0/1750909092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 msgr2=0x555be61c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.328+0000 7f3a46d9d640 1 -- 172.21.15.2:0/1750909092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be60e6c90 con 0x555be61c9190 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61c62e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3a40019e10 tx=0x7f3a4000e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1308fac318ece97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a2dffb640 1 -- 172.21.15.2:0/1750909092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400190d0 con 0x555be61c9190 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a2dffb640 1 -- 172.21.15.2:0/1750909092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3a40017420 con 0x555be61c9190 2024-09-10T23:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555be6130df0 con 0x555be61c9190 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a2dffb640 1 -- 172.21.15.2:0/1750909092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a40019270 con 0x555be61c9190 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a4eecc740 10 client.16500 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555be61d7340 con 0x555be61c9190 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a2dffb640 1 -- 172.21.15.2:0/1750909092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555be6130df0 con 0x555be61c9190 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.329+0000 7f3a2dffb640 1 -- 172.21.15.2:0/1750909092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a4002d600 con 0x555be61c9190 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4eecc740 10 client.16500 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4eecc740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4eecc740 20 client.16500 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be61dac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4eecc740 4 client.16500 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555be612c8a0 con 0x555be61d8810 2024-09-10T23:27:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4659c640 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be61dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a4659c640 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be61dac00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dda667aeb92bf96f server_cookie=ca35bc8973063c27 in_seq=0 out_seq=0 2024-09-10T23:27:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.330+0000 7f3a2dffb640 10 client.16500 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a2dffb640 1 -- 172.21.15.2:0/1750909092 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555be612c8a0 con 0x555be61d8810 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a2dffb640 10 client.16500 handle_command_reply: tid=0 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 client.16500 shutdown 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 msgr2=0x555be61c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61c62e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3a40019e10 tx=0x7f3a4000e040 comp rx=0 tx=0).stop 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 shutdown_connections 2024-09-10T23:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be61dac00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61c62e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a2dffb640 0 client.16500 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/1750909092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 >> 172.21.15.2:0/1750909092 conn(0x555be61b6300 msgr2=0x555be61bbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 shutdown_connections 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 1 -- 172.21.15.2:0/1750909092 wait complete. 2024-09-10T23:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.331+0000 7f3a4eecc740 20 client.16500 trim_cache size 0 max 16384 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.344+0000 7f3a4eecc740 1 Processor -- start 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 -- start start 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481ac160 con 0x555be61c9190 2024-09-10T23:27:49.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481adca0 con 0x555be61b8df0 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481ac830 con 0x555be61b84d0 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48692/0 (socket says 172.21.15.2:48692) 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 -- 172.21.15.2:0/83365012 learned_addr learned my addr 172.21.15.2:0/83365012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a4659c640 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 -- 172.21.15.2:0/83365012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 msgr2=0x555be61caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 -- 172.21.15.2:0/83365012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 msgr2=0x555be61cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 -- 172.21.15.2:0/83365012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be61be630 con 0x555be61c9190 2024-09-10T23:27:49.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.345+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61b71a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3a40019410 tx=0x7f3a40019b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8496d37c81d42b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a2ffff640 1 -- 172.21.15.2:0/83365012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40009820 con 0x555be61c9190 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a2ffff640 1 -- 172.21.15.2:0/83365012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a40022470 con 0x555be61c9190 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a2ffff640 1 -- 172.21.15.2:0/83365012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40017680 con 0x555be61c9190 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 -- 172.21.15.2:0/83365012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 msgr2=0x555be61b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61b71a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3a40019410 tx=0x7f3a40019b20 comp rx=0 tx=0).stop 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 -- 172.21.15.2:0/83365012 shutdown_connections 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61c9190 0x555be61b71a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/83365012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61b84d0 0x555be61caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 -- 172.21.15.2:0/83365012 >> 172.21.15.2:0/83365012 conn(0x555be61b6300 msgr2=0x555be61c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 -- 172.21.15.2:0/83365012 shutdown_connections 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.346+0000 7f3a4eecc740 1 -- 172.21.15.2:0/83365012 wait complete. 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 -- start start 2024-09-10T23:27:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 Processor -- start 2024-09-10T23:27:49.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 0x555be61d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481ad5d0 con 0x555be61b84d0 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481acf00 con 0x555be61b8df0 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481aa140 con 0x555be61c9190 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4eecc740 10 client.0 _ll_register_callbacks cb 0x7f3a400071d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 0x555be61d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 0x555be61d1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48698/0 (socket says 172.21.15.2:48698) 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 -- 172.21.15.2:0/4142890289 learned_addr learned my addr 172.21.15.2:0/4142890289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a46d9d640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 -- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 msgr2=0x555be61cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 -- 172.21.15.2:0/4142890289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 msgr2=0x555be61d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.347+0000 7f3a4659c640 1 -- 172.21.15.2:0/4142890289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be61cc5c0 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4659c640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 0x555be61d1130 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3a38031440 tx=0x7f3a3802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1091f1017b4160 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a2dffb640 1 -- 172.21.15.2:0/4142890289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38049040 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a2dffb640 1 -- 172.21.15.2:0/4142890289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3a380b40c0 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a40022470 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a2dffb640 1 -- 172.21.15.2:0/4142890289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a380cc450 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 10 client.16506 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555be6246330 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a2dffb640 1 -- 172.21.15.2:0/4142890289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a40022470 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a2dffb640 1 -- 172.21.15.2:0/4142890289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a381040a0 con 0x555be61b84d0 2024-09-10T23:27:49.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 10 client.16506 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 20 client.16506 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be62488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 4 client.16506 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.348+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555be6129cd0 con 0x555be61d8810 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be62488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a2dffb640 10 client.16506 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a3dd9b640 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be62488c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80fd297dd56b86a1 server_cookie=d4e48a127cbacbb6 in_seq=0 out_seq=0 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a2dffb640 1 -- 172.21.15.2:0/4142890289 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555be6129cd0 con 0x555be61d8810 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a2dffb640 10 client.16506 handle_command_reply: tid=0 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a4eecc740 1 client.16506 shutdown 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 msgr2=0x555be61d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 0x555be61d1130 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3a38031440 tx=0x7f3a3802a410 comp rx=0 tx=0).stop 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.349+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 shutdown_connections 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555be61d8810 0x555be62488c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555be61c9190 0x555be61cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555be61b8df0 0x555be61d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 --2- 172.21.15.2:0/4142890289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555be61b84d0 0x555be61d1130 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 >> 172.21.15.2:0/4142890289 conn(0x555be61b6300 msgr2=0x555be61caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a2dffb640 0 client.16506 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 shutdown_connections 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 1 -- 172.21.15.2:0/4142890289 wait complete. 2024-09-10T23:27:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4eecc740 20 client.16506 trim_cache size 0 max 16384 2024-09-10T23:27:49.357 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a340b52e0 msgr2=0x7f3a340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a340b52e0 0x7f3a340b77a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000a4e0 tx=0x7f3a4000c040 comp rx=0 tx=0).stop 2024-09-10T23:27:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 msgr2=0x7f3a48199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a48199260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006010 tx=0x7f3a380042f0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 shutdown_connections 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f3a340b52e0 0x7f3a340b77a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a4810d120 0x7f3a4819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a481045e0 0x7f3a481997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 --2- 172.21.15.2:0/1501201121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48103cc0 0x7f3a48199260 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 >> 172.21.15.2:0/1501201121 conn(0x7f3a480fd740 msgr2=0x7f3a4810f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 shutdown_connections 2024-09-10T23:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:49.350+0000 7f3a4caf7640 1 -- 172.21.15.2:0/1501201121 wait complete. 2024-09-10T23:27:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 -- 172.21.15.2:0/3776630739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481018b0 msgr2=0x7fb748101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 --2- 172.21.15.2:0/3776630739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481018b0 0x7fb748101cb0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb744009930 tx=0x7fb74402a420 comp rx=0 tx=0).stop 2024-09-10T23:27:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 -- 172.21.15.2:0/3776630739 shutdown_connections 2024-09-10T23:27:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 --2- 172.21.15.2:0/3776630739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481033c0 0x7fb748109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 --2- 172.21.15.2:0/3776630739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 0x7fb748102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 --2- 172.21.15.2:0/3776630739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481018b0 0x7fb748101cb0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 -- 172.21.15.2:0/3776630739 >> 172.21.15.2:0/3776630739 conn(0x7fb7480fd150 msgr2=0x7fb7480ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 -- 172.21.15.2:0/3776630739 shutdown_connections 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.963+0000 7fb7505bb640 1 -- 172.21.15.2:0/3776630739 wait complete. 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 Processor -- start 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 -- start start 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481018b0 0x7fb74819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 0x7fb74819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 0x7fb74819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb74810d520 con 0x7fb7481033c0 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb74810d3a0 con 0x7fb7481018b0 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb7505bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb74810d6a0 con 0x7fb748102a00 2024-09-10T23:27:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 0x7fb74819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 0x7fb74819c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48716/0 (socket says 172.21.15.2:48716) 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 -- 172.21.15.2:0/2762732509 learned_addr learned my addr 172.21.15.2:0/2762732509 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74e357640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481018b0 0x7fb74819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74db56640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 0x7fb74819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 -- 172.21.15.2:0/2762732509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 msgr2=0x7fb74819b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 0x7fb74819b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 -- 172.21.15.2:0/2762732509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481018b0 msgr2=0x7fb74819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481018b0 0x7fb74819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74eb58640 1 -- 172.21.15.2:0/2762732509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74819cb70 con 0x7fb7481033c0 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74db56640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 0x7fb74819b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.964+0000 7fb74e357640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481018b0 0x7fb74819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.965+0000 7fb74eb58640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 0x7fb74819c2b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb74000eaa0 tx=0x7fb74000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.965+0000 7fb73f7fe640 1 -- 172.21.15.2:0/2762732509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74000cdb0 con 0x7fb7481033c0 2024-09-10T23:27:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.965+0000 7fb73f7fe640 1 -- 172.21.15.2:0/2762732509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb740005020 con 0x7fb7481033c0 2024-09-10T23:27:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.965+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74819ce60 con 0x7fb7481033c0 2024-09-10T23:27:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.965+0000 7fb73f7fe640 1 -- 172.21.15.2:0/2762732509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400116d0 con 0x7fb7481033c0 2024-09-10T23:27:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.965+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7481a3530 con 0x7fb7481033c0 2024-09-10T23:27:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.968+0000 7fb753466740 1 Processor -- start 2024-09-10T23:27:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.968+0000 7fb73f7fe640 1 -- 172.21.15.2:0/2762732509 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb74000f040 con 0x7fb7481033c0 2024-09-10T23:27:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.968+0000 7fb753466740 1 -- start start 2024-09-10T23:27:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb753466740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fefc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb753466740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb753466740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb753466740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5618d1f5f6f0 con 0x5618d1ff2bd0 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb753466740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5618d1f4eb20 con 0x5618d1ff0190 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb753466740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5618d1f52930 con 0x5618d1fed860 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48726/0 (socket says 172.21.15.2:48726) 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 -- 172.21.15.2:0/318389287 learned_addr learned my addr 172.21.15.2:0/318389287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fefc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74e357640 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb73f7fe640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7340b52e0 0x7fb7340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 -- 172.21.15.2:0/318389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 msgr2=0x5618d1fefc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fefc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 -- 172.21.15.2:0/318389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 msgr2=0x5618d1ff2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 -- 172.21.15.2:0/318389287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d1f14530 con 0x5618d1ff2bd0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74e357640 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74eb58640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7340b52e0 0x7fb7340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb73f7fe640 1 -- 172.21.15.2:0/2762732509 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb7400e5b20 con 0x7fb7481033c0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.969+0000 7fb74db56640 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff5090 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb738012550 tx=0x7fb73800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699f9109af597dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb73cbfe640 1 -- 172.21.15.2:0/318389287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738018030 con 0x5618d1ff2bd0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb73cbfe640 1 -- 172.21.15.2:0/318389287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb738005020 con 0x5618d1ff2bd0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb73cbfe640 1 -- 172.21.15.2:0/318389287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7380049a0 con 0x5618d1ff2bd0 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 -- 172.21.15.2:0/318389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 msgr2=0x5618d1ff5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb74eb58640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7340b52e0 0x7fb7340b77a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb7400e39a0 tx=0x7fb7400a0ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff5090 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb738012550 tx=0x7fb73800b4c0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 -- 172.21.15.2:0/318389287 shutdown_connections 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff5090 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 --2- 172.21.15.2:0/318389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fefc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.970+0000 7fb753466740 1 -- 172.21.15.2:0/318389287 >> 172.21.15.2:0/318389287 conn(0x5618d1fe89b0 msgr2=0x5618d1fe9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 -- 172.21.15.2:0/318389287 shutdown_connections 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 -- 172.21.15.2:0/318389287 wait complete. 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 -- start start 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 Processor -- start 2024-09-10T23:27:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ff6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5618d1e86ab0 con 0x5618d1fed860 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5618d1ef4730 con 0x5618d1ff0190 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5618d1ff5bb0 con 0x5618d1ff2bd0 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb753466740 10 client.0 _ll_register_callbacks cb 0x5618d1f486b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ff6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ff6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48728/0 (socket says 172.21.15.2:48728) 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.971+0000 7fb74db56640 1 -- 172.21.15.2:0/2739912669 learned_addr learned my addr 172.21.15.2:0/2739912669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74e357640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74db56640 1 -- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff2bd0 msgr2=0x5618d1ff8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74db56640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74db56640 1 -- 172.21.15.2:0/2739912669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 msgr2=0x5618d1ff75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74db56640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74db56640 1 -- 172.21.15.2:0/2739912669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d1cb0790 con 0x5618d1fed860 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74e357640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb74db56640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ff6f20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb73800b820 tx=0x7fb738005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3961918b83dd1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb731ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb731ffb640 1 -- 172.21.15.2:0/2739912669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738018050 con 0x5618d1fed860 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb731ffb640 1 -- 172.21.15.2:0/2739912669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb738010b10 con 0x5618d1fed860 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb738005020 con 0x5618d1fed860 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb731ffb640 1 -- 172.21.15.2:0/2739912669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb738010d10 con 0x5618d1fed860 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb753466740 10 client.16518 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.972+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618d1d29620 con 0x5618d1fed860 2024-09-10T23:27:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb731ffb640 1 -- 172.21.15.2:0/2739912669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb738005020 con 0x5618d1fed860 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb731ffb640 1 -- 172.21.15.2:0/2739912669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb738003780 con 0x5618d1fed860 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb753466740 10 client.16518 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb753466740 10 client.16518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb753466740 20 client.16518 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb753466740 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d2002480 0x5618d2004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb753466740 4 client.16518 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618d1f61640 con 0x5618d2002480 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.973+0000 7fb74e357640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d2002480 0x5618d2004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb731ffb640 10 client.16518 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb74e357640 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d2002480 0x5618d2004870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c307c3cb5c85a server_cookie=eee701c7c4b3a301 in_seq=0 out_seq=0 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb731ffb640 1 -- 172.21.15.2:0/2739912669 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618d1f61640 con 0x5618d2002480 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb731ffb640 10 client.16518 handle_command_reply: tid=0 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb753466740 1 client.16518 shutdown 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 msgr2=0x5618d1ff6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.974+0000 7fb753466740 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ff6f20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb73800b820 tx=0x7fb738005470 comp rx=0 tx=0).stop 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 shutdown_connections 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d2002480 0x5618d2004870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff2bd0 0x5618d1ff8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1ff75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb731ffb640 0 client.16518 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 --2- 172.21.15.2:0/2739912669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ff6f20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 >> 172.21.15.2:0/2739912669 conn(0x5618d1fe89b0 msgr2=0x5618d1fe7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 shutdown_connections 2024-09-10T23:27:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 1 -- 172.21.15.2:0/2739912669 wait complete. 2024-09-10T23:27:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.975+0000 7fb753466740 20 client.16518 trim_cache size 0 max 16384 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 Processor -- start 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 -- start start 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fe83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1fecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1fed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481ac140 con 0x5618d1ff2bd0 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481adc80 con 0x5618d1ff0190 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.989+0000 7fb753466740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481ac810 con 0x5618d1fed860 2024-09-10T23:27:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1fed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1fed260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48740/0 (socket says 172.21.15.2:48740) 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 -- 172.21.15.2:0/3820765243 learned_addr learned my addr 172.21.15.2:0/3820765243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74e357640 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1fecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fe83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 -- 172.21.15.2:0/3820765243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 msgr2=0x5618d1fe83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fe83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 -- 172.21.15.2:0/3820765243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 msgr2=0x5618d1fecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1fecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 -- 172.21.15.2:0/3820765243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d1ff8500 con 0x5618d1ff2bd0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb74db56640 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1fed260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb7380057c0 tx=0x7fb738005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f9ab679ce3e7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb733fff640 1 -- 172.21.15.2:0/3820765243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73803a020 con 0x5618d1ff2bd0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb733fff640 1 -- 172.21.15.2:0/3820765243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb738020070 con 0x5618d1ff2bd0 2024-09-10T23:27:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.990+0000 7fb733fff640 1 -- 172.21.15.2:0/3820765243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738018070 con 0x5618d1ff2bd0 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- 172.21.15.2:0/3820765243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 msgr2=0x5618d1fed260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1fed260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb7380057c0 tx=0x7fb738005750 comp rx=0 tx=0).stop 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- 172.21.15.2:0/3820765243 shutdown_connections 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1ff2bd0 0x5618d1fed260 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff0190 0x5618d1fecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- 172.21.15.2:0/3820765243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1fed860 0x5618d1fe83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- 172.21.15.2:0/3820765243 >> 172.21.15.2:0/3820765243 conn(0x5618d1fe89b0 msgr2=0x5618d1fe9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- 172.21.15.2:0/3820765243 shutdown_connections 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- 172.21.15.2:0/3820765243 wait complete. 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- start start 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 Processor -- start 2024-09-10T23:27:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ffbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff0190 0x5618d1ffc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff2bd0 0x5618d1ffcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481ad5b0 con 0x5618d1fed860 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481acee0 con 0x5618d1ff2bd0 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481aa120 con 0x5618d1ff0190 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb753466740 10 client.0 _ll_register_callbacks cb 0x7fb738012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.991+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ffbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ffbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48748/0 (socket says 172.21.15.2:48748) 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 -- 172.21.15.2:0/4203460405 learned_addr learned my addr 172.21.15.2:0/4203460405 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 -- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff0190 msgr2=0x5618d1ffc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff0190 0x5618d1ffc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 -- 172.21.15.2:0/4203460405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff2bd0 msgr2=0x5618d1ffcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff2bd0 0x5618d1ffcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 -- 172.21.15.2:0/4203460405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d1ffd440 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb74db56640 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ffbab0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb738012ea0 tx=0x7fb738010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05faf1c5247aa61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb731ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb731ffb640 1 -- 172.21.15.2:0/4203460405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738018070 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb738020070 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb731ffb640 1 -- 172.21.15.2:0/4203460405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb738010b10 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb731ffb640 1 -- 172.21.15.2:0/4203460405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb738045050 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb753466740 10 client.16524 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618d1ffe800 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.992+0000 7fb731ffb640 1 -- 172.21.15.2:0/4203460405 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb738020070 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb731ffb640 1 -- 172.21.15.2:0/4203460405 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb738028430 con 0x5618d1fed860 2024-09-10T23:27:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb753466740 10 client.16524 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb753466740 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb753466740 20 client.16524 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb753466740 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d206f2a0 0x5618d2071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb753466740 4 client.16524 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618d1f5d0f0 con 0x5618d206f2a0 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb74e357640 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d206f2a0 0x5618d2071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb731ffb640 10 client.16524 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:49.993+0000 7fb74e357640 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d206f2a0 0x5618d2071690 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1666d77319fa78df server_cookie=2135d4bfa56e2338 in_seq=0 out_seq=0 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb731ffb640 1 -- 172.21.15.2:0/4203460405 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618d1f5d0f0 con 0x5618d206f2a0 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb731ffb640 10 client.16524 handle_command_reply: tid=0 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 client.16524 shutdown 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 msgr2=0x5618d1ffbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ffbab0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb738012ea0 tx=0x7fb738010eb0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 shutdown_connections 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618d206f2a0 0x5618d2071690 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618d1ff2bd0 0x5618d1ffcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618d1ff0190 0x5618d1ffc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 --2- 172.21.15.2:0/4203460405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618d1fed860 0x5618d1ffbab0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb731ffb640 0 client.16524 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 >> 172.21.15.2:0/4203460405 conn(0x5618d1fe89b0 msgr2=0x5618d1fecc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 shutdown_connections 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 1 -- 172.21.15.2:0/4203460405 wait complete. 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.012+0000 7fb753466740 20 client.16524 trim_cache size 0 max 16384 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:27:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:27:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7340b52e0 msgr2=0x7fb7340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7340b52e0 0x7fb7340b77a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb7400e39a0 tx=0x7fb7400a0ba0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 msgr2=0x7fb74819c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 0x7fb74819c2b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb74000eaa0 tx=0x7fb74000ef60 comp rx=0 tx=0).stop 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 shutdown_connections 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb7340b52e0 0x7fb7340b77a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7481033c0 0x7fb74819c2b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb748102a00 0x7fb74819b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 --2- 172.21.15.2:0/2762732509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7481018b0 0x7fb74819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 >> 172.21.15.2:0/2762732509 conn(0x7fb7480fd150 msgr2=0x7fb7480fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 shutdown_connections 2024-09-10T23:27:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:27:50.013+0000 7fb7505bb640 1 -- 172.21.15.2:0/2762732509 wait complete. 2024-09-10T23:27:50.201 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:50 smithi002 ceph-mon[31150]: pgmap v456: 97 pgs: 97 active+clean; 2.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:27:50.410 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:50 smithi154 ceph-mon[35136]: pgmap v456: 97 pgs: 97 active+clean; 2.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:27:50.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:50 smithi177 ceph-mon[35760]: pgmap v456: 97 pgs: 97 active+clean; 2.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:27:51.411 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:27:51.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:27:51.682 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:52.097 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:52 smithi002 ceph-mon[31150]: pgmap v457: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 -- 172.21.15.2:0/1954990374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 msgr2=0x7f8fa01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 --2- 172.21.15.2:0/1954990374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa01031a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009900 tx=0x7f8f9002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 -- 172.21.15.2:0/1954990374 shutdown_connections 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 --2- 172.21.15.2:0/1954990374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa0109150 0x7f8fa010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 --2- 172.21.15.2:0/1954990374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa01087d0 0x7f8fa0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 --2- 172.21.15.2:0/1954990374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa01031a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 -- 172.21.15.2:0/1954990374 >> 172.21.15.2:0/1954990374 conn(0x7f8fa00fe830 msgr2=0x7f8fa0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 -- 172.21.15.2:0/1954990374 shutdown_connections 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.183+0000 7f8fa5680640 1 -- 172.21.15.2:0/1954990374 wait complete. 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 Processor -- start 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 -- start start 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa01087d0 0x7f8fa0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa0109150 0x7f8fa019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0112e10 con 0x7f8fa0102dc0 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0112c90 con 0x7f8fa01087d0 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8fa5680640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0112f90 con 0x7f8fa0109150 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52060/0 (socket says 172.21.15.2:52060) 2024-09-10T23:27:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.184+0000 7f8f9effd640 1 -- 172.21.15.2:0/4081993992 learned_addr learned my addr 172.21.15.2:0/4081993992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa01087d0 0x7f8fa0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa0109150 0x7f8fa019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9effd640 1 -- 172.21.15.2:0/4081993992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa0109150 msgr2=0x7f8fa019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9effd640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa0109150 0x7f8fa019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9effd640 1 -- 172.21.15.2:0/4081993992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa01087d0 msgr2=0x7f8fa0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9effd640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa01087d0 0x7f8fa0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9effd640 1 -- 172.21.15.2:0/4081993992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa019f3d0 con 0x7f8fa0102dc0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f9effd640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa0199320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8f90006010 tx=0x7f8f900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f87fff640 1 -- 172.21.15.2:0/4081993992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9003f030 con 0x7f8fa0102dc0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa019f660 con 0x7f8fa0102dc0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f87fff640 1 -- 172.21.15.2:0/4081993992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f90003800 con 0x7f8fa0102dc0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8f87fff640 1 -- 172.21.15.2:0/4081993992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90035070 con 0x7f8fa0102dc0 2024-09-10T23:27:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.185+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa01a5d80 con 0x7f8fa0102dc0 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8f87fff640 1 -- 172.21.15.2:0/4081993992 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8f90031b10 con 0x7f8fa0102dc0 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 Processor -- start 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 -- start start 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563b4a741e60 con 0x563b4a7d7790 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563b4a731290 con 0x563b4a7caee0 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563b4a7350a0 con 0x563b4a7cb800 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8f9e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8f9e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52076/0 (socket says 172.21.15.2:52076) 2024-09-10T23:27:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/1255247944 learned_addr learned my addr 172.21.15.2:0/1255247944 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.188+0000 7f8f9effd640 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f87fff640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f880b52e0 0x7f8f880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/1255247944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 msgr2=0x563b4a7d7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/1255247944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 msgr2=0x563b4a7cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/1255247944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4a48f930 con 0x563b4a7d7790 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9effd640 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f880b52e0 0x7f8f880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f87fff640 1 -- 172.21.15.2:0/4081993992 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8f901065c0 con 0x7f8fa0102dc0 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d9b80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400cc70 tx=0x7f8f9400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8601cc0e27f27b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f857fa640 1 -- 172.21.15.2:0/1255247944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94014070 con 0x563b4a7d7790 2024-09-10T23:27:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f857fa640 1 -- 172.21.15.2:0/1255247944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f940047a0 con 0x563b4a7d7790 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.189+0000 7f8f857fa640 1 -- 172.21.15.2:0/1255247944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94010690 con 0x563b4a7d7790 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1255247944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 msgr2=0x563b4a7d9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f880b52e0 0x7f8f880b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800a5a0 tx=0x7f8f9800c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d9b80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400cc70 tx=0x7f8f9400e720 comp rx=0 tx=0).stop 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1255247944 shutdown_connections 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d9b80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1255247944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1255247944 >> 172.21.15.2:0/1255247944 conn(0x563b4a7c8d10 msgr2=0x563b4a7c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1255247944 shutdown_connections 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1255247944 wait complete. 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.190+0000 7f8fa7a55740 1 -- start start 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 Processor -- start 2024-09-10T23:27:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 0x563b4a7d7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7cb800 0x563b4a7d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7d7790 0x563b4a7d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563b4a592890 con 0x563b4a7caee0 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563b4a6cbd40 con 0x563b4a7cb800 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563b4a7da440 con 0x563b4a7d7790 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8fa7a55740 10 client.0 _ll_register_callbacks cb 0x563b4a72fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 0x563b4a7d7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 0x563b4a7d7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52078/0 (socket says 172.21.15.2:52078) 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 -- 172.21.15.2:0/1250476547 learned_addr learned my addr 172.21.15.2:0/1250476547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7cb800 0x563b4a7d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7d7790 0x563b4a7d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 -- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7d7790 msgr2=0x563b4a7d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7d7790 0x563b4a7d4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 -- 172.21.15.2:0/1250476547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7cb800 msgr2=0x563b4a7d4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7cb800 0x563b4a7d4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.191+0000 7f8f9effd640 1 -- 172.21.15.2:0/1250476547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4a7e37a0 con 0x563b4a7caee0 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f9effd640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 0x563b4a7d7220 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8f900c9360 tx=0x7f8f90031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dc317c3cfb19c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f82ff5640 1 -- 172.21.15.2:0/1250476547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90049040 con 0x563b4a7caee0 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f82ff5640 1 -- 172.21.15.2:0/1250476547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8f900c9000 con 0x563b4a7caee0 2024-09-10T23:27:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f940047a0 con 0x563b4a7caee0 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f82ff5640 1 -- 172.21.15.2:0/1250476547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f900cc500 con 0x563b4a7caee0 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 10 client.16536 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563b4a7e6120 con 0x563b4a7caee0 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f82ff5640 1 -- 172.21.15.2:0/1250476547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f940047a0 con 0x563b4a7caee0 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8f82ff5640 1 -- 172.21.15.2:0/1250476547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f900b4070 con 0x563b4a7caee0 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 10 client.16536 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 20 client.16536 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a7e74e0 0x563b4a7e9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 4 client.16536 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.192+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b4a743db0 con 0x563b4a7e74e0 2024-09-10T23:27:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.193+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a7e74e0 0x563b4a7e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.193+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a7e74e0 0x563b4a7e9970 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48eee66fd4fafc23 server_cookie=b0463486612ec462 in_seq=0 out_seq=0 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.193+0000 7f8f82ff5640 10 client.16536 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8f82ff5640 1 -- 172.21.15.2:0/1250476547 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b4a743db0 con 0x563b4a7e74e0 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8f82ff5640 10 client.16536 handle_command_reply: tid=0 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 client.16536 shutdown 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 msgr2=0x563b4a7d7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 0x563b4a7d7220 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8f900c9360 tx=0x7f8f90031ef0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 shutdown_connections 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a7e74e0 0x563b4a7e9970 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7d7790 0x563b4a7d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7cb800 0x563b4a7d4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/1250476547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7caee0 0x563b4a7d7220 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 >> 172.21.15.2:0/1250476547 conn(0x563b4a7c8d10 msgr2=0x563b4a7c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8f82ff5640 0 client.16536 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 shutdown_connections 2024-09-10T23:27:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 1 -- 172.21.15.2:0/1250476547 wait complete. 2024-09-10T23:27:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.194+0000 7f8fa7a55740 20 client.16536 trim_cache size 0 max 16384 2024-09-10T23:27:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 Processor -- start 2024-09-10T23:27:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 -- start start 2024-09-10T23:27:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7caee0 0x563b4a7d3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 0x563b4a7d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7d7790 0x563b4a7d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01ae3b0 con 0x563b4a7cb800 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01afef0 con 0x563b4a7d7790 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01aea80 con 0x563b4a7caee0 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 0x563b4a7d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 0x563b4a7d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52094/0 (socket says 172.21.15.2:52094) 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/843573914 learned_addr learned my addr 172.21.15.2:0/843573914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9effd640 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7caee0 0x563b4a7d3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/843573914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7caee0 msgr2=0x563b4a7d3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7caee0 0x563b4a7d3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7d7790 0x563b4a7d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/843573914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7d7790 msgr2=0x563b4a7d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7d7790 0x563b4a7d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9e7fc640 1 -- 172.21.15.2:0/843573914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4a7d5190 con 0x563b4a7cb800 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.212+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7d7790 0x563b4a7d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 0x563b4a7d1880 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400f010 tx=0x7f8f9400c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d6a4eb4870838d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8f84ff9640 1 -- 172.21.15.2:0/843573914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94014040 con 0x563b4a7cb800 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8f84ff9640 1 -- 172.21.15.2:0/843573914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f94003aa0 con 0x563b4a7cb800 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8f84ff9640 1 -- 172.21.15.2:0/843573914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94010800 con 0x563b4a7cb800 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 -- 172.21.15.2:0/843573914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 msgr2=0x563b4a7d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 0x563b4a7d1880 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400f010 tx=0x7f8f9400c530 comp rx=0 tx=0).stop 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 -- 172.21.15.2:0/843573914 shutdown_connections 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7d7790 0x563b4a7d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7cb800 0x563b4a7d1880 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/843573914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7caee0 0x563b4a7d3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 -- 172.21.15.2:0/843573914 >> 172.21.15.2:0/843573914 conn(0x563b4a7c8d10 msgr2=0x563b4a7cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 -- 172.21.15.2:0/843573914 shutdown_connections 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.213+0000 7f8fa7a55740 1 -- 172.21.15.2:0/843573914 wait complete. 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 -- start start 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 Processor -- start 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7e0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01af820 con 0x563b4a7d7790 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01af150 con 0x563b4a7caee0 2024-09-10T23:27:52.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01ac390 con 0x563b4a7cb800 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8fa7a55740 10 client.0 _ll_register_callbacks cb 0x7f8f90009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52102/0 (socket says 172.21.15.2:52102) 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8f9f7fe640 1 -- 172.21.15.2:0/607410063 learned_addr learned my addr 172.21.15.2:0/607410063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8f9e7fc640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.214+0000 7f8f9effd640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9f7fe640 1 -- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 msgr2=0x563b4a7d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9f7fe640 1 -- 172.21.15.2:0/607410063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 msgr2=0x563b4a7e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9f7fe640 1 -- 172.21.15.2:0/607410063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4a7decd0 con 0x563b4a7d7790 2024-09-10T23:27:52.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9effd640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f9f7fe640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d1ef0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8f980095a0 tx=0x7f8f98004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602f2512ed9ad9c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f82ff5640 1 -- 172.21.15.2:0/607410063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9801c110 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f82ff5640 1 -- 172.21.15.2:0/607410063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8f9801a440 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f94003aa0 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f82ff5640 1 -- 172.21.15.2:0/607410063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f9801c2b0 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8fa7a55740 10 client.16542 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563b4a854730 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.215+0000 7f8f82ff5640 1 -- 172.21.15.2:0/607410063 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f94003aa0 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8f82ff5640 1 -- 172.21.15.2:0/607410063 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f98026780 con 0x563b4a7d7790 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8fa7a55740 10 client.16542 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:52.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8fa7a55740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8fa7a55740 20 client.16542 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a854f10 0x563b4a857330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8fa7a55740 4 client.16542 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563b4a73f860 con 0x563b4a854f10 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8f9effd640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a854f10 0x563b4a857330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8f9effd640 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a854f10 0x563b4a857330 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d75a7ce18e34831 server_cookie=1b02b136af76bc42 in_seq=0 out_seq=0 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.216+0000 7f8f82ff5640 10 client.16542 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8f82ff5640 1 -- 172.21.15.2:0/607410063 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563b4a73f860 con 0x563b4a854f10 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8f82ff5640 10 client.16542 handle_command_reply: tid=0 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 client.16542 shutdown 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 msgr2=0x563b4a7d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d1ef0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8f980095a0 tx=0x7f8f98004b50 comp rx=0 tx=0).stop 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 shutdown_connections 2024-09-10T23:27:52.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563b4a854f10 0x563b4a857330 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8f82ff5640 0 client.16542 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b4a7d7790 0x563b4a7d1ef0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563b4a7cb800 0x563b4a7d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 --2- 172.21.15.2:0/607410063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563b4a7caee0 0x563b4a7e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 >> 172.21.15.2:0/607410063 conn(0x563b4a7c8d10 msgr2=0x563b4a7c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 shutdown_connections 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.218+0000 7f8fa7a55740 1 -- 172.21.15.2:0/607410063 wait complete. 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa7a55740 20 client.16542 trim_cache size 0 max 16384 2024-09-10T23:27:52.228 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:27:52.229 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:27:52.229 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a", 2024-09-10T23:27:52.229 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:27:52.229 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f880b52e0 msgr2=0x7f8f880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f880b52e0 0x7f8f880b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800a5a0 tx=0x7f8f9800c040 comp rx=0 tx=0).stop 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 msgr2=0x7f8fa0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa0199320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8f90006010 tx=0x7f8f900042f0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 shutdown_connections 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f880b52e0 0x7f8f880b77a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa0109150 0x7f8fa019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa01087d0 0x7f8fa0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 --2- 172.21.15.2:0/4081993992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fa0102dc0 0x7f8fa0199320 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 >> 172.21.15.2:0/4081993992 conn(0x7f8fa00fe830 msgr2=0x7f8fa00ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 shutdown_connections 2024-09-10T23:27:52.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:52.219+0000 7f8fa5680640 1 -- 172.21.15.2:0/4081993992 wait complete. 2024-09-10T23:27:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:52 smithi154 ceph-mon[35136]: pgmap v457: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:52.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:52 smithi177 ceph-mon[35760]: pgmap v457: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:27:53.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:53 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:27:53.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:53 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:53.188 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:53 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:27:53.188 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:53 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:53.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:27:53.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:53 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:27:53.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:53 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:53.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:53 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:27:53.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:53 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:53.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:53 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:27:53.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:53 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:53.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:53 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:27:53.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:53 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:27:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 -- 172.21.15.2:0/691209954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 msgr2=0x7f24b010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 --2- 172.21.15.2:0/691209954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b010f950 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009ca0 tx=0x7f24a802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 -- 172.21.15.2:0/691209954 shutdown_connections 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 --2- 172.21.15.2:0/691209954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b010f950 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 --2- 172.21.15.2:0/691209954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24b01087d0 0x7f24b0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 --2- 172.21.15.2:0/691209954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b0102dc0 0x7f24b01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.000+0000 7f24b71f3640 1 -- 172.21.15.2:0/691209954 >> 172.21.15.2:0/691209954 conn(0x7f24b00fe830 msgr2=0x7f24b0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 -- 172.21.15.2:0/691209954 shutdown_connections 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 -- 172.21.15.2:0/691209954 wait complete. 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 Processor -- start 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 -- start start 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24b0102dc0 0x7f24b01991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b01087d0 0x7f24b01996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b019ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112e10 con 0x7f24b0109150 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112c90 con 0x7f24b01087d0 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b71f3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112f90 con 0x7f24b0102dc0 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b5790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b019ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b5790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b019ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52126/0 (socket says 172.21.15.2:52126) 2024-09-10T23:27:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.001+0000 7f24b5790640 1 -- 172.21.15.2:0/994182202 learned_addr learned my addr 172.21.15.2:0/994182202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24b0102dc0 0x7f24b01991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24affff640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b01087d0 0x7f24b01996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b5790640 1 -- 172.21.15.2:0/994182202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24b0102dc0 msgr2=0x7f24b01991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b5790640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24b0102dc0 0x7f24b01991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b5790640 1 -- 172.21.15.2:0/994182202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b01087d0 msgr2=0x7f24b01996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b5790640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b01087d0 0x7f24b01996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b5790640 1 -- 172.21.15.2:0/994182202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b019f250 con 0x7f24b0109150 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b5790640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b019ea80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f24a8005cc0 tx=0x7f24a802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24adffb640 1 -- 172.21.15.2:0/994182202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8003bf0 con 0x7f24b0109150 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24adffb640 1 -- 172.21.15.2:0/994182202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a8003d90 con 0x7f24b0109150 2024-09-10T23:27:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b019f4e0 con 0x7f24b0109150 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24adffb640 1 -- 172.21.15.2:0/994182202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a802fb20 con 0x7f24b0109150 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.002+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a5c00 con 0x7f24b0109150 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 Processor -- start 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24adffb640 1 -- 172.21.15.2:0/994182202 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f24a8004580 con 0x7f24b0109150 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 -- start start 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec51860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec5dd30 0x5558aec60120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5558aebc7e50 con 0x5558aec51480 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5558aebb7280 con 0x5558aec5dd30 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24b95c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5558aebbb090 con 0x5558aec51da0 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec51860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec51860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52138/0 (socket says 172.21.15.2:52138) 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.005+0000 7f24affff640 1 -- 172.21.15.2:0/180842026 learned_addr learned my addr 172.21.15.2:0/180842026 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec5dd30 0x5558aec60120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 -- 172.21.15.2:0/180842026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 msgr2=0x5558aec5d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 -- 172.21.15.2:0/180842026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec5dd30 msgr2=0x5558aec60120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec5dd30 0x5558aec60120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 -- 172.21.15.2:0/180842026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ae915650 con 0x5558aec51480 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24adffb640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24a00b5360 0x7f24a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24affff640 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec51860 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f249c013610 tx=0x7f249c00a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e140f5d05a943750 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:54.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24a00b5360 0x7f24a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f24adffb640 1 -- 172.21.15.2:0/994182202 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24a8106e50 con 0x7f24b0109150 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f249affd640 1 -- 172.21.15.2:0/180842026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c019030 con 0x5558aec51480 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f249affd640 1 -- 172.21.15.2:0/180842026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f249c0110d0 con 0x5558aec51480 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.006+0000 7f249affd640 1 -- 172.21.15.2:0/180842026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c00f7a0 con 0x5558aec51480 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 -- 172.21.15.2:0/180842026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 msgr2=0x5558aec51860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24a00b5360 0x7f24a00b7820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5558aec50190 tx=0x7f24a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec51860 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f249c013610 tx=0x7f249c00a800 comp rx=0 tx=0).stop 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 -- 172.21.15.2:0/180842026 shutdown_connections 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec5dd30 0x5558aec60120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 --2- 172.21.15.2:0/180842026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec51860 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 -- 172.21.15.2:0/180842026 >> 172.21.15.2:0/180842026 conn(0x5558aec4f2b0 msgr2=0x5558aec50450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 -- 172.21.15.2:0/180842026 shutdown_connections 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.007+0000 7f24b95c8740 1 -- 172.21.15.2:0/180842026 wait complete. 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 -- start start 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 Processor -- start 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec5d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 0x5558aec5b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5558aea18700 con 0x5558aec5dd30 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5558aeb52110 con 0x5558aec51480 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5558aec609b0 con 0x5558aec51da0 2024-09-10T23:27:54.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b95c8740 10 client.0 _ll_register_callbacks cb 0x5558aeb6b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b5790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 0x5558aec5b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b5790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 0x5558aec5b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52152/0 (socket says 172.21.15.2:52152) 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b5790640 1 -- 172.21.15.2:0/3315942320 learned_addr learned my addr 172.21.15.2:0/3315942320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24affff640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.008+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec5d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b5790640 1 -- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 msgr2=0x5558aec5aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b5790640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b5790640 1 -- 172.21.15.2:0/3315942320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 msgr2=0x5558aec5d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b5790640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec5d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b5790640 1 -- 172.21.15.2:0/3315942320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558aeb7fc40 con 0x5558aec5dd30 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec5d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b5790640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 0x5558aec5b0a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f24a802f550 tx=0x7f24a80ccd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a0fcf970009595 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f248ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f248ffff640 1 -- 172.21.15.2:0/3315942320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a802fec0 con 0x5558aec5dd30 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f248ffff640 1 -- 172.21.15.2:0/3315942320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24a80cd880 con 0x5558aec5dd30 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249c0110d0 con 0x5558aec5dd30 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f248ffff640 1 -- 172.21.15.2:0/3315942320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a80098b0 con 0x5558aec5dd30 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b95c8740 10 client.16554 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:54.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558aec6c2e0 con 0x5558aec5dd30 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.009+0000 7f248ffff640 1 -- 172.21.15.2:0/3315942320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f249c0110d0 con 0x5558aec5dd30 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f248ffff640 1 -- 172.21.15.2:0/3315942320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24a80cc880 con 0x5558aec5dd30 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b95c8740 10 client.16554 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b95c8740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b95c8740 20 client.16554 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aec6d7c0 0x5558aec6fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b95c8740 4 client.16554 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558aebc9da0 con 0x5558aec6d7c0 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aec6d7c0 0x5558aec6fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f248ffff640 10 client.16554 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.010+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aec6d7c0 0x5558aec6fc20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b1187c6eba8b7b server_cookie=c76ec941d7060e7d in_seq=0 out_seq=0 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f248ffff640 1 -- 172.21.15.2:0/3315942320 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558aebc9da0 con 0x5558aec6d7c0 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f248ffff640 10 client.16554 handle_command_reply: tid=0 2024-09-10T23:27:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 client.16554 shutdown 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 msgr2=0x5558aec5b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 0x5558aec5b0a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f24a802f550 tx=0x7f24a80ccd90 comp rx=0 tx=0).stop 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 shutdown_connections 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aec6d7c0 0x5558aec6fc20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec5dd30 0x5558aec5b0a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec51da0 0x5558aec5aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3315942320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec5d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 >> 172.21.15.2:0/3315942320 conn(0x5558aec4f2b0 msgr2=0x5558aec54e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f248ffff640 0 client.16554 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:54.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 shutdown_connections 2024-09-10T23:27:54.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.011+0000 7f24b95c8740 1 -- 172.21.15.2:0/3315942320 wait complete. 2024-09-10T23:27:54.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.012+0000 7f24b95c8740 20 client.16554 trim_cache size 0 max 16384 2024-09-10T23:27:54.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.029+0000 7f24b95c8740 1 Processor -- start 2024-09-10T23:27:54.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.029+0000 7f24b95c8740 1 -- start start 2024-09-10T23:27:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec69be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 0x5558aec5f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec5f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b95c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01ae220 con 0x5558aec51da0 2024-09-10T23:27:54.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b95c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01afd60 con 0x5558aec51480 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b95c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01ae8f0 con 0x5558aec5dd30 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 0x5558aec5f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 0x5558aec5f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52160/0 (socket says 172.21.15.2:52160) 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 -- 172.21.15.2:0/3805528787 learned_addr learned my addr 172.21.15.2:0/3805528787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b5790640 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec5f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec69be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 -- 172.21.15.2:0/3805528787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 msgr2=0x5558aec5f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec5f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 -- 172.21.15.2:0/3805528787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 msgr2=0x5558aec69be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec69be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 -- 172.21.15.2:0/3805528787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558aec58f70 con 0x5558aec51da0 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24b5790640 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec5f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f24affff640 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 0x5558aec5f120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f249c013610 tx=0x7f249c005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c45c901c22213b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.030+0000 7f249a7fc640 1 -- 172.21.15.2:0/3805528787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c019040 con 0x5558aec51da0 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f249a7fc640 1 -- 172.21.15.2:0/3805528787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f249c011c60 con 0x5558aec51da0 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f249a7fc640 1 -- 172.21.15.2:0/3805528787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0055f0 con 0x5558aec51da0 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 -- 172.21.15.2:0/3805528787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 msgr2=0x5558aec5f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 0x5558aec5f120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f249c013610 tx=0x7f249c005ba0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 -- 172.21.15.2:0/3805528787 shutdown_connections 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec5f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51da0 0x5558aec5f120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 --2- 172.21.15.2:0/3805528787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51480 0x5558aec69be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 -- 172.21.15.2:0/3805528787 >> 172.21.15.2:0/3805528787 conn(0x5558aec4f2b0 msgr2=0x5558aec5c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 -- 172.21.15.2:0/3805528787 shutdown_connections 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.031+0000 7f24b95c8740 1 -- 172.21.15.2:0/3805528787 wait complete. 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 -- start start 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 Processor -- start 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec66020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51da0 0x5558aec66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec60d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01af690 con 0x5558aec51480 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01aefc0 con 0x5558aec51da0 2024-09-10T23:27:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01ac200 con 0x5558aec5dd30 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b95c8740 10 client.0 _ll_register_callbacks cb 0x7f24a8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b4f8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec66020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b4f8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec66020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52162/0 (socket says 172.21.15.2:52162) 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b4f8f640 1 -- 172.21.15.2:0/1910249288 learned_addr learned my addr 172.21.15.2:0/1910249288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24affff640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51da0 0x5558aec66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.032+0000 7f24b5790640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec60d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b4f8f640 1 -- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 msgr2=0x5558aec60d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec60d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b4f8f640 1 -- 172.21.15.2:0/1910249288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51da0 msgr2=0x5558aec66580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:54.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51da0 0x5558aec66580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b4f8f640 1 -- 172.21.15.2:0/1910249288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558aec615c0 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b4f8f640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec66020 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f24a40043f0 tx=0x7f24a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2e61bf4d6d9c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f248ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f248ffff640 1 -- 172.21.15.2:0/1910249288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4028470 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f248ffff640 1 -- 172.21.15.2:0/1910249288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24a4028610 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249c011c60 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f248ffff640 1 -- 172.21.15.2:0/1910249288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a4028810 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b95c8740 10 client.16560 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558aecdb3d0 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.033+0000 7f248ffff640 1 -- 172.21.15.2:0/1910249288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f249c011c60 con 0x5558aec51480 2024-09-10T23:27:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f248ffff640 1 -- 172.21.15.2:0/1910249288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24a4019040 con 0x5558aec51480 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24b95c8740 10 client.16560 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24b95c8740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24b95c8740 20 client.16560 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24b95c8740 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aecdbb80 0x5558aecddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24b95c8740 4 client.16560 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5558aebc5850 con 0x5558aecdbb80 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24affff640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aecdbb80 0x5558aecddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f24affff640 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aecdbb80 0x5558aecddfa0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7bc6d1f0851319e server_cookie=a43abf6608ef3b22 in_seq=0 out_seq=0 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.034+0000 7f248ffff640 10 client.16560 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f248ffff640 1 -- 172.21.15.2:0/1910249288 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x5558aebc5850 con 0x5558aecdbb80 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f248ffff640 10 client.16560 handle_command_reply: tid=0 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 client.16560 shutdown 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 msgr2=0x5558aec66020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec66020 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f24a40043f0 tx=0x7f24a4004730 comp rx=0 tx=0).stop 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 shutdown_connections 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5558aecdbb80 0x5558aecddfa0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558aec5dd30 0x5558aec60d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558aec51da0 0x5558aec66580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f248ffff640 0 client.16560 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 --2- 172.21.15.2:0/1910249288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558aec51480 0x5558aec66020 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 >> 172.21.15.2:0/1910249288 conn(0x5558aec4f2b0 msgr2=0x5558aec544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 shutdown_connections 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 1 -- 172.21.15.2:0/1910249288 wait complete. 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.035+0000 7f24b95c8740 20 client.16560 trim_cache size 0 max 16384 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:27:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:27:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:27:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:54.050 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:27:54.050 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:27:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24a00b5360 msgr2=0x7f24a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24a00b5360 0x7f24a00b7820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5558aec50190 tx=0x7f24a400b390 comp rx=0 tx=0).stop 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 msgr2=0x7f24b019ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b019ea80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f24a8005cc0 tx=0x7f24a802f380 comp rx=0 tx=0).stop 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 shutdown_connections 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24a00b5360 0x7f24a00b7820 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b0109150 0x7f24b019ea80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24b01087d0 0x7f24b01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 --2- 172.21.15.2:0/994182202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24b0102dc0 0x7f24b01991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 >> 172.21.15.2:0/994182202 conn(0x7f24b00fe830 msgr2=0x7f24b0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 shutdown_connections 2024-09-10T23:27:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:54.036+0000 7f24b71f3640 1 -- 172.21.15.2:0/994182202 wait complete. 2024-09-10T23:27:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:54 smithi002 ceph-mon[31150]: pgmap v458: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:27:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:54 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:27:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:54 smithi154 ceph-mon[35136]: pgmap v458: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:27:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:54 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:27:54.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:54 smithi177 ceph-mon[35760]: pgmap v458: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:27:54.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:54 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:27:54.873 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:27:54.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:27:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 -- 172.21.15.2:0/1429745031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc108020 msgr2=0x7f86dc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 --2- 172.21.15.2:0/1429745031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc108020 0x7f86dc10e820 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009ca0 tx=0x7f86d402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 -- 172.21.15.2:0/1429745031 shutdown_connections 2024-09-10T23:27:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 --2- 172.21.15.2:0/1429745031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc108020 0x7f86dc10e820 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 --2- 172.21.15.2:0/1429745031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc1076a0 0x7f86dc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 --2- 172.21.15.2:0/1429745031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86dc101c90 0x7f86dc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 -- 172.21.15.2:0/1429745031 >> 172.21.15.2:0/1429745031 conn(0x7f86dc0fd700 msgr2=0x7f86dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 -- 172.21.15.2:0/1429745031 shutdown_connections 2024-09-10T23:27:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.633+0000 7f86e38b9640 1 -- 172.21.15.2:0/1429745031 wait complete. 2024-09-10T23:27:55.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 Processor -- start 2024-09-10T23:27:55.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 -- start start 2024-09-10T23:27:55.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc101c90 0x7f86dc19b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 0x7f86dc19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86dc108020 0x7f86dc1a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc112dc0 con 0x7f86dc1076a0 2024-09-10T23:27:55.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc112c40 con 0x7f86dc101c90 2024-09-10T23:27:55.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e38b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc112f40 con 0x7f86dc108020 2024-09-10T23:27:55.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 0x7f86dc19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 0x7f86dc19b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52170/0 (socket says 172.21.15.2:52170) 2024-09-10T23:27:55.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 -- 172.21.15.2:0/3759111700 learned_addr learned my addr 172.21.15.2:0/3759111700 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:55.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e1e56640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86dc108020 0x7f86dc1a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e1655640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc101c90 0x7f86dc19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 -- 172.21.15.2:0/3759111700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86dc108020 msgr2=0x7f86dc1a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86dc108020 0x7f86dc1a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 -- 172.21.15.2:0/3759111700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc101c90 msgr2=0x7f86dc19b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc101c90 0x7f86dc19b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e0e54640 1 -- 172.21.15.2:0/3759111700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc1a1500 con 0x7f86dc1076a0 2024-09-10T23:27:55.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.634+0000 7f86e1655640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc101c90 0x7f86dc19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:55.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.635+0000 7f86e0e54640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 0x7f86dc19b990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00d950 tx=0x7f86cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:55.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.635+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc017070 con 0x7f86dc1076a0 2024-09-10T23:27:55.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.635+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86cc009c30 con 0x7f86dc1076a0 2024-09-10T23:27:55.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.635+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc1a17f0 con 0x7f86dc1076a0 2024-09-10T23:27:55.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.635+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc00f620 con 0x7f86dc1076a0 2024-09-10T23:27:55.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.635+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc1a7eb0 con 0x7f86dc1076a0 2024-09-10T23:27:55.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.636+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc102070 con 0x7f86dc1076a0 2024-09-10T23:27:55.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.637+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f86cc010460 con 0x7f86dc1076a0 2024-09-10T23:27:55.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.638+0000 7f86d27fc640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86c80b52e0 0x7f86c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.638+0000 7f86e1655640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86c80b52e0 0x7f86c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.638+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f86cc0e5840 con 0x7f86dc1076a0 2024-09-10T23:27:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.639+0000 7f86e1655640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86c80b52e0 0x7f86c80b77a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86d800baa0 tx=0x7f86d8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.642+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f86cc0ac710 con 0x7f86dc1076a0 2024-09-10T23:27:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.865+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86dc1a8250 con 0x7f86dc1076a0 2024-09-10T23:27:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.865+0000 7f86d27fc640 1 -- 172.21.15.2:0/3759111700 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f86cc009de0 con 0x7f86dc1076a0 2024-09-10T23:27:55.866 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:27:55.867 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:27:55.867 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86c80b52e0 msgr2=0x7f86c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86c80b52e0 0x7f86c80b77a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86d800baa0 tx=0x7f86d8005d90 comp rx=0 tx=0).stop 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 msgr2=0x7f86dc19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 0x7f86dc19b990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00d950 tx=0x7f86cc00de10 comp rx=0 tx=0).stop 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 shutdown_connections 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86c80b52e0 0x7f86c80b77a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86dc108020 0x7f86dc1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86dc1076a0 0x7f86dc19b990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 --2- 172.21.15.2:0/3759111700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86dc101c90 0x7f86dc19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 >> 172.21.15.2:0/3759111700 conn(0x7f86dc0fd700 msgr2=0x7f86dc0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 shutdown_connections 2024-09-10T23:27:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:55.868+0000 7f86e38b9640 1 -- 172.21.15.2:0/3759111700 wait complete. 2024-09-10T23:27:56.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:56 smithi002 ceph-mon[31150]: pgmap v459: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:27:56.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3759111700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:56 smithi154 ceph-mon[35136]: pgmap v459: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:27:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3759111700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:56.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:56 smithi177 ceph-mon[35760]: pgmap v459: 97 pgs: 97 active+clean; 2.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:27:56.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3759111700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:56.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:27:56.952 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 -- 172.21.15.2:0/2865632517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 msgr2=0x7f886c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 --2- 172.21.15.2:0/2865632517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c10e860 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8864009ca0 tx=0x7f886402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 -- 172.21.15.2:0/2865632517 shutdown_connections 2024-09-10T23:27:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 --2- 172.21.15.2:0/2865632517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c10e860 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 --2- 172.21.15.2:0/2865632517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c1076e0 0x7f886c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 --2- 172.21.15.2:0/2865632517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f886c101cd0 0x7f886c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 -- 172.21.15.2:0/2865632517 >> 172.21.15.2:0/2865632517 conn(0x7f886c0fd700 msgr2=0x7f886c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 -- 172.21.15.2:0/2865632517 shutdown_connections 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.421+0000 7f887160d640 1 -- 172.21.15.2:0/2865632517 wait complete. 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 Processor -- start 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 -- start start 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c101cd0 0x7f886c19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f886c1076e0 0x7f886c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f886c111d20 con 0x7f886c108060 2024-09-10T23:27:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f886c111ba0 con 0x7f886c101cd0 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.422+0000 7f887160d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f886c111ea0 con 0x7f886c1076e0 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52188/0 (socket says 172.21.15.2:52188) 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 -- 172.21.15.2:0/1550213731 learned_addr learned my addr 172.21.15.2:0/1550213731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886a7fc640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f886c1076e0 0x7f886c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886affd640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c101cd0 0x7f886c19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 -- 172.21.15.2:0/1550213731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f886c1076e0 msgr2=0x7f886c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f886c1076e0 0x7f886c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 -- 172.21.15.2:0/1550213731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c101cd0 msgr2=0x7f886c19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c101cd0 0x7f886c19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 -- 172.21.15.2:0/1550213731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886c1a53f0 con 0x7f886c108060 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886affd640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c101cd0 0x7f886c19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:57.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f886b7fe640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c19aab0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8864005cc0 tx=0x7f886402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f8853fff640 1 -- 172.21.15.2:0/1550213731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864003bf0 con 0x7f886c108060 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886c1a5680 con 0x7f886c108060 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f8853fff640 1 -- 172.21.15.2:0/1550213731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8864003d90 con 0x7f886c108060 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f8853fff640 1 -- 172.21.15.2:0/1550213731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886402fbc0 con 0x7f886c108060 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.423+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886c1a5bc0 con 0x7f886c108060 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 Processor -- start 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f8853fff640 1 -- 172.21.15.2:0/1550213731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8864004610 con 0x7f886c108060 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 -- start start 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56246660dea0 con 0x5624666974d0 2024-09-10T23:27:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5624665fd2d0 con 0x5624666a3d80 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f88739e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5624666010e0 con 0x562466697df0 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f886a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f886a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52200/0 (socket says 172.21.15.2:52200) 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.426+0000 7f886a7fc640 1 -- 172.21.15.2:0/2306373457 learned_addr learned my addr 172.21.15.2:0/2306373457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886affd640 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 -- 172.21.15.2:0/2306373457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 msgr2=0x5624666a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 -- 172.21.15.2:0/2306373457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 msgr2=0x5624666a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 -- 172.21.15.2:0/2306373457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56246635b650 con 0x5624666974d0 2024-09-10T23:27:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f8853fff640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88540b52e0 0x7f88540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666978b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f886000bfa0 tx=0x7f886000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beda0b5ebedbb76b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f886affd640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88540b52e0 0x7f88540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f8853fff640 1 -- 172.21.15.2:0/1550213731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8864107130 con 0x7f886c108060 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f88517fa640 1 -- 172.21.15.2:0/2306373457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860004030 con 0x5624666974d0 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f88517fa640 1 -- 172.21.15.2:0/2306373457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88600041d0 con 0x5624666974d0 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.427+0000 7f88517fa640 1 -- 172.21.15.2:0/2306373457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88600104a0 con 0x5624666974d0 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 -- 172.21.15.2:0/2306373457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 msgr2=0x5624666978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f886affd640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88540b52e0 0x7f88540b77a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5624666961e0 tx=0x7f885c00b710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666978b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f886000bfa0 tx=0x7f886000b840 comp rx=0 tx=0).stop 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 -- 172.21.15.2:0/2306373457 shutdown_connections 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 --2- 172.21.15.2:0/2306373457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666978b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 -- 172.21.15.2:0/2306373457 >> 172.21.15.2:0/2306373457 conn(0x562466695300 msgr2=0x5624666964a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 -- 172.21.15.2:0/2306373457 shutdown_connections 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 -- 172.21.15.2:0/2306373457 wait complete. 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 -- start start 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.428+0000 7f88739e2740 1 Processor -- start 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x5624666a3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 0x5624666a1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56246645e700 con 0x5624666a3d80 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562466598160 con 0x5624666974d0 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5624666a6a00 con 0x562466697df0 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f88739e2740 10 client.0 _ll_register_callbacks cb 0x5624665b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 0x5624666a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 0x5624666a1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52208/0 (socket says 172.21.15.2:52208) 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 -- 172.21.15.2:0/2278716342 learned_addr learned my addr 172.21.15.2:0/2278716342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886affd640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x5624666a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 -- 172.21.15.2:0/2278716342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 msgr2=0x5624666a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 -- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 msgr2=0x5624666a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x5624666a3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 -- 172.21.15.2:0/2278716342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624665c5c90 con 0x5624666a3d80 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f886b7fe640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 0x5624666a1110 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f88640c9ed0 tx=0x7f88640cd130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f58771a949fa7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.429+0000 7f884eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f884eff5640 1 -- 172.21.15.2:0/2278716342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88640ce000 con 0x5624666a3d80 2024-09-10T23:27:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f884eff5640 1 -- 172.21.15.2:0/2278716342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f88640d6a00 con 0x5624666a3d80 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88600041d0 con 0x5624666a3d80 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f884eff5640 1 -- 172.21.15.2:0/2278716342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88640cd900 con 0x5624666a3d80 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 10 client.16578 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5624666b2360 con 0x5624666a3d80 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f884eff5640 1 -- 172.21.15.2:0/2278716342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88600041d0 con 0x5624666a3d80 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f884eff5640 1 -- 172.21.15.2:0/2278716342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f88640ccb60 con 0x5624666a3d80 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 10 client.16578 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 10 client.16578 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 20 client.16578 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624666b38b0 0x5624666b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 4 client.16578 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.430+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56246660fdf0 con 0x5624666b38b0 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.431+0000 7f886affd640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624666b38b0 0x5624666b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.431+0000 7f884eff5640 10 client.16578 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.431+0000 7f886affd640 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624666b38b0 0x5624666b5ce0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=509bdb388e3ca11d server_cookie=392e7d6b519f0187 in_seq=0 out_seq=0 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f884eff5640 1 -- 172.21.15.2:0/2278716342 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56246660fdf0 con 0x5624666b38b0 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f884eff5640 10 client.16578 handle_command_reply: tid=0 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 client.16578 shutdown 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 msgr2=0x5624666a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 0x5624666a1110 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f88640c9ed0 tx=0x7f88640cd130 comp rx=0 tx=0).stop 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 shutdown_connections 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624666b38b0 0x5624666b5ce0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666a3d80 0x5624666a1110 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f884eff5640 0 client.16578 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 --2- 172.21.15.2:0/2278716342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x5624666a3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 >> 172.21.15.2:0/2278716342 conn(0x562466695300 msgr2=0x56246669ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 shutdown_connections 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 1 -- 172.21.15.2:0/2278716342 wait complete. 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.432+0000 7f88739e2740 20 client.16578 trim_cache size 0 max 16384 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 Processor -- start 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 -- start start 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x562466694c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 0x5624666a2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624666a3d80 0x5624666a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1ae1a0 con 0x562466697df0 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1afce0 con 0x5624666974d0 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.445+0000 7f88739e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1ae870 con 0x5624666a3d80 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 0x5624666a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 0x5624666a2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52220/0 (socket says 172.21.15.2:52220) 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 -- 172.21.15.2:0/1664304301 learned_addr learned my addr 172.21.15.2:0/1664304301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886affd640 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x562466694c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886b7fe640 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624666a3d80 0x5624666a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 -- 172.21.15.2:0/1664304301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624666a3d80 msgr2=0x5624666a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624666a3d80 0x5624666a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 -- 172.21.15.2:0/1664304301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 msgr2=0x562466694c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x562466694c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 -- 172.21.15.2:0/1664304301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56246669efe0 con 0x562466697df0 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886b7fe640 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624666a3d80 0x5624666a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f886a7fc640 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 0x5624666a2820 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8860003c50 tx=0x7f886000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eecb420509a7d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f8850ff9640 1 -- 172.21.15.2:0/1664304301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860012110 con 0x562466697df0 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f8850ff9640 1 -- 172.21.15.2:0/1664304301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8860005040 con 0x562466697df0 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.446+0000 7f8850ff9640 1 -- 172.21.15.2:0/1664304301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88600106a0 con 0x562466697df0 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 -- 172.21.15.2:0/1664304301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 msgr2=0x5624666a2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 0x5624666a2820 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8860003c50 tx=0x7f886000b5b0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 -- 172.21.15.2:0/1664304301 shutdown_connections 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624666a3d80 0x5624666a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562466697df0 0x5624666a2820 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 --2- 172.21.15.2:0/1664304301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666974d0 0x562466694c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 -- 172.21.15.2:0/1664304301 >> 172.21.15.2:0/1664304301 conn(0x562466695300 msgr2=0x5624666a2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 -- 172.21.15.2:0/1664304301 shutdown_connections 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 -- 172.21.15.2:0/1664304301 wait complete. 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 -- start start 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.447+0000 7f88739e2740 1 Processor -- start 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666ac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1af610 con 0x5624666974d0 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1aef40 con 0x5624666a3d80 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1ac180 con 0x562466697df0 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 10 client.0 _ll_register_callbacks cb 0x7f88640cd7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52230/0 (socket says 172.21.15.2:52230) 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 -- 172.21.15.2:0/2788394358 learned_addr learned my addr 172.21.15.2:0/2788394358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886b7fe640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 -- 172.21.15.2:0/2788394358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 msgr2=0x5624666ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 -- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 msgr2=0x5624666a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 -- 172.21.15.2:0/2788394358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624666a7210 con 0x5624666974d0 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f886affd640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666abca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x5624666b6520 tx=0x7f885c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d787fbe0e337664 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:57.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f884eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f884eff5640 1 -- 172.21.15.2:0/2788394358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c035060 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f884eff5640 1 -- 172.21.15.2:0/2788394358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f885c020840 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.448+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8860005040 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f884eff5640 1 -- 172.21.15.2:0/2788394358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f885c020a40 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 10 client.16584 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562466721040 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f884eff5640 1 -- 172.21.15.2:0/2788394358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8860005040 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f884eff5640 1 -- 172.21.15.2:0/2788394358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f885c01f420 con 0x5624666974d0 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 10 client.16584 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 10 client.16584 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 20 client.16584 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624667217a0 0x562466723bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 4 client.16584 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56246660b8a0 con 0x5624667217a0 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.449+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624667217a0 0x562466723bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f884eff5640 10 client.16584 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f886a7fc640 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624667217a0 0x562466723bc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f34a8b05f8b40d6d server_cookie=3871a2b7771dacbd in_seq=0 out_seq=0 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f884eff5640 1 -- 172.21.15.2:0/2788394358 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56246660b8a0 con 0x5624667217a0 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f884eff5640 10 client.16584 handle_command_reply: tid=0 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 client.16584 shutdown 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 msgr2=0x5624666abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666abca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x5624666b6520 tx=0x7f885c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 shutdown_connections 2024-09-10T23:27:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5624667217a0 0x562466723bc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624666a3d80 0x5624666a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f884eff5640 0 client.16584 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562466697df0 0x5624666ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 --2- 172.21.15.2:0/2788394358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624666974d0 0x5624666abca0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 >> 172.21.15.2:0/2788394358 conn(0x562466695300 msgr2=0x5624666a2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 shutdown_connections 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 1 -- 172.21.15.2:0/2788394358 wait complete. 2024-09-10T23:27:57.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.450+0000 7f88739e2740 20 client.16584 trim_cache size 0 max 16384 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88540b52e0 msgr2=0x7f88540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88540b52e0 0x7f88540b77a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5624666961e0 tx=0x7f885c00b710 comp rx=0 tx=0).stop 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 msgr2=0x7f886c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c19aab0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8864005cc0 tx=0x7f886402f380 comp rx=0 tx=0).stop 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 shutdown_connections 2024-09-10T23:27:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88540b52e0 0x7f88540b77a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f886c108060 0x7f886c19aab0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f886c1076e0 0x7f886c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 --2- 172.21.15.2:0/1550213731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f886c101cd0 0x7f886c19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 >> 172.21.15.2:0/1550213731 conn(0x7f886c0fd700 msgr2=0x7f886c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 shutdown_connections 2024-09-10T23:27:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:57.451+0000 7f887160d640 1 -- 172.21.15.2:0/1550213731 wait complete. 2024-09-10T23:27:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:27:58 smithi154 ceph-mon[35136]: pgmap v460: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:27:58.319 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:27:58 smithi002 ceph-mon[31150]: pgmap v460: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:27:58.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:27:58.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:27:58 smithi177 ceph-mon[35760]: pgmap v460: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:27:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 -- 172.21.15.2:0/2094548325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc1087d0 msgr2=0x7f53cc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 --2- 172.21.15.2:0/2094548325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc1087d0 0x7f53cc108c10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009900 tx=0x7f53c002a410 comp rx=0 tx=0).stop 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 -- 172.21.15.2:0/2094548325 shutdown_connections 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 --2- 172.21.15.2:0/2094548325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc109150 0x7f53cc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 --2- 172.21.15.2:0/2094548325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc1087d0 0x7f53cc108c10 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 --2- 172.21.15.2:0/2094548325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53cc102dc0 0x7f53cc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 -- 172.21.15.2:0/2094548325 >> 172.21.15.2:0/2094548325 conn(0x7f53cc0fe830 msgr2=0x7f53cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 -- 172.21.15.2:0/2094548325 shutdown_connections 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.108+0000 7f53d0848640 1 -- 172.21.15.2:0/2094548325 wait complete. 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 Processor -- start 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 -- start start 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc102dc0 0x7f53cc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53cc1087d0 0x7f53cc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 0x7f53cc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc112e10 con 0x7f53cc109150 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc112c90 con 0x7f53cc1087d0 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53d0848640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc112f90 con 0x7f53cc102dc0 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 0x7f53cc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 0x7f53cc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52246/0 (socket says 172.21.15.2:52246) 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53ca59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc102dc0 0x7f53cc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 -- 172.21.15.2:0/1402379036 learned_addr learned my addr 172.21.15.2:0/1402379036 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53cc1087d0 0x7f53cc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 -- 172.21.15.2:0/1402379036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc102dc0 msgr2=0x7f53cc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc102dc0 0x7f53cc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 -- 172.21.15.2:0/1402379036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53cc1087d0 msgr2=0x7f53cc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53cc1087d0 0x7f53cc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.109+0000 7f53cad9d640 1 -- 172.21.15.2:0/1402379036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc1a7700 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.110+0000 7f53cad9d640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 0x7f53cc075f20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f53c400eaa0 tx=0x7f53c400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.110+0000 7f53bb7fe640 1 -- 172.21.15.2:0/1402379036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4004d20 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.110+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc1a79f0 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.110+0000 7f53bb7fe640 1 -- 172.21.15.2:0/1402379036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c4005020 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.110+0000 7f53bb7fe640 1 -- 172.21.15.2:0/1402379036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40116d0 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.110+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc1a7fd0 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.112+0000 7f53d2c1d740 1 Processor -- start 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53bb7fe640 1 -- 172.21.15.2:0/1402379036 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f53c400f040 con 0x7f53cc109150 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 -- start start 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefc08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefcc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefcf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596eef36ea0 con 0x5596eefc0df0 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5596eef262d0 con 0x5596eefc04d0 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596eef2a0e0 con 0x5596eefccd80 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefcc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefcc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52258/0 (socket says 172.21.15.2:52258) 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 -- 172.21.15.2:0/2529265149 learned_addr learned my addr 172.21.15.2:0/2529265149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefc08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefcf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 -- 172.21.15.2:0/2529265149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 msgr2=0x5596eefcf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefcf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 -- 172.21.15.2:0/2529265149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 msgr2=0x5596eefc08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.113+0000 7f53ca59c640 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefc08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53ca59c640 1 -- 172.21.15.2:0/2529265149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596eec84650 con 0x5596eefc0df0 2024-09-10T23:27:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefcf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53bb7fe640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53b40b52e0 0x7f53b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53ca59c640 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefcc840 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009a70 tx=0x7f53bc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459654930abcf978 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53b40b52e0 0x7f53b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53b8ff9640 1 -- 172.21.15.2:0/2529265149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017070 con 0x5596eefc0df0 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53bb7fe640 1 -- 172.21.15.2:0/1402379036 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53c40e59f0 con 0x7f53cc109150 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53b8ff9640 1 -- 172.21.15.2:0/2529265149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53bc013470 con 0x5596eefc0df0 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.114+0000 7f53b8ff9640 1 -- 172.21.15.2:0/2529265149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc012630 con 0x5596eefc0df0 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2529265149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 msgr2=0x5596eefcc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefcc840 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009a70 tx=0x7f53bc009f30 comp rx=0 tx=0).stop 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53b40b52e0 0x7f53b40b77a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f53c0031440 tx=0x7f53c002a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2529265149 shutdown_connections 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefcf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefcc840 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2529265149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefc08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2529265149 >> 172.21.15.2:0/2529265149 conn(0x5596eefbe300 msgr2=0x5596eefbf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2529265149 shutdown_connections 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2529265149 wait complete. 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 -- start start 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.115+0000 7f53d2c1d740 1 Processor -- start 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefcc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefc9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596eed87700 con 0x5596eefc0df0 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5596eeec1160 con 0x5596eefc04d0 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5596eefcfa00 con 0x5596eefccd80 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 10 client.0 _ll_register_callbacks cb 0x5596eeeda9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefc9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefc9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52264/0 (socket says 172.21.15.2:52264) 2024-09-10T23:27:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 -- 172.21.15.2:0/533304398 learned_addr learned my addr 172.21.15.2:0/533304398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53cad9d640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53ca59c640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefcc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 -- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 msgr2=0x5596eefca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 -- 172.21.15.2:0/533304398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 msgr2=0x5596eefcc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefcc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 -- 172.21.15.2:0/533304398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596eeeeec90 con 0x5596eefc0df0 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefc9a80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009900 tx=0x7f53c0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcade8a088533537 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53b1ffb640 1 -- 172.21.15.2:0/533304398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c004d020 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53bc013470 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.116+0000 7f53b1ffb640 1 -- 172.21.15.2:0/533304398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53c00318b0 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53b1ffb640 1 -- 172.21.15.2:0/533304398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53c0035040 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 10 client.16596 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5596eefdb2b0 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53b1ffb640 1 -- 172.21.15.2:0/533304398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53bc013470 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53b1ffb640 1 -- 172.21.15.2:0/533304398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53c0049480 con 0x5596eefc0df0 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 10 client.16596 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 10 client.16596 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 20 client.16596 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596eefdc710 0x5596eefdeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 4 client.16596 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.117+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596eef38df0 con 0x5596eefdc710 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.118+0000 7f53ca59c640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596eefdc710 0x5596eefdeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.118+0000 7f53b1ffb640 10 client.16596 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.118+0000 7f53ca59c640 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596eefdc710 0x5596eefdeb40 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8859689daa632d6e server_cookie=a21f03743bbe0f04 in_seq=0 out_seq=0 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53b1ffb640 1 -- 172.21.15.2:0/533304398 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596eef38df0 con 0x5596eefdc710 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53b1ffb640 10 client.16596 handle_command_reply: tid=0 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 client.16596 shutdown 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 msgr2=0x5596eefc9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefc9a80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009900 tx=0x7f53c0009260 comp rx=0 tx=0).stop 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 shutdown_connections 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596eefdc710 0x5596eefdeb40 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc0df0 0x5596eefc9a80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/533304398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefcc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 >> 172.21.15.2:0/533304398 conn(0x5596eefbe300 msgr2=0x5596eefc3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53b1ffb640 0 client.16596 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 shutdown_connections 2024-09-10T23:27:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 1 -- 172.21.15.2:0/533304398 wait complete. 2024-09-10T23:27:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.119+0000 7f53d2c1d740 20 client.16596 trim_cache size 0 max 16384 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.132+0000 7f53d2c1d740 1 Processor -- start 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.132+0000 7f53d2c1d740 1 -- start start 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefbdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefc0df0 0x5596eefc8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 0x5596eefc8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1b0680 con 0x5596eefccd80 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1b21c0 con 0x5596eefc04d0 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1b0d50 con 0x5596eefc0df0 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 0x5596eefc8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 0x5596eefc8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52274/0 (socket says 172.21.15.2:52274) 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 -- 172.21.15.2:0/2077921486 learned_addr learned my addr 172.21.15.2:0/2077921486 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefc0df0 0x5596eefc8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53ca59c640 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefbdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 -- 172.21.15.2:0/2077921486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefc0df0 msgr2=0x5596eefc8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefc0df0 0x5596eefc8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 -- 172.21.15.2:0/2077921486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 msgr2=0x5596eefbdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefbdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 -- 172.21.15.2:0/2077921486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596eefcf4e0 con 0x5596eefccd80 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53ca59c640 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefbdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53cad9d640 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 0x5596eefc8840 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f53c4004ff0 tx=0x7f53c40abb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812e249b741435da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53b3fff640 1 -- 172.21.15.2:0/2077921486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c401f040 con 0x5596eefccd80 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53b3fff640 1 -- 172.21.15.2:0/2077921486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c40abcd0 con 0x5596eefccd80 2024-09-10T23:27:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.133+0000 7f53b3fff640 1 -- 172.21.15.2:0/2077921486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40cf0d0 con 0x5596eefccd80 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2077921486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 msgr2=0x5596eefc8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 0x5596eefc8840 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f53c4004ff0 tx=0x7f53c40abb10 comp rx=0 tx=0).stop 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2077921486 shutdown_connections 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefccd80 0x5596eefc8840 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefc0df0 0x5596eefc8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/2077921486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc04d0 0x5596eefbdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2077921486 >> 172.21.15.2:0/2077921486 conn(0x5596eefbe300 msgr2=0x5596eefc4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2077921486 shutdown_connections 2024-09-10T23:27:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 -- 172.21.15.2:0/2077921486 wait complete. 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.134+0000 7f53d2c1d740 1 -- start start 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 Processor -- start 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 0x5596eefd0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc0df0 0x5596eefd1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefd17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1b1af0 con 0x5596eefc04d0 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1b1420 con 0x5596eefc0df0 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc1ae660 con 0x5596eefccd80 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53d2c1d740 10 client.0 _ll_register_callbacks cb 0x7f53c0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 0x5596eefd0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 0x5596eefd0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52278/0 (socket says 172.21.15.2:52278) 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 -- 172.21.15.2:0/3855097907 learned_addr learned my addr 172.21.15.2:0/3855097907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53cad9d640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefd17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc0df0 0x5596eefd1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 -- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 msgr2=0x5596eefd17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefd17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 -- 172.21.15.2:0/3855097907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc0df0 msgr2=0x5596eefd1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc0df0 0x5596eefd1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 -- 172.21.15.2:0/3855097907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ef048780 con 0x5596eefc04d0 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc0df0 0x5596eefd1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53ca59c640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 0x5596eefd0d30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f53bc013d90 tx=0x7f53bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861cd2d20438bbd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.135+0000 7f53b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:27:59.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53b1ffb640 1 -- 172.21.15.2:0/3855097907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017040 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53b1ffb640 1 -- 172.21.15.2:0/3855097907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53bc00edc0 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c40abcd0 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53b1ffb640 1 -- 172.21.15.2:0/3855097907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53bc013470 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 10 client.16602 fetch_fsmap learned FSMap version 28 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5596ef049a80 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53b1ffb640 1 -- 172.21.15.2:0/3855097907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c40abcd0 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53b1ffb640 1 -- 172.21.15.2:0/3855097907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53bc02b020 con 0x5596eefc04d0 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 10 client.16602 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 10 client.16602 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 20 client.16602 populate_metadata read hostname 'smithi002' 2024-09-10T23:27:59.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596ef04a010 0x5596ef04c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 4 client.16602 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.136+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596eef348a0 con 0x5596ef04a010 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596ef04a010 0x5596ef04c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53c9d9b640 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596ef04a010 0x5596ef04c400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1332b09dfd083d04 server_cookie=b7e67691174d42bd in_seq=0 out_seq=0 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53b1ffb640 10 client.16602 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53b1ffb640 1 -- 172.21.15.2:0/3855097907 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596eef348a0 con 0x5596ef04a010 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53b1ffb640 10 client.16602 handle_command_reply: tid=0 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 client.16602 shutdown 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 msgr2=0x5596eefd0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 0x5596eefd0d30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f53bc013d90 tx=0x7f53bc000bc0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 shutdown_connections 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5596ef04a010 0x5596ef04c400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5596eefccd80 0x5596eefd17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5596eefc0df0 0x5596eefd1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 --2- 172.21.15.2:0/3855097907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596eefc04d0 0x5596eefd0d30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 >> 172.21.15.2:0/3855097907 conn(0x5596eefbe300 msgr2=0x5596eefc8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.137+0000 7f53b1ffb640 0 client.16602 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 shutdown_connections 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d2c1d740 1 -- 172.21.15.2:0/3855097907 wait complete. 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d2c1d740 20 client.16602 trim_cache size 0 max 16384 2024-09-10T23:27:59.147 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53b40b52e0 msgr2=0x7f53b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53b40b52e0 0x7f53b40b77a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f53c0031440 tx=0x7f53c002a410 comp rx=0 tx=0).stop 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 msgr2=0x7f53cc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 0x7f53cc075f20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f53c400eaa0 tx=0x7f53c400eea0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 shutdown_connections 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53b40b52e0 0x7f53b40b77a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53cc109150 0x7f53cc075f20 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53cc1087d0 0x7f53cc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 --2- 172.21.15.2:0/1402379036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc102dc0 0x7f53cc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:59.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 >> 172.21.15.2:0/1402379036 conn(0x7f53cc0fe830 msgr2=0x7f53cc105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:59.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 shutdown_connections 2024-09-10T23:27:59.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:27:59.138+0000 7f53d0848640 1 -- 172.21.15.2:0/1402379036 wait complete. 2024-09-10T23:28:00.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:28:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:00 smithi154 ceph-mon[35136]: pgmap v461: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:00.307 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:00.429 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:00 smithi002 ceph-mon[31150]: pgmap v461: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:00.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:00 smithi177 ceph-mon[35760]: pgmap v461: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 -- 172.21.15.2:0/3282999428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc1087d0 msgr2=0x7f09bc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 --2- 172.21.15.2:0/3282999428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc1087d0 0x7f09bc108c10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009900 tx=0x7f09b002a410 comp rx=0 tx=0).stop 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 -- 172.21.15.2:0/3282999428 shutdown_connections 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 --2- 172.21.15.2:0/3282999428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc109150 0x7f09bc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 --2- 172.21.15.2:0/3282999428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc1087d0 0x7f09bc108c10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 --2- 172.21.15.2:0/3282999428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09bc102dc0 0x7f09bc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 -- 172.21.15.2:0/3282999428 >> 172.21.15.2:0/3282999428 conn(0x7f09bc0fe830 msgr2=0x7f09bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 -- 172.21.15.2:0/3282999428 shutdown_connections 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 -- 172.21.15.2:0/3282999428 wait complete. 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 Processor -- start 2024-09-10T23:28:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.803+0000 7f09c2041640 1 -- start start 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09c2041640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 0x7f09bc19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09c2041640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc1087d0 0x7f09bc19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09c2041640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09bc109150 0x7f09bc1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09c2041640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc112e10 con 0x7f09bc102dc0 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09c2041640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc112c90 con 0x7f09bc1087d0 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09c2041640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc112f90 con 0x7f09bc109150 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 0x7f09bc19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 0x7f09bc19b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52306/0 (socket says 172.21.15.2:52306) 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 -- 172.21.15.2:0/2729049142 learned_addr learned my addr 172.21.15.2:0/2729049142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bbfff640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09bc109150 0x7f09bc1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09baffd640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc1087d0 0x7f09bc19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 -- 172.21.15.2:0/2729049142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09bc109150 msgr2=0x7f09bc1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09bc109150 0x7f09bc1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 -- 172.21.15.2:0/2729049142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc1087d0 msgr2=0x7f09bc19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc1087d0 0x7f09bc19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 -- 172.21.15.2:0/2729049142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc1a1540 con 0x7f09bc102dc0 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09baffd640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc1087d0 0x7f09bc19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 0x7f09bc19b490 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00c920 tx=0x7f09ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.804+0000 7f09b8ff9640 1 -- 172.21.15.2:0/2729049142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac007c70 con 0x7f09bc102dc0 2024-09-10T23:28:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.805+0000 7f09b8ff9640 1 -- 172.21.15.2:0/2729049142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ac007e10 con 0x7f09bc102dc0 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.805+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc1a1830 con 0x7f09bc102dc0 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.805+0000 7f09b8ff9640 1 -- 172.21.15.2:0/2729049142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac018820 con 0x7f09bc102dc0 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.805+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc1a7f70 con 0x7f09bc102dc0 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.807+0000 7f09c4416740 1 Processor -- start 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.807+0000 7f09b8ff9640 1 -- 172.21.15.2:0/2729049142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f09ac00f450 con 0x7f09bc102dc0 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.807+0000 7f09c4416740 1 -- start start 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09c4416740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dc4d0 0x5614f60dc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09c4416740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09c4416740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60e8d80 0x5614f60eb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09c4416740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614f6052ea0 con 0x5614f60dcdf0 2024-09-10T23:28:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09c4416740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5614f60422d0 con 0x5614f60dc4d0 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09c4416740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5614f60460e0 con 0x5614f60e8d80 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52316/0 (socket says 172.21.15.2:52316) 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3740716235 learned_addr learned my addr 172.21.15.2:0/3740716235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09baffd640 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60e8d80 0x5614f60eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bbfff640 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dc4d0 0x5614f60dc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09b8ff9640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09a40b52e0 0x7f09a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3740716235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60e8d80 msgr2=0x5614f60eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60e8d80 0x5614f60eb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3740716235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dc4d0 msgr2=0x5614f60dc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dc4d0 0x5614f60dc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3740716235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f5da0650 con 0x5614f60dcdf0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09bbfff640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09a40b52e0 0x7f09a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.808+0000 7f09b8ff9640 1 -- 172.21.15.2:0/2729049142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f09ac0e5df0 con 0x7f09bc102dc0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e8840 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0d9ba0 tx=0x7f09ac0a8520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2ad21f43e73920 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09a1ffb640 1 -- 172.21.15.2:0/3740716235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0d7070 con 0x5614f60dcdf0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09a1ffb640 1 -- 172.21.15.2:0/3740716235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ac0d8920 con 0x5614f60dcdf0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09a1ffb640 1 -- 172.21.15.2:0/3740716235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0abf10 con 0x5614f60dcdf0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 -- 172.21.15.2:0/3740716235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 msgr2=0x5614f60e8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09bbfff640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09a40b52e0 0x7f09a40b77a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f09b400a4e0 tx=0x7f09b400c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e8840 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0d9ba0 tx=0x7f09ac0a8520 comp rx=0 tx=0).stop 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 -- 172.21.15.2:0/3740716235 shutdown_connections 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60e8d80 0x5614f60eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e8840 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 --2- 172.21.15.2:0/3740716235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dc4d0 0x5614f60dc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.809+0000 7f09c4416740 1 -- 172.21.15.2:0/3740716235 >> 172.21.15.2:0/3740716235 conn(0x5614f60da300 msgr2=0x5614f60db4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 -- 172.21.15.2:0/3740716235 shutdown_connections 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 -- 172.21.15.2:0/3740716235 wait complete. 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 -- start start 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 Processor -- start 2024-09-10T23:28:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60e6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614f5ea3700 con 0x5614f60dcdf0 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5614f5fdd160 con 0x5614f60e8d80 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5614f60eba00 con 0x5614f60dc4d0 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09c4416740 10 client.0 _ll_register_callbacks cb 0x5614f5ff69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.810+0000 7f09baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52332/0 (socket says 172.21.15.2:52332) 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 -- 172.21.15.2:0/4123389287 learned_addr learned my addr 172.21.15.2:0/4123389287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09bbfff640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 -- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 msgr2=0x5614f60e8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60e8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 -- 172.21.15.2:0/4123389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 msgr2=0x5614f60e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 -- 172.21.15.2:0/4123389287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f600ac90 con 0x5614f60dcdf0 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09baffd640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e5a80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009900 tx=0x7f09b00316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d04f2cb0be56d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f099affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f099affd640 1 -- 172.21.15.2:0/4123389287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0040070 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f099affd640 1 -- 172.21.15.2:0/4123389287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f09b0004250 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5614f6054df0 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f099affd640 1 -- 172.21.15.2:0/4123389287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f09b0035040 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09c4416740 10 client.16614 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.811+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5614f60f72f0 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f099affd640 1 -- 172.21.15.2:0/4123389287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5614f6054df0 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f099affd640 1 -- 172.21.15.2:0/4123389287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f09b00049f0 con 0x5614f60dcdf0 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09c4416740 10 client.16614 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09c4416740 10 client.16614 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:28:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09c4416740 20 client.16614 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09c4416740 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f60f8800 0x5614f60fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09c4416740 4 client.16614 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614f60508a0 con 0x5614f60f8800 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f60f8800 0x5614f60fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f099affd640 10 client.16614 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.812+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f60f8800 0x5614f60fabf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5e0b6995068c0bf server_cookie=a33f1385773ba9bb in_seq=0 out_seq=0 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f099affd640 1 -- 172.21.15.2:0/4123389287 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614f60508a0 con 0x5614f60f8800 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f099affd640 10 client.16614 handle_command_reply: tid=0 2024-09-10T23:28:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 client.16614 shutdown 2024-09-10T23:28:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 msgr2=0x5614f60e5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e5a80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009900 tx=0x7f09b00316d0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 shutdown_connections 2024-09-10T23:28:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f60f8800 0x5614f60fabf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.880 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dcdf0 0x5614f60e5a80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f099affd640 0 client.16614 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 --2- 172.21.15.2:0/4123389287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.813+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 >> 172.21.15.2:0/4123389287 conn(0x5614f60da300 msgr2=0x5614f60dfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.814+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 shutdown_connections 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.814+0000 7f09c4416740 1 -- 172.21.15.2:0/4123389287 wait complete. 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.814+0000 7f09c4416740 20 client.16614 trim_cache size 0 max 16384 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 Processor -- start 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 -- start start 2024-09-10T23:28:00.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dcdf0 0x5614f60ea170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 0x5614f60ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1b0660 con 0x5614f60e8d80 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1b21a0 con 0x5614f60dcdf0 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09c4416740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1b0d30 con 0x5614f60dc4d0 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 0x5614f60ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 0x5614f60ea6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52342/0 (socket says 172.21.15.2:52342) 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 -- 172.21.15.2:0/3161884858 learned_addr learned my addr 172.21.15.2:0/3161884858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09baffd640 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dcdf0 0x5614f60ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 -- 172.21.15.2:0/3161884858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 msgr2=0x5614f60f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 -- 172.21.15.2:0/3161884858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dcdf0 msgr2=0x5614f60ea170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dcdf0 0x5614f60ea170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.827+0000 7f09bbfff640 1 -- 172.21.15.2:0/3161884858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f60e07f0 con 0x5614f60e8d80 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09bbfff640 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 0x5614f60ea6b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f09b4017840 tx=0x7f09b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ac536e7e845e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09a17fa640 1 -- 172.21.15.2:0/3161884858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4028070 con 0x5614f60e8d80 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09a17fa640 1 -- 172.21.15.2:0/3161884858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b4016cc0 con 0x5614f60e8d80 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09a17fa640 1 -- 172.21.15.2:0/3161884858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40076f0 con 0x5614f60e8d80 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 -- 172.21.15.2:0/3161884858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 msgr2=0x5614f60ea6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 0x5614f60ea6b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f09b4017840 tx=0x7f09b4004a40 comp rx=0 tx=0).stop 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 -- 172.21.15.2:0/3161884858 shutdown_connections 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60e8d80 0x5614f60ea6b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60dcdf0 0x5614f60ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 --2- 172.21.15.2:0/3161884858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dc4d0 0x5614f60f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 -- 172.21.15.2:0/3161884858 >> 172.21.15.2:0/3161884858 conn(0x5614f60da300 msgr2=0x5614f60e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 -- 172.21.15.2:0/3161884858 shutdown_connections 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.828+0000 7f09c4416740 1 -- 172.21.15.2:0/3161884858 wait complete. 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 -- start start 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 Processor -- start 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 0x5614f60f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dcdf0 0x5614f60f1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60ebc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1b1ad0 con 0x5614f60dc4d0 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1b1400 con 0x5614f60e8d80 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1ae640 con 0x5614f60dcdf0 2024-09-10T23:28:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09c4416740 10 client.0 _ll_register_callbacks cb 0x7f09b0032d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 0x5614f60f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 0x5614f60f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52348/0 (socket says 172.21.15.2:52348) 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.829+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3304133487 learned_addr learned my addr 172.21.15.2:0/3304133487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09baffd640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dcdf0 0x5614f60f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bbfff640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60ebc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dcdf0 msgr2=0x5614f60f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dcdf0 0x5614f60f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3304133487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 msgr2=0x5614f60ebc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:00.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60ebc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bb7fe640 1 -- 172.21.15.2:0/3304133487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f60ec480 con 0x5614f60dc4d0 2024-09-10T23:28:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09baffd640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dcdf0 0x5614f60f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bbfff640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60ebc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 0x5614f60f0e80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0e3c70 tx=0x7f09ac0a8590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff519d4e913422 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f099affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:00.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f099affd640 1 -- 172.21.15.2:0/3304133487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0b2230 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f099affd640 1 -- 172.21.15.2:0/3304133487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f09ac0a7f90 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09b4016cc0 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f099affd640 1 -- 172.21.15.2:0/3304133487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f09ac0b5b50 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09c4416740 10 client.16620 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5614f61661a0 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.830+0000 7f099affd640 1 -- 172.21.15.2:0/3304133487 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b4016cc0 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f099affd640 1 -- 172.21.15.2:0/3304133487 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f09ac0a8830 con 0x5614f60dc4d0 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09c4416740 10 client.16620 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:00.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09c4416740 10 client.16620 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09c4416740 20 client.16620 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09c4416740 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f6166530 0x5614f6168920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09c4416740 4 client.16620 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614f604dcd0 con 0x5614f6166530 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09baffd640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f6166530 0x5614f6168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f09baffd640 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f6166530 0x5614f6168920 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ad734a9c22a4f74 server_cookie=9c6c4c8da27d370b in_seq=0 out_seq=0 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.831+0000 7f099affd640 10 client.16620 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f099affd640 1 -- 172.21.15.2:0/3304133487 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614f604dcd0 con 0x5614f6166530 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f099affd640 10 client.16620 handle_command_reply: tid=0 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 client.16620 shutdown 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 msgr2=0x5614f60f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 0x5614f60f0e80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0e3c70 tx=0x7f09ac0a8590 comp rx=0 tx=0).stop 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 shutdown_connections 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5614f6166530 0x5614f6168920 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f60e8d80 0x5614f60ebc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5614f60dcdf0 0x5614f60f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f099affd640 0 client.16620 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 --2- 172.21.15.2:0/3304133487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614f60dc4d0 0x5614f60f0e80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 >> 172.21.15.2:0/3304133487 conn(0x5614f60da300 msgr2=0x5614f60e70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 shutdown_connections 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 1 -- 172.21.15.2:0/3304133487 wait complete. 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c4416740 20 client.16620 trim_cache size 0 max 16384 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09a40b52e0 msgr2=0x7f09a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09a40b52e0 0x7f09a40b77a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f09b400a4e0 tx=0x7f09b400c040 comp rx=0 tx=0).stop 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 msgr2=0x7f09bc19b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 0x7f09bc19b490 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00c920 tx=0x7f09ac00cde0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 shutdown_connections 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f09a40b52e0 0x7f09a40b77a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09bc109150 0x7f09bc1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09bc1087d0 0x7f09bc19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 --2- 172.21.15.2:0/2729049142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc102dc0 0x7f09bc19b490 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.832+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 >> 172.21.15.2:0/2729049142 conn(0x7f09bc0fe830 msgr2=0x7f09bc105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.833+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 shutdown_connections 2024-09-10T23:28:00.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:00.833+0000 7f09c2041640 1 -- 172.21.15.2:0/2729049142 wait complete. 2024-09-10T23:28:01.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:28:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:02.292 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:02 smithi002 ceph-mon[31150]: pgmap v462: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:02.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:02 smithi177 ceph-mon[35760]: pgmap v462: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 -- 172.21.15.2:0/1823173206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 msgr2=0x7f7900107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 --2- 172.21.15.2:0/1823173206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f7900107b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009900 tx=0x7f78e802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 -- 172.21.15.2:0/1823173206 shutdown_connections 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 --2- 172.21.15.2:0/1823173206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7900108040 0x7f790010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 --2- 172.21.15.2:0/1823173206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f7900107b00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 --2- 172.21.15.2:0/1823173206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900101cb0 0x7f7900102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 -- 172.21.15.2:0/1823173206 >> 172.21.15.2:0/1823173206 conn(0x7f79000fd700 msgr2=0x7f79000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 -- 172.21.15.2:0/1823173206 shutdown_connections 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.495+0000 7f7906bba640 1 -- 172.21.15.2:0/1823173206 wait complete. 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 Processor -- start 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 -- start start 2024-09-10T23:28:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7900101cb0 0x7f790019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f790019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900108040 0x7f79001a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7900112e10 con 0x7f79001076c0 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7900112c90 con 0x7f7900108040 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7906bba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7900112f90 con 0x7f7900101cb0 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f790019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f790019b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33452/0 (socket says 172.21.15.2:33452) 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 -- 172.21.15.2:0/340391581 learned_addr learned my addr 172.21.15.2:0/340391581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7904956640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7900101cb0 0x7f790019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7905157640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900108040 0x7f79001a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 -- 172.21.15.2:0/340391581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7900101cb0 msgr2=0x7f790019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7900101cb0 0x7f790019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 -- 172.21.15.2:0/340391581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900108040 msgr2=0x7f79001a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900108040 0x7f79001a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f78fffff640 1 -- 172.21.15.2:0/340391581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79001a14c0 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.496+0000 7f7905157640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900108040 0x7f79001a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.497+0000 7f78fffff640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f790019b950 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f78e8005ab0 tx=0x7f78e8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.497+0000 7f78fdffb640 1 -- 172.21.15.2:0/340391581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e803f070 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.497+0000 7f78fdffb640 1 -- 172.21.15.2:0/340391581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e8031d60 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.497+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79001a1750 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.497+0000 7f78fdffb640 1 -- 172.21.15.2:0/340391581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8035030 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.497+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79001a7e70 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f78fdffb640 1 -- 172.21.15.2:0/340391581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f78e803b460 con 0x7f79001076c0 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 Processor -- start 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 -- start start 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a820f0 0x55c396a824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a8e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a8e9a0 0x55c396a90d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c3969f8ea0 con 0x55c396a82a10 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c3969e82d0 con 0x55c396a820f0 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7908f8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c3969ec0e0 con 0x55c396a8e9a0 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7904956640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a8e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7904956640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a8e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33464/0 (socket says 172.21.15.2:33464) 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7904956640 1 -- 172.21.15.2:0/3498868177 learned_addr learned my addr 172.21.15.2:0/3498868177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7905157640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a820f0 0x55c396a824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f78fffff640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a8e9a0 0x55c396a90d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7904956640 1 -- 172.21.15.2:0/3498868177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a8e9a0 msgr2=0x55c396a90d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.500+0000 7f7904956640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a8e9a0 0x55c396a90d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f7904956640 1 -- 172.21.15.2:0/3498868177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a820f0 msgr2=0x55c396a824d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78fdffb640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78ec0b52e0 0x7f78ec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f7904956640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a820f0 0x55c396a824d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f7904956640 1 -- 172.21.15.2:0/3498868177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c396746650 con 0x55c396a82a10 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78fffff640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a8e9a0 0x55c396a90d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f7905157640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a820f0 0x55c396a824d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f7904956640 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a8e460 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ad00 tx=0x7f78f000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e1e6d2a06b1c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78fffff640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78ec0b52e0 0x7f78ec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78fdffb640 1 -- 172.21.15.2:0/340391581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78e81067b0 con 0x7f79001076c0 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78f6ffd640 1 -- 172.21.15.2:0/3498868177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f001d070 con 0x55c396a82a10 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78f6ffd640 1 -- 172.21.15.2:0/3498868177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f0018af0 con 0x55c396a82a10 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.501+0000 7f78f6ffd640 1 -- 172.21.15.2:0/3498868177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0010b50 con 0x55c396a82a10 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 -- 172.21.15.2:0/3498868177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 msgr2=0x55c396a8e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f78fffff640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78ec0b52e0 0x7f78ec0b77a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8031f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a8e460 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ad00 tx=0x7f78f000f790 comp rx=0 tx=0).stop 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 -- 172.21.15.2:0/3498868177 shutdown_connections 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a8e9a0 0x55c396a90d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a8e460 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 --2- 172.21.15.2:0/3498868177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a820f0 0x55c396a824d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 -- 172.21.15.2:0/3498868177 >> 172.21.15.2:0/3498868177 conn(0x55c396a7ff20 msgr2=0x55c396a810c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 -- 172.21.15.2:0/3498868177 shutdown_connections 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 -- 172.21.15.2:0/3498868177 wait complete. 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 -- start start 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.502+0000 7f7908f8f740 1 Processor -- start 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a8e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a82a10 0x55c396a8b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 0x55c396a8bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c396849700 con 0x55c396a8e9a0 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c396983160 con 0x55c396a82a10 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c396a91620 con 0x55c396a820f0 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 10 client.0 _ll_register_callbacks cb 0x55c39699c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 0x55c396a8bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 0x55c396a8bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33472/0 (socket says 172.21.15.2:33472) 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 -- 172.21.15.2:0/236971371 learned_addr learned my addr 172.21.15.2:0/236971371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a8e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7904956640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a82a10 0x55c396a8b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 -- 172.21.15.2:0/236971371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 msgr2=0x55c396a8e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a8e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 -- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a82a10 msgr2=0x55c396a8b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a82a10 0x55c396a8b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 -- 172.21.15.2:0/236971371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3969b0c90 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7904956640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a82a10 0x55c396a8b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7905157640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 0x55c396a8bd40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f78f8013b60 tx=0x7f78f8009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f2c6fdbc03e8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f78dffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f78dffff640 1 -- 172.21.15.2:0/236971371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8012450 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f78dffff640 1 -- 172.21.15.2:0/236971371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78f80125f0 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f0018af0 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.503+0000 7f78dffff640 1 -- 172.21.15.2:0/236971371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78f8026050 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 10 client.16632 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c396a9cf50 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f78dffff640 1 -- 172.21.15.2:0/236971371 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f0018af0 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f78dffff640 1 -- 172.21.15.2:0/236971371 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78f800f630 con 0x55c396a8e9a0 2024-09-10T23:28:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 10 client.16632 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 10 client.16632 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 20 client.16632 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396a9e3b0 0x55c396aa07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 4 client.16632 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3969fadf0 con 0x55c396a9e3b0 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.504+0000 7f7904956640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396a9e3b0 0x55c396aa07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.505+0000 7f78dffff640 10 client.16632 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.505+0000 7f7904956640 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396a9e3b0 0x55c396aa07a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4e5eb3311d47033 server_cookie=293422dd96ea1a17 in_seq=0 out_seq=0 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.505+0000 7f78dffff640 1 -- 172.21.15.2:0/236971371 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3969fadf0 con 0x55c396a9e3b0 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.505+0000 7f78dffff640 10 client.16632 handle_command_reply: tid=0 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.505+0000 7f7908f8f740 1 client.16632 shutdown 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 msgr2=0x55c396a8bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 0x55c396a8bd40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f78f8013b60 tx=0x7f78f8009a10 comp rx=0 tx=0).stop 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 shutdown_connections 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396a9e3b0 0x55c396aa07a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a8e9a0 0x55c396a8bd40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a82a10 0x55c396a8b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 --2- 172.21.15.2:0/236971371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a8e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f78dffff640 0 client.16632 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 >> 172.21.15.2:0/236971371 conn(0x55c396a7ff20 msgr2=0x55c396a85ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 shutdown_connections 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 1 -- 172.21.15.2:0/236971371 wait complete. 2024-09-10T23:28:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.506+0000 7f7908f8f740 20 client.16632 trim_cache size 0 max 16384 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.519+0000 7f7908f8f740 1 Processor -- start 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.519+0000 7f7908f8f740 1 -- start start 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 0x55c396a8d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a82a10 0x55c396a8fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a902d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7908f8f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79001b0520 con 0x55c396a820f0 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7908f8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79001b2060 con 0x55c396a8e9a0 2024-09-10T23:28:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7908f8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79001b0bf0 con 0x55c396a82a10 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 0x55c396a8d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 0x55c396a8d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33482/0 (socket says 172.21.15.2:33482) 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 -- 172.21.15.2:0/1024007850 learned_addr learned my addr 172.21.15.2:0/1024007850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7904956640 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a82a10 0x55c396a8fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a902d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 -- 172.21.15.2:0/1024007850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a82a10 msgr2=0x55c396a8fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a82a10 0x55c396a8fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 -- 172.21.15.2:0/1024007850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 msgr2=0x55c396a902d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a902d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 -- 172.21.15.2:0/1024007850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c396aa0b10 con 0x55c396a820f0 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f7905157640 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 0x55c396a8d450 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f78f8013b30 tx=0x7f78f8013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8867b5167fdc8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f78f67fc640 1 -- 172.21.15.2:0/1024007850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8009a80 con 0x55c396a820f0 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f78f67fc640 1 -- 172.21.15.2:0/1024007850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f8032070 con 0x55c396a820f0 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.520+0000 7f78f67fc640 1 -- 172.21.15.2:0/1024007850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f801f680 con 0x55c396a820f0 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 -- 172.21.15.2:0/1024007850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 msgr2=0x55c396a8d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 0x55c396a8d450 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f78f8013b30 tx=0x7f78f8013680 comp rx=0 tx=0).stop 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 -- 172.21.15.2:0/1024007850 shutdown_connections 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a902d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a82a10 0x55c396a8fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1024007850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a820f0 0x55c396a8d450 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 -- 172.21.15.2:0/1024007850 >> 172.21.15.2:0/1024007850 conn(0x55c396a7ff20 msgr2=0x55c396a8cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 -- 172.21.15.2:0/1024007850 shutdown_connections 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 -- 172.21.15.2:0/1024007850 wait complete. 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.521+0000 7f7908f8f740 1 -- start start 2024-09-10T23:28:02.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 Processor -- start 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a91870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a91db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a922f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79001b1990 con 0x55c396a82a10 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79001b12c0 con 0x55c396a8e9a0 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79001ae500 con 0x55c396a820f0 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7908f8f740 10 client.0 _ll_register_callbacks cb 0x7f78f80098b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a91db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a91db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33484/0 (socket says 172.21.15.2:33484) 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 -- 172.21.15.2:0/1302715275 learned_addr learned my addr 172.21.15.2:0/1302715275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7905157640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a91870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7905157640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 -- 172.21.15.2:0/1302715275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 msgr2=0x55c396a91870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a91870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 -- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 msgr2=0x55c396a922f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a922f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.522+0000 7f7904956640 1 -- 172.21.15.2:0/1302715275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c396b0b2c0 con 0x55c396a82a10 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f7905157640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a91870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f7904956640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a91db0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f78f000fc90 tx=0x7f78f000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5a4a7f863c8bee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f78dffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f78dffff640 1 -- 172.21.15.2:0/1302715275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f002f020 con 0x55c396a82a10 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f78dffff640 1 -- 172.21.15.2:0/1302715275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78f0018980 con 0x55c396a82a10 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f8032070 con 0x55c396a82a10 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f78dffff640 1 -- 172.21.15.2:0/1302715275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78f001d040 con 0x55c396a82a10 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f7908f8f740 10 client.16638 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c396b0c5f0 con 0x55c396a82a10 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f78dffff640 1 -- 172.21.15.2:0/1302715275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f8032070 con 0x55c396a82a10 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.523+0000 7f78dffff640 1 -- 172.21.15.2:0/1302715275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78f0004b80 con 0x55c396a82a10 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7908f8f740 10 client.16638 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7908f8f740 10 client.16638 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7908f8f740 20 client.16638 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396b0cc10 0x55c396b0f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7908f8f740 4 client.16638 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3969f68a0 con 0x55c396b0cc10 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7905157640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396b0cc10 0x55c396b0f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f7905157640 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396b0cc10 0x55c396b0f030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e34dbb757b690bc2 server_cookie=f0cec6e7eb920035 in_seq=0 out_seq=0 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.524+0000 7f78dffff640 10 client.16638 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f78dffff640 1 -- 172.21.15.2:0/1302715275 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3969f68a0 con 0x55c396b0cc10 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f78dffff640 10 client.16638 handle_command_reply: tid=0 2024-09-10T23:28:02.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 client.16638 shutdown 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 msgr2=0x55c396a91db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a91db0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f78f000fc90 tx=0x7f78f000a890 comp rx=0 tx=0).stop 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 shutdown_connections 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c396a8e9a0 0x55c396a922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55c396b0cc10 0x55c396b0f030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c396a82a10 0x55c396a91db0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 --2- 172.21.15.2:0/1302715275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c396a820f0 0x55c396a91870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f78dffff640 0 client.16638 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 >> 172.21.15.2:0/1302715275 conn(0x55c396a7ff20 msgr2=0x55c396a8d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 shutdown_connections 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 1 -- 172.21.15.2:0/1302715275 wait complete. 2024-09-10T23:28:02.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.525+0000 7f7908f8f740 20 client.16638 trim_cache size 0 max 16384 2024-09-10T23:28:02.534 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:02.534 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:02 smithi154 ceph-mon[35136]: pgmap v462: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78ec0b52e0 msgr2=0x7f78ec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78ec0b52e0 0x7f78ec0b77a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8031f10 comp rx=0 tx=0).stop 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 msgr2=0x7f790019b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f790019b950 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f78e8005ab0 tx=0x7f78e8003cd0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 shutdown_connections 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78ec0b52e0 0x7f78ec0b77a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7900108040 0x7f79001a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79001076c0 0x7f790019b950 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 --2- 172.21.15.2:0/340391581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7900101cb0 0x7f790019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:02.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 >> 172.21.15.2:0/340391581 conn(0x7f79000fd700 msgr2=0x7f7900100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:02.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 shutdown_connections 2024-09-10T23:28:02.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:02.526+0000 7f7906bba640 1 -- 172.21.15.2:0/340391581 wait complete. 2024-09-10T23:28:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 -- 172.21.15.2:0/1922552278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c103ad0 msgr2=0x7fdf1c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/1922552278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c103f50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009930 tx=0x7fdf1002a420 comp rx=0 tx=0).stop 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 -- 172.21.15.2:0/1922552278 shutdown_connections 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/1922552278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c104490 0x7fdf1c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/1922552278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c103f50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/1922552278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf1c102980 0x7fdf1c102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 -- 172.21.15.2:0/1922552278 >> 172.21.15.2:0/1922552278 conn(0x7fdf1c0fe240 msgr2=0x7fdf1c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 -- 172.21.15.2:0/1922552278 shutdown_connections 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.105+0000 7fdf20fb4640 1 -- 172.21.15.2:0/1922552278 wait complete. 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 Processor -- start 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 -- start start 2024-09-10T23:28:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf1c102980 0x7fdf1c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 0x7fdf1c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c10e640 con 0x7fdf1c104490 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c10e4c0 con 0x7fdf1c102980 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf20fb4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c10e7c0 con 0x7fdf1c103ad0 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 0x7fdf1c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 0x7fdf1c19a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33496/0 (socket says 172.21.15.2:33496) 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 -- 172.21.15.2:0/150523891 learned_addr learned my addr 172.21.15.2:0/150523891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf1c102980 0x7fdf1c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 -- 172.21.15.2:0/150523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c103ad0 msgr2=0x7fdf1c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 -- 172.21.15.2:0/150523891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf1c102980 msgr2=0x7fdf1c198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf1c102980 0x7fdf1c198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf1ad9d640 1 -- 172.21.15.2:0/150523891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c19a930 con 0x7fdf1c104490 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.106+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.107+0000 7fdf1ad9d640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 0x7fdf1c19a070 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400eb10 tx=0x7fdf1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.107+0000 7fdf0b7fe640 1 -- 172.21.15.2:0/150523891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14004b20 con 0x7fdf1c104490 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.107+0000 7fdf0b7fe640 1 -- 172.21.15.2:0/150523891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf14004cc0 con 0x7fdf1c104490 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.107+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1c19ac20 con 0x7fdf1c104490 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.107+0000 7fdf0b7fe640 1 -- 172.21.15.2:0/150523891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14010670 con 0x7fdf1c104490 2024-09-10T23:28:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.107+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1c1a12f0 con 0x7fdf1c104490 2024-09-10T23:28:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.110+0000 7fdf23e61740 1 Processor -- start 2024-09-10T23:28:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.110+0000 7fdf0b7fe640 1 -- 172.21.15.2:0/150523891 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdf14010810 con 0x7fdf1c104490 2024-09-10T23:28:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.110+0000 7fdf23e61740 1 -- start start 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78bf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf23e61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647b782c6f0 con 0x5647b78bd190 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf23e61740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647b781bb20 con 0x5647b78bfbd0 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf23e61740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5647b781f930 con 0x5647b78ba860 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33502/0 (socket says 172.21.15.2:33502) 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 -- 172.21.15.2:0/2760457432 learned_addr learned my addr 172.21.15.2:0/2760457432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 -- 172.21.15.2:0/2760457432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 msgr2=0x5647b78bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf0b7fe640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf040b52e0 0x7fdf040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 -- 172.21.15.2:0/2760457432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 msgr2=0x5647b78c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1a59c640 1 -- 172.21.15.2:0/2760457432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647b77e1530 con 0x5647b78bd190 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.111+0000 7fdf1ad9d640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf040b52e0 0x7fdf040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78bf580 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009cf0 tx=0x7fdf0c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca3ede16a20bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf0b7fe640 1 -- 172.21.15.2:0/150523891 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdf140e6100 con 0x7fdf1c104490 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf08ff9640 1 -- 172.21.15.2:0/2760457432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c004230 con 0x5647b78bd190 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf08ff9640 1 -- 172.21.15.2:0/2760457432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c0043d0 con 0x5647b78bd190 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf08ff9640 1 -- 172.21.15.2:0/2760457432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c019840 con 0x5647b78bd190 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf23e61740 1 -- 172.21.15.2:0/2760457432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 msgr2=0x5647b78bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf1ad9d640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf040b52e0 0x7fdf040b77a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdf1405cb90 tx=0x7fdf14000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.112+0000 7fdf23e61740 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78bf580 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009cf0 tx=0x7fdf0c011810 comp rx=0 tx=0).stop 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- 172.21.15.2:0/2760457432 shutdown_connections 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78bf580 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 --2- 172.21.15.2:0/2760457432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- 172.21.15.2:0/2760457432 >> 172.21.15.2:0/2760457432 conn(0x5647b78b59b0 msgr2=0x5647b78b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- 172.21.15.2:0/2760457432 shutdown_connections 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- 172.21.15.2:0/2760457432 wait complete. 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- start start 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 Processor -- start 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78ba860 0x5647b78c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78bfbd0 0x5647b78c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647b7753ab0 con 0x5647b78bd190 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647b77c1730 con 0x5647b78ba860 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5647b78c2bb0 con 0x5647b78bfbd0 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf23e61740 10 client.0 _ll_register_callbacks cb 0x5647b78156b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33518/0 (socket says 172.21.15.2:33518) 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.113+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3959804262 learned_addr learned my addr 172.21.15.2:0/3959804262 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78bfbd0 0x5647b78c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78ba860 0x5647b78c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78bfbd0 msgr2=0x5647b78c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78bfbd0 0x5647b78c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3959804262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78ba860 msgr2=0x5647b78c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78ba860 0x5647b78c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3959804262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647b757d790 con 0x5647b78bd190 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78ba860 0x5647b78c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c4560 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf96088427bd1583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3959804262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c027070 con 0x5647b78bd190 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3959804262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdf0c005240 con 0x5647b78bd190 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf0c0043d0 con 0x5647b78bd190 2024-09-10T23:28:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.114+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3959804262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdf0c033050 con 0x5647b78bd190 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 10 client.16650 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647b75f6620 con 0x5647b78bd190 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3959804262 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c0043d0 con 0x5647b78bd190 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3959804262 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdf0c004c00 con 0x5647b78bd190 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 10 client.16650 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 10 client.16650 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 20 client.16650 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b78d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 4 client.16650 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647b782e640 con 0x5647b78cf5b0 2024-09-10T23:28:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.115+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b78d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.116+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b78d19a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79dc1b125b7c1017 server_cookie=bf453227b2adc8f3 in_seq=0 out_seq=0 2024-09-10T23:28:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.116+0000 7fdf01ffb640 10 client.16650 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3959804262 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5647b782e640 con 0x5647b78cf5b0 2024-09-10T23:28:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf01ffb640 10 client.16650 handle_command_reply: tid=0 2024-09-10T23:28:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 client.16650 shutdown 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 msgr2=0x5647b78c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c4560 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c003820 comp rx=0 tx=0).stop 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 shutdown_connections 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b78d19a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78bfbd0 0x5647b78c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf01ffb640 0 client.16650 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c4560 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3959804262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78ba860 0x5647b78c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 >> 172.21.15.2:0/3959804262 conn(0x5647b78b59b0 msgr2=0x5647b78b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 shutdown_connections 2024-09-10T23:28:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 1 -- 172.21.15.2:0/3959804262 wait complete. 2024-09-10T23:28:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.117+0000 7fdf23e61740 20 client.16650 trim_cache size 0 max 16384 2024-09-10T23:28:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 Processor -- start 2024-09-10T23:28:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 -- start start 2024-09-10T23:28:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1a9fd0 con 0x5647b78bd190 2024-09-10T23:28:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1abb10 con 0x5647b78bfbd0 2024-09-10T23:28:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf23e61740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1aa6a0 con 0x5647b78ba860 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33526/0 (socket says 172.21.15.2:33526) 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.132+0000 7fdf1a59c640 1 -- 172.21.15.2:0/1994021274 learned_addr learned my addr 172.21.15.2:0/1994021274 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf1a59c640 1 -- 172.21.15.2:0/1994021274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 msgr2=0x5647b78c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf1a59c640 1 -- 172.21.15.2:0/1994021274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 msgr2=0x5647b78c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf1a59c640 1 -- 172.21.15.2:0/1994021274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647b78d1d10 con 0x5647b78bd190 2024-09-10T23:28:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c3100 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c006010 tx=0x7fdf0c011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba0fbfd9d7d987b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf03fff640 1 -- 172.21.15.2:0/1994021274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c027070 con 0x5647b78bd190 2024-09-10T23:28:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf03fff640 1 -- 172.21.15.2:0/1994021274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c009910 con 0x5647b78bd190 2024-09-10T23:28:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.133+0000 7fdf03fff640 1 -- 172.21.15.2:0/1994021274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c004610 con 0x5647b78bd190 2024-09-10T23:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 -- 172.21.15.2:0/1994021274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 msgr2=0x5647b78c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c3100 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c006010 tx=0x7fdf0c011d30 comp rx=0 tx=0).stop 2024-09-10T23:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 -- 172.21.15.2:0/1994021274 shutdown_connections 2024-09-10T23:28:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78c3100 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 --2- 172.21.15.2:0/1994021274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 -- 172.21.15.2:0/1994021274 >> 172.21.15.2:0/1994021274 conn(0x5647b78b59b0 msgr2=0x5647b78c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 -- 172.21.15.2:0/1994021274 shutdown_connections 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 -- 172.21.15.2:0/1994021274 wait complete. 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 -- start start 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.134+0000 7fdf23e61740 1 Processor -- start 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1ab440 con 0x5647b78bd190 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1aad70 con 0x5647b78bfbd0 2024-09-10T23:28:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1a7fb0 con 0x5647b78ba860 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 10 client.0 _ll_register_callbacks cb 0x7fdf140093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33542/0 (socket says 172.21.15.2:33542) 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3636355524 learned_addr learned my addr 172.21.15.2:0/3636355524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 msgr2=0x5647b78cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3636355524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 msgr2=0x5647b78cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 -- 172.21.15.2:0/3636355524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647b78c94b0 con 0x5647b78bd190 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf1a59c640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78caa10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c011f20 tx=0x7fdf0c009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df5edf5c1dd748f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3636355524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c027070 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3636355524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdf0c005410 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf0c009910 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.135+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3636355524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdf0c023460 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 10 client.16656 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647b793c700 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3636355524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c009910 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3636355524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdf0c02c560 con 0x5647b78bd190 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 10 client.16656 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 20 client.16656 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b793f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 4 client.16656 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:28:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647b782a0f0 con 0x5647b78cf5b0 2024-09-10T23:28:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.136+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b793f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.137+0000 7fdf19d9b640 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b793f030 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85dc025646cd03b5 server_cookie=d5774249bb68f63 in_seq=0 out_seq=0 2024-09-10T23:28:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.137+0000 7fdf01ffb640 10 client.16656 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf01ffb640 1 -- 172.21.15.2:0/3636355524 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5647b782a0f0 con 0x5647b78cf5b0 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf01ffb640 10 client.16656 handle_command_reply: tid=0 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 client.16656 shutdown 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 msgr2=0x5647b78caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78caa10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c011f20 tx=0x7fdf0c009290 comp rx=0 tx=0).stop 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 shutdown_connections 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5647b78cf5b0 0x5647b793f030 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647b78bfbd0 0x5647b78cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf01ffb640 0 client.16656 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647b78bd190 0x5647b78caa10 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 --2- 172.21.15.2:0/3636355524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b78ba860 0x5647b78cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 >> 172.21.15.2:0/3636355524 conn(0x5647b78b59b0 msgr2=0x5647b78c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 shutdown_connections 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 1 -- 172.21.15.2:0/3636355524 wait complete. 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf23e61740 20 client.16656 trim_cache size 0 max 16384 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:28:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf040b52e0 msgr2=0x7fdf040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf040b52e0 0x7fdf040b77a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdf1405cb90 tx=0x7fdf14000f40 comp rx=0 tx=0).stop 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 msgr2=0x7fdf1c19a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.152+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 0x7fdf1c19a070 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400eb10 tx=0x7fdf1400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 shutdown_connections 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf040b52e0 0x7fdf040b77a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1c104490 0x7fdf1c19a070 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf1c103ad0 0x7fdf1c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 --2- 172.21.15.2:0/150523891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf1c102980 0x7fdf1c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 >> 172.21.15.2:0/150523891 conn(0x7fdf1c0fe240 msgr2=0x7fdf1c106e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 shutdown_connections 2024-09-10T23:28:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:03.153+0000 7fdf20fb4640 1 -- 172.21.15.2:0/150523891 wait complete. 2024-09-10T23:28:03.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:28:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:04.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:04 smithi002 ceph-mon[31150]: pgmap v463: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 -- 172.21.15.2:0/1358270808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc101c90 msgr2=0x7f52bc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/1358270808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc101c90 0x7f52bc102070 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009900 tx=0x7f52ac02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 -- 172.21.15.2:0/1358270808 shutdown_connections 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/1358270808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52bc108020 0x7f52bc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/1358270808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc1076a0 0x7f52bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/1358270808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc101c90 0x7f52bc102070 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 -- 172.21.15.2:0/1358270808 >> 172.21.15.2:0/1358270808 conn(0x7f52bc0fd700 msgr2=0x7f52bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 -- 172.21.15.2:0/1358270808 shutdown_connections 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.251+0000 7f52c2d8b640 1 -- 172.21.15.2:0/1358270808 wait complete. 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 Processor -- start 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 -- start start 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52bc101c90 0x7f52bc1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 0x7f52bc198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc108020 0x7f52bc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc111d20 con 0x7f52bc1076a0 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc111ba0 con 0x7f52bc108020 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c2d8b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc111ea0 con 0x7f52bc101c90 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 0x7f52bc198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 0x7f52bc198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33556/0 (socket says 172.21.15.2:33556) 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52bbfff640 1 -- 172.21.15.2:0/3668079334 learned_addr learned my addr 172.21.15.2:0/3668079334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c0b27640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52bc101c90 0x7f52bc1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52bbfff640 1 -- 172.21.15.2:0/3668079334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52bc101c90 msgr2=0x7f52bc1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52bbfff640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52bc101c90 0x7f52bc1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.252+0000 7f52c1328640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc108020 0x7f52bc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52bbfff640 1 -- 172.21.15.2:0/3668079334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc108020 msgr2=0x7f52bc19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52bbfff640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc108020 0x7f52bc19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52bbfff640 1 -- 172.21.15.2:0/3668079334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc19e380 con 0x7f52bc1076a0 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52c1328640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc108020 0x7f52bc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52bbfff640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 0x7f52bc198810 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f52a400d990 tx=0x7f52a400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52b9ffb640 1 -- 172.21.15.2:0/3668079334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a401b070 con 0x7f52bc1076a0 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52b9ffb640 1 -- 172.21.15.2:0/3668079334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a400edf0 con 0x7f52bc1076a0 2024-09-10T23:28:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc19e670 con 0x7f52bc1076a0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52b9ffb640 1 -- 172.21.15.2:0/3668079334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4014800 con 0x7f52bc1076a0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.253+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc06ab30 con 0x7f52bc1076a0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52b9ffb640 1 -- 172.21.15.2:0/3668079334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f52a400e040 con 0x7f52bc1076a0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 Processor -- start 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 -- start start 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a34d0 0x56135d6a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 0x56135d6af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56135d619ea0 con 0x56135d6a3df0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56135d6092d0 con 0x56135d6a34d0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c5160740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56135d60d0e0 con 0x56135d6afd80 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 0x56135d6af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 0x56135d6af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33566/0 (socket says 172.21.15.2:33566) 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 -- 172.21.15.2:0/4191736557 learned_addr learned my addr 172.21.15.2:0/4191736557 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52bbfff640 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c1328640 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a34d0 0x56135d6a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 -- 172.21.15.2:0/4191736557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 msgr2=0x56135d6b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 -- 172.21.15.2:0/4191736557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a34d0 msgr2=0x56135d6a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a34d0 0x56135d6a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.256+0000 7f52c0b27640 1 -- 172.21.15.2:0/4191736557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56135d367650 con 0x56135d6a3df0 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52b9ffb640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52a80b52e0 0x7f52a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52c0b27640 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 0x56135d6af840 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f52ac02a910 tx=0x7f52ac031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69830c728f6f8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52c1328640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52a80b52e0 0x7f52a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52b2ffd640 1 -- 172.21.15.2:0/4191736557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac03f070 con 0x56135d6a3df0 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52b9ffb640 1 -- 172.21.15.2:0/3668079334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52a40e7400 con 0x7f52bc1076a0 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52b2ffd640 1 -- 172.21.15.2:0/4191736557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac0316a0 con 0x56135d6a3df0 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.257+0000 7f52b2ffd640 1 -- 172.21.15.2:0/4191736557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac035070 con 0x56135d6a3df0 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 -- 172.21.15.2:0/4191736557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 msgr2=0x56135d6af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c1328640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52a80b52e0 0x7f52a80b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f52b4007f90 tx=0x7f52b4007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:04.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 0x56135d6af840 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f52ac02a910 tx=0x7f52ac031cd0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 -- 172.21.15.2:0/4191736557 shutdown_connections 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a3df0 0x56135d6af840 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 --2- 172.21.15.2:0/4191736557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a34d0 0x56135d6a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 -- 172.21.15.2:0/4191736557 >> 172.21.15.2:0/4191736557 conn(0x56135d6a1300 msgr2=0x56135d6a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 -- 172.21.15.2:0/4191736557 shutdown_connections 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 -- 172.21.15.2:0/4191736557 wait complete. 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 -- start start 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.258+0000 7f52c5160740 1 Processor -- start 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6a3df0 0x56135d6acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6afd80 0x56135d6ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56135d46a700 con 0x56135d6a34d0 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56135d5a4160 con 0x56135d6afd80 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56135d6b29a0 con 0x56135d6a3df0 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c5160740 10 client.0 _ll_register_callbacks cb 0x56135d5bd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33582/0 (socket says 172.21.15.2:33582) 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 -- 172.21.15.2:0/2794775706 learned_addr learned my addr 172.21.15.2:0/2794775706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6a3df0 0x56135d6acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c1328640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6afd80 0x56135d6ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 -- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6a3df0 msgr2=0x56135d6acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6a3df0 0x56135d6acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 -- 172.21.15.2:0/2794775706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6afd80 msgr2=0x56135d6ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6afd80 0x56135d6ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 -- 172.21.15.2:0/2794775706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56135d5d1c90 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6af660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f52ac031440 tx=0x7f52ac0092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921351b09c654fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f529bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.259+0000 7f529bfff640 1 -- 172.21.15.2:0/2794775706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac04a070 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f529bfff640 1 -- 172.21.15.2:0/2794775706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52ac004bb0 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52ac0316a0 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f529bfff640 1 -- 172.21.15.2:0/2794775706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52ac056050 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 10 client.16668 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56135d6be2c0 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f529bfff640 1 -- 172.21.15.2:0/2794775706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac0316a0 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f529bfff640 1 -- 172.21.15.2:0/2794775706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52ac03b430 con 0x56135d6a34d0 2024-09-10T23:28:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 10 client.16668 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 20 client.16668 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d6bf610 0x56135d6c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 4 client.16668 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56135d61bdf0 con 0x56135d6bf610 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.260+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d6bf610 0x56135d6c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.261+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d6bf610 0x56135d6c1a00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcfd92b463629b51 server_cookie=1b20b84995c6531 in_seq=0 out_seq=0 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.261+0000 7f529bfff640 10 client.16668 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.261+0000 7f529bfff640 1 -- 172.21.15.2:0/2794775706 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56135d61bdf0 con 0x56135d6bf610 2024-09-10T23:28:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f529bfff640 10 client.16668 handle_command_reply: tid=0 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 client.16668 shutdown 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 msgr2=0x56135d6af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6af660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f52ac031440 tx=0x7f52ac0092b0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 shutdown_connections 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d6bf610 0x56135d6c1a00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6afd80 0x56135d6ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6a3df0 0x56135d6acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f529bfff640 0 client.16668 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 --2- 172.21.15.2:0/2794775706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6af660 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 >> 172.21.15.2:0/2794775706 conn(0x56135d6a1300 msgr2=0x56135d6a6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 shutdown_connections 2024-09-10T23:28:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 1 -- 172.21.15.2:0/2794775706 wait complete. 2024-09-10T23:28:04.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.262+0000 7f52c5160740 20 client.16668 trim_cache size 0 max 16384 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.275+0000 7f52c5160740 1 Processor -- start 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.275+0000 7f52c5160740 1 -- start start 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.275+0000 7f52c5160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.275+0000 7f52c5160740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.275+0000 7f52c5160740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.275+0000 7f52c5160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1ac270 con 0x56135d6a34d0 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c5160740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1addb0 con 0x56135d6a3df0 2024-09-10T23:28:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c5160740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1ac940 con 0x56135d6afd80 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33584/0 (socket says 172.21.15.2:33584) 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 -- 172.21.15.2:0/2660578131 learned_addr learned my addr 172.21.15.2:0/2660578131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c1328640 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 -- 172.21.15.2:0/2660578131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 msgr2=0x56135d6aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 -- 172.21.15.2:0/2660578131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 msgr2=0x56135d6ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 -- 172.21.15.2:0/2660578131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56135d69cbb0 con 0x56135d6a34d0 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6a0c10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f52ac02a430 tx=0x7f52ac005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e38c172a766d96e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52b27fc640 1 -- 172.21.15.2:0/2660578131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac04a070 con 0x56135d6a34d0 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52b27fc640 1 -- 172.21.15.2:0/2660578131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac03b430 con 0x56135d6a34d0 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.276+0000 7f52b27fc640 1 -- 172.21.15.2:0/2660578131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac03f030 con 0x56135d6a34d0 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 -- 172.21.15.2:0/2660578131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 msgr2=0x56135d6a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6a0c10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f52ac02a430 tx=0x7f52ac005a20 comp rx=0 tx=0).stop 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 -- 172.21.15.2:0/2660578131 shutdown_connections 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d6aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 --2- 172.21.15.2:0/2660578131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6a0c10 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 -- 172.21.15.2:0/2660578131 >> 172.21.15.2:0/2660578131 conn(0x56135d6a1300 msgr2=0x56135d6ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 -- 172.21.15.2:0/2660578131 shutdown_connections 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 -- 172.21.15.2:0/2660578131 wait complete. 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 -- start start 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.277+0000 7f52c5160740 1 Processor -- start 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d72b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1ad6e0 con 0x56135d6a34d0 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1ad010 con 0x56135d6a3df0 2024-09-10T23:28:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1aa250 con 0x56135d6afd80 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c5160740 10 client.0 _ll_register_callbacks cb 0x7f52a40ead10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33588/0 (socket says 172.21.15.2:33588) 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 -- 172.21.15.2:0/2932780609 learned_addr learned my addr 172.21.15.2:0/2932780609 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c1328640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d72b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 -- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 msgr2=0x56135d72b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d72b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 -- 172.21.15.2:0/2932780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 msgr2=0x56135d6c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.278+0000 7f52c0b27640 1 -- 172.21.15.2:0/2932780609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56135d72b6c0 con 0x56135d6a34d0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c0b27640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6c2ea0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009850 tx=0x7f52ac031d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eff2aade8d0508 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f529bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f529bfff640 1 -- 172.21.15.2:0/2932780609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac03f040 con 0x56135d6a34d0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f529bfff640 1 -- 172.21.15.2:0/2932780609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52ac03bde0 con 0x56135d6a34d0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52ac03b430 con 0x56135d6a34d0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f529bfff640 1 -- 172.21.15.2:0/2932780609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52ac04a040 con 0x56135d6a34d0 2024-09-10T23:28:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 10 client.16674 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56135d72c970 con 0x56135d6a34d0 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f529bfff640 1 -- 172.21.15.2:0/2932780609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac03b430 con 0x56135d6a34d0 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f529bfff640 1 -- 172.21.15.2:0/2932780609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52ac066910 con 0x56135d6a34d0 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 10 client.16674 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 20 client.16674 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d72d050 0x56135d72f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 4 client.16674 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.279+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56135d6178a0 con 0x56135d72d050 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d72d050 0x56135d72f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52bbfff640 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d72d050 0x56135d72f470 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ce09b67287893f server_cookie=ad0417321b10091d in_seq=0 out_seq=0 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f529bfff640 10 client.16674 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f529bfff640 1 -- 172.21.15.2:0/2932780609 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56135d6178a0 con 0x56135d72d050 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f529bfff640 10 client.16674 handle_command_reply: tid=0 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52c5160740 1 client.16674 shutdown 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 msgr2=0x56135d6c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52c5160740 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6c2ea0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009850 tx=0x7f52ac031d50 comp rx=0 tx=0).stop 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 shutdown_connections 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52c5160740 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56135d72d050 0x56135d72f470 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f529bfff640 0 client.16674 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.280+0000 7f52c5160740 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56135d6afd80 0x56135d72b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c5160740 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56135d6a3df0 0x56135d6c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c5160740 1 --2- 172.21.15.2:0/2932780609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56135d6a34d0 0x56135d6c2ea0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 >> 172.21.15.2:0/2932780609 conn(0x56135d6a1300 msgr2=0x56135d6ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 shutdown_connections 2024-09-10T23:28:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c5160740 1 -- 172.21.15.2:0/2932780609 wait complete. 2024-09-10T23:28:04.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c5160740 20 client.16674 trim_cache size 0 max 16384 2024-09-10T23:28:04.300 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52a80b52e0 msgr2=0x7f52a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52a80b52e0 0x7f52a80b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f52b4007f90 tx=0x7f52b4007520 comp rx=0 tx=0).stop 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 msgr2=0x7f52bc198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 0x7f52bc198810 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f52a400d990 tx=0x7f52a400de50 comp rx=0 tx=0).stop 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 shutdown_connections 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52a80b52e0 0x7f52a80b77a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52bc108020 0x7f52bc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc1076a0 0x7f52bc198810 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 --2- 172.21.15.2:0/3668079334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52bc101c90 0x7f52bc1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.281+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 >> 172.21.15.2:0/3668079334 conn(0x7f52bc0fd700 msgr2=0x7f52bc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.282+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 shutdown_connections 2024-09-10T23:28:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:04.282+0000 7f52c2d8b640 1 -- 172.21.15.2:0/3668079334 wait complete. 2024-09-10T23:28:04.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:04 smithi177 ceph-mon[35760]: pgmap v463: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:28:04.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:04 smithi154 ceph-mon[35136]: pgmap v463: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:28:06.004 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:28:06.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:28:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:06.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:06 smithi002 ceph-mon[31150]: pgmap v464: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:06.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:06 smithi177 ceph-mon[35760]: pgmap v464: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:06.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:06 smithi154 ceph-mon[35136]: pgmap v464: 97 pgs: 97 active+clean; 2.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:28:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.786+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2193662375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20104600 msgr2=0x7f1b2010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.786+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2193662375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20104600 0x7f1b2010caf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009900 tx=0x7f1b1402a410 comp rx=0 tx=0).stop 2024-09-10T23:28:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.786+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2193662375 shutdown_connections 2024-09-10T23:28:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.786+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2193662375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2010d140 0x7f1b2010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.786+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2193662375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20104600 0x7f1b2010caf0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.786+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2193662375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b20103ce0 0x7f1b201040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2193662375 >> 172.21.15.2:0/2193662375 conn(0x7f1b200fd720 msgr2=0x7f1b200ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2193662375 shutdown_connections 2024-09-10T23:28:06.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2193662375 wait complete. 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 Processor -- start 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- start start 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 0x7f1b20199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b20104600 0x7f1b20199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2010d140 0x7f1b2019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20112db0 con 0x7f1b20103ce0 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20112c30 con 0x7f1b2010d140 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.787+0000 7f1b26cd8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20112f30 con 0x7f1b20104600 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 0x7f1b20199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 0x7f1b20199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33606/0 (socket says 172.21.15.2:33606) 2024-09-10T23:28:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 -- 172.21.15.2:0/2347078481 learned_addr learned my addr 172.21.15.2:0/2347078481 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b25275640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2010d140 0x7f1b2019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b20104600 0x7f1b20199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 -- 172.21.15.2:0/2347078481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b20104600 msgr2=0x7f1b20199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b20104600 0x7f1b20199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 -- 172.21.15.2:0/2347078481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2010d140 msgr2=0x7f1b2019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2010d140 0x7f1b2019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 -- 172.21.15.2:0/2347078481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2019f3b0 con 0x7f1b20103ce0 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b24a74640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 0x7f1b20199300 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000e9f0 tx=0x7f1b1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b1dffb640 1 -- 172.21.15.2:0/2347078481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000cd80 con 0x7f1b20103ce0 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2019f6a0 con 0x7f1b20103ce0 2024-09-10T23:28:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b1dffb640 1 -- 172.21.15.2:0/2347078481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b100054d0 con 0x7f1b20103ce0 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.788+0000 7f1b1dffb640 1 -- 172.21.15.2:0/2347078481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10010690 con 0x7f1b20103ce0 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.789+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b201a5d60 con 0x7f1b20103ce0 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 Processor -- start 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b1dffb640 1 -- 172.21.15.2:0/2347078481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1b10004e90 con 0x7f1b20103ce0 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 -- start start 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x5653099172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 0x565309923250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309925b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56530988de60 con 0x565309917800 2024-09-10T23:28:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56530987d290 con 0x565309923790 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b290ad740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5653098810a0 con 0x565309916ee0 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 0x565309923250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 0x565309923250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33612/0 (socket says 172.21.15.2:33612) 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b24a74640 1 -- 172.21.15.2:0/795998183 learned_addr learned my addr 172.21.15.2:0/795998183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b25275640 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x5653099172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.792+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309925b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b24a74640 1 -- 172.21.15.2:0/795998183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 msgr2=0x5653099172c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b24a74640 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x5653099172c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b24a74640 1 -- 172.21.15.2:0/795998183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 msgr2=0x565309925b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b24a74640 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309925b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b24a74640 1 -- 172.21.15.2:0/795998183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653095db930 con 0x565309917800 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309925b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b24a74640 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 0x565309923250 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1b100ee110 tx=0x7f1b100ee200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f58aee891603e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b06ffd640 1 -- 172.21.15.2:0/795998183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100f9070 con 0x565309917800 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b1dffb640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b080b52e0 0x7f1b080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b06ffd640 1 -- 172.21.15.2:0/795998183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b100e64d0 con 0x565309917800 2024-09-10T23:28:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b06ffd640 1 -- 172.21.15.2:0/795998183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100f4660 con 0x565309917800 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b25275640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b080b52e0 0x7f1b080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.793+0000 7f1b1dffb640 1 -- 172.21.15.2:0/2347078481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1b100e5fb0 con 0x7f1b20103ce0 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 -- 172.21.15.2:0/795998183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 msgr2=0x565309923250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b25275640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b080b52e0 0x7f1b080b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b18005fd0 tx=0x7f1b18009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 0x565309923250 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1b100ee110 tx=0x7f1b100ee200 comp rx=0 tx=0).stop 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 -- 172.21.15.2:0/795998183 shutdown_connections 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309925b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309917800 0x565309923250 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 --2- 172.21.15.2:0/795998183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x5653099172c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 -- 172.21.15.2:0/795998183 >> 172.21.15.2:0/795998183 conn(0x565309914d10 msgr2=0x565309915eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 -- 172.21.15.2:0/795998183 shutdown_connections 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 -- 172.21.15.2:0/795998183 wait complete. 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 -- start start 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.794+0000 7f1b290ad740 1 Processor -- start 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 0x5653099206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x565309920c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309921140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5653096de890 con 0x565309916ee0 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x565309817d40 con 0x565309923790 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x565309926440 con 0x565309917800 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b290ad740 10 client.0 _ll_register_callbacks cb 0x56530987bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 0x5653099206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 0x5653099206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33622/0 (socket says 172.21.15.2:33622) 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 -- 172.21.15.2:0/45452300 learned_addr learned my addr 172.21.15.2:0/45452300 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x565309920c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b25275640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309921140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 -- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 msgr2=0x565309920c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x565309920c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 -- 172.21.15.2:0/45452300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 msgr2=0x565309921140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309921140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 -- 172.21.15.2:0/45452300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56530992f7d0 con 0x565309916ee0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1b24a74640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 0x5653099206c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1b100a8df0 tx=0x7f1b10009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff3469ed97888a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.795+0000 7f1afffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1afffff640 1 -- 172.21.15.2:0/45452300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a8e70 con 0x565309916ee0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1afffff640 1 -- 172.21.15.2:0/45452300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1b100a8a90 con 0x565309916ee0 2024-09-10T23:28:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b100e64d0 con 0x565309916ee0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1afffff640 1 -- 172.21.15.2:0/45452300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b100e9c10 con 0x565309916ee0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 10 client.16686 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565309932160 con 0x565309916ee0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1afffff640 1 -- 172.21.15.2:0/45452300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b100e64d0 con 0x565309916ee0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1afffff640 1 -- 172.21.15.2:0/45452300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b100aca80 con 0x565309916ee0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 10 client.16686 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 20 client.16686 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099334b0 0x5653099358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 4 client.16686 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.796+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56530988fdb0 con 0x5653099334b0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.797+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099334b0 0x5653099358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.797+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099334b0 0x5653099358a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b85e611f9722246 server_cookie=c2654ba50700a496 in_seq=0 out_seq=0 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.797+0000 7f1afffff640 10 client.16686 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1afffff640 1 -- 172.21.15.2:0/45452300 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56530988fdb0 con 0x5653099334b0 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1afffff640 10 client.16686 handle_command_reply: tid=0 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 client.16686 shutdown 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 msgr2=0x5653099206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 0x5653099206c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1b100a8df0 tx=0x7f1b10009310 comp rx=0 tx=0).stop 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 shutdown_connections 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099334b0 0x5653099358a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309923790 0x565309921140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1afffff640 0 client.16686 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x565309920c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 --2- 172.21.15.2:0/45452300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309916ee0 0x5653099206c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 >> 172.21.15.2:0/45452300 conn(0x565309914d10 msgr2=0x565309913f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:06.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 shutdown_connections 2024-09-10T23:28:06.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 1 -- 172.21.15.2:0/45452300 wait complete. 2024-09-10T23:28:06.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.798+0000 7f1b290ad740 20 client.16686 trim_cache size 0 max 16384 2024-09-10T23:28:06.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 Processor -- start 2024-09-10T23:28:06.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 -- start start 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309916ee0 0x56530991fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x56530992ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x56530991d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201ae370 con 0x565309923790 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201afeb0 con 0x565309916ee0 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b290ad740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201aea40 con 0x565309917800 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b25275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x56530991d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b25275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x56530991d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33634/0 (socket says 172.21.15.2:33634) 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b25275640 1 -- 172.21.15.2:0/65283480 learned_addr learned my addr 172.21.15.2:0/65283480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b24a74640 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309916ee0 0x56530991fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.816+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x56530992ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b25275640 1 -- 172.21.15.2:0/65283480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 msgr2=0x56530992ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b25275640 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x56530992ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b25275640 1 -- 172.21.15.2:0/65283480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309916ee0 msgr2=0x56530991fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b25275640 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309916ee0 0x56530991fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b25275640 1 -- 172.21.15.2:0/65283480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565309917630 con 0x565309923790 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b25275640 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x56530991d8f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1b18003ca0 tx=0x7f1b18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a64520436f8c1ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b067fc640 1 -- 172.21.15.2:0/65283480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18004b20 con 0x565309923790 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b067fc640 1 -- 172.21.15.2:0/65283480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b18004cc0 con 0x565309923790 2024-09-10T23:28:06.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.817+0000 7f1b067fc640 1 -- 172.21.15.2:0/65283480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180053e0 con 0x565309923790 2024-09-10T23:28:06.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 -- 172.21.15.2:0/65283480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 msgr2=0x56530991d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x56530991d8f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1b18003ca0 tx=0x7f1b18019000 comp rx=0 tx=0).stop 2024-09-10T23:28:06.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 -- 172.21.15.2:0/65283480 shutdown_connections 2024-09-10T23:28:06.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x56530991d8f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309917800 0x56530992ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 --2- 172.21.15.2:0/65283480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309916ee0 0x56530991fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 -- 172.21.15.2:0/65283480 >> 172.21.15.2:0/65283480 conn(0x565309914d10 msgr2=0x56530992e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 -- 172.21.15.2:0/65283480 shutdown_connections 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 -- 172.21.15.2:0/65283480 wait complete. 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 -- start start 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.818+0000 7f1b290ad740 1 Processor -- start 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x565309938ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309917800 0x5653099374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x565309937a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201af7e0 con 0x565309923790 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201af110 con 0x565309917800 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201ac350 con 0x565309916ee0 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b290ad740 10 client.0 _ll_register_callbacks cb 0x7f1b100f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:06.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b25275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x565309937a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b25275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x565309937a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33640/0 (socket says 172.21.15.2:33640) 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x565309938ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b25275640 1 -- 172.21.15.2:0/3018891881 learned_addr learned my addr 172.21.15.2:0/3018891881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309917800 0x5653099374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 -- 172.21.15.2:0/3018891881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309917800 msgr2=0x5653099374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309917800 0x5653099374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 -- 172.21.15.2:0/3018891881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 msgr2=0x565309937a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x565309937a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 -- 172.21.15.2:0/3018891881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565309938260 con 0x565309916ee0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b25275640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x565309937a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1b24a74640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x565309938ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000e9c0 tx=0x7f1b1000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce225ed52c840e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.819+0000 7f1afffff640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1afffff640 1 -- 172.21.15.2:0/3018891881 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100abf90 con 0x565309916ee0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b18004cc0 con 0x565309916ee0 2024-09-10T23:28:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1afffff640 1 -- 172.21.15.2:0/3018891881 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1b100b5920 con 0x565309916ee0 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1afffff640 1 -- 172.21.15.2:0/3018891881 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b100ac170 con 0x565309916ee0 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 10 client.26095 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653099a1040 con 0x565309916ee0 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1afffff640 1 -- 172.21.15.2:0/3018891881 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b18004cc0 con 0x565309916ee0 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1afffff640 1 -- 172.21.15.2:0/3018891881 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b100cfb70 con 0x565309916ee0 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 10 client.26095 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 10 client.26095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 20 client.26095 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099a15e0 0x5653099a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 4 client.26095 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.820+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56530988b860 con 0x5653099a15e0 2024-09-10T23:28:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.821+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099a15e0 0x5653099a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:06.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.821+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099a15e0 0x5653099a3a00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=771b17404abc7c90 server_cookie=c01c472800995f1c in_seq=0 out_seq=0 2024-09-10T23:28:06.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.821+0000 7f1afffff640 10 client.26095 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:06.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1afffff640 1 -- 172.21.15.2:0/3018891881 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56530988b860 con 0x5653099a15e0 2024-09-10T23:28:06.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1afffff640 10 client.26095 handle_command_reply: tid=0 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 client.26095 shutdown 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 msgr2=0x565309938ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x565309938ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000e9c0 tx=0x7f1b1000c7d0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 shutdown_connections 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5653099a15e0 0x5653099a3a00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565309923790 0x565309937a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565309917800 0x5653099374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 --2- 172.21.15.2:0/3018891881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x565309916ee0 0x565309938ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 >> 172.21.15.2:0/3018891881 conn(0x565309914d10 msgr2=0x56530992ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.822+0000 7f1afffff640 0 client.26095 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 shutdown_connections 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b290ad740 1 -- 172.21.15.2:0/3018891881 wait complete. 2024-09-10T23:28:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b290ad740 20 client.26095 trim_cache size 0 max 16384 2024-09-10T23:28:06.828 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:28:06.828 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:28:06.828 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d", 2024-09-10T23:28:06.828 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:28:06.828 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b080b52e0 msgr2=0x7f1b080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b080b52e0 0x7f1b080b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b18005fd0 tx=0x7f1b18009600 comp rx=0 tx=0).stop 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 msgr2=0x7f1b20199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 0x7f1b20199300 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000e9f0 tx=0x7f1b1000edf0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 shutdown_connections 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b080b52e0 0x7f1b080b77a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2010d140 0x7f1b2019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b20104600 0x7f1b20199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 --2- 172.21.15.2:0/2347078481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b20103ce0 0x7f1b20199300 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:06.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 >> 172.21.15.2:0/2347078481 conn(0x7f1b200fd720 msgr2=0x7f1b200fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:06.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 shutdown_connections 2024-09-10T23:28:06.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:06.823+0000 7f1b26cd8640 1 -- 172.21.15.2:0/2347078481 wait complete. 2024-09-10T23:28:07.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:28:07.840 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:08 smithi002 ceph-mon[31150]: pgmap v465: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:08 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:28:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:08 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:08 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:28:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:08 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:08.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1901390039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a41076a0 msgr2=0x7fc7a4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1901390039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a41076a0 0x7fc7a4107ae0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc798009900 tx=0x7fc79802a410 comp rx=0 tx=0).stop 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1901390039 shutdown_connections 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1901390039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4108020 0x7fc7a410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1901390039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a41076a0 0x7fc7a4107ae0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1901390039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a4101c90 0x7fc7a4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1901390039 >> 172.21.15.2:0/1901390039 conn(0x7fc7a40fd700 msgr2=0x7fc7a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1901390039 shutdown_connections 2024-09-10T23:28:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.372+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1901390039 wait complete. 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 Processor -- start 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 -- start start 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4101c90 0x7fc7a41981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a41076a0 0x7fc7a4198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 0x7fc7a419dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a4111ce0 con 0x7fc7a4108020 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a4111b60 con 0x7fc7a4101c90 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7aac7d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a4111e60 con 0x7fc7a41076a0 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 0x7fc7a419dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 0x7fc7a419dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33670/0 (socket says 172.21.15.2:33670) 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 -- 172.21.15.2:0/1129170855 learned_addr learned my addr 172.21.15.2:0/1129170855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4101c90 0x7fc7a41981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a41076a0 0x7fc7a4198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 -- 172.21.15.2:0/1129170855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a41076a0 msgr2=0x7fc7a4198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a41076a0 0x7fc7a4198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 -- 172.21.15.2:0/1129170855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4101c90 msgr2=0x7fc7a41981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4101c90 0x7fc7a41981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.373+0000 7fc7a921a640 1 -- 172.21.15.2:0/1129170855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a419e280 con 0x7fc7a4108020 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.374+0000 7fc7a921a640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 0x7fc7a419dab0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009fd0 tx=0x7fc79c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.374+0000 7fc7a1ffb640 1 -- 172.21.15.2:0/1129170855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c017070 con 0x7fc7a4108020 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.374+0000 7fc7a1ffb640 1 -- 172.21.15.2:0/1129170855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79c003e20 con 0x7fc7a4108020 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.374+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a419e570 con 0x7fc7a4108020 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.374+0000 7fc7a1ffb640 1 -- 172.21.15.2:0/1129170855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c010460 con 0x7fc7a4108020 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.374+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a41a4c30 con 0x7fc7a4108020 2024-09-10T23:28:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.376+0000 7fc7a1ffb640 1 -- 172.21.15.2:0/1129170855 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc79c003970 con 0x7fc7a4108020 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 Processor -- start 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 -- start start 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bb98480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb989c0 0x556c9bba4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bba6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556c9bb0ee50 con 0x556c9bba4950 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556c9bafe280 con 0x556c9bb989c0 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7ad052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556c9bb02090 con 0x556c9bb980a0 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bba6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bba6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33676/0 (socket says 172.21.15.2:33676) 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 -- 172.21.15.2:0/830086011 learned_addr learned my addr 172.21.15.2:0/830086011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bb98480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb989c0 0x556c9bba4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 -- 172.21.15.2:0/830086011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 msgr2=0x556c9bb98480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bb98480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a1ffb640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc78c0b52e0 0x7fc78c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 -- 172.21.15.2:0/830086011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb989c0 msgr2=0x556c9bba4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb989c0 0x556c9bba4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.377+0000 7fc7a3fff640 1 -- 172.21.15.2:0/830086011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9b85c650 con 0x556c9bba4950 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.378+0000 7fc7a921a640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc78c0b52e0 0x7fc78c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.378+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bba6d40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc798033000 tx=0x7fc798031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1a75bc2a087c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.378+0000 7fc7a1ffb640 1 -- 172.21.15.2:0/1129170855 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc79c0e5a70 con 0x7fc7a4108020 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.378+0000 7fc78affd640 1 -- 172.21.15.2:0/830086011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798045070 con 0x556c9bba4950 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.378+0000 7fc78affd640 1 -- 172.21.15.2:0/830086011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc798031810 con 0x556c9bba4950 2024-09-10T23:28:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.378+0000 7fc78affd640 1 -- 172.21.15.2:0/830086011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798035040 con 0x556c9bba4950 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 -- 172.21.15.2:0/830086011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 msgr2=0x556c9bba6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7a921a640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc78c0b52e0 0x7fc78c0b77a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0ac170 tx=0x7fc79c0796b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bba6d40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc798033000 tx=0x7fc798031400 comp rx=0 tx=0).stop 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 -- 172.21.15.2:0/830086011 shutdown_connections 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bba6d40 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb989c0 0x556c9bba4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 --2- 172.21.15.2:0/830086011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bb98480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 -- 172.21.15.2:0/830086011 >> 172.21.15.2:0/830086011 conn(0x556c9bb95ed0 msgr2=0x556c9bb97070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 -- 172.21.15.2:0/830086011 shutdown_connections 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 -- 172.21.15.2:0/830086011 wait complete. 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 -- start start 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.379+0000 7fc7ad052740 1 Processor -- start 2024-09-10T23:28:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bba3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 0x556c9bba4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bbac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556c9b95f700 con 0x556c9bb989c0 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556c9ba99110 con 0x556c9bba4950 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556c9bba7570 con 0x556c9bb980a0 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7ad052740 10 client.0 _ll_register_callbacks cb 0x556c9bab2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 0x556c9bba4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 0x556c9bba4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33678/0 (socket says 172.21.15.2:33678) 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 -- 172.21.15.2:0/2221610279 learned_addr learned my addr 172.21.15.2:0/2221610279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bba3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bbac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 -- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 msgr2=0x556c9bba3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bba3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 -- 172.21.15.2:0/2221610279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 msgr2=0x556c9bbac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bbac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 -- 172.21.15.2:0/2221610279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9bac6c40 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 0x556c9bba4050 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc79400bed0 tx=0x7fc7940117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7814c190d50eea55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc783fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc783fff640 1 -- 172.21.15.2:0/2221610279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794012650 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.380+0000 7fc783fff640 1 -- 172.21.15.2:0/2221610279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc7940127f0 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc798031810 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc783fff640 1 -- 172.21.15.2:0/2221610279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc7940129f0 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 10 client.16704 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c9bbb5180 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc783fff640 1 -- 172.21.15.2:0/2221610279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc798031810 con 0x556c9bb989c0 2024-09-10T23:28:08.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc783fff640 1 -- 172.21.15.2:0/2221610279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc7940253f0 con 0x556c9bb989c0 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 10 client.16704 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 20 client.16704 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bbb6630 0x556c9bbb8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 4 client.16704 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c9bb10da0 con 0x556c9bbb6630 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.381+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bbb6630 0x556c9bbb8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.382+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bbb6630 0x556c9bbb8a50 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e81ceda265fa98b3 server_cookie=ea1e725a4154de4c in_seq=0 out_seq=0 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.382+0000 7fc783fff640 10 client.16704 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc783fff640 1 -- 172.21.15.2:0/2221610279 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c9bb10da0 con 0x556c9bbb6630 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc783fff640 10 client.16704 handle_command_reply: tid=0 2024-09-10T23:28:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 client.16704 shutdown 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 msgr2=0x556c9bba4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 0x556c9bba4050 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc79400bed0 tx=0x7fc7940117b0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 shutdown_connections 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bbb6630 0x556c9bbb8a50 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bbac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc783fff640 0 client.16704 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb989c0 0x556c9bba4050 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2221610279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb980a0 0x556c9bba3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 >> 172.21.15.2:0/2221610279 conn(0x556c9bb95ed0 msgr2=0x556c9bb9ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 shutdown_connections 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 1 -- 172.21.15.2:0/2221610279 wait complete. 2024-09-10T23:28:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.383+0000 7fc7ad052740 20 client.16704 trim_cache size 0 max 16384 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 Processor -- start 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 -- start start 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 0x556c9bb95710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bb9e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bb9ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41ac170 con 0x556c9bb980a0 2024-09-10T23:28:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41adcb0 con 0x556c9bba4950 2024-09-10T23:28:08.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7ad052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41ac840 con 0x556c9bb989c0 2024-09-10T23:28:08.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 0x556c9bb95710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 0x556c9bb95710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33682/0 (socket says 172.21.15.2:33682) 2024-09-10T23:28:08.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.401+0000 7fc7a3fff640 1 -- 172.21.15.2:0/2934225891 learned_addr learned my addr 172.21.15.2:0/2934225891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:08.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bb9e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bb9ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 -- 172.21.15.2:0/2934225891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 msgr2=0x556c9bb9e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bb9e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 -- 172.21.15.2:0/2934225891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 msgr2=0x556c9bb9ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bb9ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 -- 172.21.15.2:0/2934225891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9bbb90b0 con 0x556c9bb980a0 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 0x556c9bb95710 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc798003660 tx=0x7fc798031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbd7d4f0fe854d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:08.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc78a7fc640 1 -- 172.21.15.2:0/2934225891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798035040 con 0x556c9bb980a0 2024-09-10T23:28:08.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc78a7fc640 1 -- 172.21.15.2:0/2934225891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc798042070 con 0x556c9bb980a0 2024-09-10T23:28:08.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.402+0000 7fc78a7fc640 1 -- 172.21.15.2:0/2934225891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798045040 con 0x556c9bb980a0 2024-09-10T23:28:08.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 -- 172.21.15.2:0/2934225891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 msgr2=0x556c9bb95710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 0x556c9bb95710 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc798003660 tx=0x7fc798031400 comp rx=0 tx=0).stop 2024-09-10T23:28:08.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 -- 172.21.15.2:0/2934225891 shutdown_connections 2024-09-10T23:28:08.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bba4950 0x556c9bb9ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bb9e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 --2- 172.21.15.2:0/2934225891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bb980a0 0x556c9bb95710 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 -- 172.21.15.2:0/2934225891 >> 172.21.15.2:0/2934225891 conn(0x556c9bb95ed0 msgr2=0x556c9bbaa660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:08.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 -- 172.21.15.2:0/2934225891 shutdown_connections 2024-09-10T23:28:08.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 -- 172.21.15.2:0/2934225891 wait complete. 2024-09-10T23:28:08.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.403+0000 7fc7ad052740 1 -- start start 2024-09-10T23:28:08.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 Processor -- start 2024-09-10T23:28:08.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb980a0 0x556c9bbaee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bbaf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bc1c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41ad5e0 con 0x556c9bba4950 2024-09-10T23:28:08.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41acf10 con 0x556c9bb980a0 2024-09-10T23:28:08.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41aa150 con 0x556c9bb989c0 2024-09-10T23:28:08.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7ad052740 10 client.0 _ll_register_callbacks cb 0x7fc79400b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:08.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bc1c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bc1c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33694/0 (socket says 172.21.15.2:33694) 2024-09-10T23:28:08.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 -- 172.21.15.2:0/3211019519 learned_addr learned my addr 172.21.15.2:0/3211019519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:08.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bbaf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb980a0 0x556c9bbaee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 -- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 msgr2=0x556c9bbaf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bbaf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 -- 172.21.15.2:0/3211019519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb980a0 msgr2=0x556c9bbaee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb980a0 0x556c9bbaee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.404+0000 7fc7a3fff640 1 -- 172.21.15.2:0/3211019519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9bc1cbf0 con 0x556c9bba4950 2024-09-10T23:28:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7a3fff640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bc1c4b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc7980096b0 tx=0x7fc798000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756cdf1627a27f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc783fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc783fff640 1 -- 172.21.15.2:0/3211019519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798045070 con 0x556c9bba4950 2024-09-10T23:28:08.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc783fff640 1 -- 172.21.15.2:0/3211019519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc7980048c0 con 0x556c9bba4950 2024-09-10T23:28:08.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc798042070 con 0x556c9bba4950 2024-09-10T23:28:08.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc783fff640 1 -- 172.21.15.2:0/3211019519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc798056040 con 0x556c9bba4950 2024-09-10T23:28:08.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 10 client.16710 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:08.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c9bc24060 con 0x556c9bba4950 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc783fff640 1 -- 172.21.15.2:0/3211019519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc798042070 con 0x556c9bba4950 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc783fff640 1 -- 172.21.15.2:0/3211019519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc79803a040 con 0x556c9bba4950 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 10 client.16710 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 20 client.16710 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bc24330 0x556c9bc26720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 4 client.16710 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:28:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.405+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c9bb0c850 con 0x556c9bc24330 2024-09-10T23:28:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.406+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bc24330 0x556c9bc26720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.406+0000 7fc7a8a19640 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bc24330 0x556c9bc26720 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da8d53e17eca145a server_cookie=263af50eb871ec34 in_seq=0 out_seq=0 2024-09-10T23:28:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.406+0000 7fc783fff640 10 client.16710 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.406+0000 7fc783fff640 1 -- 172.21.15.2:0/3211019519 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x556c9bb0c850 con 0x556c9bc24330 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.406+0000 7fc783fff640 10 client.16710 handle_command_reply: tid=0 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.406+0000 7fc7ad052740 1 client.16710 shutdown 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 msgr2=0x556c9bc1c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bc1c4b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc7980096b0 tx=0x7fc798000bc0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 shutdown_connections 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556c9bc24330 0x556c9bc26720 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9bba4950 0x556c9bc1c4b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc783fff640 0 client.16710 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556c9bb989c0 0x556c9bbaf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 --2- 172.21.15.2:0/3211019519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c9bb980a0 0x556c9bbaee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 >> 172.21.15.2:0/3211019519 conn(0x556c9bb95ed0 msgr2=0x556c9bb9b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 shutdown_connections 2024-09-10T23:28:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 1 -- 172.21.15.2:0/3211019519 wait complete. 2024-09-10T23:28:08.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7ad052740 20 client.16710 trim_cache size 0 max 16384 2024-09-10T23:28:08.423 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:28:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:28:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:28:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:28:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:28:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:28:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:28:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:08.429 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc78c0b52e0 msgr2=0x7fc78c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc78c0b52e0 0x7fc78c0b77a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0ac170 tx=0x7fc79c0796b0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 msgr2=0x7fc7a419dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.407+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 0x7fc7a419dab0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009fd0 tx=0x7fc79c00b260 comp rx=0 tx=0).stop 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 shutdown_connections 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc78c0b52e0 0x7fc78c0b77a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a4108020 0x7fc7a419dab0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a41076a0 0x7fc7a4198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 --2- 172.21.15.2:0/1129170855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4101c90 0x7fc7a41981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 >> 172.21.15.2:0/1129170855 conn(0x7fc7a40fd700 msgr2=0x7fc7a40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 shutdown_connections 2024-09-10T23:28:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:08.408+0000 7fc7aac7d640 1 -- 172.21.15.2:0/1129170855 wait complete. 2024-09-10T23:28:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:08 smithi177 ceph-mon[35760]: pgmap v465: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:08 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:28:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:08 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:08 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:28:08.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:08 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:08.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:08 smithi154 ceph-mon[35136]: pgmap v465: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:08.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:08 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:28:08.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:08 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:08.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:08 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:28:08.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:08 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:09.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:09 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:28:09.271 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:28:09.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:28:09.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:09 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:28:09.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:09 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:28:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:10.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 -- 172.21.15.2:0/2391364442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8108060 msgr2=0x7fbdd810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:10.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2391364442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8108060 0x7fbdd810e860 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009ca0 tx=0x7fbdd002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 -- 172.21.15.2:0/2391364442 shutdown_connections 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2391364442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8108060 0x7fbdd810e860 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2391364442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd81076e0 0x7fbdd8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2391364442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd8101cd0 0x7fbdd81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 -- 172.21.15.2:0/2391364442 >> 172.21.15.2:0/2391364442 conn(0x7fbdd80fd700 msgr2=0x7fbdd80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 -- 172.21.15.2:0/2391364442 shutdown_connections 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.029+0000 7fbdddacd640 1 -- 172.21.15.2:0/2391364442 wait complete. 2024-09-10T23:28:10.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 Processor -- start 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 -- start start 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 0x7fbdd8198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd81076e0 0x7fbdd8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd8108060 0x7fbdd819da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8111d20 con 0x7fbdd8101cd0 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.030+0000 7fbdddacd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8111ba0 con 0x7fbdd81076e0 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdddacd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8111ea0 con 0x7fbdd8108060 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 0x7fbdd8198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 0x7fbdd8198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33716/0 (socket says 172.21.15.2:33716) 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 -- 172.21.15.2:0/2945268040 learned_addr learned my addr 172.21.15.2:0/2945268040 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd6ffd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd81076e0 0x7fbdd8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd7fff640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd8108060 0x7fbdd819da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 -- 172.21.15.2:0/2945268040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd8108060 msgr2=0x7fbdd819da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd8108060 0x7fbdd819da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 -- 172.21.15.2:0/2945268040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd81076e0 msgr2=0x7fbdd8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd81076e0 0x7fbdd8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 -- 172.21.15.2:0/2945268040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd819e1e0 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd77fe640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 0x7fbdd8198130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800d770 tx=0x7fbdc800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8017070 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdc80054d0 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd819e4d0 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8004c30 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.031+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81a4b90 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.032+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd81020b0 con 0x7fbdd8101cd0 2024-09-10T23:28:10.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.034+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fbdc8004dd0 con 0x7fbdd8101cd0 2024-09-10T23:28:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.035+0000 7fbdd4ff9640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbdc00b5360 0x7fbdc00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.035+0000 7fbdd6ffd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbdc00b5360 0x7fbdc00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.035+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbdc80e5ad0 con 0x7fbdd8101cd0 2024-09-10T23:28:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.035+0000 7fbdd6ffd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbdc00b5360 0x7fbdc00b7820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005fd0 tx=0x7fbdcc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.038+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbdc80aca20 con 0x7fbdd8101cd0 2024-09-10T23:28:10.235 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:10 smithi002 ceph-mon[31150]: pgmap v466: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:28:10.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.262+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdd8199260 con 0x7fbdd8101cd0 2024-09-10T23:28:10.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.262+0000 7fbdd4ff9640 1 -- 172.21.15.2:0/2945268040 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fbdd8199260 con 0x7fbdd8101cd0 2024-09-10T23:28:10.263 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:28:10.263 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:28:10.263 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:28:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.264+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbdc00b5360 msgr2=0x7fbdc00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.264+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbdc00b5360 0x7fbdc00b7820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005fd0 tx=0x7fbdcc005850 comp rx=0 tx=0).stop 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 msgr2=0x7fbdd8198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 0x7fbdd8198130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800d770 tx=0x7fbdc800dc30 comp rx=0 tx=0).stop 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 shutdown_connections 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbdc00b5360 0x7fbdc00b7820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd8108060 0x7fbdd819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd81076e0 0x7fbdd8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 --2- 172.21.15.2:0/2945268040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd8101cd0 0x7fbdd8198130 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 >> 172.21.15.2:0/2945268040 conn(0x7fbdd80fd700 msgr2=0x7fbdd80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 shutdown_connections 2024-09-10T23:28:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:10.265+0000 7fbdddacd640 1 -- 172.21.15.2:0/2945268040 wait complete. 2024-09-10T23:28:10.430 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:10 smithi154 ceph-mon[35136]: pgmap v466: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:28:10.463 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:10 smithi177 ceph-mon[35760]: pgmap v466: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:28:10.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:28:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2945268040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:11.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2945268040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:11.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2945268040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/2032395711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 msgr2=0x7f5b581020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/2032395711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b581020b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009900 tx=0x7f5b5402a410 comp rx=0 tx=0).stop 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/2032395711 shutdown_connections 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/2032395711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b58108060 0x7f5b5810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/2032395711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b581076e0 0x7f5b58107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/2032395711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b581020b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/2032395711 >> 172.21.15.2:0/2032395711 conn(0x7f5b580fd720 msgr2=0x7f5b580ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/2032395711 shutdown_connections 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.684+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/2032395711 wait complete. 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 Processor -- start 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 -- start start 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b580fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b581076e0 0x7f5b580fe160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b58108060 0x7f5b580fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111d20 con 0x7f5b58101cd0 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111ba0 con 0x7f5b581076e0 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5fbd5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111ea0 con 0x7f5b58108060 2024-09-10T23:28:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b580fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b580fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45794/0 (socket says 172.21.15.2:45794) 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 -- 172.21.15.2:0/3278666356 learned_addr learned my addr 172.21.15.2:0/3278666356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5e172640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b58108060 0x7f5b580fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d170640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b581076e0 0x7f5b580fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 -- 172.21.15.2:0/3278666356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b58108060 msgr2=0x7f5b580fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b58108060 0x7f5b580fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 -- 172.21.15.2:0/3278666356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b581076e0 msgr2=0x7f5b580fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b581076e0 0x7f5b580fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.685+0000 7f5b5d971640 1 -- 172.21.15.2:0/3278666356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b581a7710 con 0x7f5b58101cd0 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.686+0000 7f5b5d971640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b580fdc20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5b54005940 tx=0x7f5b540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.686+0000 7f5b4effd640 1 -- 172.21.15.2:0/3278666356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5403f030 con 0x7f5b58101cd0 2024-09-10T23:28:11.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.686+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b581a79a0 con 0x7f5b58101cd0 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.686+0000 7f5b4effd640 1 -- 172.21.15.2:0/3278666356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b54003cb0 con 0x7f5b58101cd0 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.686+0000 7f5b4effd640 1 -- 172.21.15.2:0/3278666356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54035070 con 0x7f5b58101cd0 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.686+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b581a7e80 con 0x7f5b58101cd0 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.688+0000 7f5b61faa740 1 Processor -- start 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.688+0000 7f5b4effd640 1 -- 172.21.15.2:0/3278666356 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5b5403bbf0 con 0x7f5b58101cd0 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 -- start start 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 0x55f2932528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f29325e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f29325ed80 0x55f293261170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f2931c8ea0 con 0x55f2932524d0 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f2931b82d0 con 0x55f293252df0 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b61faa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f2931bc0e0 con 0x55f29325ed80 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 0x55f2932528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 0x55f2932528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45808/0 (socket says 172.21.15.2:45808) 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 -- 172.21.15.2:0/218717887 learned_addr learned my addr 172.21.15.2:0/218717887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5d170640 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f29325ed80 0x55f293261170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5d971640 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f29325e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 -- 172.21.15.2:0/218717887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f29325ed80 msgr2=0x55f293261170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f29325ed80 0x55f293261170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 -- 172.21.15.2:0/218717887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 msgr2=0x55f29325e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f29325e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 -- 172.21.15.2:0/218717887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f292f16650 con 0x55f2932524d0 2024-09-10T23:28:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5d971640 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f29325e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b5e172640 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 0x55f2932528b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000ae60 tx=0x7f5b5000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37280df0f0b7168a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.689+0000 7f5b4effd640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b440b52e0 0x7f5b440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b43fff640 1 -- 172.21.15.2:0/218717887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50004d20 con 0x55f2932524d0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b5d971640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b440b52e0 0x7f5b440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b43fff640 1 -- 172.21.15.2:0/218717887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b50003e20 con 0x55f2932524d0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b43fff640 1 -- 172.21.15.2:0/218717887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50010840 con 0x55f2932524d0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b4effd640 1 -- 172.21.15.2:0/3278666356 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b54106780 con 0x7f5b58101cd0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b61faa740 1 -- 172.21.15.2:0/218717887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 msgr2=0x55f2932528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b61faa740 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 0x55f2932528b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000ae60 tx=0x7f5b5000f790 comp rx=0 tx=0).stop 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.690+0000 7f5b5d971640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b440b52e0 0x7f5b440b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b54104600 tx=0x7f5b5402a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- 172.21.15.2:0/218717887 shutdown_connections 2024-09-10T23:28:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f29325ed80 0x55f293261170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f29325e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 --2- 172.21.15.2:0/218717887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2932524d0 0x55f2932528b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- 172.21.15.2:0/218717887 >> 172.21.15.2:0/218717887 conn(0x55f293250300 msgr2=0x55f2932514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- 172.21.15.2:0/218717887 shutdown_connections 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- 172.21.15.2:0/218717887 wait complete. 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- start start 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 Processor -- start 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29325e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29325ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f29325c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f293019700 con 0x55f29325ed80 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f293153160 con 0x55f2932524d0 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f293261a00 con 0x55f293252df0 2024-09-10T23:28:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.691+0000 7f5b61faa740 10 client.0 _ll_register_callbacks cb 0x55f29316c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f29325c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f29325c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45822/0 (socket says 172.21.15.2:45822) 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 -- 172.21.15.2:0/1976541055 learned_addr learned my addr 172.21.15.2:0/1976541055 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29325e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5d170640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29325ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 -- 172.21.15.2:0/1976541055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 msgr2=0x55f29325ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29325ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 -- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 msgr2=0x55f29325e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29325e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 -- 172.21.15.2:0/1976541055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f293180c90 con 0x55f29325ed80 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b5e172640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f29325c070 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5b50004720 tx=0x7f5b50004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bf09c7033c5ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b417fa640 1 -- 172.21.15.2:0/1976541055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50004c40 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b417fa640 1 -- 172.21.15.2:0/1976541055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b50010900 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b50003e20 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b417fa640 1 -- 172.21.15.2:0/1976541055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b50004de0 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.692+0000 7f5b61faa740 10 client.16728 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f29326d2a0 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b417fa640 1 -- 172.21.15.2:0/1976541055 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b50003e20 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b417fa640 1 -- 172.21.15.2:0/1976541055 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b50005700 con 0x55f29325ed80 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 10 client.16728 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 10 client.16728 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 20 client.16728 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f29326e700 0x55f293270af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 4 client.16728 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2931cadf0 con 0x55f29326e700 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.693+0000 7f5b5d170640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f29326e700 0x55f293270af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b5d170640 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f29326e700 0x55f293270af0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8308548b23ade321 server_cookie=2a69500e2668fcd9 in_seq=0 out_seq=0 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b417fa640 10 client.16728 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b417fa640 1 -- 172.21.15.2:0/1976541055 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2931cadf0 con 0x55f29326e700 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b417fa640 10 client.16728 handle_command_reply: tid=0 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b61faa740 1 client.16728 shutdown 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 msgr2=0x55f29325c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.694+0000 7f5b61faa740 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f29325c070 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5b50004720 tx=0x7f5b50004620 comp rx=0 tx=0).stop 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 shutdown_connections 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f29326e700 0x55f293270af0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f29325c070 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b417fa640 0 client.16728 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29325ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 --2- 172.21.15.2:0/1976541055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29325e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 >> 172.21.15.2:0/1976541055 conn(0x55f293250300 msgr2=0x55f293255e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 shutdown_connections 2024-09-10T23:28:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 1 -- 172.21.15.2:0/1976541055 wait complete. 2024-09-10T23:28:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.695+0000 7f5b61faa740 20 client.16728 trim_cache size 0 max 16384 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 Processor -- start 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 -- start start 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29326ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29324f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f293258ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b05b0 con 0x55f29325ed80 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b20f0 con 0x55f2932524d0 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b61faa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b0c80 con 0x55f293252df0 2024-09-10T23:28:11.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f293258ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f293258ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45836/0 (socket says 172.21.15.2:45836) 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.708+0000 7f5b5e172640 1 -- 172.21.15.2:0/823189215 learned_addr learned my addr 172.21.15.2:0/823189215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5d170640 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29324f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29326ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 -- 172.21.15.2:0/823189215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 msgr2=0x55f29324f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29324f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 -- 172.21.15.2:0/823189215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 msgr2=0x55f29326ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29326ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 -- 172.21.15.2:0/823189215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29325e9b0 con 0x55f29325ed80 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b5e172640 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f293258ca0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5b50003d00 tx=0x7f5b5000a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc2f8245f57ced3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b437fe640 1 -- 172.21.15.2:0/823189215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000fc90 con 0x55f29325ed80 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b437fe640 1 -- 172.21.15.2:0/823189215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b50039070 con 0x55f29325ed80 2024-09-10T23:28:11.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.709+0000 7f5b437fe640 1 -- 172.21.15.2:0/823189215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50018560 con 0x55f29325ed80 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 -- 172.21.15.2:0/823189215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 msgr2=0x55f293258ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f293258ca0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5b50003d00 tx=0x7f5b5000a4d0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 -- 172.21.15.2:0/823189215 shutdown_connections 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f293258ca0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f293252df0 0x55f29324f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 --2- 172.21.15.2:0/823189215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2932524d0 0x55f29326ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 -- 172.21.15.2:0/823189215 >> 172.21.15.2:0/823189215 conn(0x55f293250300 msgr2=0x55f29324ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 -- 172.21.15.2:0/823189215 shutdown_connections 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 -- 172.21.15.2:0/823189215 wait complete. 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 -- start start 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.710+0000 7f5b61faa740 1 Processor -- start 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2932524d0 0x55f2932634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f293263a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f2932da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b1a20 con 0x55f29325ed80 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b1350 con 0x55f293252df0 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581ae590 con 0x55f2932524d0 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b61faa740 10 client.0 _ll_register_callbacks cb 0x7f5b4800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f2932da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2932524d0 0x55f2932634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5d170640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f293263a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f2932da2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45848/0 (socket says 172.21.15.2:45848) 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5e172640 1 -- 172.21.15.2:0/2606339821 learned_addr learned my addr 172.21.15.2:0/2606339821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5d170640 1 -- 172.21.15.2:0/2606339821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2932524d0 msgr2=0x55f2932634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5d170640 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2932524d0 0x55f2932634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5d170640 1 -- 172.21.15.2:0/2606339821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 msgr2=0x55f2932da2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5d170640 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f2932da2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5d170640 1 -- 172.21.15.2:0/2606339821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2932da9b0 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.711+0000 7f5b5e172640 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f2932da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b5d170640 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f293263a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55f293261b10 tx=0x7f5b48013a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdfa55c7a44545f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b417fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b417fa640 1 -- 172.21.15.2:0/2606339821 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48005020 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b417fa640 1 -- 172.21.15.2:0/2606339821 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b480051c0 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b50039070 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b417fa640 1 -- 172.21.15.2:0/2606339821 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b480053c0 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b61faa740 10 client.25970 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2932dbd00 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b417fa640 1 -- 172.21.15.2:0/2606339821 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b50039070 con 0x55f293252df0 2024-09-10T23:28:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.712+0000 7f5b417fa640 1 -- 172.21.15.2:0/2606339821 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b4801d530 con 0x55f293252df0 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b61faa740 10 client.25970 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b61faa740 10 client.25970 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b61faa740 20 client.25970 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b61faa740 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f2932dc3d0 0x55f2932de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b61faa740 4 client.25970 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2931c68a0 con 0x55f2932dc3d0 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b5e172640 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f2932dc3d0 0x55f2932de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b5e172640 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f2932dc3d0 0x55f2932de7c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=10d2a50f275ab63e server_cookie=efd3c89132ddf50d in_seq=0 out_seq=0 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.713+0000 7f5b417fa640 10 client.25970 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b417fa640 1 -- 172.21.15.2:0/2606339821 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2931c68a0 con 0x55f2932dc3d0 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b417fa640 10 client.25970 handle_command_reply: tid=0 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 client.25970 shutdown 2024-09-10T23:28:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 msgr2=0x55f293263a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f293263a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55f293261b10 tx=0x7f5b48013a30 comp rx=0 tx=0).stop 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 shutdown_connections 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55f2932dc3d0 0x55f2932de7c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f29325ed80 0x55f2932da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f293252df0 0x55f293263a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b417fa640 0 client.25970 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 --2- 172.21.15.2:0/2606339821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f2932524d0 0x55f2932634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 >> 172.21.15.2:0/2606339821 conn(0x55f293250300 msgr2=0x55f29325d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 shutdown_connections 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 1 -- 172.21.15.2:0/2606339821 wait complete. 2024-09-10T23:28:11.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.714+0000 7f5b61faa740 20 client.25970 trim_cache size 0 max 16384 2024-09-10T23:28:11.723 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:11.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b440b52e0 msgr2=0x7f5b440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b440b52e0 0x7f5b440b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b54104600 tx=0x7f5b5402a410 comp rx=0 tx=0).stop 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 msgr2=0x7f5b580fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b580fdc20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5b54005940 tx=0x7f5b540042f0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 shutdown_connections 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b440b52e0 0x7f5b440b77a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b58108060 0x7f5b580fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b581076e0 0x7f5b580fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 --2- 172.21.15.2:0/3278666356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58101cd0 0x7f5b580fdc20 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 >> 172.21.15.2:0/3278666356 conn(0x7f5b580fd720 msgr2=0x7f5b5806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 shutdown_connections 2024-09-10T23:28:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:11.715+0000 7f5b5fbd5640 1 -- 172.21.15.2:0/3278666356 wait complete. 2024-09-10T23:28:12.365 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:12 smithi177 ceph-mon[35760]: pgmap v467: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:12.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:12 smithi002 ceph-mon[31150]: pgmap v467: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:12.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:12 smithi154 ceph-mon[35136]: pgmap v467: 97 pgs: 97 active+clean; 2.8 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:12.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:28:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:13.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:13 smithi002 ceph-mon[31150]: pgmap v468: 97 pgs: 97 active+clean; 2.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:28:13.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 -- 172.21.15.2:0/194530790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 msgr2=0x7f3734101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 --2- 172.21.15.2:0/194530790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734101bf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3730009900 tx=0x7f373002a410 comp rx=0 tx=0).stop 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 -- 172.21.15.2:0/194530790 shutdown_connections 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 --2- 172.21.15.2:0/194530790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373410d250 0x7f373410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 --2- 172.21.15.2:0/194530790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f373410a920 0x7f373410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 --2- 172.21.15.2:0/194530790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734101bf0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 -- 172.21.15.2:0/194530790 >> 172.21.15.2:0/194530790 conn(0x7f3734076f50 msgr2=0x7f3734077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 -- 172.21.15.2:0/194530790 shutdown_connections 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 -- 172.21.15.2:0/194530790 wait complete. 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 Processor -- start 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.277+0000 7f373c356640 1 -- start start 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373410a920 0x7f37341997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f373410d250 0x7f373419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3734112db0 con 0x7f3734101810 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3734112c30 con 0x7f373410a920 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3734112f30 con 0x7f373410d250 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45856/0 (socket says 172.21.15.2:45856) 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 -- 172.21.15.2:0/1548705977 learned_addr learned my addr 172.21.15.2:0/1548705977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f37398f1640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373410a920 0x7f37341997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a8f3640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f373410d250 0x7f373419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 -- 172.21.15.2:0/1548705977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f373410d250 msgr2=0x7f373419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f373410d250 0x7f373419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 -- 172.21.15.2:0/1548705977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373410a920 msgr2=0x7f37341997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373410a920 0x7f37341997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 -- 172.21.15.2:0/1548705977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373419f330 con 0x7f3734101810 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373a0f2640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734199280 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3730006010 tx=0x7f37300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f37277fe640 1 -- 172.21.15.2:0/1548705977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373003f030 con 0x7f3734101810 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373419f5c0 con 0x7f3734101810 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.278+0000 7f37277fe640 1 -- 172.21.15.2:0/1548705977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3730003800 con 0x7f3734101810 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.279+0000 7f37277fe640 1 -- 172.21.15.2:0/1548705977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730035070 con 0x7f3734101810 2024-09-10T23:28:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.279+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37341a5ce0 con 0x7f3734101810 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.281+0000 7f37277fe640 1 -- 172.21.15.2:0/1548705977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3730031b10 con 0x7f3734101810 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.281+0000 7f373e72b740 1 Processor -- start 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.281+0000 7f373e72b740 1 -- start start 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.281+0000 7f373e72b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373e72b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373e72b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649c0d80 0x5636649c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373e72b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56366492aea0 con 0x5636649b44d0 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373e72b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56366491a2d0 con 0x5636649c0d80 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373e72b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56366491e0e0 con 0x5636649b4df0 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45866/0 (socket says 172.21.15.2:45866) 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 -- 172.21.15.2:0/3864428000 learned_addr learned my addr 172.21.15.2:0/3864428000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a0f2640 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f37398f1640 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649c0d80 0x5636649c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 -- 172.21.15.2:0/3864428000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 msgr2=0x5636649c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 -- 172.21.15.2:0/3864428000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649c0d80 msgr2=0x5636649c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649c0d80 0x5636649c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 -- 172.21.15.2:0/3864428000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563664678650 con 0x5636649b44d0 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f37277fe640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37200b52e0 0x7f37200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649b48b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f372c007e50 tx=0x7f372c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f4026ab3c7ecc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.282+0000 7f373a0f2640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37200b52e0 0x7f37200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f37277fe640 1 -- 172.21.15.2:0/1548705977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f37301064f0 con 0x7f3734101810 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f3724de6640 1 -- 172.21.15.2:0/3864428000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c014070 con 0x5636649b44d0 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f3724de6640 1 -- 172.21.15.2:0/3864428000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f372c00ee90 con 0x5636649b44d0 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f3724de6640 1 -- 172.21.15.2:0/3864428000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c005440 con 0x5636649b44d0 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 -- 172.21.15.2:0/3864428000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 msgr2=0x5636649b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373a0f2640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37200b52e0 0x7f37200b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f37300c9290 tx=0x7f373010c060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649b48b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f372c007e50 tx=0x7f372c00e720 comp rx=0 tx=0).stop 2024-09-10T23:28:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 -- 172.21.15.2:0/3864428000 shutdown_connections 2024-09-10T23:28:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649c0d80 0x5636649c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 --2- 172.21.15.2:0/3864428000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649b48b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.283+0000 7f373e72b740 1 -- 172.21.15.2:0/3864428000 >> 172.21.15.2:0/3864428000 conn(0x5636649b2300 msgr2=0x5636649b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 -- 172.21.15.2:0/3864428000 shutdown_connections 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 -- 172.21.15.2:0/3864428000 wait complete. 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 -- start start 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 Processor -- start 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649be180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56366477b700 con 0x5636649b44d0 2024-09-10T23:28:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5636648b5160 con 0x5636649b4df0 2024-09-10T23:28:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5636649c3a00 con 0x5636649c0d80 2024-09-10T23:28:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373e72b740 10 client.0 _ll_register_callbacks cb 0x5636648ce9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45876/0 (socket says 172.21.15.2:45876) 2024-09-10T23:28:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.284+0000 7f373a8f3640 1 -- 172.21.15.2:0/3662378815 learned_addr learned my addr 172.21.15.2:0/3662378815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f37398f1640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 -- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 msgr2=0x5636649be180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649be180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 -- 172.21.15.2:0/3662378815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 msgr2=0x5636649bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 -- 172.21.15.2:0/3662378815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636648e2c90 con 0x5636649b44d0 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649c06b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f372c010fa0 tx=0x7f372c0074c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92496c0f5b878c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f371dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f371dffb640 1 -- 172.21.15.2:0/3662378815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c014070 con 0x5636649b44d0 2024-09-10T23:28:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f372c00ee90 con 0x5636649b44d0 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f371dffb640 1 -- 172.21.15.2:0/3662378815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f372c010640 con 0x5636649b44d0 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f371dffb640 1 -- 172.21.15.2:0/3662378815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f372c010840 con 0x5636649b44d0 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373e72b740 10 client.16746 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.285+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5636649cf370 con 0x5636649b44d0 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f371dffb640 1 -- 172.21.15.2:0/3662378815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f372c00ee90 con 0x5636649b44d0 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f371dffb640 1 -- 172.21.15.2:0/3662378815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f372c004040 con 0x5636649b44d0 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f373e72b740 10 client.16746 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f373e72b740 10 client.16746 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f373e72b740 20 client.16746 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f373e72b740 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5636649d06c0 0x5636649d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f373e72b740 4 client.16746 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56366492cdf0 con 0x5636649d06c0 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f37398f1640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5636649d06c0 0x5636649d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f37398f1640 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5636649d06c0 0x5636649d2ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3db2aeaec50ace2c server_cookie=a97e5d0ba82682df in_seq=0 out_seq=0 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.286+0000 7f371dffb640 10 client.16746 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f371dffb640 1 -- 172.21.15.2:0/3662378815 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56366492cdf0 con 0x5636649d06c0 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f371dffb640 10 client.16746 handle_command_reply: tid=0 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 client.16746 shutdown 2024-09-10T23:28:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 msgr2=0x5636649c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649c06b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f372c010fa0 tx=0x7f372c0074c0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 shutdown_connections 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5636649d06c0 0x5636649d2ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649be180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 --2- 172.21.15.2:0/3662378815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649c06b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f371dffb640 0 client.16746 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.287+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 >> 172.21.15.2:0/3662378815 conn(0x5636649b2300 msgr2=0x5636649b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.288+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 shutdown_connections 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.288+0000 7f373e72b740 1 -- 172.21.15.2:0/3662378815 wait complete. 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.288+0000 7f373e72b740 20 client.16746 trim_cache size 0 max 16384 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 Processor -- start 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 -- start start 2024-09-10T23:28:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37341ae390 con 0x5636649b44d0 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37341afed0 con 0x5636649b4df0 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373e72b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37341aea60 con 0x5636649c0d80 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45884/0 (socket says 172.21.15.2:45884) 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.301+0000 7f373a8f3640 1 -- 172.21.15.2:0/470517404 learned_addr learned my addr 172.21.15.2:0/470517404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f37398f1640 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f373a8f3640 1 -- 172.21.15.2:0/470517404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 msgr2=0x5636649c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f373a8f3640 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f373a8f3640 1 -- 172.21.15.2:0/470517404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 msgr2=0x5636649b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f373a8f3640 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f373a8f3640 1 -- 172.21.15.2:0/470517404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636649be4f0 con 0x5636649b44d0 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f37398f1640 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f373a8f3640 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649ccc30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f372c007640 tx=0x7f372c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfad8328b248b6a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f371ffff640 1 -- 172.21.15.2:0/470517404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c014070 con 0x5636649b44d0 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f371ffff640 1 -- 172.21.15.2:0/470517404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f372c037070 con 0x5636649b44d0 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.302+0000 7f371ffff640 1 -- 172.21.15.2:0/470517404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c0109e0 con 0x5636649b44d0 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 -- 172.21.15.2:0/470517404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 msgr2=0x5636649ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649ccc30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f372c007640 tx=0x7f372c007ca0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 -- 172.21.15.2:0/470517404 shutdown_connections 2024-09-10T23:28:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649c0d80 0x5636649c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b4df0 0x5636649b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 --2- 172.21.15.2:0/470517404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649b44d0 0x5636649ccc30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 -- 172.21.15.2:0/470517404 >> 172.21.15.2:0/470517404 conn(0x5636649b2300 msgr2=0x5636649b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 -- 172.21.15.2:0/470517404 shutdown_connections 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 -- 172.21.15.2:0/470517404 wait complete. 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 -- start start 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.303+0000 7f373e72b740 1 Processor -- start 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b44d0 0x5636649c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 0x5636649c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37341af800 con 0x5636649c0d80 2024-09-10T23:28:13.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37341af130 con 0x5636649b44d0 2024-09-10T23:28:13.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37341ac370 con 0x5636649b4df0 2024-09-10T23:28:13.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 10 client.0 _ll_register_callbacks cb 0x7f37280093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:13.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 0x5636649c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 0x5636649c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45890/0 (socket says 172.21.15.2:45890) 2024-09-10T23:28:13.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 -- 172.21.15.2:0/3918988934 learned_addr learned my addr 172.21.15.2:0/3918988934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b44d0 0x5636649c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f37398f1640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 -- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 msgr2=0x5636649c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 -- 172.21.15.2:0/3918988934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b44d0 msgr2=0x5636649c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b44d0 0x5636649c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 -- 172.21.15.2:0/3918988934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563664a3d2e0 con 0x5636649c0d80 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373a8f3640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 0x5636649c43e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f372c007560 tx=0x7f372c007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148dd43a849c2fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f371dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f371dffb640 1 -- 172.21.15.2:0/3918988934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c014070 con 0x5636649c0d80 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f372c037070 con 0x5636649c0d80 2024-09-10T23:28:13.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.304+0000 7f371dffb640 1 -- 172.21.15.2:0/3918988934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f372c0109e0 con 0x5636649c0d80 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f371dffb640 1 -- 172.21.15.2:0/3918988934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f372c010be0 con 0x5636649c0d80 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 10 client.16752 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563664a3e500 con 0x5636649c0d80 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f371dffb640 1 -- 172.21.15.2:0/3918988934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f372c037070 con 0x5636649c0d80 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f371dffb640 1 -- 172.21.15.2:0/3918988934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f372c005160 con 0x5636649c0d80 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 10 client.16752 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 10 client.16752 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 20 client.16752 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x563664a3eb00 0x563664a40ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 4 client.16752 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:13.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636649288a0 con 0x563664a3eb00 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.305+0000 7f37398f1640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x563664a3eb00 0x563664a40ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f37398f1640 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x563664a3eb00 0x563664a40ef0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=81fcbd87680d2ee6 server_cookie=28c9c9790c6dd51d in_seq=0 out_seq=0 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f371dffb640 10 client.16752 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f371dffb640 1 -- 172.21.15.2:0/3918988934 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636649288a0 con 0x563664a3eb00 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f371dffb640 10 client.16752 handle_command_reply: tid=0 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 client.16752 shutdown 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 msgr2=0x5636649c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 0x5636649c43e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f372c007560 tx=0x7f372c007740 comp rx=0 tx=0).stop 2024-09-10T23:28:13.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 shutdown_connections 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x563664a3eb00 0x563664a40ef0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f371dffb640 0 client.16752 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636649c0d80 0x5636649c43e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636649b4df0 0x5636649c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 --2- 172.21.15.2:0/3918988934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5636649b44d0 0x5636649c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 >> 172.21.15.2:0/3918988934 conn(0x5636649b2300 msgr2=0x5636649bf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 shutdown_connections 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 1 -- 172.21.15.2:0/3918988934 wait complete. 2024-09-10T23:28:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.306+0000 7f373e72b740 20 client.16752 trim_cache size 0 max 16384 2024-09-10T23:28:13.329 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:13.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37200b52e0 msgr2=0x7f37200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37200b52e0 0x7f37200b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f37300c9290 tx=0x7f373010c060 comp rx=0 tx=0).stop 2024-09-10T23:28:13.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 msgr2=0x7f3734199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:13.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734199280 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3730006010 tx=0x7f37300042f0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 shutdown_connections 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f37200b52e0 0x7f37200b77a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f373410d250 0x7f373419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373410a920 0x7f37341997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 --2- 172.21.15.2:0/1548705977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3734101810 0x7f3734199280 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 >> 172.21.15.2:0/1548705977 conn(0x7f3734076f50 msgr2=0x7f37341005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 shutdown_connections 2024-09-10T23:28:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:13.307+0000 7f373c356640 1 -- 172.21.15.2:0/1548705977 wait complete. 2024-09-10T23:28:13.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:13 smithi177 ceph-mon[35760]: pgmap v468: 97 pgs: 97 active+clean; 2.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:28:13.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:13 smithi154 ceph-mon[35136]: pgmap v468: 97 pgs: 97 active+clean; 2.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:28:14.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:28:14.361 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:14.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.846+0000 7ff65fe11640 1 -- 172.21.15.2:0/2178432267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65810d100 msgr2=0x7ff65810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.846+0000 7ff65fe11640 1 --2- 172.21.15.2:0/2178432267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65810d100 0x7ff65810f560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff650009ca0 tx=0x7ff65002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- 172.21.15.2:0/2178432267 shutdown_connections 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 --2- 172.21.15.2:0/2178432267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65810d100 0x7ff65810f560 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 --2- 172.21.15.2:0/2178432267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6581045c0 0x7ff65810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 --2- 172.21.15.2:0/2178432267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff658103ca0 0x7ff658104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- 172.21.15.2:0/2178432267 >> 172.21.15.2:0/2178432267 conn(0x7ff6580fd700 msgr2=0x7ff6580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- 172.21.15.2:0/2178432267 shutdown_connections 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- 172.21.15.2:0/2178432267 wait complete. 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 Processor -- start 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- start start 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 0x7ff65819b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6581045c0 0x7ff65819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff65810d100 0x7ff6581a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff658112dd0 con 0x7ff658103ca0 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff658112c50 con 0x7ff6581045c0 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.847+0000 7ff65fe11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff658112f50 con 0x7ff65810d100 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 0x7ff65819b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 0x7ff65819b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45908/0 (socket says 172.21.15.2:45908) 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 -- 172.21.15.2:0/924574238 learned_addr learned my addr 172.21.15.2:0/924574238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6581045c0 0x7ff65819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff65810d100 0x7ff6581a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 -- 172.21.15.2:0/924574238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff65810d100 msgr2=0x7ff6581a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff65810d100 0x7ff6581a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 -- 172.21.15.2:0/924574238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6581045c0 msgr2=0x7ff65819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6581045c0 0x7ff65819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 -- 172.21.15.2:0/924574238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6581a1630 con 0x7ff658103ca0 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65dbad640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 0x7ff65819b580 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b4a0 tx=0x7ff65400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff64effd640 1 -- 172.21.15.2:0/924574238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654014070 con 0x7ff658103ca0 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6581a1920 con 0x7ff658103ca0 2024-09-10T23:28:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff64effd640 1 -- 172.21.15.2:0/924574238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff654010ac0 con 0x7ff658103ca0 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff64effd640 1 -- 172.21.15.2:0/924574238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654017c30 con 0x7ff658103ca0 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.848+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581a7fe0 con 0x7ff658103ca0 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.851+0000 7ff64effd640 1 -- 172.21.15.2:0/924574238 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff654010610 con 0x7ff658103ca0 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.851+0000 7ff6621e6740 1 Processor -- start 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.851+0000 7ff6621e6740 1 -- start start 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3332074d0 0x55e3332078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 0x55e333213840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e333216170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff6621e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e33317dea0 con 0x55e333207df0 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff6621e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e33316d2d0 con 0x55e3332074d0 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff6621e6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e3331710e0 con 0x55e333213d80 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 0x55e333213840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 0x55e333213840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45920/0 (socket says 172.21.15.2:45920) 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 -- 172.21.15.2:0/3842467107 learned_addr learned my addr 172.21.15.2:0/3842467107 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3332074d0 0x55e3332078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e333216170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 -- 172.21.15.2:0/3842467107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 msgr2=0x55e333216170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e333216170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 -- 172.21.15.2:0/3842467107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3332074d0 msgr2=0x55e3332078b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3332074d0 0x55e3332078b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 -- 172.21.15.2:0/3842467107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e332ecb650 con 0x55e333207df0 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3332074d0 0x55e3332078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff64effd640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff6440b52e0 0x7ff6440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff6440b52e0 0x7ff6440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.852+0000 7ff65dbad640 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 0x55e333213840 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff6540e2ed0 tx=0x7ff6540eb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc968cbf8da034e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff64effd640 1 -- 172.21.15.2:0/924574238 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff6540e5480 con 0x7ff658103ca0 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff643fff640 1 -- 172.21.15.2:0/3842467107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65401e030 con 0x55e333207df0 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff643fff640 1 -- 172.21.15.2:0/3842467107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6540ebe50 con 0x55e333207df0 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff643fff640 1 -- 172.21.15.2:0/3842467107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540a7af0 con 0x55e333207df0 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff6621e6740 1 -- 172.21.15.2:0/3842467107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 msgr2=0x55e333213840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff6440b52e0 0x7ff6440b77a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff650005fa0 tx=0x7ff650005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.853+0000 7ff6621e6740 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 0x55e333213840 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff6540e2ed0 tx=0x7ff6540eb6e0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- 172.21.15.2:0/3842467107 shutdown_connections 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e333216170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e333207df0 0x55e333213840 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 --2- 172.21.15.2:0/3842467107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3332074d0 0x55e3332078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- 172.21.15.2:0/3842467107 >> 172.21.15.2:0/3842467107 conn(0x55e333205300 msgr2=0x55e3332064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- 172.21.15.2:0/3842467107 shutdown_connections 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- 172.21.15.2:0/3842467107 wait complete. 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- start start 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 Processor -- start 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333213610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333210a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e333211000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e332fce700 con 0x55e3332074d0 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e333108160 con 0x55e333213d80 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.854+0000 7ff6621e6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e333216a00 con 0x55e333207df0 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff6621e6740 10 client.0 _ll_register_callbacks cb 0x55e3331219e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:14.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333213610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333213610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45934/0 (socket says 172.21.15.2:45934) 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 -- 172.21.15.2:0/732911159 learned_addr learned my addr 172.21.15.2:0/732911159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e333211000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333210a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 -- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 msgr2=0x55e333210a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333210a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 -- 172.21.15.2:0/732911159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 msgr2=0x55e333211000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e333211000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 -- 172.21.15.2:0/732911159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e333135c90 con 0x55e3332074d0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff65dbad640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333213610 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff6540ab950 tx=0x7ff6540e8ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86056ad3033d2f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff6417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff6417fa640 1 -- 172.21.15.2:0/732911159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540ab3c0 con 0x55e3332074d0 2024-09-10T23:28:14.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff6417fa640 1 -- 172.21.15.2:0/732911159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff6540eb160 con 0x55e3332074d0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6540ebe50 con 0x55e3332074d0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.855+0000 7ff6417fa640 1 -- 172.21.15.2:0/732911159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6540ab5a0 con 0x55e3332074d0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 10 client.16764 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e333222300 con 0x55e3332074d0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6417fa640 1 -- 172.21.15.2:0/732911159 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6540ebe50 con 0x55e3332074d0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6417fa640 1 -- 172.21.15.2:0/732911159 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff6540e50e0 con 0x55e3332074d0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 10 client.16764 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 10 client.16764 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 20 client.16764 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333223650 0x55e333225a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 4 client.16764 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e33317fdf0 con 0x55e333223650 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.856+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333223650 0x55e333225a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.857+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333223650 0x55e333225a40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=607e2498f13248cd server_cookie=baeaaec21f46d8a5 in_seq=0 out_seq=0 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.857+0000 7ff6417fa640 10 client.16764 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6417fa640 1 -- 172.21.15.2:0/732911159 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e33317fdf0 con 0x55e333223650 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6417fa640 10 client.16764 handle_command_reply: tid=0 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 client.16764 shutdown 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 msgr2=0x55e333213610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333213610 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff6540ab950 tx=0x7ff6540e8ad0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 shutdown_connections 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333223650 0x55e333225a40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e333211000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333210a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6417fa640 0 client.16764 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 --2- 172.21.15.2:0/732911159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333213610 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 >> 172.21.15.2:0/732911159 conn(0x55e333205300 msgr2=0x55e33320aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 shutdown_connections 2024-09-10T23:28:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 1 -- 172.21.15.2:0/732911159 wait complete. 2024-09-10T23:28:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.858+0000 7ff6621e6740 20 client.16764 trim_cache size 0 max 16384 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.871+0000 7ff6621e6740 1 Processor -- start 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.871+0000 7ff6621e6740 1 -- start start 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.871+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333204c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333207df0 0x55e3332127a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e33320dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6621e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581b06c0 con 0x55e3332074d0 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6621e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581b2200 con 0x55e333207df0 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6621e6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581b0d90 con 0x55e333213d80 2024-09-10T23:28:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333204c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333204c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45950/0 (socket says 172.21.15.2:45950) 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 -- 172.21.15.2:0/1317827058 learned_addr learned my addr 172.21.15.2:0/1317827058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e33320dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 -- 172.21.15.2:0/1317827058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 msgr2=0x55e33320dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e33320dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 -- 172.21.15.2:0/1317827058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333207df0 msgr2=0x55e3332127a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333207df0 0x55e3332127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 -- 172.21.15.2:0/1317827058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e333211370 con 0x55e3332074d0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff65dbad640 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333204c10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff654004810 tx=0x7ff65400b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5957d41dc517078 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6437fe640 1 -- 172.21.15.2:0/1317827058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65401e070 con 0x55e3332074d0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6437fe640 1 -- 172.21.15.2:0/1317827058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6540ebe50 con 0x55e3332074d0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.872+0000 7ff6437fe640 1 -- 172.21.15.2:0/1317827058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540aba20 con 0x55e3332074d0 2024-09-10T23:28:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 -- 172.21.15.2:0/1317827058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 msgr2=0x55e333204c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333204c10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff654004810 tx=0x7ff65400b3f0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 -- 172.21.15.2:0/1317827058 shutdown_connections 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333213d80 0x55e33320dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333207df0 0x55e3332127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 --2- 172.21.15.2:0/1317827058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333204c10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 -- 172.21.15.2:0/1317827058 >> 172.21.15.2:0/1317827058 conn(0x55e333205300 msgr2=0x55e333212090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 -- 172.21.15.2:0/1317827058 shutdown_connections 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 -- 172.21.15.2:0/1317827058 wait complete. 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.873+0000 7ff6621e6740 1 -- start start 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 Processor -- start 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333226ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333227460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e33328f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581b1b30 con 0x55e3332074d0 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581b1460 con 0x55e333213d80 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581ae6a0 con 0x55e333207df0 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff6621e6740 10 client.0 _ll_register_callbacks cb 0x7ff650009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333226ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333226ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45956/0 (socket says 172.21.15.2:45956) 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 -- 172.21.15.2:0/384288401 learned_addr learned my addr 172.21.15.2:0/384288401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333227460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e33328f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 -- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 msgr2=0x55e333227460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333227460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 -- 172.21.15.2:0/384288401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 msgr2=0x55e33328f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e33328f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65dbad640 1 -- 172.21.15.2:0/384288401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33328f700 con 0x55e3332074d0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333227460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.874+0000 7ff65e3ae640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e33328f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff65dbad640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333226ee0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff6540a8220 tx=0x7ff654097160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2aaad83fc23789d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6417fa640 1 -- 172.21.15.2:0/384288401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65401e030 con 0x55e3332074d0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6417fa640 1 -- 172.21.15.2:0/384288401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff6540b4d50 con 0x55e3332074d0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6540ebe50 con 0x55e3332074d0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6417fa640 1 -- 172.21.15.2:0/384288401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6540a7af0 con 0x55e3332074d0 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 10 client.16770 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e33328f700 con 0x55e3332074d0 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6417fa640 1 -- 172.21.15.2:0/384288401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6540ebe50 con 0x55e3332074d0 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6417fa640 1 -- 172.21.15.2:0/384288401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff6540abeb0 con 0x55e3332074d0 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 10 client.16770 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 10 client.16770 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 20 client.16770 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333290c50 0x55e333293040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 4 client.16770 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.875+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e33317b8a0 con 0x55e333290c50 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333290c50 0x55e333293040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff65d3ac640 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333290c50 0x55e333293040 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f3b3d7c5796dd2d server_cookie=3fb06cf5b0c225bd in_seq=0 out_seq=0 2024-09-10T23:28:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6417fa640 10 client.16770 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6417fa640 1 -- 172.21.15.2:0/384288401 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e33317b8a0 con 0x55e333290c50 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6417fa640 10 client.16770 handle_command_reply: tid=0 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 client.16770 shutdown 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 msgr2=0x55e333226ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333226ee0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff6540a8220 tx=0x7ff654097160 comp rx=0 tx=0).stop 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 shutdown_connections 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55e333290c50 0x55e333293040 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e333213d80 0x55e33328f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6417fa640 0 client.16770 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e333207df0 0x55e333227460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 --2- 172.21.15.2:0/384288401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3332074d0 0x55e333226ee0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.876+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 >> 172.21.15.2:0/384288401 conn(0x55e333205300 msgr2=0x55e3332128b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 shutdown_connections 2024-09-10T23:28:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff6621e6740 1 -- 172.21.15.2:0/384288401 wait complete. 2024-09-10T23:28:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff6621e6740 20 client.16770 trim_cache size 0 max 16384 2024-09-10T23:28:14.888 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff6440b52e0 msgr2=0x7ff6440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff6440b52e0 0x7ff6440b77a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff650005fa0 tx=0x7ff650005c30 comp rx=0 tx=0).stop 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 msgr2=0x7ff65819b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 0x7ff65819b580 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b4a0 tx=0x7ff65400b960 comp rx=0 tx=0).stop 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 shutdown_connections 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff6440b52e0 0x7ff6440b77a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff65810d100 0x7ff6581a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6581045c0 0x7ff65819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 --2- 172.21.15.2:0/924574238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff658103ca0 0x7ff65819b580 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 >> 172.21.15.2:0/924574238 conn(0x7ff6580fd700 msgr2=0x7ff65810f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 shutdown_connections 2024-09-10T23:28:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:14.877+0000 7ff65fe11640 1 -- 172.21.15.2:0/924574238 wait complete. 2024-09-10T23:28:15.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:15 smithi177 ceph-mon[35760]: pgmap v469: 97 pgs: 97 active+clean; 2.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:28:15.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:15 smithi002 ceph-mon[31150]: pgmap v469: 97 pgs: 97 active+clean; 2.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:28:15.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:15 smithi154 ceph-mon[35136]: pgmap v469: 97 pgs: 97 active+clean; 2.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:28:15.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:28:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 -- 172.21.15.2:0/592699159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581029e0 msgr2=0x7faa58102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 --2- 172.21.15.2:0/592699159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581029e0 0x7faa58102e60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faa48009930 tx=0x7faa4802a420 comp rx=0 tx=0).stop 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 -- 172.21.15.2:0/592699159 shutdown_connections 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 --2- 172.21.15.2:0/592699159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa581033a0 0x7faa58109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 --2- 172.21.15.2:0/592699159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581029e0 0x7faa58102e60 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 --2- 172.21.15.2:0/592699159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58101890 0x7faa58101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 -- 172.21.15.2:0/592699159 >> 172.21.15.2:0/592699159 conn(0x7faa580fd170 msgr2=0x7faa580ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 -- 172.21.15.2:0/592699159 shutdown_connections 2024-09-10T23:28:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.241+0000 7faa60085640 1 -- 172.21.15.2:0/592699159 wait complete. 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 Processor -- start 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 -- start start 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa58101890 0x7faa58198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa581029e0 0x7faa58199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 0x7faa5819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa5810e690 con 0x7faa581033a0 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa5810e510 con 0x7faa581029e0 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa60085640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa5810e810 con 0x7faa58101890 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 0x7faa5819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 0x7faa5819a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45976/0 (socket says 172.21.15.2:45976) 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 -- 172.21.15.2:0/2529845349 learned_addr learned my addr 172.21.15.2:0/2529845349 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5d620640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa581029e0 0x7faa58199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5de21640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa58101890 0x7faa58198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 -- 172.21.15.2:0/2529845349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa58101890 msgr2=0x7faa58198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa58101890 0x7faa58198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 -- 172.21.15.2:0/2529845349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa581029e0 msgr2=0x7faa58199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa581029e0 0x7faa58199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.242+0000 7faa5e622640 1 -- 172.21.15.2:0/2529845349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5819a8f0 con 0x7faa581033a0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.243+0000 7faa5e622640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 0x7faa5819a030 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faa50009fd0 tx=0x7faa5000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.243+0000 7faa4effd640 1 -- 172.21.15.2:0/2529845349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50017070 con 0x7faa581033a0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.243+0000 7faa4effd640 1 -- 172.21.15.2:0/2529845349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa50003e20 con 0x7faa581033a0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.243+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5819abe0 con 0x7faa581033a0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.243+0000 7faa4effd640 1 -- 172.21.15.2:0/2529845349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50010460 con 0x7faa581033a0 2024-09-10T23:28:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.243+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa581a12b0 con 0x7faa581033a0 2024-09-10T23:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.245+0000 7faa62e5b740 1 Processor -- start 2024-09-10T23:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa4effd640 1 -- 172.21.15.2:0/2529845349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faa50003970 con 0x7faa581033a0 2024-09-10T23:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 -- start start 2024-09-10T23:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070e8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 0x5559070ea990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559070536f0 con 0x5559070e85a0 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555907042b20 con 0x5559070eafe0 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa62e5b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555907046930 con 0x5559070e5c70 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 0x5559070ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 0x5559070ea990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45984/0 (socket says 172.21.15.2:45984) 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 -- 172.21.15.2:0/693333830 learned_addr learned my addr 172.21.15.2:0/693333830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5d620640 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5d620640 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 -- 172.21.15.2:0/693333830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 msgr2=0x5559070e8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070e8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 -- 172.21.15.2:0/693333830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 msgr2=0x5559070ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5de21640 1 -- 172.21.15.2:0/693333830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555907008530 con 0x5559070e85a0 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.246+0000 7faa5d620640 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070e8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa4effd640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa440b5360 0x7faa440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa5d620640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa440b5360 0x7faa440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa5de21640 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 0x5559070ea990 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faa5400ac20 tx=0x7faa5400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9330956068a6f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa4effd640 1 -- 172.21.15.2:0/2529845349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa500e5850 con 0x7faa581033a0 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa43fff640 1 -- 172.21.15.2:0/693333830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5401d070 con 0x5559070e85a0 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa43fff640 1 -- 172.21.15.2:0/693333830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa54018af0 con 0x5559070e85a0 2024-09-10T23:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.247+0000 7faa43fff640 1 -- 172.21.15.2:0/693333830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54010ab0 con 0x5559070e85a0 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 -- 172.21.15.2:0/693333830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 msgr2=0x5559070ea990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa5d620640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa440b5360 0x7faa440b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa48005ab0 tx=0x7faa4803f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 0x5559070ea990 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faa5400ac20 tx=0x7faa5400f790 comp rx=0 tx=0).stop 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 -- 172.21.15.2:0/693333830 shutdown_connections 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e85a0 0x5559070ea990 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 --2- 172.21.15.2:0/693333830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070e8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 -- 172.21.15.2:0/693333830 >> 172.21.15.2:0/693333830 conn(0x5559070dc9b0 msgr2=0x5559070dd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 -- 172.21.15.2:0/693333830 shutdown_connections 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 -- 172.21.15.2:0/693333830 wait complete. 2024-09-10T23:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 -- start start 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.248+0000 7faa62e5b740 1 Processor -- start 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 0x5559070ef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070f0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555906f7aab0 con 0x5559070e5c70 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555906fe8730 con 0x5559070eafe0 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5559070edfc0 con 0x5559070e85a0 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa62e5b740 10 client.0 _ll_register_callbacks cb 0x55590703c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 0x5559070ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 0x5559070ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45992/0 (socket says 172.21.15.2:45992) 2024-09-10T23:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 -- 172.21.15.2:0/3209748792 learned_addr learned my addr 172.21.15.2:0/3209748792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5d620640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5e622640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 -- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 msgr2=0x5559070ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070ef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 -- 172.21.15.2:0/3209748792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 msgr2=0x5559070f0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070f0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 -- 172.21.15.2:0/3209748792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555906da4790 con 0x5559070e5c70 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5d620640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa5de21640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 0x5559070ef300 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faa54018720 tx=0x7faa54018750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8567e140b87780e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.249+0000 7faa417fa640 1 -- 172.21.15.2:0/3209748792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5401d050 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa417fa640 1 -- 172.21.15.2:0/3209748792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa54005450 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa54018af0 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa417fa640 1 -- 172.21.15.2:0/3209748792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa54005650 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 10 client.16782 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555906e1d620 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa417fa640 1 -- 172.21.15.2:0/3209748792 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa54018af0 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa417fa640 1 -- 172.21.15.2:0/3209748792 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa54004900 con 0x5559070e5c70 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 10 client.16782 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 10 client.16782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 20 client.16782 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5559070fa870 0x5559070fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 4 client.16782 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555907055640 con 0x5559070fa870 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.250+0000 7faa5d620640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5559070fa870 0x5559070fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.251+0000 7faa5d620640 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5559070fa870 0x5559070fcc60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d78a41be10e44 server_cookie=df97b7d2c4ef91d5 in_seq=0 out_seq=0 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.251+0000 7faa417fa640 10 client.16782 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa417fa640 1 -- 172.21.15.2:0/3209748792 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555907055640 con 0x5559070fa870 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa417fa640 10 client.16782 handle_command_reply: tid=0 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 client.16782 shutdown 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 msgr2=0x5559070ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 0x5559070ef300 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faa54018720 tx=0x7faa54018750 comp rx=0 tx=0).stop 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 shutdown_connections 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5559070fa870 0x5559070fcc60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070eafe0 0x5559070f0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 --2- 172.21.15.2:0/3209748792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070e5c70 0x5559070ef300 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa417fa640 0 client.16782 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 >> 172.21.15.2:0/3209748792 conn(0x5559070dc9b0 msgr2=0x5559070dbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 shutdown_connections 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 1 -- 172.21.15.2:0/3209748792 wait complete. 2024-09-10T23:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.252+0000 7faa62e5b740 20 client.16782 trim_cache size 0 max 16384 2024-09-10T23:28:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.266+0000 7faa62e5b740 1 Processor -- start 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.266+0000 7faa62e5b740 1 -- start start 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e85a0 0x5559070ded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x5559070df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa62e5b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa581a7ca0 con 0x5559070eafe0 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa62e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa581a97e0 con 0x5559070e85a0 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa62e5b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa581a8370 con 0x5559070e5c70 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x5559070df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x5559070df260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46004/0 (socket says 172.21.15.2:46004) 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 -- 172.21.15.2:0/1788038148 learned_addr learned my addr 172.21.15.2:0/1788038148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5de21640 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5d620640 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e85a0 0x5559070ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 -- 172.21.15.2:0/1788038148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 msgr2=0x5559070de7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070de7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 -- 172.21.15.2:0/1788038148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e85a0 msgr2=0x5559070ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e85a0 0x5559070ded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 -- 172.21.15.2:0/1788038148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559070dd450 con 0x5559070eafe0 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5d620640 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e85a0 0x5559070ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa5e622640 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x5559070df260 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faa500a9340 tx=0x7faa50004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0b3e1f260b79a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa437fe640 1 -- 172.21.15.2:0/1788038148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50020070 con 0x5559070eafe0 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa437fe640 1 -- 172.21.15.2:0/1788038148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa500ac0d0 con 0x5559070eafe0 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.267+0000 7faa437fe640 1 -- 172.21.15.2:0/1788038148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500a7da0 con 0x5559070eafe0 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 -- 172.21.15.2:0/1788038148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 msgr2=0x5559070df260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x5559070df260 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faa500a9340 tx=0x7faa50004480 comp rx=0 tx=0).stop 2024-09-10T23:28:16.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 -- 172.21.15.2:0/1788038148 shutdown_connections 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x5559070df260 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e85a0 0x5559070ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 --2- 172.21.15.2:0/1788038148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e5c70 0x5559070de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 -- 172.21.15.2:0/1788038148 >> 172.21.15.2:0/1788038148 conn(0x5559070dc9b0 msgr2=0x5559070dd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 -- 172.21.15.2:0/1788038148 shutdown_connections 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 -- 172.21.15.2:0/1788038148 wait complete. 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 -- start start 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.268+0000 7faa62e5b740 1 Processor -- start 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e5c70 0x5559070f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x55590715f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa581a9110 con 0x5559070eafe0 2024-09-10T23:28:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa581a8a40 con 0x5559070e5c70 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa581a5c80 con 0x5559070e85a0 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa62e5b740 10 client.0 _ll_register_callbacks cb 0x7faa5401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x55590715f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x55590715f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46016/0 (socket says 172.21.15.2:46016) 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 -- 172.21.15.2:0/870460726 learned_addr learned my addr 172.21.15.2:0/870460726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5de21640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e5c70 0x5559070f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5d620640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 -- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 msgr2=0x5559070f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 -- 172.21.15.2:0/870460726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e5c70 msgr2=0x5559070f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e5c70 0x5559070f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 -- 172.21.15.2:0/870460726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55590715fee0 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa5e622640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x55590715f6b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faa500e33b0 tx=0x7faa50004010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d995e50a9b413f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.269+0000 7faa417fa640 1 -- 172.21.15.2:0/870460726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50097070 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa417fa640 1 -- 172.21.15.2:0/870460726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa500a7d20 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa500ac0d0 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa417fa640 1 -- 172.21.15.2:0/870460726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa50020070 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 10 client.16788 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555907167220 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa417fa640 1 -- 172.21.15.2:0/870460726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa500ac0d0 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa417fa640 1 -- 172.21.15.2:0/870460726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa500b1c90 con 0x5559070eafe0 2024-09-10T23:28:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 10 client.16788 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 10 client.16788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 20 client.16788 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555907167b50 0x555907169f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 4 client.16788 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.270+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559070510f0 con 0x555907167b50 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.271+0000 7faa5de21640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555907167b50 0x555907169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.271+0000 7faa5de21640 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555907167b50 0x555907169f70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c7a657bbd51e3d6 server_cookie=cb7a98cc8da431d2 in_seq=0 out_seq=0 2024-09-10T23:28:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.271+0000 7faa417fa640 10 client.16788 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa417fa640 1 -- 172.21.15.2:0/870460726 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559070510f0 con 0x555907167b50 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa417fa640 10 client.16788 handle_command_reply: tid=0 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 client.16788 shutdown 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 msgr2=0x55590715f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x55590715f6b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faa500e33b0 tx=0x7faa50004010 comp rx=0 tx=0).stop 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 shutdown_connections 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555907167b50 0x555907169f70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559070eafe0 0x55590715f6b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5559070e85a0 0x5559070f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa417fa640 0 client.16788 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 --2- 172.21.15.2:0/870460726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559070e5c70 0x5559070f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 >> 172.21.15.2:0/870460726 conn(0x5559070dc9b0 msgr2=0x5559070e1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 shutdown_connections 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 1 -- 172.21.15.2:0/870460726 wait complete. 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.285+0000 7faa62e5b740 20 client.16788 trim_cache size 0 max 16384 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:28:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:28:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:28:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa440b5360 msgr2=0x7faa440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa440b5360 0x7faa440b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa48005ab0 tx=0x7faa4803f040 comp rx=0 tx=0).stop 2024-09-10T23:28:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 msgr2=0x7faa5819a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 0x7faa5819a030 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faa50009fd0 tx=0x7faa5000b260 comp rx=0 tx=0).stop 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 shutdown_connections 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa440b5360 0x7faa440b7820 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa581033a0 0x7faa5819a030 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa581029e0 0x7faa58199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 --2- 172.21.15.2:0/2529845349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa58101890 0x7faa58198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 >> 172.21.15.2:0/2529845349 conn(0x7faa580fd170 msgr2=0x7faa58105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 shutdown_connections 2024-09-10T23:28:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:16.286+0000 7faa60085640 1 -- 172.21.15.2:0/2529845349 wait complete. 2024-09-10T23:28:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 -- 172.21.15.2:0/3986210819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc8108020 msgr2=0x7f0dc810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/3986210819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc8108020 0x7f0dc810e820 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009ca0 tx=0x7f0dc002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 -- 172.21.15.2:0/3986210819 shutdown_connections 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/3986210819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc8108020 0x7f0dc810e820 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/3986210819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc81076a0 0x7f0dc8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/3986210819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc8101c90 0x7f0dc8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 -- 172.21.15.2:0/3986210819 >> 172.21.15.2:0/3986210819 conn(0x7f0dc80fd700 msgr2=0x7f0dc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 -- 172.21.15.2:0/3986210819 shutdown_connections 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 -- 172.21.15.2:0/3986210819 wait complete. 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.550+0000 7f0dce0e4640 1 Processor -- start 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 -- start start 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8101c90 0x7f0dc8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 0x7f0dc8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc8108020 0x7f0dc819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8112dc0 con 0x7f0dc81076a0 2024-09-10T23:28:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8112c40 con 0x7f0dc8101c90 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dce0e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8112f40 con 0x7f0dc8108020 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 0x7f0dc8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 0x7f0dc8199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46034/0 (socket says 172.21.15.2:46034) 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2063745342 learned_addr learned my addr 172.21.15.2:0/2063745342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8101c90 0x7f0dc8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc8108020 0x7f0dc819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2063745342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc8108020 msgr2=0x7f0dc819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc8108020 0x7f0dc819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2063745342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8101c90 msgr2=0x7f0dc8199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8101c90 0x7f0dc8199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.551+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2063745342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc819f300 con 0x7f0dc81076a0 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.552+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 0x7f0dc8199790 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e9f0 tx=0x7f0dbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.552+0000 7f0dc4ff9640 1 -- 172.21.15.2:0/2063745342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00cd80 con 0x7f0dc81076a0 2024-09-10T23:28:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.552+0000 7f0dc4ff9640 1 -- 172.21.15.2:0/2063745342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dbc0108e0 con 0x7f0dc81076a0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.552+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc819f5f0 con 0x7f0dc81076a0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.552+0000 7f0dc4ff9640 1 -- 172.21.15.2:0/2063745342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc018980 con 0x7f0dc81076a0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.552+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc81a5cb0 con 0x7f0dc81076a0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.554+0000 7f0dd04b9740 1 Processor -- start 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.554+0000 7f0dc4ff9640 1 -- 172.21.15.2:0/2063745342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0dbc010430 con 0x7f0dc81076a0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.554+0000 7f0dd04b9740 1 -- start start 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.554+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda8578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.554+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda863840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.554+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda863d80 0x557fda866170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557fda7cdea0 con 0x557fda857df0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fda7bd2d0 con 0x557fda8574d0 2024-09-10T23:28:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557fda7c10e0 con 0x557fda863d80 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda863840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda863840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46050/0 (socket says 172.21.15.2:46050) 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 -- 172.21.15.2:0/507003578 learned_addr learned my addr 172.21.15.2:0/507003578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda8578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda863d80 0x557fda866170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 -- 172.21.15.2:0/507003578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda863d80 msgr2=0x557fda866170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda863d80 0x557fda866170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 -- 172.21.15.2:0/507003578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 msgr2=0x557fda8578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda8578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 -- 172.21.15.2:0/507003578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fda51b650 con 0x557fda857df0 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda8578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc4ff9640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0db00b52e0 0x7f0db00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda863840 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b760 tx=0x7f0db800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8f055d5118c140 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0db00b52e0 0x7f0db00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dc4ff9640 1 -- 172.21.15.2:0/2063745342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0dbc0e5f60 con 0x7f0dc81076a0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.555+0000 7f0dadffb640 1 -- 172.21.15.2:0/507003578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8003dd0 con 0x557fda857df0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dadffb640 1 -- 172.21.15.2:0/507003578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db8015070 con 0x557fda857df0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dadffb640 1 -- 172.21.15.2:0/507003578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8004e00 con 0x557fda857df0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 -- 172.21.15.2:0/507003578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 msgr2=0x557fda863840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0db00b52e0 0x7f0db00b77a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0006010 tx=0x7f0dc0009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda863840 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b760 tx=0x7f0db800bc20 comp rx=0 tx=0).stop 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 -- 172.21.15.2:0/507003578 shutdown_connections 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda863d80 0x557fda866170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda863840 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/507003578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda8578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 -- 172.21.15.2:0/507003578 >> 172.21.15.2:0/507003578 conn(0x557fda855300 msgr2=0x557fda8564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 -- 172.21.15.2:0/507003578 shutdown_connections 2024-09-10T23:28:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.556+0000 7f0dd04b9740 1 -- 172.21.15.2:0/507003578 wait complete. 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 -- start start 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 Processor -- start 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda8574d0 0x557fda863650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda860aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda861080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557fda61e700 con 0x557fda857df0 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fda758160 con 0x557fda863d80 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557fda866a00 con 0x557fda8574d0 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dd04b9740 10 client.0 _ll_register_callbacks cb 0x557fda7719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.557+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda860aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda8574d0 0x557fda863650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda860aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46064/0 (socket says 172.21.15.2:46064) 2024-09-10T23:28:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2856690445 learned_addr learned my addr 172.21.15.2:0/2856690445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda861080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2856690445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda8574d0 msgr2=0x557fda863650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda8574d0 0x557fda863650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 msgr2=0x557fda861080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda861080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 -- 172.21.15.2:0/2856690445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fda785c90 con 0x557fda857df0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda860aa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0a8d00 tx=0x7f0dbc0a85d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387a6bda7894b9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0da6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0da6ffd640 1 -- 172.21.15.2:0/2856690445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0abea0 con 0x557fda857df0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0da6ffd640 1 -- 172.21.15.2:0/2856690445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0dbc0ab990 con 0x557fda857df0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db8015070 con 0x557fda857df0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0da6ffd640 1 -- 172.21.15.2:0/2856690445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0dbc0ac240 con 0x557fda857df0 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dd04b9740 10 client.16800 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.558+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557fda872310 con 0x557fda857df0 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0da6ffd640 1 -- 172.21.15.2:0/2856690445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db8015070 con 0x557fda857df0 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0da6ffd640 1 -- 172.21.15.2:0/2856690445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0dbc0a8080 con 0x557fda857df0 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dd04b9740 10 client.16800 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dd04b9740 10 client.16800 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dd04b9740 20 client.16800 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda875c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dd04b9740 4 client.16800 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fda7cfdf0 con 0x557fda873820 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.559+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda875c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0da6ffd640 10 client.16800 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda875c50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=424859b22ed14e0a server_cookie=46a953511295d77e in_seq=0 out_seq=0 2024-09-10T23:28:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0da6ffd640 1 -- 172.21.15.2:0/2856690445 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fda7cfdf0 con 0x557fda873820 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0da6ffd640 10 client.16800 handle_command_reply: tid=0 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0dd04b9740 1 client.16800 shutdown 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 msgr2=0x557fda860aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.560+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda860aa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0a8d00 tx=0x7f0dbc0a85d0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 shutdown_connections 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda861080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda875c50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda857df0 0x557fda860aa0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0da6ffd640 0 client.16800 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/2856690445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda8574d0 0x557fda863650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 >> 172.21.15.2:0/2856690445 conn(0x557fda855300 msgr2=0x557fda85aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 shutdown_connections 2024-09-10T23:28:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 1 -- 172.21.15.2:0/2856690445 wait complete. 2024-09-10T23:28:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.561+0000 7f0dd04b9740 20 client.16800 trim_cache size 0 max 16384 2024-09-10T23:28:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 Processor -- start 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 -- start start 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 0x557fda86fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda865170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda8656b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81ae320 con 0x557fda8574d0 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81afe60 con 0x557fda863d80 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81ae9f0 con 0x557fda857df0 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 0x557fda86fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 0x557fda86fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46066/0 (socket says 172.21.15.2:46066) 2024-09-10T23:28:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 -- 172.21.15.2:0/1801485121 learned_addr learned my addr 172.21.15.2:0/1801485121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda865170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda8656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 -- 172.21.15.2:0/1801485121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 msgr2=0x557fda865170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda865170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 -- 172.21.15.2:0/1801485121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 msgr2=0x557fda8656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda8656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc77fe640 1 -- 172.21.15.2:0/1801485121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fda850bb0 con 0x557fda8574d0 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.574+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda865170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.575+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 0x557fda86fc30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000c00 tx=0x7f0db800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f38b7910c5f283 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.575+0000 7f0dad7fa640 1 -- 172.21.15.2:0/1801485121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8004740 con 0x557fda8574d0 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.575+0000 7f0dad7fa640 1 -- 172.21.15.2:0/1801485121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db8015030 con 0x557fda8574d0 2024-09-10T23:28:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.575+0000 7f0dad7fa640 1 -- 172.21.15.2:0/1801485121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8026af0 con 0x557fda8574d0 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.575+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1801485121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 msgr2=0x557fda86fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.575+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 0x557fda86fc30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000c00 tx=0x7f0db800b420 comp rx=0 tx=0).stop 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1801485121 shutdown_connections 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda863d80 0x557fda8656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda865170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1801485121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda8574d0 0x557fda86fc30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1801485121 >> 172.21.15.2:0/1801485121 conn(0x557fda855300 msgr2=0x557fda8628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1801485121 shutdown_connections 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1801485121 wait complete. 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 -- start start 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.576+0000 7f0dd04b9740 1 Processor -- start 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda86c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda86c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 0x557fda866ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81af790 con 0x557fda863d80 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81af0c0 con 0x557fda8574d0 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81ac300 con 0x557fda857df0 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dd04b9740 10 client.0 _ll_register_callbacks cb 0x7f0dbc009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 0x557fda866ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 0x557fda866ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46070/0 (socket says 172.21.15.2:46070) 2024-09-10T23:28:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda86c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 -- 172.21.15.2:0/1656896973 learned_addr learned my addr 172.21.15.2:0/1656896973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc6ffd640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda86c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 -- 172.21.15.2:0/1656896973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 msgr2=0x557fda86c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda86c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 -- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 msgr2=0x557fda86c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda86c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 -- 172.21.15.2:0/1656896973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fda8676d0 con 0x557fda863d80 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda86c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0dc7fff640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 0x557fda866ea0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00316d0 tx=0x7f0dc00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2b2cea707ac1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0da6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0da6ffd640 1 -- 172.21.15.2:0/1656896973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0056060 con 0x557fda863d80 2024-09-10T23:28:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.577+0000 7f0da6ffd640 1 -- 172.21.15.2:0/1656896973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0dc002fb60 con 0x557fda863d80 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db8015030 con 0x557fda863d80 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0da6ffd640 1 -- 172.21.15.2:0/1656896973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0dc002fd60 con 0x557fda863d80 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 10 client.16806 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557fda8e1430 con 0x557fda863d80 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0da6ffd640 1 -- 172.21.15.2:0/1656896973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db8015030 con 0x557fda863d80 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0da6ffd640 1 -- 172.21.15.2:0/1656896973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0dc0044040 con 0x557fda863d80 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 10 client.16806 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 10 client.16806 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 20 client.16806 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda8e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 4 client.16806 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.578+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fda7cb8a0 con 0x557fda873820 2024-09-10T23:28:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.579+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda8e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.579+0000 7f0dc77fe640 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda8e3c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2d6ce975dd2a70d server_cookie=f3cc959829b51a7 in_seq=0 out_seq=0 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.579+0000 7f0da6ffd640 10 client.16806 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.579+0000 7f0da6ffd640 1 -- 172.21.15.2:0/1656896973 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fda7cb8a0 con 0x557fda873820 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.579+0000 7f0da6ffd640 10 client.16806 handle_command_reply: tid=0 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.579+0000 7f0dd04b9740 1 client.16806 shutdown 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 msgr2=0x557fda866ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 0x557fda866ea0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00316d0 tx=0x7f0dc00095c0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 shutdown_connections 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557fda873820 0x557fda8e3c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557fda863d80 0x557fda866ea0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557fda857df0 0x557fda86c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0da6ffd640 0 client.16806 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:28:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 --2- 172.21.15.2:0/1656896973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fda8574d0 0x557fda86c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 >> 172.21.15.2:0/1656896973 conn(0x557fda855300 msgr2=0x557fda85a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 shutdown_connections 2024-09-10T23:28:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 1 -- 172.21.15.2:0/1656896973 wait complete. 2024-09-10T23:28:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dd04b9740 20 client.16806 trim_cache size 0 max 16384 2024-09-10T23:28:16.587 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0db00b52e0 msgr2=0x7f0db00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0db00b52e0 0x7f0db00b77a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0006010 tx=0x7f0dc0009360 comp rx=0 tx=0).stop 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 msgr2=0x7f0dc8199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 0x7f0dc8199790 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e9f0 tx=0x7f0dbc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 shutdown_connections 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0db00b52e0 0x7f0db00b77a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc8108020 0x7f0dc819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dc81076a0 0x7f0dc8199790 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 --2- 172.21.15.2:0/2063745342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8101c90 0x7f0dc8199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.580+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 >> 172.21.15.2:0/2063745342 conn(0x7f0dc80fd700 msgr2=0x7f0dc80fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.581+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 shutdown_connections 2024-09-10T23:28:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:16.581+0000 7f0dce0e4640 1 -- 172.21.15.2:0/2063745342 wait complete. 2024-09-10T23:28:17.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:28:17.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:17 smithi002 ceph-mon[31150]: pgmap v470: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:17.702 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:17.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:17 smithi177 ceph-mon[35760]: pgmap v470: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:17.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:17 smithi154 ceph-mon[35136]: pgmap v470: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 -- 172.21.15.2:0/2517875773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 msgr2=0x7fc60c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2517875773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c10f560 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc604009ca0 tx=0x7fc60402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 -- 172.21.15.2:0/2517875773 shutdown_connections 2024-09-10T23:28:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2517875773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c10f560 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2517875773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc60c1045c0 0x7fc60c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2517875773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60c103ca0 0x7fc60c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 -- 172.21.15.2:0/2517875773 >> 172.21.15.2:0/2517875773 conn(0x7fc60c0fd700 msgr2=0x7fc60c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 -- 172.21.15.2:0/2517875773 shutdown_connections 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 -- 172.21.15.2:0/2517875773 wait complete. 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.201+0000 7fc611ff8640 1 Processor -- start 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 -- start start 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60c103ca0 0x7fc60c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc60c1045c0 0x7fc60c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c112d70 con 0x7fc60c10d100 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c112bf0 con 0x7fc60c1045c0 2024-09-10T23:28:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc611ff8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c112ef0 con 0x7fc60c103ca0 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46092/0 (socket says 172.21.15.2:46092) 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 -- 172.21.15.2:0/2943456002 learned_addr learned my addr 172.21.15.2:0/2943456002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60c103ca0 0x7fc60c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60affd640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc60c1045c0 0x7fc60c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 -- 172.21.15.2:0/2943456002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60c103ca0 msgr2=0x7fc60c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60c103ca0 0x7fc60c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 -- 172.21.15.2:0/2943456002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc60c1045c0 msgr2=0x7fc60c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc60c1045c0 0x7fc60c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.202+0000 7fc60bfff640 1 -- 172.21.15.2:0/2943456002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c19f330 con 0x7fc60c10d100 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.203+0000 7fc60bfff640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c19eb60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc604005cc0 tx=0x7fc60402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.203+0000 7fc608ff9640 1 -- 172.21.15.2:0/2943456002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604003bf0 con 0x7fc60c10d100 2024-09-10T23:28:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.203+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c19f5c0 con 0x7fc60c10d100 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.203+0000 7fc608ff9640 1 -- 172.21.15.2:0/2943456002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc604003d90 con 0x7fc60c10d100 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.203+0000 7fc608ff9640 1 -- 172.21.15.2:0/2943456002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60402fbc0 con 0x7fc60c10d100 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.203+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1a5ce0 con 0x7fc60c10d100 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.205+0000 7fc608ff9640 1 -- 172.21.15.2:0/2943456002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc604004610 con 0x7fc60c10d100 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.205+0000 7fc6143cd740 1 Processor -- start 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.205+0000 7fc6143cd740 1 -- start start 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ae0f0 0x5569393ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393ba460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393bcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc6143cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556939324ea0 con 0x5569393ba9a0 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc6143cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569393142d0 con 0x5569393aea10 2024-09-10T23:28:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc6143cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5569393180e0 con 0x5569393ae0f0 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393bcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393bcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46094/0 (socket says 172.21.15.2:46094) 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 -- 172.21.15.2:0/417861044 learned_addr learned my addr 172.21.15.2:0/417861044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ae0f0 0x5569393ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 -- 172.21.15.2:0/417861044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ae0f0 msgr2=0x5569393ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ae0f0 0x5569393ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 -- 172.21.15.2:0/417861044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 msgr2=0x5569393ba460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393ba460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 -- 172.21.15.2:0/417861044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556939072650 con 0x5569393ba9a0 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc608ff9640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5f40b52e0 0x7fc5f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60affd640 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393bcd90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc600011700 tx=0x7fc60000a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc04c6040ad3ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.206+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5f40b52e0 0x7fc5f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc608ff9640 1 -- 172.21.15.2:0/2943456002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc604106f90 con 0x7fc60c10d100 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc5f1ffb640 1 -- 172.21.15.2:0/417861044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600004030 con 0x5569393ba9a0 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc5f1ffb640 1 -- 172.21.15.2:0/417861044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6000054d0 con 0x5569393ba9a0 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc5f1ffb640 1 -- 172.21.15.2:0/417861044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600004b00 con 0x5569393ba9a0 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc6143cd740 1 -- 172.21.15.2:0/417861044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 msgr2=0x5569393bcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5f40b52e0 0x7fc5f40b77a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5569393ace00 tx=0x7fc5fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc6143cd740 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393bcd90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc600011700 tx=0x7fc60000a670 comp rx=0 tx=0).stop 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.207+0000 7fc6143cd740 1 -- 172.21.15.2:0/417861044 shutdown_connections 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393bcd90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393ba460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 --2- 172.21.15.2:0/417861044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ae0f0 0x5569393ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 -- 172.21.15.2:0/417861044 >> 172.21.15.2:0/417861044 conn(0x5569393abf20 msgr2=0x5569393ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 -- 172.21.15.2:0/417861044 shutdown_connections 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 -- 172.21.15.2:0/417861044 wait complete. 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 -- start start 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.208+0000 7fc6143cd740 1 Processor -- start 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ba9a0 0x5569393b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556939175700 con 0x5569393ae0f0 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569392af160 con 0x5569393aea10 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5569393bd620 con 0x5569393ba9a0 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 10 client.0 _ll_register_callbacks cb 0x5569392c89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46104/0 (socket says 172.21.15.2:46104) 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 -- 172.21.15.2:0/538462248 learned_addr learned my addr 172.21.15.2:0/538462248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60affd640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60bfff640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ba9a0 0x5569393b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 -- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ba9a0 msgr2=0x5569393b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ba9a0 0x5569393b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 -- 172.21.15.2:0/538462248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 msgr2=0x5569393b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 -- 172.21.15.2:0/538462248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569392dcc90 con 0x5569393ae0f0 2024-09-10T23:28:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393ba310 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc004130 tx=0x7fc5fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3830c893381673 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc5eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc5eaffd640 1 -- 172.21.15.2:0/538462248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc02c060 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc5eaffd640 1 -- 172.21.15.2:0/538462248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc5fc017030 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.209+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6000054d0 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc5eaffd640 1 -- 172.21.15.2:0/538462248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5fc027410 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 10 client.16818 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5569393c9060 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc5eaffd640 1 -- 172.21.15.2:0/538462248 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6000054d0 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc5eaffd640 1 -- 172.21.15.2:0/538462248 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc5fc01c480 con 0x5569393ae0f0 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 10 client.16818 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 20 client.16818 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:18.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x5569393cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 4 client.16818 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556939326df0 con 0x5569393ca520 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.210+0000 7fc60affd640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x5569393cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.211+0000 7fc5eaffd640 10 client.16818 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.211+0000 7fc60affd640 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x5569393cc970 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3922c7ffd0668de8 server_cookie=11aba3f7f0897a4 in_seq=0 out_seq=0 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc5eaffd640 1 -- 172.21.15.2:0/538462248 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556939326df0 con 0x5569393ca520 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc5eaffd640 10 client.16818 handle_command_reply: tid=0 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 client.16818 shutdown 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 msgr2=0x5569393ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393ba310 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc004130 tx=0x7fc5fc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 shutdown_connections 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x5569393cc970 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393ba9a0 0x5569393b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393aea10 0x5569393b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc5eaffd640 0 client.16818 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 --2- 172.21.15.2:0/538462248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393ba310 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 >> 172.21.15.2:0/538462248 conn(0x5569393abf20 msgr2=0x5569393b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 shutdown_connections 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 1 -- 172.21.15.2:0/538462248 wait complete. 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.212+0000 7fc6143cd740 20 client.16818 trim_cache size 0 max 16384 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.225+0000 7fc6143cd740 1 Processor -- start 2024-09-10T23:28:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.225+0000 7fc6143cd740 1 -- start start 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ba9a0 0x5569393bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc6143cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c1ae360 con 0x5569393ae0f0 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc6143cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c1afea0 con 0x5569393ba9a0 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc6143cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c1aea30 con 0x5569393aea10 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46114/0 (socket says 172.21.15.2:46114) 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 -- 172.21.15.2:0/4034458733 learned_addr learned my addr 172.21.15.2:0/4034458733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60affd640 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 -- 172.21.15.2:0/4034458733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 msgr2=0x5569393bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 -- 172.21.15.2:0/4034458733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ba9a0 msgr2=0x5569393bc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ba9a0 0x5569393bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 -- 172.21.15.2:0/4034458733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569393b86b0 con 0x5569393ae0f0 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60affd640 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393c6880 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0044d0 tx=0x7fc5fc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939c1cb80dd4d824 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc5f17fa640 1 -- 172.21.15.2:0/4034458733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc037070 con 0x5569393ae0f0 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc5f17fa640 1 -- 172.21.15.2:0/4034458733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc01cd10 con 0x5569393ae0f0 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.226+0000 7fc5f17fa640 1 -- 172.21.15.2:0/4034458733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc027e50 con 0x5569393ae0f0 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 -- 172.21.15.2:0/4034458733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 msgr2=0x5569393c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393c6880 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0044d0 tx=0x7fc5fc005740 comp rx=0 tx=0).stop 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 -- 172.21.15.2:0/4034458733 shutdown_connections 2024-09-10T23:28:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ba9a0 0x5569393bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 --2- 172.21.15.2:0/4034458733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ae0f0 0x5569393c6880 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 -- 172.21.15.2:0/4034458733 >> 172.21.15.2:0/4034458733 conn(0x5569393abf20 msgr2=0x5569393b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 -- 172.21.15.2:0/4034458733 shutdown_connections 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 -- 172.21.15.2:0/4034458733 wait complete. 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.227+0000 7fc6143cd740 1 -- start start 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 Processor -- start 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ae0f0 0x5569393bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393be320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c1af7d0 con 0x5569393ba9a0 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c1af100 con 0x5569393ae0f0 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c1ac340 con 0x5569393aea10 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc6143cd740 10 client.0 _ll_register_callbacks cb 0x7fc5fc004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393be320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393be320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46118/0 (socket says 172.21.15.2:46118) 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 -- 172.21.15.2:0/2689843577 learned_addr learned my addr 172.21.15.2:0/2689843577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60affd640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ae0f0 0x5569393bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 -- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 msgr2=0x5569393bdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 -- 172.21.15.2:0/2689843577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ae0f0 msgr2=0x5569393bd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ae0f0 0x5569393bd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60bfff640 1 -- 172.21.15.2:0/2689843577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556939437440 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60affd640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.228+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ae0f0 0x5569393bd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc60bfff640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393be320 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc6040c9dd0 tx=0x7fc6040ccf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fb5131973221ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc5eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc5eaffd640 1 -- 172.21.15.2:0/2689843577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6040098b0 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc5eaffd640 1 -- 172.21.15.2:0/2689843577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc6040d6900 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5fc01cd10 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc5eaffd640 1 -- 172.21.15.2:0/2689843577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6040cd800 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 10 client.16824 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556939438710 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc5eaffd640 1 -- 172.21.15.2:0/2689843577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc01cd10 con 0x5569393ba9a0 2024-09-10T23:28:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc5eaffd640 1 -- 172.21.15.2:0/2689843577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc604004b40 con 0x5569393ba9a0 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 10 client.16824 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 20 client.16824 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x55693943adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 4 client.16824 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.229+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569393228a0 con 0x5569393ca520 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.230+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x55693943adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.230+0000 7fc5eaffd640 10 client.16824 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.230+0000 7fc60b7fe640 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x55693943adf0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c33bafd7fa62122 server_cookie=96081a3983c6f08 in_seq=0 out_seq=0 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.230+0000 7fc5eaffd640 1 -- 172.21.15.2:0/2689843577 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569393228a0 con 0x5569393ca520 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.230+0000 7fc5eaffd640 10 client.16824 handle_command_reply: tid=0 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.230+0000 7fc6143cd740 1 client.16824 shutdown 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 msgr2=0x5569393be320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393be320 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc6040c9dd0 tx=0x7fc6040ccf70 comp rx=0 tx=0).stop 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 shutdown_connections 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5569393ca520 0x55693943adf0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569393ba9a0 0x5569393be320 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569393aea10 0x5569393bdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 --2- 172.21.15.2:0/2689843577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569393ae0f0 0x5569393bd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 >> 172.21.15.2:0/2689843577 conn(0x5569393abf20 msgr2=0x5569393b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc5eaffd640 0 client.16824 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 shutdown_connections 2024-09-10T23:28:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 1 -- 172.21.15.2:0/2689843577 wait complete. 2024-09-10T23:28:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc6143cd740 20 client.16824 trim_cache size 0 max 16384 2024-09-10T23:28:18.252 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5f40b52e0 msgr2=0x7fc5f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5f40b52e0 0x7fc5f40b77a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5569393ace00 tx=0x7fc5fc00b390 comp rx=0 tx=0).stop 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 msgr2=0x7fc60c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.231+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c19eb60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc604005cc0 tx=0x7fc60402f380 comp rx=0 tx=0).stop 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 shutdown_connections 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc5f40b52e0 0x7fc5f40b77a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc60c10d100 0x7fc60c19eb60 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc60c1045c0 0x7fc60c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 --2- 172.21.15.2:0/2943456002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60c103ca0 0x7fc60c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 >> 172.21.15.2:0/2943456002 conn(0x7fc60c0fd700 msgr2=0x7fc60c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 shutdown_connections 2024-09-10T23:28:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:18.232+0000 7fc611ff8640 1 -- 172.21.15.2:0/2943456002 wait complete. 2024-09-10T23:28:19.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:19 smithi177 ceph-mon[35760]: pgmap v471: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 17 op/s 2024-09-10T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:19 smithi002 ceph-mon[31150]: pgmap v471: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 17 op/s 2024-09-10T23:28:19.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:19 smithi154 ceph-mon[35136]: pgmap v471: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 17 op/s 2024-09-10T23:28:20.056 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:28:20.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:28:20.335 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1342025430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 msgr2=0x7fc92410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1342025430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92410e860 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009ca0 tx=0x7fc91c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1342025430 shutdown_connections 2024-09-10T23:28:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1342025430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92410e860 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1342025430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 0x7fc924107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1342025430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc924101cd0 0x7fc9241020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1342025430 >> 172.21.15.2:0/1342025430 conn(0x7fc9240fd700 msgr2=0x7fc9240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1342025430 shutdown_connections 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.839+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1342025430 wait complete. 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 Processor -- start 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 -- start start 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc924101cd0 0x7fc924199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 0x7fc9241998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc924111d20 con 0x7fc924108060 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc924111ba0 con 0x7fc924101cd0 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc92b9f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc924111ea0 con 0x7fc9241076e0 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46144/0 (socket says 172.21.15.2:46144) 2024-09-10T23:28:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 -- 172.21.15.2:0/1463241804 learned_addr learned my addr 172.21.15.2:0/1463241804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929794640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc924101cd0 0x7fc924199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc928f93640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 0x7fc9241998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 -- 172.21.15.2:0/1463241804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 msgr2=0x7fc9241998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 0x7fc9241998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 -- 172.21.15.2:0/1463241804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc924101cd0 msgr2=0x7fc924199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc924101cd0 0x7fc924199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc929f95640 1 -- 172.21.15.2:0/1463241804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92419f410 con 0x7fc924108060 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.840+0000 7fc928f93640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 0x7fc9241998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.841+0000 7fc929f95640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92419ec40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005cc0 tx=0x7fc91c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.841+0000 7fc91a7fc640 1 -- 172.21.15.2:0/1463241804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c003bf0 con 0x7fc924108060 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.841+0000 7fc91a7fc640 1 -- 172.21.15.2:0/1463241804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91c003d90 con 0x7fc924108060 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.841+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92419f6a0 con 0x7fc924108060 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.841+0000 7fc91a7fc640 1 -- 172.21.15.2:0/1463241804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c02fbc0 con 0x7fc924108060 2024-09-10T23:28:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.841+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9241a5dc0 con 0x7fc924108060 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.843+0000 7fc92ddcd740 1 Processor -- start 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.843+0000 7fc91a7fc640 1 -- 172.21.15.2:0/1463241804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc91c004610 con 0x7fc924108060 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 -- start start 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9aef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aef800 0x560df9aff660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b01f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560df9a65e60 con 0x560df9affba0 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560df9a55290 con 0x560df9aef800 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560df9a590a0 con 0x560df9aeeee0 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b01f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b01f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46150/0 (socket says 172.21.15.2:46150) 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 -- 172.21.15.2:0/345550699 learned_addr learned my addr 172.21.15.2:0/345550699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9aef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc929794640 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aef800 0x560df9aff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 -- 172.21.15.2:0/345550699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 msgr2=0x560df9aef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9aef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 -- 172.21.15.2:0/345550699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aef800 msgr2=0x560df9aff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aef800 0x560df9aff660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc928f93640 1 -- 172.21.15.2:0/345550699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df97b3930 con 0x560df9affba0 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc91a7fc640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc9100b5360 0x7fc9100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.844+0000 7fc929794640 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aef800 0x560df9aff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.845+0000 7fc928f93640 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b01f90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc91400ae20 tx=0x7fc91400a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc144e394210552 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.845+0000 7fc91a7fc640 1 -- 172.21.15.2:0/1463241804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc91c106fc0 con 0x7fc924108060 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.845+0000 7fc928f93640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc9100b5360 0x7fc9100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.845+0000 7fc90f7fe640 1 -- 172.21.15.2:0/345550699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91401c070 con 0x560df9affba0 2024-09-10T23:28:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.845+0000 7fc90f7fe640 1 -- 172.21.15.2:0/345550699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9140179f0 con 0x560df9affba0 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.845+0000 7fc90f7fe640 1 -- 172.21.15.2:0/345550699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914014c50 con 0x560df9affba0 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 -- 172.21.15.2:0/345550699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 msgr2=0x560df9b01f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc928f93640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc9100b5360 0x7fc9100b7820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc914019000 tx=0x7fc914013740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b01f90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc91400ae20 tx=0x7fc91400a520 comp rx=0 tx=0).stop 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 -- 172.21.15.2:0/345550699 shutdown_connections 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b01f90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aef800 0x560df9aff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/345550699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9aef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 -- 172.21.15.2:0/345550699 >> 172.21.15.2:0/345550699 conn(0x560df9aecd10 msgr2=0x560df9aedeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 -- 172.21.15.2:0/345550699 shutdown_connections 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 -- 172.21.15.2:0/345550699 wait complete. 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 -- start start 2024-09-10T23:28:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.846+0000 7fc92ddcd740 1 Processor -- start 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9afcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9afd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9affba0 0x560df9afd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560df98b6890 con 0x560df9aef800 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560df99efd40 con 0x560df9affba0 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560df9b02850 con 0x560df9aeeee0 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc92ddcd740 10 client.0 _ll_register_callbacks cb 0x560df9a53c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9afd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9afd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46162/0 (socket says 172.21.15.2:46162) 2024-09-10T23:28:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 -- 172.21.15.2:0/1067317894 learned_addr learned my addr 172.21.15.2:0/1067317894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc929794640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9afcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc929f95640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9affba0 0x560df9afd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 -- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 msgr2=0x560df9afcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9afcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 -- 172.21.15.2:0/1067317894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9affba0 msgr2=0x560df9afd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9affba0 0x560df9afd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 -- 172.21.15.2:0/1067317894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df9b0bc80 con 0x560df9aef800 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc928f93640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9afd0e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc914006fd0 tx=0x7fc914022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3612cd0b405ce297 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc90cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.847+0000 7fc90cff9640 1 -- 172.21.15.2:0/1067317894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91401c070 con 0x560df9aef800 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc90cff9640 1 -- 172.21.15.2:0/1067317894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc914017670 con 0x560df9aef800 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9140179f0 con 0x560df9aef800 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc90cff9640 1 -- 172.21.15.2:0/1067317894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc91400a610 con 0x560df9aef800 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 10 client.16836 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560df9b0e580 con 0x560df9aef800 2024-09-10T23:28:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc90cff9640 1 -- 172.21.15.2:0/1067317894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9140179f0 con 0x560df9aef800 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc90cff9640 1 -- 172.21.15.2:0/1067317894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc914015040 con 0x560df9aef800 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 10 client.16836 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 20 client.16836 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b0f9e0 0x560df9b11dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 4 client.16836 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560df9a67db0 con 0x560df9b0f9e0 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.848+0000 7fc929794640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b0f9e0 0x560df9b11dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.849+0000 7fc90cff9640 10 client.16836 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.849+0000 7fc929794640 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b0f9e0 0x560df9b11dd0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65b7168897760d89 server_cookie=7d39e9de556c3e83 in_seq=0 out_seq=0 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc90cff9640 1 -- 172.21.15.2:0/1067317894 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560df9a67db0 con 0x560df9b0f9e0 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc90cff9640 10 client.16836 handle_command_reply: tid=0 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 client.16836 shutdown 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 msgr2=0x560df9afd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9afd0e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc914006fd0 tx=0x7fc914022000 comp rx=0 tx=0).stop 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 shutdown_connections 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b0f9e0 0x560df9b11dd0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9affba0 0x560df9afd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9afd0e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc90cff9640 0 client.16836 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/1067317894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aeeee0 0x560df9afcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 >> 172.21.15.2:0/1067317894 conn(0x560df9aecd10 msgr2=0x560df9aebf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 shutdown_connections 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 1 -- 172.21.15.2:0/1067317894 wait complete. 2024-09-10T23:28:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.850+0000 7fc92ddcd740 20 client.16836 trim_cache size 0 max 16384 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 Processor -- start 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 -- start start 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9afe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9b174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9affba0 0x560df9b17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ac200 con 0x560df9aef800 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241add40 con 0x560df9aeeee0 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ac8d0 con 0x560df9affba0 2024-09-10T23:28:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc928f93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9b174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc928f93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9b174c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46178/0 (socket says 172.21.15.2:46178) 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.868+0000 7fc928f93640 1 -- 172.21.15.2:0/3584544654 learned_addr learned my addr 172.21.15.2:0/3584544654 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc929794640 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9afe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc928f93640 1 -- 172.21.15.2:0/3584544654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9affba0 msgr2=0x560df9b17a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc928f93640 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9affba0 0x560df9b17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc928f93640 1 -- 172.21.15.2:0/3584544654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 msgr2=0x560df9afe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc928f93640 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9afe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc928f93640 1 -- 172.21.15.2:0/3584544654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df9aecb40 con 0x560df9aef800 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc929794640 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9afe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc928f93640 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9b174c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc91400a560 tx=0x7fc91400ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796ed8e9530bf4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc90effd640 1 -- 172.21.15.2:0/3584544654 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91401c070 con 0x560df9aef800 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc90effd640 1 -- 172.21.15.2:0/3584544654 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc914033070 con 0x560df9aef800 2024-09-10T23:28:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.869+0000 7fc90effd640 1 -- 172.21.15.2:0/3584544654 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914005d40 con 0x560df9aef800 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 -- 172.21.15.2:0/3584544654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 msgr2=0x560df9b174c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9b174c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc91400a560 tx=0x7fc91400ada0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 -- 172.21.15.2:0/3584544654 shutdown_connections 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9affba0 0x560df9b17a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9aef800 0x560df9b174c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/3584544654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9afe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 -- 172.21.15.2:0/3584544654 >> 172.21.15.2:0/3584544654 conn(0x560df9aecd10 msgr2=0x560df9afe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 -- 172.21.15.2:0/3584544654 shutdown_connections 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 -- 172.21.15.2:0/3584544654 wait complete. 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 -- start start 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.870+0000 7fc92ddcd740 1 Processor -- start 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9b080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aef800 0x560df9b04580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b04ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ad670 con 0x560df9affba0 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241acfa0 con 0x560df9aeeee0 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241aa200 con 0x560df9aef800 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 10 client.0 _ll_register_callbacks cb 0x7fc91401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b04ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b04ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46194/0 (socket says 172.21.15.2:46194) 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 -- 172.21.15.2:0/2546341403 learned_addr learned my addr 172.21.15.2:0/2546341403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc928f93640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aef800 0x560df9b04580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929794640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9b080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 -- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aef800 msgr2=0x560df9b04580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aef800 0x560df9b04580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 -- 172.21.15.2:0/2546341403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 msgr2=0x560df9b080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9b080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 -- 172.21.15.2:0/2546341403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df9af5040 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc928f93640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aef800 0x560df9b04580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929794640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9b080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc929f95640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b04ac0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005fa0 tx=0x7fc91c0cd340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588d4804e4b2c1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc90cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc90cff9640 1 -- 172.21.15.2:0/2546341403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0cd830 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc90cff9640 1 -- 172.21.15.2:0/2546341403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc91c0c9aa0 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.871+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc914033070 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc90cff9640 1 -- 172.21.15.2:0/2546341403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc91c0d2310 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 10 client.16842 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560df9b7d380 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc90cff9640 1 -- 172.21.15.2:0/2546341403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc914033070 con 0x560df9affba0 2024-09-10T23:28:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc90cff9640 1 -- 172.21.15.2:0/2546341403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc91c0f0b80 con 0x560df9affba0 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 10 client.16842 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 20 client.16842 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b7da80 0x560df9b7fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 4 client.16842 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560df9a63860 con 0x560df9b7da80 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.872+0000 7fc929794640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b7da80 0x560df9b7fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.873+0000 7fc929794640 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b7da80 0x560df9b7fea0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=458fc5d62dccffcf server_cookie=bdb08d032d345d47 in_seq=0 out_seq=0 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.873+0000 7fc90cff9640 10 client.16842 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.874+0000 7fc90cff9640 1 -- 172.21.15.2:0/2546341403 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560df9a63860 con 0x560df9b7da80 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.874+0000 7fc90cff9640 10 client.16842 handle_command_reply: tid=0 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.874+0000 7fc92ddcd740 1 client.16842 shutdown 2024-09-10T23:28:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.874+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 msgr2=0x560df9b04ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.874+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b04ac0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005fa0 tx=0x7fc91c0cd340 comp rx=0 tx=0).stop 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 shutdown_connections 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560df9b7da80 0x560df9b7fea0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560df9affba0 0x560df9b04ac0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc90cff9640 0 client.16842 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560df9aef800 0x560df9b04580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 --2- 172.21.15.2:0/2546341403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560df9aeeee0 0x560df9b080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 >> 172.21.15.2:0/2546341403 conn(0x560df9aecd10 msgr2=0x560df9af4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 shutdown_connections 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 1 -- 172.21.15.2:0/2546341403 wait complete. 2024-09-10T23:28:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.875+0000 7fc92ddcd740 20 client.16842 trim_cache size 0 max 16384 2024-09-10T23:28:21.164 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:28:21.164 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:28:21.164 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "8337d245-b578-4ff3-bb11-3177035a5f2c", 2024-09-10T23:28:21.164 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:28:21.164 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc9100b5360 msgr2=0x7fc9100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc9100b5360 0x7fc9100b7820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc914019000 tx=0x7fc914013740 comp rx=0 tx=0).stop 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 msgr2=0x7fc92419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92419ec40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005cc0 tx=0x7fc91c02f380 comp rx=0 tx=0).stop 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 shutdown_connections 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc9100b5360 0x7fc9100b7820 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc924108060 0x7fc92419ec40 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9241076e0 0x7fc9241998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 --2- 172.21.15.2:0/1463241804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc924101cd0 0x7fc924199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 >> 172.21.15.2:0/1463241804 conn(0x7fc9240fd700 msgr2=0x7fc92406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 shutdown_connections 2024-09-10T23:28:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:20.876+0000 7fc92b9f8640 1 -- 172.21.15.2:0/1463241804 wait complete. 2024-09-10T23:28:21.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:21 smithi002 ceph-mon[31150]: pgmap v472: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:28:21.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:28:21.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:21.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:28:21.713 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:21 smithi177 ceph-mon[35760]: pgmap v472: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:28:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:28:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:28:21.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:21.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:28:21.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:21 smithi154 ceph-mon[35136]: pgmap v472: 97 pgs: 97 active+clean; 2.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:28:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:28:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:28:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:28:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 -- 172.21.15.2:0/1431223080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8101cd0 msgr2=0x7f0df81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 --2- 172.21.15.2:0/1431223080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8101cd0 0x7f0df81020b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009900 tx=0x7f0de802a410 comp rx=0 tx=0).stop 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 -- 172.21.15.2:0/1431223080 shutdown_connections 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 --2- 172.21.15.2:0/1431223080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8108060 0x7f0df810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 --2- 172.21.15.2:0/1431223080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 0x7f0df8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 --2- 172.21.15.2:0/1431223080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8101cd0 0x7f0df81020b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 -- 172.21.15.2:0/1431223080 >> 172.21.15.2:0/1431223080 conn(0x7f0df80fd720 msgr2=0x7f0df80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 -- 172.21.15.2:0/1431223080 shutdown_connections 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.508+0000 7f0dfe335640 1 -- 172.21.15.2:0/1431223080 wait complete. 2024-09-10T23:28:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 Processor -- start 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 -- start start 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8101cd0 0x7f0df81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 0x7f0df8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 0x7f0df819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8111d20 con 0x7f0df8108060 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8111ba0 con 0x7f0df8101cd0 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfe335640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8111ea0 con 0x7f0df81076e0 2024-09-10T23:28:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfc8d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 0x7f0df819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfc8d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 0x7f0df819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46254/0 (socket says 172.21.15.2:46254) 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfc8d2640 1 -- 172.21.15.2:0/2019310228 learned_addr learned my addr 172.21.15.2:0/2019310228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8101cd0 0x7f0df81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 0x7f0df8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfc8d2640 1 -- 172.21.15.2:0/2019310228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 msgr2=0x7f0df8199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.509+0000 7f0dfc8d2640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 0x7f0df8199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0dfc8d2640 1 -- 172.21.15.2:0/2019310228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8101cd0 msgr2=0x7f0df81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0dfc8d2640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8101cd0 0x7f0df81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0dfc8d2640 1 -- 172.21.15.2:0/2019310228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df819f370 con 0x7f0df8108060 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8101cd0 0x7f0df81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 0x7f0df8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0dfc8d2640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 0x7f0df819eba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0df000eaa0 tx=0x7f0df000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0df57fa640 1 -- 172.21.15.2:0/2019310228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df000cdb0 con 0x7f0df8108060 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0df57fa640 1 -- 172.21.15.2:0/2019310228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df0005020 con 0x7f0df8108060 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df819f660 con 0x7f0df8108060 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0df57fa640 1 -- 172.21.15.2:0/2019310228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df00116d0 con 0x7f0df8108060 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.510+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df81a5d20 con 0x7f0df8108060 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.513+0000 7f0e0070a740 1 Processor -- start 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.513+0000 7f0df57fa640 1 -- 172.21.15.2:0/2019310228 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0df000f040 con 0x7f0df8108060 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.513+0000 7f0e0070a740 1 -- start start 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a927480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a937820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0e0070a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55649a89de50 con 0x55649a937d60 2024-09-10T23:28:22.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0e0070a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55649a88d280 con 0x55649a9279c0 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0e0070a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55649a891090 con 0x55649a9270a0 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46256/0 (socket says 172.21.15.2:46256) 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 -- 172.21.15.2:0/3346332025 learned_addr learned my addr 172.21.15.2:0/3346332025 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a927480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df7fff640 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a937820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 -- 172.21.15.2:0/3346332025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 msgr2=0x55649a927480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a927480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 -- 172.21.15.2:0/3346332025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 msgr2=0x55649a937820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a937820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df57fa640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0de00b52e0 0x7f0de00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 -- 172.21.15.2:0/3346332025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649a5eb650 con 0x55649a937d60 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0dfc8d2640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0de00b52e0 0x7f0de00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.514+0000 7f0df77fe640 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93a150 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014a30 tx=0x7f0dec00c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ab171c1049c309 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0df57fa640 1 -- 172.21.15.2:0/2019310228 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0df00e5b20 con 0x7f0df8108060 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0dde7fc640 1 -- 172.21.15.2:0/3346332025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0142d0 con 0x55649a937d60 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0dde7fc640 1 -- 172.21.15.2:0/3346332025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dec0054d0 con 0x55649a937d60 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0dde7fc640 1 -- 172.21.15.2:0/3346332025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0047a0 con 0x55649a937d60 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 -- 172.21.15.2:0/3346332025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 msgr2=0x55649a93a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0dfc8d2640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0de00b52e0 0x7f0de00b77a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0df00abff0 tx=0x7f0df0088040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93a150 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014a30 tx=0x7f0dec00c570 comp rx=0 tx=0).stop 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 -- 172.21.15.2:0/3346332025 shutdown_connections 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93a150 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a937820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 --2- 172.21.15.2:0/3346332025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a927480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 -- 172.21.15.2:0/3346332025 >> 172.21.15.2:0/3346332025 conn(0x55649a924ed0 msgr2=0x55649a926070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 -- 172.21.15.2:0/3346332025 shutdown_connections 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.515+0000 7f0e0070a740 1 -- 172.21.15.2:0/3346332025 wait complete. 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 -- start start 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 Processor -- start 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 0x55649a937610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9279c0 0x55649a934ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a935070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55649a6ee700 con 0x55649a9270a0 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55649a828110 con 0x55649a937d60 2024-09-10T23:28:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55649a93a9b0 con 0x55649a9279c0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0e0070a740 10 client.0 _ll_register_callbacks cb 0x55649a841990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0df77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 0x55649a937610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0df77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 0x55649a937610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46268/0 (socket says 172.21.15.2:46268) 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.516+0000 7f0df77fe640 1 -- 172.21.15.2:0/1261868169 learned_addr learned my addr 172.21.15.2:0/1261868169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a935070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df7fff640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9279c0 0x55649a934ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 -- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9279c0 msgr2=0x55649a934ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9279c0 0x55649a934ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 -- 172.21.15.2:0/1261868169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 msgr2=0x55649a935070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a935070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 -- 172.21.15.2:0/1261868169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649a855c40 con 0x55649a9270a0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0df77fe640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 0x55649a937610 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00fae0 tx=0x7f0dec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d4c304574d0f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0dd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0dd77fe640 1 -- 172.21.15.2:0/1261868169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec012650 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0dd77fe640 1 -- 172.21.15.2:0/1261868169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0dec0127f0 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dec0054d0 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0dd77fe640 1 -- 172.21.15.2:0/1261868169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0dec0129f0 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0e0070a740 10 client.16854 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55649a9462d0 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.517+0000 7f0dd77fe640 1 -- 172.21.15.2:0/1261868169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dec0054d0 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0dd77fe640 1 -- 172.21.15.2:0/1261868169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0dec021a00 con 0x55649a9270a0 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0e0070a740 10 client.16854 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0e0070a740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0e0070a740 20 client.16854 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0e0070a740 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a947620 0x55649a949a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0e0070a740 4 client.16854 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55649a89fda0 con 0x55649a947620 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0df7fff640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a947620 0x55649a949a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0df7fff640 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a947620 0x55649a949a10 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4cfdbd921d18e0 server_cookie=1919b1b1e75bceda in_seq=0 out_seq=0 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.518+0000 7f0dd77fe640 10 client.16854 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0dd77fe640 1 -- 172.21.15.2:0/1261868169 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55649a89fda0 con 0x55649a947620 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0dd77fe640 10 client.16854 handle_command_reply: tid=0 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 client.16854 shutdown 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 msgr2=0x55649a937610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 0x55649a937610 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00fae0 tx=0x7f0dec001e70 comp rx=0 tx=0).stop 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 shutdown_connections 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a947620 0x55649a949a10 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a935070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9279c0 0x55649a934ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0dd77fe640 0 client.16854 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 --2- 172.21.15.2:0/1261868169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9270a0 0x55649a937610 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.519+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 >> 172.21.15.2:0/1261868169 conn(0x55649a924ed0 msgr2=0x55649a92aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.520+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 shutdown_connections 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.520+0000 7f0e0070a740 1 -- 172.21.15.2:0/1261868169 wait complete. 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.520+0000 7f0e0070a740 20 client.16854 trim_cache size 0 max 16384 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 Processor -- start 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 -- start start 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a943c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 0x55649a924710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a926710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0df81ac170 con 0x55649a9279c0 2024-09-10T23:28:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0df81adcb0 con 0x55649a937d60 2024-09-10T23:28:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.537+0000 7f0e0070a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0df81ac840 con 0x55649a9270a0 2024-09-10T23:28:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 0x55649a924710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 0x55649a924710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46278/0 (socket says 172.21.15.2:46278) 2024-09-10T23:28:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 -- 172.21.15.2:0/2347721680 learned_addr learned my addr 172.21.15.2:0/2347721680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a943c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a926710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 -- 172.21.15.2:0/2347721680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 msgr2=0x55649a943c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a943c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 -- 172.21.15.2:0/2347721680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 msgr2=0x55649a926710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a926710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 -- 172.21.15.2:0/2347721680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649a9353e0 con 0x55649a9279c0 2024-09-10T23:28:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 0x55649a924710 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0de802a930 tx=0x7f0de8005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff35f67462bab318 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0dddffb640 1 -- 172.21.15.2:0/2347721680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8048070 con 0x55649a9279c0 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0dddffb640 1 -- 172.21.15.2:0/2347721680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0de8005040 con 0x55649a9279c0 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.538+0000 7f0dddffb640 1 -- 172.21.15.2:0/2347721680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8035040 con 0x55649a9279c0 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 -- 172.21.15.2:0/2347721680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 msgr2=0x55649a924710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 0x55649a924710 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0de802a930 tx=0x7f0de8005b50 comp rx=0 tx=0).stop 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 -- 172.21.15.2:0/2347721680 shutdown_connections 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a937d60 0x55649a926710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a9279c0 0x55649a924710 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2347721680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a943c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 -- 172.21.15.2:0/2347721680 >> 172.21.15.2:0/2347721680 conn(0x55649a924ed0 msgr2=0x55649a926000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 -- 172.21.15.2:0/2347721680 shutdown_connections 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 -- 172.21.15.2:0/2347721680 wait complete. 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 -- start start 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.539+0000 7f0e0070a740 1 Processor -- start 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a93fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a9401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0df81ad5e0 con 0x55649a937d60 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0df81acf10 con 0x55649a9279c0 2024-09-10T23:28:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0df81aa170 con 0x55649a9270a0 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0e0070a740 10 client.0 _ll_register_callbacks cb 0x7f0de8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46294/0 (socket says 172.21.15.2:46294) 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 -- 172.21.15.2:0/2424522259 learned_addr learned my addr 172.21.15.2:0/2424522259 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a93fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 -- 172.21.15.2:0/2424522259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 msgr2=0x55649a9401b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a9401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a9401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 -- 172.21.15.2:0/2424522259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 msgr2=0x55649a93cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.540+0000 7f0df77fe640 1 -- 172.21.15.2:0/2424522259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649a9409e0 con 0x55649a9270a0 2024-09-10T23:28:22.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.541+0000 7f0df77fe640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a93fc70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014fd0 tx=0x7f0dec021f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc0eba248590617 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.541+0000 7f0dd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.541+0000 7f0dd77fe640 1 -- 172.21.15.2:0/2424522259 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec012d90 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.541+0000 7f0dd77fe640 1 -- 172.21.15.2:0/2424522259 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0dec012450 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.541+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de8005040 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.541+0000 7f0dd77fe640 1 -- 172.21.15.2:0/2424522259 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0dec012650 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 10 client.26233 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55649a9b4810 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0dd77fe640 1 -- 172.21.15.2:0/2424522259 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0de8005040 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0dd77fe640 1 -- 172.21.15.2:0/2424522259 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0dec038070 con 0x55649a9270a0 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 10 client.26233 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 10 client.26233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:22.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 20 client.26233 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a9b4ea0 0x55649a9b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 4 client.26233 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:28:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55649a89b850 con 0x55649a9b4ea0 2024-09-10T23:28:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.542+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a9b4ea0 0x55649a9b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0df7fff640 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a9b4ea0 0x55649a9b72c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=864960de5dcd44f server_cookie=d3bc582f1594f443 in_seq=0 out_seq=0 2024-09-10T23:28:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0dd77fe640 10 client.26233 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0dd77fe640 1 -- 172.21.15.2:0/2424522259 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55649a89b850 con 0x55649a9b4ea0 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0dd77fe640 10 client.26233 handle_command_reply: tid=0 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 client.26233 shutdown 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 msgr2=0x55649a93fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a93fc70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014fd0 tx=0x7f0dec021f90 comp rx=0 tx=0).stop 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 shutdown_connections 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55649a9b4ea0 0x55649a9b72c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55649a937d60 0x55649a93cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55649a9279c0 0x55649a9401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0dd77fe640 0 client.26233 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 --2- 172.21.15.2:0/2424522259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55649a9270a0 0x55649a93fc70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 >> 172.21.15.2:0/2424522259 conn(0x55649a924ed0 msgr2=0x55649a92c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 shutdown_connections 2024-09-10T23:28:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 1 -- 172.21.15.2:0/2424522259 wait complete. 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.543+0000 7f0e0070a740 20 client.26233 trim_cache size 0 max 16384 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "8337d245-b578-4ff3-bb11-3177035a5f2c", 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:28:22.564 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.565 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.566 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.567 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:28:22.568 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.569 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:22.570 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0de00b52e0 msgr2=0x7f0de00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0de00b52e0 0x7f0de00b77a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0df00abff0 tx=0x7f0df0088040 comp rx=0 tx=0).stop 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 msgr2=0x7f0df819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 0x7f0df819eba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0df000eaa0 tx=0x7f0df000ef60 comp rx=0 tx=0).stop 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 shutdown_connections 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0de00b52e0 0x7f0de00b77a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8108060 0x7f0df819eba0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0df81076e0 0x7f0df8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 --2- 172.21.15.2:0/2019310228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0df8101cd0 0x7f0df81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 >> 172.21.15.2:0/2019310228 conn(0x7f0df80fd720 msgr2=0x7f0df806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 shutdown_connections 2024-09-10T23:28:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:22.544+0000 7f0dfe335640 1 -- 172.21.15.2:0/2019310228 wait complete. 2024-09-10T23:28:23.363 INFO:tasks.cephfs.filesystem:scrub status for tag:8337d245-b578-4ff3-bb11-3177035a5f2c - {'path': '/', 'tag': '8337d245-b578-4ff3-bb11-3177035a5f2c', 'options': 'recursive,force'} 2024-09-10T23:28:23.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:23 smithi177 ceph-mon[35760]: pgmap v473: 97 pgs: 97 active+clean; 3.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:28:23.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:23 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:28:23.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:23 smithi002 ceph-mon[31150]: pgmap v473: 97 pgs: 97 active+clean; 3.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:28:23.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:23 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:28:23.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:23 smithi154 ceph-mon[35136]: pgmap v473: 97 pgs: 97 active+clean; 3.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:28:23.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:23 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:28:24.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.882 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:127/600: open fd = 3 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:128/600: open fd = 3 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:129/600: open fd = 3 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.883 INFO:tasks.workunit.client.0.smithi002.stdout:130/600: open fd = 3 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:131/600: open fd = 3 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:132/600: open fd = 3 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:133/600: open fd = 3 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:134/600: open fd = 3 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:135/600: open fd = 3 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:136/600: open fd = 3 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.885 INFO:tasks.workunit.client.0.smithi002.stdout:137/600: open fd = 3 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:138/600: open fd = 3 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:139/600: open fd = 3 2024-09-10T23:28:24.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:140/600: open fd = 3 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:141/600: open fd = 3 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:142/600: open fd = 3 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:143/600: open fd = 3 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:144/600: open fd = 3 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:145/600: open fd = 3 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.888 INFO:tasks.workunit.client.0.smithi002.stdout:146/600: open fd = 3 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:147/600: open fd = 3 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:148/600: open fd = 3 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:149/600: open fd = 3 2024-09-10T23:28:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:150/600: open fd = 3 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:151/600: open fd = 3 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:152/600: open fd = 3 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:153/600: open fd = 3 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:154/600: open fd = 3 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:155/600: open fd = 3 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:156/600: open fd = 3 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:157/600: open fd = 3 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:158/600: open fd = 3 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:159/600: open fd = 3 2024-09-10T23:28:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:160/600: open fd = 3 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:161/600: open fd = 3 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:162/600: open fd = 3 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:163/600: open fd = 3 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:164/600: open fd = 3 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:165/600: open fd = 3 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.894 INFO:tasks.workunit.client.0.smithi002.stdout:166/600: open fd = 3 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:167/600: open fd = 3 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:168/600: open fd = 3 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:169/600: open fd = 3 2024-09-10T23:28:24.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:170/600: open fd = 3 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:171/600: open fd = 3 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:172/600: open fd = 3 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:173/600: open fd = 3 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:174/600: open fd = 3 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:175/600: open fd = 3 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:176/600: open fd = 3 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:177/600: open fd = 3 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.898 INFO:tasks.workunit.client.0.smithi002.stdout:178/600: open fd = 3 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:179/600: open fd = 3 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:180/600: open fd = 3 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.899 INFO:tasks.workunit.client.0.smithi002.stdout:181/600: open fd = 3 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:182/600: open fd = 3 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:183/600: open fd = 3 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:184/600: open fd = 3 2024-09-10T23:28:24.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:185/600: open fd = 3 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:186/600: open fd = 3 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.901 INFO:tasks.workunit.client.0.smithi002.stdout:187/600: open fd = 3 2024-09-10T23:28:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:28:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:188/600: open fd = 3 2024-09-10T23:28:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:28:25.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:25 smithi177 ceph-mon[35760]: pgmap v474: 97 pgs: 97 active+clean; 3.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:28:25.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:25 smithi002 ceph-mon[31150]: pgmap v474: 97 pgs: 97 active+clean; 3.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:28:25.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:25 smithi154 ceph-mon[35136]: pgmap v474: 97 pgs: 97 active+clean; 3.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:28:27.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:27 smithi177 ceph-mon[35760]: pgmap v475: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:28:27.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:27 smithi002 ceph-mon[31150]: pgmap v475: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:28:27.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:27 smithi154 ceph-mon[35136]: pgmap v475: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 -- 172.21.15.2:0/3968952839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb12810a910 msgr2=0x7fb12810cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 --2- 172.21.15.2:0/3968952839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb12810a910 0x7fb12810cd60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb120009900 tx=0x7fb12002a410 comp rx=0 tx=0).stop 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 -- 172.21.15.2:0/3968952839 shutdown_connections 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 --2- 172.21.15.2:0/3968952839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb12810a910 0x7fb12810cd60 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 --2- 172.21.15.2:0/3968952839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb128075ac0 0x7fb128075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 --2- 172.21.15.2:0/3968952839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb128076f30 0x7fb128075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 -- 172.21.15.2:0/3968952839 >> 172.21.15.2:0/3968952839 conn(0x7fb1280fe250 msgr2=0x7fb128100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 -- 172.21.15.2:0/3968952839 shutdown_connections 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 -- 172.21.15.2:0/3968952839 wait complete. 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 Processor -- start 2024-09-10T23:28:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.376+0000 7fb12f510640 1 -- start start 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 0x7fb12819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb128076f30 0x7fb12819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb12810a910 0x7fb12819c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281107d0 con 0x7fb128075ac0 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb128110650 con 0x7fb12810a910 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb128110950 con 0x7fb128076f30 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 0x7fb12819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 0x7fb12819aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46322/0 (socket says 172.21.15.2:46322) 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 -- 172.21.15.2:0/763230736 learned_addr learned my addr 172.21.15.2:0/763230736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12caab640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb128076f30 0x7fb12819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12daad640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb12810a910 0x7fb12819c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 -- 172.21.15.2:0/763230736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb128076f30 msgr2=0x7fb12819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb128076f30 0x7fb12819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 -- 172.21.15.2:0/763230736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb12810a910 msgr2=0x7fb12819c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb12810a910 0x7fb12819c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 -- 172.21.15.2:0/763230736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12819c9f0 con 0x7fb128075ac0 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12daad640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb12810a910 0x7fb12819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 0x7fb12819aeb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb11800eab0 tx=0x7fb11800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb1267fc640 1 -- 172.21.15.2:0/763230736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11800cd80 con 0x7fb128075ac0 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb1267fc640 1 -- 172.21.15.2:0/763230736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb118011920 con 0x7fb128075ac0 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12819cce0 con 0x7fb128075ac0 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb1267fc640 1 -- 172.21.15.2:0/763230736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118010930 con 0x7fb128075ac0 2024-09-10T23:28:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.377+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1281a33b0 con 0x7fb128075ac0 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1267fc640 1 -- 172.21.15.2:0/763230736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb11800f040 con 0x7fb128075ac0 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 Processor -- start 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 -- start start 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55da6b72f6f0 con 0x55da6b7bd860 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da6b71eb20 con 0x55da6b7c2bd0 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.380+0000 7fb1323bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55da6b722930 con 0x55da6b7c0190 2024-09-10T23:28:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7bfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46328/0 (socket says 172.21.15.2:46328) 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 -- 172.21.15.2:0/3035310374 learned_addr learned my addr 172.21.15.2:0/3035310374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12caab640 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 -- 172.21.15.2:0/3035310374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 msgr2=0x55da6b7c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb1267fc640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb1100b52e0 0x7fb1100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 -- 172.21.15.2:0/3035310374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 msgr2=0x55da6b7c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 -- 172.21.15.2:0/3035310374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da6b6e4530 con 0x55da6b7bd860 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb1267fc640 1 -- 172.21.15.2:0/763230736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb1180e5f30 con 0x7fb128075ac0 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb1100b52e0 0x7fb1100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb12daad640 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7bfc50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb120005ab0 tx=0x7fb120032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde87cb17d064382 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb10f7fe640 1 -- 172.21.15.2:0/3035310374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12003f040 con 0x55da6b7bd860 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb10f7fe640 1 -- 172.21.15.2:0/3035310374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb120005040 con 0x55da6b7bd860 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.381+0000 7fb10f7fe640 1 -- 172.21.15.2:0/3035310374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120035070 con 0x55da6b7bd860 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 -- 172.21.15.2:0/3035310374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 msgr2=0x55da6b7bfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb12daad640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb1100b52e0 0x7fb1100b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb120044000 tx=0x7fb120004df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7bfc50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb120005ab0 tx=0x7fb120032c50 comp rx=0 tx=0).stop 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 -- 172.21.15.2:0/3035310374 shutdown_connections 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3035310374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7bfc50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 -- 172.21.15.2:0/3035310374 >> 172.21.15.2:0/3035310374 conn(0x55da6b7b89b0 msgr2=0x55da6b7b9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 -- 172.21.15.2:0/3035310374 shutdown_connections 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.382+0000 7fb1323bb740 1 -- 172.21.15.2:0/3035310374 wait complete. 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 -- start start 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 Processor -- start 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55da6b656ab0 con 0x55da6b7bd860 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da6b6c4730 con 0x55da6b7c2bd0 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55da6b7c5af0 con 0x55da6b7c0190 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb1323bb740 10 client.0 _ll_register_callbacks cb 0x55da6b7186b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb12d2ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb12d2ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46332/0 (socket says 172.21.15.2:46332) 2024-09-10T23:28:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb12d2ac640 1 -- 172.21.15.2:0/3954335256 learned_addr learned my addr 172.21.15.2:0/3954335256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb12daad640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.383+0000 7fb12caab640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb12d2ac640 1 -- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 msgr2=0x55da6b7c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb12d2ac640 1 -- 172.21.15.2:0/3954335256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 msgr2=0x55da6b7c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb12d2ac640 1 -- 172.21.15.2:0/3954335256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da6b480790 con 0x55da6b7bd860 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7c6dd0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb11800c640 tx=0x7fb1180ac530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2503bb119f8c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb10cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb10cff9640 1 -- 172.21.15.2:0/3954335256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b59a0 con 0x55da6b7bd860 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb10cff9640 1 -- 172.21.15.2:0/3954335256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb118011470 con 0x55da6b7bd860 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb120005040 con 0x55da6b7bd860 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb10cff9640 1 -- 172.21.15.2:0/3954335256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb1180acda0 con 0x55da6b7bd860 2024-09-10T23:28:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb1323bb740 10 client.16872 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da6b4f9620 con 0x55da6b7bd860 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb10cff9640 1 -- 172.21.15.2:0/3954335256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb120005040 con 0x55da6b7bd860 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb10cff9640 1 -- 172.21.15.2:0/3954335256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1180a7ff0 con 0x55da6b7bd860 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.384+0000 7fb1323bb740 10 client.16872 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb1323bb740 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb1323bb740 20 client.16872 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b7d2630 0x55da6b7d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb1323bb740 4 client.16872 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da6b731640 con 0x55da6b7d2630 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb12caab640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b7d2630 0x55da6b7d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb12caab640 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b7d2630 0x55da6b7d4a40 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de7a3e385d305a87 server_cookie=7312cb6ae1884c36 in_seq=0 out_seq=0 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.385+0000 7fb10cff9640 10 client.16872 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb10cff9640 1 -- 172.21.15.2:0/3954335256 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da6b731640 con 0x55da6b7d2630 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb10cff9640 10 client.16872 handle_command_reply: tid=0 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 client.16872 shutdown 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 msgr2=0x55da6b7c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7c6dd0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb11800c640 tx=0x7fb1180ac530 comp rx=0 tx=0).stop 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 shutdown_connections 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b7d2630 0x55da6b7d4a40 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c0190 0x55da6b7c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 --2- 172.21.15.2:0/3954335256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7bd860 0x55da6b7c6dd0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb10cff9640 0 client.16872 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 >> 172.21.15.2:0/3954335256 conn(0x55da6b7b89b0 msgr2=0x55da6b7b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 shutdown_connections 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 1 -- 172.21.15.2:0/3954335256 wait complete. 2024-09-10T23:28:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.386+0000 7fb1323bb740 20 client.16872 trim_cache size 0 max 16384 2024-09-10T23:28:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 Processor -- start 2024-09-10T23:28:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 -- start start 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7bd860 0x55da6b7c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7bccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7bd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281abfd0 con 0x55da6b7c0190 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281adb10 con 0x55da6b7c2bd0 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb1323bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281ac6a0 con 0x55da6b7bd860 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7bccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7bccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46334/0 (socket says 172.21.15.2:46334) 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 -- 172.21.15.2:0/2335117983 learned_addr learned my addr 172.21.15.2:0/2335117983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7bd860 0x55da6b7c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12daad640 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7bd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 -- 172.21.15.2:0/2335117983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7bd860 msgr2=0x55da6b7c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7bd860 0x55da6b7c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 -- 172.21.15.2:0/2335117983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 msgr2=0x55da6b7bd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7bd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.401+0000 7fb12caab640 1 -- 172.21.15.2:0/2335117983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da6b7bffc0 con 0x55da6b7c0190 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.402+0000 7fb12caab640 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7bccc0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x55da6b7d52c0 tx=0x7fb11c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a8a6a64e086f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.402+0000 7fb10effd640 1 -- 172.21.15.2:0/2335117983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c013110 con 0x55da6b7c0190 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.402+0000 7fb10effd640 1 -- 172.21.15.2:0/2335117983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb11c0132b0 con 0x55da6b7c0190 2024-09-10T23:28:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.402+0000 7fb10effd640 1 -- 172.21.15.2:0/2335117983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c01d430 con 0x55da6b7c0190 2024-09-10T23:28:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.402+0000 7fb1323bb740 1 -- 172.21.15.2:0/2335117983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 msgr2=0x55da6b7bccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.402+0000 7fb1323bb740 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7bccc0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x55da6b7d52c0 tx=0x7fb11c013830 comp rx=0 tx=0).stop 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- 172.21.15.2:0/2335117983 shutdown_connections 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7c2bd0 0x55da6b7bd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7bccc0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 --2- 172.21.15.2:0/2335117983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7bd860 0x55da6b7c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- 172.21.15.2:0/2335117983 >> 172.21.15.2:0/2335117983 conn(0x55da6b7b89b0 msgr2=0x55da6b7c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- 172.21.15.2:0/2335117983 shutdown_connections 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- 172.21.15.2:0/2335117983 wait complete. 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- start start 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 Processor -- start 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 0x55da6b7cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c2bd0 0x55da6b7ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281ad440 con 0x55da6b7c0190 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281acd70 con 0x55da6b7bd860 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281a9fb0 con 0x55da6b7c2bd0 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.403+0000 7fb1323bb740 10 client.0 _ll_register_callbacks cb 0x7fb1180a8540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12caab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 0x55da6b7cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 0x55da6b7cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:60354/0 (socket says 172.21.15.2:60354) 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 -- 172.21.15.2:0/1329064471 learned_addr learned my addr 172.21.15.2:0/1329064471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12caab640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46336/0 (socket says 172.21.15.2:46336) 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12daad640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c2bd0 0x55da6b7ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 -- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c2bd0 msgr2=0x55da6b7ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c2bd0 0x55da6b7ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 -- 172.21.15.2:0/1329064471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 msgr2=0x55da6b7cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 -- 172.21.15.2:0/1329064471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da6b7cd5c0 con 0x55da6b7bd860 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12caab640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb12d2ac640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 0x55da6b7cbb20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1180a8c70 tx=0x7fb1180e3d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef5e92f09697a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.404+0000 7fb10cff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb10cff9640 1 -- 172.21.15.2:0/1329064471 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b5c30 con 0x55da6b7bd860 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb10cff9640 1 -- 172.21.15.2:0/1329064471 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb1180ab460 con 0x55da6b7bd860 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb11c0132b0 con 0x55da6b7bd860 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb10cff9640 1 -- 172.21.15.2:0/1329064471 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb1180ac6a0 con 0x55da6b7bd860 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 10 client.26066 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da6b7ce9a0 con 0x55da6b7bd860 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb10cff9640 1 -- 172.21.15.2:0/1329064471 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb11c0132b0 con 0x55da6b7bd860 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb10cff9640 1 -- 172.21.15.2:0/1329064471 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1180b2310 con 0x55da6b7bd860 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 10 client.26066 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 10 client.26066 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 20 client.26066 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b847e20 0x55da6b84a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 4 client.26066 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da6b72d0f0 con 0x55da6b847e20 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.406+0000 7fb12caab640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b847e20 0x55da6b84a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.407+0000 7fb12caab640 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b847e20 0x55da6b84a210 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7acc960bafed49ad server_cookie=3dd5baa5be4ba8b6 in_seq=0 out_seq=0 2024-09-10T23:28:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.407+0000 7fb10cff9640 10 client.26066 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb10cff9640 1 -- 172.21.15.2:0/1329064471 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da6b72d0f0 con 0x55da6b847e20 2024-09-10T23:28:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb10cff9640 10 client.26066 handle_command_reply: tid=0 2024-09-10T23:28:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 client.26066 shutdown 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 msgr2=0x55da6b7cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 0x55da6b7cbb20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1180a8c70 tx=0x7fb1180e3d00 comp rx=0 tx=0).stop 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 shutdown_connections 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da6b847e20 0x55da6b84a210 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6b7c2bd0 0x55da6b7ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb10cff9640 0 client.26066 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da6b7c0190 0x55da6b7cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 --2- 172.21.15.2:0/1329064471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da6b7bd860 0x55da6b7cbb20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.419+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 >> 172.21.15.2:0/1329064471 conn(0x55da6b7b89b0 msgr2=0x55da6b7c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 shutdown_connections 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb1323bb740 1 -- 172.21.15.2:0/1329064471 wait complete. 2024-09-10T23:28:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb1323bb740 20 client.26066 trim_cache size 0 max 16384 2024-09-10T23:28:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:28:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:28:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:28:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb1100b52e0 msgr2=0x7fb1100b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb1100b52e0 0x7fb1100b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb120044000 tx=0x7fb120004df0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 msgr2=0x7fb12819aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 0x7fb12819aeb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb11800eab0 tx=0x7fb11800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 shutdown_connections 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb1100b52e0 0x7fb1100b77a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb12810a910 0x7fb12819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb128076f30 0x7fb12819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 --2- 172.21.15.2:0/763230736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb128075ac0 0x7fb12819aeb0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 >> 172.21.15.2:0/763230736 conn(0x7fb1280fe250 msgr2=0x7fb1281068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 shutdown_connections 2024-09-10T23:28:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:29.420+0000 7fb12f510640 1 -- 172.21.15.2:0/763230736 wait complete. 2024-09-10T23:28:29.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:29 smithi177 ceph-mon[35760]: pgmap v476: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:28:29.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:29.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:29.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:29.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:28:29.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:29 smithi002 ceph-mon[31150]: pgmap v476: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:28:29.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:29.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:29.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:29.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:28:29.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:29 smithi154 ceph-mon[35136]: pgmap v476: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:28:29.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:29.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:28:31.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:31 smithi177 ceph-mon[35760]: pgmap v477: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:31.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:31 smithi002 ceph-mon[31150]: pgmap v477: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:31.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:31 smithi154 ceph-mon[35136]: pgmap v477: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:33.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:33 smithi177 ceph-mon[35760]: pgmap v478: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:28:33.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:33 smithi002 ceph-mon[31150]: pgmap v478: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:28:33.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:33 smithi154 ceph-mon[35136]: pgmap v478: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:28:35.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:35 smithi177 ceph-mon[35760]: pgmap v479: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:35.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:35 smithi002 ceph-mon[31150]: pgmap v479: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:35.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:35 smithi154 ceph-mon[35136]: pgmap v479: 97 pgs: 97 active+clean; 3.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:37.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:37 smithi177 ceph-mon[35760]: pgmap v480: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:28:37.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:37 smithi002 ceph-mon[31150]: pgmap v480: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:28:37.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:37 smithi154 ceph-mon[35136]: pgmap v480: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:28:39.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:39 smithi177 ceph-mon[35760]: pgmap v481: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:28:39.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:39 smithi002 ceph-mon[31150]: pgmap v481: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:28:39.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:39 smithi154 ceph-mon[35136]: pgmap v481: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:28:41.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:41 smithi177 ceph-mon[35760]: pgmap v482: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:28:41.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:41 smithi002 ceph-mon[31150]: pgmap v482: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:28:41.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:41 smithi154 ceph-mon[35136]: pgmap v482: 97 pgs: 97 active+clean; 3.2 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:28:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 -- 172.21.15.2:0/3870895095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 msgr2=0x7f8188109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 --2- 172.21.15.2:0/3870895095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188109d40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8180009cd0 tx=0x7f818002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 -- 172.21.15.2:0/3870895095 shutdown_connections 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 --2- 172.21.15.2:0/3870895095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188109d40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 --2- 172.21.15.2:0/3870895095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8188102a00 0x7f8188102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 --2- 172.21.15.2:0/3870895095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881018b0 0x7f8188101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 -- 172.21.15.2:0/3870895095 >> 172.21.15.2:0/3870895095 conn(0x7f81880fd150 msgr2=0x7f81880ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 -- 172.21.15.2:0/3870895095 shutdown_connections 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.520+0000 7f818e2e2640 1 -- 172.21.15.2:0/3870895095 wait complete. 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 Processor -- start 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 -- start start 2024-09-10T23:28:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881018b0 0x7f8188197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8188102a00 0x7f8188198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f818810d550 con 0x7f81881033c0 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f818810d3d0 con 0x7f81881018b0 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818e2e2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f818810d6d0 con 0x7f8188102a00 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.521+0000 7f818c87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43904/0 (socket says 172.21.15.2:43904) 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 -- 172.21.15.2:0/2609250018 learned_addr learned my addr 172.21.15.2:0/2609250018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f8187fff640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881018b0 0x7f8188197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f81877fe640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8188102a00 0x7f8188198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 -- 172.21.15.2:0/2609250018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8188102a00 msgr2=0x7f8188198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8188102a00 0x7f8188198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 -- 172.21.15.2:0/2609250018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881018b0 msgr2=0x7f8188197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881018b0 0x7f8188197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 -- 172.21.15.2:0/2609250018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81881997f0 con 0x7f81881033c0 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818c87f640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188198f30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f81800098d0 tx=0x7f8180003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f81857fa640 1 -- 172.21.15.2:0/2609250018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180004040 con 0x7f81881033c0 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f81857fa640 1 -- 172.21.15.2:0/2609250018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8180004690 con 0x7f81881033c0 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8188199a80 con 0x7f81881033c0 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f81857fa640 1 -- 172.21.15.2:0/2609250018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180030e70 con 0x7f81881033c0 2024-09-10T23:28:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.522+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881a01b0 con 0x7f81881033c0 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81857fa640 1 -- 172.21.15.2:0/2609250018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8180030070 con 0x7f81881033c0 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 Processor -- start 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 -- start start 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b744e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b747790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bb4b6b26f0 con 0x55bb4b7453a0 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb4b6a1b20 con 0x55bb4b742a70 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f81910b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bb4b6a5930 con 0x55bb4b747de0 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.525+0000 7f8187fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b747790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b747790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43916/0 (socket says 172.21.15.2:43916) 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 -- 172.21.15.2:0/4112908618 learned_addr learned my addr 172.21.15.2:0/4112908618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f81877fe640 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b744e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f81877fe640 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 -- 172.21.15.2:0/4112908618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 msgr2=0x55bb4b74a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 -- 172.21.15.2:0/4112908618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 msgr2=0x55bb4b744e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b744e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 -- 172.21.15.2:0/4112908618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4b667530 con 0x55bb4b7453a0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f81857fa640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81700b52e0 0x7f81700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f81877fe640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81700b52e0 0x7f81700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f8187fff640 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b747790 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f817800bd10 tx=0x7f81780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2508b5c829c0675 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f81857fa640 1 -- 172.21.15.2:0/2609250018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f818002e030 con 0x7f81881033c0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f816e7fc640 1 -- 172.21.15.2:0/4112908618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178004030 con 0x55bb4b7453a0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f816e7fc640 1 -- 172.21.15.2:0/4112908618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81780035f0 con 0x55bb4b7453a0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.526+0000 7f816e7fc640 1 -- 172.21.15.2:0/4112908618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178011680 con 0x55bb4b7453a0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 -- 172.21.15.2:0/4112908618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 msgr2=0x55bb4b747790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81877fe640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81700b52e0 0x7f81700b77a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f817c00d010 tx=0x7f817c016040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b747790 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f817800bd10 tx=0x7f81780107a0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 -- 172.21.15.2:0/4112908618 shutdown_connections 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b747790 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 --2- 172.21.15.2:0/4112908618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b744e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 -- 172.21.15.2:0/4112908618 >> 172.21.15.2:0/4112908618 conn(0x55bb4b73b9b0 msgr2=0x55bb4b73c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 -- 172.21.15.2:0/4112908618 shutdown_connections 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 -- 172.21.15.2:0/4112908618 wait complete. 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.527+0000 7f81910b2740 1 -- start start 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 Processor -- start 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b74c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bb4b5d9ab0 con 0x55bb4b7453a0 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb4b647730 con 0x55bb4b742a70 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bb4b74adc0 con 0x55bb4b747de0 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81910b2740 10 client.0 _ll_register_callbacks cb 0x55bb4b69b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b74c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b74c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43932/0 (socket says 172.21.15.2:43932) 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 -- 172.21.15.2:0/945317042 learned_addr learned my addr 172.21.15.2:0/945317042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f8187fff640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f818c87f640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 -- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 msgr2=0x55bb4b74d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 -- 172.21.15.2:0/945317042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 msgr2=0x55bb4b74c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.528+0000 7f81877fe640 1 -- 172.21.15.2:0/945317042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb4b403790 con 0x55bb4b7453a0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81877fe640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b74c740 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f817c011c50 tx=0x7f817c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ea20285025d18a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81677fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81677fe640 1 -- 172.21.15.2:0/945317042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c025070 con 0x55bb4b7453a0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81780035f0 con 0x55bb4b7453a0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81677fe640 1 -- 172.21.15.2:0/945317042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f817c02a660 con 0x55bb4b7453a0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81677fe640 1 -- 172.21.15.2:0/945317042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f817c01b070 con 0x55bb4b7453a0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81910b2740 10 client.16890 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb4b47c620 con 0x55bb4b7453a0 2024-09-10T23:28:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81677fe640 1 -- 172.21.15.2:0/945317042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81780035f0 con 0x55bb4b7453a0 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.529+0000 7f81677fe640 1 -- 172.21.15.2:0/945317042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f817c00e3b0 con 0x55bb4b7453a0 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81910b2740 10 client.16890 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81910b2740 10 client.16890 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81910b2740 20 client.16890 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81910b2740 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b757a00 0x55bb4b759df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81910b2740 4 client.16890 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb4b6b4640 con 0x55bb4b757a00 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f8187fff640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b757a00 0x55bb4b759df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f8187fff640 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b757a00 0x55bb4b759df0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243f746872e9c830 server_cookie=bfad7297a9c9b9be in_seq=0 out_seq=0 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.530+0000 7f81677fe640 10 client.16890 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81677fe640 1 -- 172.21.15.2:0/945317042 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb4b6b4640 con 0x55bb4b757a00 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81677fe640 10 client.16890 handle_command_reply: tid=0 2024-09-10T23:28:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 client.16890 shutdown 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 msgr2=0x55bb4b74c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b74c740 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f817c011c50 tx=0x7f817c004730 comp rx=0 tx=0).stop 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 shutdown_connections 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b757a00 0x55bb4b759df0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b747de0 0x55bb4b74d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b74c740 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81677fe640 0 client.16890 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 --2- 172.21.15.2:0/945317042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 >> 172.21.15.2:0/945317042 conn(0x55bb4b73b9b0 msgr2=0x55bb4b73abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 shutdown_connections 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 1 -- 172.21.15.2:0/945317042 wait complete. 2024-09-10T23:28:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.531+0000 7f81910b2740 20 client.16890 trim_cache size 0 max 16384 2024-09-10T23:28:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 Processor -- start 2024-09-10T23:28:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 -- start start 2024-09-10T23:28:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b7453a0 0x55bb4b74b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 0x55bb4b74b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81881a7d80 con 0x55bb4b747de0 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81881a98c0 con 0x55bb4b742a70 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81910b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81881a8450 con 0x55bb4b7453a0 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 0x55bb4b74b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 0x55bb4b74b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43934/0 (socket says 172.21.15.2:43934) 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 -- 172.21.15.2:0/1607134072 learned_addr learned my addr 172.21.15.2:0/1607134072 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f81877fe640 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b7453a0 0x55bb4b74b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 -- 172.21.15.2:0/1607134072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b7453a0 msgr2=0x55bb4b74b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f8187fff640 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b7453a0 0x55bb4b74b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 -- 172.21.15.2:0/1607134072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 msgr2=0x55bb4b74c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 -- 172.21.15.2:0/1607134072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4b7451d0 con 0x55bb4b747de0 2024-09-10T23:28:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.547+0000 7f818c87f640 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 0x55bb4b74b700 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f81801045d0 tx=0x7f81800093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47211cc5814cb126 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f816dffb640 1 -- 172.21.15.2:0/1607134072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800d6160 con 0x55bb4b747de0 2024-09-10T23:28:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f816dffb640 1 -- 172.21.15.2:0/1607134072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8180036020 con 0x55bb4b747de0 2024-09-10T23:28:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f816dffb640 1 -- 172.21.15.2:0/1607134072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800d6820 con 0x55bb4b747de0 2024-09-10T23:28:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 -- 172.21.15.2:0/1607134072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 msgr2=0x55bb4b74b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 0x55bb4b74b700 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f81801045d0 tx=0x7f81800093d0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 -- 172.21.15.2:0/1607134072 shutdown_connections 2024-09-10T23:28:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b747de0 0x55bb4b74b700 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b7453a0 0x55bb4b74b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 --2- 172.21.15.2:0/1607134072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b742a70 0x55bb4b74c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 -- 172.21.15.2:0/1607134072 >> 172.21.15.2:0/1607134072 conn(0x55bb4b73b9b0 msgr2=0x55bb4b7481c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 -- 172.21.15.2:0/1607134072 shutdown_connections 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.548+0000 7f81910b2740 1 -- 172.21.15.2:0/1607134072 wait complete. 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 -- start start 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 Processor -- start 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b742a70 0x55bb4b753730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b753dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b747de0 0x55bb4b74f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81881a91f0 con 0x55bb4b7453a0 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81881a8b20 con 0x55bb4b747de0 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81881a5d60 con 0x55bb4b742a70 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81910b2740 10 client.0 _ll_register_callbacks cb 0x7f817c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b753dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b753dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43938/0 (socket says 172.21.15.2:43938) 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81877fe640 1 -- 172.21.15.2:0/2136614111 learned_addr learned my addr 172.21.15.2:0/2136614111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f8187fff640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b742a70 0x55bb4b753730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f818c87f640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b747de0 0x55bb4b74f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81877fe640 1 -- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b742a70 msgr2=0x55bb4b753730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81877fe640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b742a70 0x55bb4b753730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.549+0000 7f81877fe640 1 -- 172.21.15.2:0/2136614111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b747de0 msgr2=0x55bb4b74f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81877fe640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b747de0 0x55bb4b74f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81877fe640 1 -- 172.21.15.2:0/2136614111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb4b74fe00 con 0x55bb4b7453a0 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f818c87f640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b747de0 0x55bb4b74f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81877fe640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b753dd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f817c00e990 tx=0x7f817c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accc96d6a4561bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81677fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81677fe640 1 -- 172.21.15.2:0/2136614111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c025070 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81677fe640 1 -- 172.21.15.2:0/2136614111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f817c02a870 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8180036020 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81677fe640 1 -- 172.21.15.2:0/2136614111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f817c011800 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81910b2740 10 client.16896 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb4b7c6d00 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81677fe640 1 -- 172.21.15.2:0/2136614111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8180036020 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.550+0000 7f81677fe640 1 -- 172.21.15.2:0/2136614111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f817c03d070 con 0x55bb4b7453a0 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81910b2740 10 client.16896 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81910b2740 10 client.16896 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81910b2740 20 client.16896 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81910b2740 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b7c75f0 0x55bb4b7c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81910b2740 4 client.16896 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:28:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb4b6b00f0 con 0x55bb4b7c75f0 2024-09-10T23:28:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f8187fff640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b7c75f0 0x55bb4b7c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f81677fe640 10 client.16896 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.551+0000 7f8187fff640 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b7c75f0 0x55bb4b7c9a10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feceaa6068f078e6 server_cookie=816018fd92934207 in_seq=0 out_seq=0 2024-09-10T23:28:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81677fe640 1 -- 172.21.15.2:0/2136614111 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb4b6b00f0 con 0x55bb4b7c75f0 2024-09-10T23:28:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81677fe640 10 client.16896 handle_command_reply: tid=0 2024-09-10T23:28:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 client.16896 shutdown 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 msgr2=0x55bb4b753dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b753dd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f817c00e990 tx=0x7f817c00ed40 comp rx=0 tx=0).stop 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 shutdown_connections 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bb4b7c75f0 0x55bb4b7c9a10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4b747de0 0x55bb4b74f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb4b7453a0 0x55bb4b753dd0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81677fe640 0 client.16896 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 --2- 172.21.15.2:0/2136614111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb4b742a70 0x55bb4b753730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 >> 172.21.15.2:0/2136614111 conn(0x55bb4b73b9b0 msgr2=0x55bb4b73f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 shutdown_connections 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.567+0000 7f81910b2740 1 -- 172.21.15.2:0/2136614111 wait complete. 2024-09-10T23:28:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f81910b2740 20 client.16896 trim_cache size 0 max 16384 2024-09-10T23:28:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:28:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:28:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:28:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81700b52e0 msgr2=0x7f81700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81700b52e0 0x7f81700b77a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f817c00d010 tx=0x7f817c016040 comp rx=0 tx=0).stop 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 msgr2=0x7f8188198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188198f30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f81800098d0 tx=0x7f8180003ba0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 shutdown_connections 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f81700b52e0 0x7f81700b77a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81881033c0 0x7f8188198f30 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8188102a00 0x7f8188198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 --2- 172.21.15.2:0/2609250018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81881018b0 0x7f8188197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 >> 172.21.15.2:0/2609250018 conn(0x7f81880fd150 msgr2=0x7f8188105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 shutdown_connections 2024-09-10T23:28:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:42.568+0000 7f818e2e2640 1 -- 172.21.15.2:0/2609250018 wait complete. 2024-09-10T23:28:43.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:43 smithi177 ceph-mon[35760]: pgmap v483: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:28:43.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:43 smithi002 ceph-mon[31150]: pgmap v483: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:28:43.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:43 smithi154 ceph-mon[35136]: pgmap v483: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:28:45.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:45 smithi177 ceph-mon[35760]: pgmap v484: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:28:45.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:45 smithi002 ceph-mon[31150]: pgmap v484: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:28:45.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:45 smithi154 ceph-mon[35136]: pgmap v484: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:28:47.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:47 smithi177 ceph-mon[35760]: pgmap v485: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:47.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:47 smithi002 ceph-mon[31150]: pgmap v485: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:47.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:47 smithi154 ceph-mon[35136]: pgmap v485: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:28:49.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:49 smithi177 ceph-mon[35760]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:49.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:49 smithi002 ceph-mon[31150]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:49.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:49 smithi154 ceph-mon[35136]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:28:51.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:51 smithi177 ceph-mon[35760]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:28:51.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:51 smithi002 ceph-mon[31150]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:28:51.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:51 smithi154 ceph-mon[35136]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:28:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:53.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:53 smithi177 ceph-mon[35760]: pgmap v488: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:28:53.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:53 smithi002 ceph-mon[31150]: pgmap v488: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:28:53.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:53 smithi154 ceph-mon[35136]: pgmap v488: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:28:54.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/3830417582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 msgr2=0x7fc2b410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/3830417582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b410e820 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009900 tx=0x7fc2ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:28:54.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/3830417582 shutdown_connections 2024-09-10T23:28:54.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/3830417582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b410e820 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/3830417582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b41076a0 0x7fc2b4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/3830417582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b4101c90 0x7fc2b4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/3830417582 >> 172.21.15.2:0/3830417582 conn(0x7fc2b40fd700 msgr2=0x7fc2b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/3830417582 shutdown_connections 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/3830417582 wait complete. 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.277+0000 7fc2b9d0f640 1 Processor -- start 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 -- start start 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b4101c90 0x7fc2b4199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b41076a0 0x7fc2b4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4111ce0 con 0x7fc2b4108020 2024-09-10T23:28:54.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4111b60 con 0x7fc2b41076a0 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b9d0f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4111e60 con 0x7fc2b4101c90 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b419eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55784/0 (socket says 172.21.15.2:55784) 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 -- 172.21.15.2:0/212482674 learned_addr learned my addr 172.21.15.2:0/212482674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b41076a0 0x7fc2b4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b4101c90 0x7fc2b4199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 -- 172.21.15.2:0/212482674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b4101c90 msgr2=0x7fc2b4199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b4101c90 0x7fc2b4199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 -- 172.21.15.2:0/212482674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b41076a0 msgr2=0x7fc2b4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b41076a0 0x7fc2b4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.278+0000 7fc2b3fff640 1 -- 172.21.15.2:0/212482674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b419f2d0 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.279+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b419eb00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009a20 tx=0x7fc2ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.279+0000 7fc2b0ff9640 1 -- 172.21.15.2:0/212482674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac03f030 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.279+0000 7fc2b0ff9640 1 -- 172.21.15.2:0/212482674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ac003aa0 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.279+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b419f560 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.279+0000 7fc2b0ff9640 1 -- 172.21.15.2:0/212482674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac035070 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.279+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b41a5c80 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.281+0000 7fc2bc0e4740 1 Processor -- start 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b0ff9640 1 -- 172.21.15.2:0/212482674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc2ac0035f0 con 0x7fc2b4108020 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 -- start start 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f65075480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65081410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65083d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558f64febe50 con 0x558f650750a0 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558f64fdb280 con 0x558f65081950 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558f64fdf090 con 0x558f650759c0 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f65075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f65075480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55786/0 (socket says 172.21.15.2:55786) 2024-09-10T23:28:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/2035703804 learned_addr learned my addr 172.21.15.2:0/2035703804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/2035703804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 msgr2=0x558f65081410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65081410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/2035703804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 msgr2=0x558f65083d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65083d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/2035703804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f64d39650 con 0x558f650750a0 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65081410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.282+0000 7fc2b0ff9640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2a00b52e0 0x7fc2a00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2a00b52e0 0x7fc2a00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2b0ff9640 1 -- 172.21.15.2:0/212482674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc2ac1065e0 con 0x7fc2b4108020 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f65075480 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00ad40 tx=0x7fc29c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6815c83fbbc613dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2a9ffb640 1 -- 172.21.15.2:0/2035703804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c012450 con 0x558f650750a0 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2a9ffb640 1 -- 172.21.15.2:0/2035703804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc29c012aa0 con 0x558f650750a0 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2a9ffb640 1 -- 172.21.15.2:0/2035703804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00fac0 con 0x558f650750a0 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/2035703804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 msgr2=0x558f65075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2a00b52e0 0x7fc2a00b77a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x558f65073db0 tx=0x7fc2a40096d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.283+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f65075480 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00ad40 tx=0x7fc29c0117b0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/2035703804 shutdown_connections 2024-09-10T23:28:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65083d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65081410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/2035703804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f65075480 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/2035703804 >> 172.21.15.2:0/2035703804 conn(0x558f65072ed0 msgr2=0x558f65074070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/2035703804 shutdown_connections 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/2035703804 wait complete. 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- start start 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 Processor -- start 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650750a0 0x558f65081220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 0x558f6507e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558f64e3c700 con 0x558f650759c0 2024-09-10T23:28:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558f64f76110 con 0x558f65081950 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558f650845d0 con 0x558f650750a0 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.284+0000 7fc2bc0e4740 10 client.0 _ll_register_callbacks cb 0x558f64f8f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 0x558f6507e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 0x558f6507e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55792/0 (socket says 172.21.15.2:55792) 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/818180409 learned_addr learned my addr 172.21.15.2:0/818180409 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650750a0 0x558f65081220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650750a0 msgr2=0x558f65081220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650750a0 0x558f65081220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/818180409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 msgr2=0x558f6507ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/818180409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f64fa3c40 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 0x558f6507e670 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00f600 tx=0x7fc29c012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de2fe4acbbe42fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc292ffd640 1 -- 172.21.15.2:0/818180409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c029060 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc292ffd640 1 -- 172.21.15.2:0/818180409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc29c00fc10 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc29c012aa0 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.285+0000 7fc292ffd640 1 -- 172.21.15.2:0/818180409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc29c00a9a0 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 10 client.16908 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558f6508feb0 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc292ffd640 1 -- 172.21.15.2:0/818180409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc29c012aa0 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc292ffd640 1 -- 172.21.15.2:0/818180409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc29c023030 con 0x558f650759c0 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 10 client.16908 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 20 client.16908 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650935f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 4 client.16908 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f64fedda0 con 0x558f65091200 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.286+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650935f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.287+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650935f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e16b0b14f25e09 server_cookie=5cba96afc90d0497 in_seq=0 out_seq=0 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.287+0000 7fc292ffd640 10 client.16908 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.287+0000 7fc292ffd640 1 -- 172.21.15.2:0/818180409 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f64fedda0 con 0x558f65091200 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.287+0000 7fc292ffd640 10 client.16908 handle_command_reply: tid=0 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 client.16908 shutdown 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 msgr2=0x558f6507e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 0x558f6507e670 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00f600 tx=0x7fc29c012a00 comp rx=0 tx=0).stop 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 shutdown_connections 2024-09-10T23:28:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650935f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc292ffd640 0 client.16908 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650759c0 0x558f6507e670 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/818180409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650750a0 0x558f65081220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 >> 172.21.15.2:0/818180409 conn(0x558f65072ed0 msgr2=0x558f65078a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 shutdown_connections 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/818180409 wait complete. 2024-09-10T23:28:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.288+0000 7fc2bc0e4740 20 client.16908 trim_cache size 0 max 16384 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 Processor -- start 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 -- start start 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f6508d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f6507b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41ae290 con 0x558f650750a0 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41afdd0 con 0x558f65081950 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41ae960 con 0x558f650759c0 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f6508d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f6508d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55798/0 (socket says 172.21.15.2:55798) 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 -- 172.21.15.2:0/524953499 learned_addr learned my addr 172.21.15.2:0/524953499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f6507b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 -- 172.21.15.2:0/524953499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 msgr2=0x558f6507b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f6507b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 -- 172.21.15.2:0/524953499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 msgr2=0x558f6507bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b37fe640 1 -- 172.21.15.2:0/524953499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f65079110 con 0x558f650750a0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.306+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.307+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f6508d860 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40183f0 tx=0x7fc2a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc53ad6541edde35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.307+0000 7fc2a97fa640 1 -- 172.21.15.2:0/524953499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4027070 con 0x558f650750a0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.307+0000 7fc2a97fa640 1 -- 172.21.15.2:0/524953499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a40258e0 con 0x558f650750a0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.307+0000 7fc2a97fa640 1 -- 172.21.15.2:0/524953499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4017910 con 0x558f650750a0 2024-09-10T23:28:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/524953499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 msgr2=0x558f6508d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f6508d860 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40183f0 tx=0x7fc2a4012000 comp rx=0 tx=0).stop 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/524953499 shutdown_connections 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f6507bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f6507b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/524953499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f6508d860 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/524953499 >> 172.21.15.2:0/524953499 conn(0x558f65072ed0 msgr2=0x558f6507cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/524953499 shutdown_connections 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/524953499 wait complete. 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 -- start start 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.308+0000 7fc2bc0e4740 1 Processor -- start 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f650898d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65089e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65084880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41af700 con 0x558f650750a0 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41af030 con 0x558f65081950 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41ac270 con 0x558f650759c0 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2bc0e4740 10 client.0 _ll_register_callbacks cb 0x7fc29c00ac10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65089e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f650898d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65089e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:33758/0 (socket says 172.21.15.2:33758) 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/463154507 learned_addr learned my addr 172.21.15.2:0/463154507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.309+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65084880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b3fff640 1 -- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 msgr2=0x558f65089e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65089e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b3fff640 1 -- 172.21.15.2:0/463154507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 msgr2=0x558f650898d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f650898d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b3fff640 1 -- 172.21.15.2:0/463154507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f6508a620 con 0x558f65081950 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f650898d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2b3fff640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65084880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0ccab0 tx=0x7fc2ac0c8d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35216a46750b85ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc292ffd640 1 -- 172.21.15.2:0/463154507 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac049050 con 0x558f65081950 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a40258e0 con 0x558f65081950 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc292ffd640 1 -- 172.21.15.2:0/463154507 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc2ac0b40b0 con 0x558f65081950 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc292ffd640 1 -- 172.21.15.2:0/463154507 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2ac0cc520 con 0x558f65081950 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2bc0e4740 10 client.26090 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.310+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558f650fc4d0 con 0x558f65081950 2024-09-10T23:28:54.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc292ffd640 1 -- 172.21.15.2:0/463154507 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a40258e0 con 0x558f65081950 2024-09-10T23:28:54.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc292ffd640 1 -- 172.21.15.2:0/463154507 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc2ac0cd010 con 0x558f65081950 2024-09-10T23:28:54.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2bc0e4740 10 client.26090 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:54.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2bc0e4740 10 client.26090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:54.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2bc0e4740 20 client.26090 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:54.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2bc0e4740 4 client.26090 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f64fe9850 con 0x558f65091200 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650fec00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66c0b529506a0a7e server_cookie=9f2e8d12d5a8b45 in_seq=0 out_seq=0 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.311+0000 7fc292ffd640 10 client.26090 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc292ffd640 1 -- 172.21.15.2:0/463154507 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x558f64fe9850 con 0x558f65091200 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc292ffd640 10 client.26090 handle_command_reply: tid=0 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 client.26090 shutdown 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 msgr2=0x558f65084880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65084880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0ccab0 tx=0x7fc2ac0c8d10 comp rx=0 tx=0).stop 2024-09-10T23:28:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 shutdown_connections 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x558f65091200 0x558f650fec00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f65081950 0x558f65084880 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f650759c0 0x558f65089e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 --2- 172.21.15.2:0/463154507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f650750a0 0x558f650898d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 >> 172.21.15.2:0/463154507 conn(0x558f65072ed0 msgr2=0x558f65078920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc292ffd640 0 client.26090 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 shutdown_connections 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 1 -- 172.21.15.2:0/463154507 wait complete. 2024-09-10T23:28:54.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.312+0000 7fc2bc0e4740 20 client.26090 trim_cache size 0 max 16384 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.320 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.321 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:28:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.323 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:28:54.324 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:28:54.326 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2a00b52e0 msgr2=0x7fc2a00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2a00b52e0 0x7fc2a00b77a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x558f65073db0 tx=0x7fc2a40096d0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 msgr2=0x7fc2b419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b419eb00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009a20 tx=0x7fc2ac004270 comp rx=0 tx=0).stop 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 shutdown_connections 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2a00b52e0 0x7fc2a00b77a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4108020 0x7fc2b419eb00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b41076a0 0x7fc2b4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 --2- 172.21.15.2:0/212482674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b4101c90 0x7fc2b4199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 >> 172.21.15.2:0/212482674 conn(0x7fc2b40fd700 msgr2=0x7fc2b4104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 shutdown_connections 2024-09-10T23:28:54.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:54.313+0000 7fc2b9d0f640 1 -- 172.21.15.2:0/212482674 wait complete. 2024-09-10T23:28:55.270 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:28:55.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:28:55.542 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:55.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:55 smithi002 ceph-mon[31150]: pgmap v489: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:28:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.658+0000 7fc290365640 1 -- 172.21.15.2:0/4233868116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288105e50 msgr2=0x7fc288108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.658+0000 7fc290365640 1 --2- 172.21.15.2:0/4233868116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288105e50 0x7fc288108240 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc278009900 tx=0x7fc27802a410 comp rx=0 tx=0).stop 2024-09-10T23:28:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.658+0000 7fc290365640 1 -- 172.21.15.2:0/4233868116 shutdown_connections 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 --2- 172.21.15.2:0/4233868116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288108780 0x7fc28810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 --2- 172.21.15.2:0/4233868116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288105e50 0x7fc288108240 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 --2- 172.21.15.2:0/4233868116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc288100d90 0x7fc288101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 -- 172.21.15.2:0/4233868116 >> 172.21.15.2:0/4233868116 conn(0x7fc2880fc8f0 msgr2=0x7fc2880fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 -- 172.21.15.2:0/4233868116 shutdown_connections 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 -- 172.21.15.2:0/4233868116 wait complete. 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 Processor -- start 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.659+0000 7fc290365640 1 -- start start 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288100d90 0x7fc288198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc288105e50 0x7fc2881993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 0x7fc28819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc28810e620 con 0x7fc288108780 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc28810e4a0 con 0x7fc288100d90 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc28810e7a0 con 0x7fc288105e50 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 0x7fc28819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 0x7fc28819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55824/0 (socket says 172.21.15.2:55824) 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 -- 172.21.15.2:0/1405833738 learned_addr learned my addr 172.21.15.2:0/1405833738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28d900640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc288105e50 0x7fc2881993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e101640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288100d90 0x7fc288198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 -- 172.21.15.2:0/1405833738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc288105e50 msgr2=0x7fc2881993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc288105e50 0x7fc2881993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 -- 172.21.15.2:0/1405833738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288100d90 msgr2=0x7fc288198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288100d90 0x7fc288198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 -- 172.21.15.2:0/1405833738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28819a8e0 con 0x7fc288108780 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e101640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288100d90 0x7fc288198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc28e902640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 0x7fc28819a020 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc28000cab0 tx=0x7fc28000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc27f7fe640 1 -- 172.21.15.2:0/1405833738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28000ae20 con 0x7fc288108780 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc27f7fe640 1 -- 172.21.15.2:0/1405833738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc28000f900 con 0x7fc288108780 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc27f7fe640 1 -- 172.21.15.2:0/1405833738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280018a50 con 0x7fc288108780 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28819abd0 con 0x7fc288108780 2024-09-10T23:28:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.660+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2881a12a0 con 0x7fc288108780 2024-09-10T23:28:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 Processor -- start 2024-09-10T23:28:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc27f7fe640 1 -- 172.21.15.2:0/1405833738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc28000f450 con 0x7fc288108780 2024-09-10T23:28:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 -- start start 2024-09-10T23:28:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05889060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af0588b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af0588e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55af057f46f0 con 0x55af05886c70 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af057e3b20 con 0x55af0588bfe0 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.663+0000 7fc29320e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55af057e7930 con 0x55af058895a0 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05889060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05889060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55836/0 (socket says 172.21.15.2:55836) 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 -- 172.21.15.2:0/2479089244 learned_addr learned my addr 172.21.15.2:0/2479089244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28e101640 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af0588b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af0588e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 -- 172.21.15.2:0/2479089244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 msgr2=0x55af0588b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af0588b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 -- 172.21.15.2:0/2479089244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 msgr2=0x55af0588e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af0588e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 -- 172.21.15.2:0/2479089244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af057a9530 con 0x55af05886c70 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28d900640 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05889060 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc278005ab0 tx=0x7fc2780058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be82dc8608b33bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc27f7fe640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2740b52e0 0x7fc2740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc27cbfe640 1 -- 172.21.15.2:0/2479089244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278035050 con 0x55af05886c70 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc28e101640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2740b52e0 0x7fc2740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.664+0000 7fc27cbfe640 1 -- 172.21.15.2:0/2479089244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc278031770 con 0x55af05886c70 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc27cbfe640 1 -- 172.21.15.2:0/2479089244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278005380 con 0x55af05886c70 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc27f7fe640 1 -- 172.21.15.2:0/1405833738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc2800e6470 con 0x7fc288108780 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 -- 172.21.15.2:0/2479089244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 msgr2=0x55af05889060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05889060 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc278005ab0 tx=0x7fc2780058b0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc28e101640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2740b52e0 0x7fc2740b77a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc284005fd0 tx=0x7fc2840094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 -- 172.21.15.2:0/2479089244 shutdown_connections 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af0588e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af0588b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 --2- 172.21.15.2:0/2479089244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05889060 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 -- 172.21.15.2:0/2479089244 >> 172.21.15.2:0/2479089244 conn(0x55af0587d9b0 msgr2=0x55af0587e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 -- 172.21.15.2:0/2479089244 shutdown_connections 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.665+0000 7fc29320e740 1 -- 172.21.15.2:0/2479089244 wait complete. 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 -- start start 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 Processor -- start 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058902a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af05890940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05891510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55af0571bab0 con 0x55af05886c70 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af05789730 con 0x55af0588bfe0 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55af0588ef60 con 0x55af058895a0 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc29320e740 10 client.0 _ll_register_callbacks cb 0x55af057dd6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058902a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55852/0 (socket says 172.21.15.2:55852) 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 -- 172.21.15.2:0/3594080376 learned_addr learned my addr 172.21.15.2:0/3594080376 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e902640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05891510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28d900640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af05890940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 -- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 msgr2=0x55af05890940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af05890940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 -- 172.21.15.2:0/3594080376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 msgr2=0x55af05891510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05891510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.666+0000 7fc28e101640 1 -- 172.21.15.2:0/3594080376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af05545790 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc28e101640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058902a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc284012690 tx=0x7fc2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3465285768e328d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc271ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc271ffb640 1 -- 172.21.15.2:0/3594080376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28401f8f0 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc271ffb640 1 -- 172.21.15.2:0/3594080376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc28401fa90 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc278031770 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc271ffb640 1 -- 172.21.15.2:0/3594080376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc28401fc90 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 10 client.16926 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af055be620 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc271ffb640 1 -- 172.21.15.2:0/3594080376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc278031770 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc271ffb640 1 -- 172.21.15.2:0/3594080376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc28400f040 con 0x55af05886c70 2024-09-10T23:28:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 10 client.16926 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 10 client.16926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 20 client.16926 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af0589bb90 0x55af0589df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 4 client.16926 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.667+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af057f6640 con 0x55af0589bb90 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.668+0000 7fc28d900640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af0589bb90 0x55af0589df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.668+0000 7fc271ffb640 10 client.16926 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.668+0000 7fc28d900640 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af0589bb90 0x55af0589df80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf91e41c681f62e server_cookie=a89b10e5967b0cfa in_seq=0 out_seq=0 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc271ffb640 1 -- 172.21.15.2:0/3594080376 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af057f6640 con 0x55af0589bb90 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc271ffb640 10 client.16926 handle_command_reply: tid=0 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 client.16926 shutdown 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 msgr2=0x55af058902a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058902a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc284012690 tx=0x7fc2840046c0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 shutdown_connections 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af0589bb90 0x55af0589df80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05891510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc271ffb640 0 client.16926 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af05890940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 --2- 172.21.15.2:0/3594080376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058902a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 >> 172.21.15.2:0/3594080376 conn(0x55af0587d9b0 msgr2=0x55af0587cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 shutdown_connections 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 1 -- 172.21.15.2:0/3594080376 wait complete. 2024-09-10T23:28:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.669+0000 7fc29320e740 20 client.16926 trim_cache size 0 max 16384 2024-09-10T23:28:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 Processor -- start 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 -- start start 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af058895a0 0x55af058a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af0588bfe0 0x55af058a3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2881a7c70 con 0x55af05886c70 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2881a97b0 con 0x55af058895a0 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc29320e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2881a8340 con 0x55af0588bfe0 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55856/0 (socket says 172.21.15.2:55856) 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 -- 172.21.15.2:0/361306256 learned_addr learned my addr 172.21.15.2:0/361306256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e902640 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af0588bfe0 0x55af058a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 -- 172.21.15.2:0/361306256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af0588bfe0 msgr2=0x55af058a3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af0588bfe0 0x55af058a3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 -- 172.21.15.2:0/361306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af058895a0 msgr2=0x55af058a2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af058895a0 0x55af058a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 -- 172.21.15.2:0/361306256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af05891880 con 0x55af05886c70 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e902640 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af0588bfe0 0x55af058a3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.684+0000 7fc28e101640 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058a2880 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc284011c40 tx=0x7fc284009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eeed141e61e06ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc273fff640 1 -- 172.21.15.2:0/361306256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284040070 con 0x55af05886c70 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc273fff640 1 -- 172.21.15.2:0/361306256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc28400e820 con 0x55af05886c70 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc273fff640 1 -- 172.21.15.2:0/361306256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840326b0 con 0x55af05886c70 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 -- 172.21.15.2:0/361306256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 msgr2=0x55af058a2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058a2880 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc284011c40 tx=0x7fc284009c00 comp rx=0 tx=0).stop 2024-09-10T23:28:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 -- 172.21.15.2:0/361306256 shutdown_connections 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af0588bfe0 0x55af058a3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af058895a0 0x55af058a2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 --2- 172.21.15.2:0/361306256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af058a2880 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 -- 172.21.15.2:0/361306256 >> 172.21.15.2:0/361306256 conn(0x55af0587d9b0 msgr2=0x55af05880a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 -- 172.21.15.2:0/361306256 shutdown_connections 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 -- 172.21.15.2:0/361306256 wait complete. 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 -- start start 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.685+0000 7fc29320e740 1 Processor -- start 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05896e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af058973c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05897900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2881a90e0 con 0x55af05886c70 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2881a8a10 con 0x55af0588bfe0 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2881a5c50 con 0x55af058895a0 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 10 client.0 _ll_register_callbacks cb 0x7fc284009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05896e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05896e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55858/0 (socket says 172.21.15.2:55858) 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 -- 172.21.15.2:0/3097378429 learned_addr learned my addr 172.21.15.2:0/3097378429 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28d900640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af058973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e902640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05897900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 -- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 msgr2=0x55af058973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af058973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 -- 172.21.15.2:0/3097378429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 msgr2=0x55af05897900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05897900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 -- 172.21.15.2:0/3097378429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af0588bd00 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28d900640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af058973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc28e101640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05896e80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc28400e390 tx=0x7fc284009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22026db3130b454 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc271ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc271ffb640 1 -- 172.21.15.2:0/3097378429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284040070 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc271ffb640 1 -- 172.21.15.2:0/3097378429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc28400ed20 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.686+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc28400e820 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc271ffb640 1 -- 172.21.15.2:0/3097378429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc284005040 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 10 client.16932 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af05908c70 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc271ffb640 1 -- 172.21.15.2:0/3097378429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc28400e820 con 0x55af05886c70 2024-09-10T23:28:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc271ffb640 1 -- 172.21.15.2:0/3097378429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc284032450 con 0x55af05886c70 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 10 client.16932 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 10 client.16932 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 20 client.16932 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af059095e0 0x55af0590ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 4 client.16932 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af0587ede0 con 0x55af059095e0 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.687+0000 7fc28d900640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af059095e0 0x55af0590ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.688+0000 7fc28d900640 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af059095e0 0x55af0590ba00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b86cb9daf619f1 server_cookie=c11ef5f7aad416a0 in_seq=0 out_seq=0 2024-09-10T23:28:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.688+0000 7fc271ffb640 10 client.16932 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc271ffb640 1 -- 172.21.15.2:0/3097378429 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af0587ede0 con 0x55af059095e0 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc271ffb640 10 client.16932 handle_command_reply: tid=0 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 client.16932 shutdown 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 msgr2=0x55af05896e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05896e80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc28400e390 tx=0x7fc284009aa0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 shutdown_connections 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af059095e0 0x55af0590ba00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af0588bfe0 0x55af05897900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af058895a0 0x55af058973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc271ffb640 0 client.16932 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 --2- 172.21.15.2:0/3097378429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af05886c70 0x55af05896e80 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.702+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 >> 172.21.15.2:0/3097378429 conn(0x55af0587d9b0 msgr2=0x55af058820e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 shutdown_connections 2024-09-10T23:28:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc29320e740 1 -- 172.21.15.2:0/3097378429 wait complete. 2024-09-10T23:28:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc29320e740 20 client.16932 trim_cache size 0 max 16384 2024-09-10T23:28:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:28:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:28:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:28:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:28:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2740b52e0 msgr2=0x7fc2740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2740b52e0 0x7fc2740b77a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc284005fd0 tx=0x7fc2840094a0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 msgr2=0x7fc28819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 0x7fc28819a020 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc28000cab0 tx=0x7fc28000cf70 comp rx=0 tx=0).stop 2024-09-10T23:28:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 shutdown_connections 2024-09-10T23:28:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc2740b52e0 0x7fc2740b77a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc288108780 0x7fc28819a020 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc288105e50 0x7fc2881993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 --2- 172.21.15.2:0/1405833738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc288100d90 0x7fc288198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 >> 172.21.15.2:0/1405833738 conn(0x7fc2880fc8f0 msgr2=0x7fc288106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 shutdown_connections 2024-09-10T23:28:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:28:55.703+0000 7fc290365640 1 -- 172.21.15.2:0/1405833738 wait complete. 2024-09-10T23:28:55.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:55 smithi177 ceph-mon[35760]: pgmap v489: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:28:55.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:55 smithi154 ceph-mon[35136]: pgmap v489: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:28:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 -- 172.21.15.2:0/1347874547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c101c90 msgr2=0x7f526c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 --2- 172.21.15.2:0/1347874547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c101c90 0x7f526c102070 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f525c009900 tx=0x7f525c02a410 comp rx=0 tx=0).stop 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 -- 172.21.15.2:0/1347874547 shutdown_connections 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 --2- 172.21.15.2:0/1347874547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f526c108020 0x7f526c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 --2- 172.21.15.2:0/1347874547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526c1076a0 0x7f526c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 --2- 172.21.15.2:0/1347874547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c101c90 0x7f526c102070 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 -- 172.21.15.2:0/1347874547 >> 172.21.15.2:0/1347874547 conn(0x7f526c0fd700 msgr2=0x7f526c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 -- 172.21.15.2:0/1347874547 shutdown_connections 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.056+0000 7f52727f4640 1 -- 172.21.15.2:0/1347874547 wait complete. 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 Processor -- start 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 -- start start 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f526c101c90 0x7f526c10f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526c1076a0 0x7f526c10f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 0x7f526c10fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f526c112e00 con 0x7f526c108020 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f526c112c80 con 0x7f526c1076a0 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f52727f4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f526c112f80 con 0x7f526c101c90 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 0x7f526c10fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 0x7f526c10fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55866/0 (socket says 172.21.15.2:55866) 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 -- 172.21.15.2:0/1045012035 learned_addr learned my addr 172.21.15.2:0/1045012035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f526b7fe640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526c1076a0 0x7f526c10f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f526bfff640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f526c101c90 0x7f526c10f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 -- 172.21.15.2:0/1045012035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f526c101c90 msgr2=0x7f526c10f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f526c101c90 0x7f526c10f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 -- 172.21.15.2:0/1045012035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526c1076a0 msgr2=0x7f526c10f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.057+0000 7f5270d91640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526c1076a0 0x7f526c10f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f5270d91640 1 -- 172.21.15.2:0/1045012035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c1a7710 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f5270d91640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 0x7f526c10fdb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5264009fd0 tx=0x7f526400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264017070 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526c1a7a00 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5264003e20 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264010460 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.058+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526c1a7f40 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.059+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526c102070 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.061+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5264003970 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.061+0000 7f52697fa640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52540b52e0 0x7f52540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.062+0000 7f526bfff640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52540b52e0 0x7f52540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.062+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52640e5920 con 0x7f526c108020 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.062+0000 7f526bfff640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52540b52e0 0x7f52540b77a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f525c031440 tx=0x7f525c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:56.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.065+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f52640ac7f0 con 0x7f526c108020 2024-09-10T23:28:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.287+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f526c02e5c0 con 0x7f526c108020 2024-09-10T23:28:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.287+0000 7f52697fa640 1 -- 172.21.15.2:0/1045012035 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f52640ac0f0 con 0x7f526c108020 2024-09-10T23:28:56.289 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:28:56.290 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:28:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:28:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.289+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52540b52e0 msgr2=0x7f52540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.289+0000 7f52727f4640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52540b52e0 0x7f52540b77a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f525c031440 tx=0x7f525c0095f0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.289+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 msgr2=0x7f526c10fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.289+0000 7f52727f4640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 0x7f526c10fdb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5264009fd0 tx=0x7f526400b260 comp rx=0 tx=0).stop 2024-09-10T23:28:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 shutdown_connections 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52540b52e0 0x7f52540b77a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f526c108020 0x7f526c10fdb0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526c1076a0 0x7f526c10f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 --2- 172.21.15.2:0/1045012035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f526c101c90 0x7f526c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 >> 172.21.15.2:0/1045012035 conn(0x7f526c0fd700 msgr2=0x7f526c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 shutdown_connections 2024-09-10T23:28:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:56.290+0000 7f52727f4640 1 -- 172.21.15.2:0/1045012035 wait complete. 2024-09-10T23:28:56.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1045012035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:56.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1045012035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:56.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1045012035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:57.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:28:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:57.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:57 smithi002 ceph-mon[31150]: pgmap v490: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-10T23:28:57.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:57 smithi177 ceph-mon[35760]: pgmap v490: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-10T23:28:57.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:57 smithi154 ceph-mon[35136]: pgmap v490: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-10T23:28:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 -- 172.21.15.2:0/3761861806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78102dc0 msgr2=0x7f1b781031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/3761861806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78102dc0 0x7f1b781031a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009900 tx=0x7f1b6802a410 comp rx=0 tx=0).stop 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 -- 172.21.15.2:0/3761861806 shutdown_connections 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/3761861806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b78109150 0x7f1b7810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/3761861806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b781087d0 0x7f1b78108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/3761861806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78102dc0 0x7f1b781031a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 -- 172.21.15.2:0/3761861806 >> 172.21.15.2:0/3761861806 conn(0x7f1b780fe830 msgr2=0x7f1b78100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 -- 172.21.15.2:0/3761861806 shutdown_connections 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.764+0000 7f1b7d59e640 1 -- 172.21.15.2:0/3761861806 wait complete. 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 Processor -- start 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 -- start start 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 0x7f1b78199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b781087d0 0x7f1b78199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78109150 0x7f1b7819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78112e10 con 0x7f1b78109150 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78112c90 con 0x7f1b781087d0 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b7d59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78112f90 con 0x7f1b78102dc0 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78109150 0x7f1b7819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 0x7f1b78199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 0x7f1b78199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:33830/0 (socket says 172.21.15.2:33830) 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b76ffd640 1 -- 172.21.15.2:0/1107600817 learned_addr learned my addr 172.21.15.2:0/1107600817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.765+0000 7f1b767fc640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b781087d0 0x7f1b78199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b777fe640 1 -- 172.21.15.2:0/1107600817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 msgr2=0x7f1b78199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b777fe640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 0x7f1b78199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b777fe640 1 -- 172.21.15.2:0/1107600817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b781087d0 msgr2=0x7f1b78199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b777fe640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b781087d0 0x7f1b78199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b777fe640 1 -- 172.21.15.2:0/1107600817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7819f3b0 con 0x7f1b78109150 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 0x7f1b78199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:57.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b777fe640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78109150 0x7f1b7819ebe0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000ca30 tx=0x7f1b7000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b5ffff640 1 -- 172.21.15.2:0/1107600817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70007d90 con 0x7f1b78109150 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b5ffff640 1 -- 172.21.15.2:0/1107600817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b70005020 con 0x7f1b78109150 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7819f6a0 con 0x7f1b78109150 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b5ffff640 1 -- 172.21.15.2:0/1107600817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000f690 con 0x7f1b78109150 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.766+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b781a5d60 con 0x7f1b78109150 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.769+0000 7f1b5ffff640 1 -- 172.21.15.2:0/1107600817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1b700054f0 con 0x7f1b78109150 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.769+0000 7f1b7f973740 1 Processor -- start 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.769+0000 7f1b7f973740 1 -- start start 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b7f973740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b50a046ea0 con 0x55b50a0d0a10 2024-09-10T23:28:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b7f973740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b50a0362d0 con 0x55b50a0dc9a0 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b7f973740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b50a03a0e0 con 0x55b50a0d00f0 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0dc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55896/0 (socket says 172.21.15.2:55896) 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 -- 172.21.15.2:0/1551738157 learned_addr learned my addr 172.21.15.2:0/1551738157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b767fc640 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b767fc640 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b5ffff640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b600b52e0 0x7f1b600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 -- 172.21.15.2:0/1551738157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 msgr2=0x55b50a0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 -- 172.21.15.2:0/1551738157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 msgr2=0x55b50a0ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0ded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 -- 172.21.15.2:0/1551738157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b509d94650 con 0x55b50a0d0a10 2024-09-10T23:28:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b777fe640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b600b52e0 0x7f1b600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0dc460 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006010 tx=0x7f1b680315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41514850798120b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.770+0000 7f1b5ffff640 1 -- 172.21.15.2:0/1107600817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1b700e5e10 con 0x7f1b78109150 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b5d7fa640 1 -- 172.21.15.2:0/1551738157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68035040 con 0x55b50a0d0a10 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b5d7fa640 1 -- 172.21.15.2:0/1551738157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b68005020 con 0x55b50a0d0a10 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b5d7fa640 1 -- 172.21.15.2:0/1551738157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68004b20 con 0x55b50a0d0a10 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 -- 172.21.15.2:0/1551738157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 msgr2=0x55b50a0dc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b777fe640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b600b52e0 0x7f1b600b77a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1b700ac330 tx=0x7f1b70078860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0dc460 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006010 tx=0x7f1b680315d0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 -- 172.21.15.2:0/1551738157 shutdown_connections 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0dc460 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 --2- 172.21.15.2:0/1551738157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 -- 172.21.15.2:0/1551738157 >> 172.21.15.2:0/1551738157 conn(0x55b50a0cdf20 msgr2=0x55b50a0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 -- 172.21.15.2:0/1551738157 shutdown_connections 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.771+0000 7f1b7f973740 1 -- 172.21.15.2:0/1551738157 wait complete. 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 -- start start 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 Processor -- start 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0dc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0d9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b509e97700 con 0x55b50a0d0a10 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b509fd1160 con 0x55b50a0dc9a0 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b50a0df5c0 con 0x55b50a0d00f0 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b7f973740 10 client.0 _ll_register_callbacks cb 0x55b509fea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:57.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0d9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0d9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55908/0 (socket says 172.21.15.2:55908) 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3325765238 learned_addr learned my addr 172.21.15.2:0/3325765238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0dc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.772+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3325765238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 msgr2=0x55b50a0dc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0dc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 msgr2=0x55b50a0d9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0d9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3325765238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b509ffec90 con 0x55b50a0d0a10 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0d9640 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1b68031440 tx=0x7f1b6802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374f9b54397fdff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:57.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3325765238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68035070 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3325765238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1b680053e0 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b68005020 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3325765238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b680055e0 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b7f973740 10 client.16950 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b50a0ef2c0 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3325765238 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b68005020 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.773+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3325765238 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b68046940 con 0x55b50a0d0a10 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b7f973740 10 client.16950 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b7f973740 10 client.16950 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b7f973740 20 client.16950 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a0f0610 0x55b50a0f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b7f973740 4 client.16950 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b50a048df0 con 0x55b50a0f0610 2024-09-10T23:28:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a0f0610 0x55b50a0f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a0f0610 0x55b50a0f2a00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4eeffc729f8ee82a server_cookie=8c839b60768fa712 in_seq=0 out_seq=0 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.774+0000 7f1b5aff5640 10 client.16950 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3325765238 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b50a048df0 con 0x55b50a0f0610 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b5aff5640 10 client.16950 handle_command_reply: tid=0 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 client.16950 shutdown 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 msgr2=0x55b50a0d9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0d9640 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1b68031440 tx=0x7f1b6802a410 comp rx=0 tx=0).stop 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 shutdown_connections 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a0f0610 0x55b50a0f2a00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a0d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0d9640 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3325765238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0dc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b5aff5640 0 client.16950 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 >> 172.21.15.2:0/3325765238 conn(0x55b50a0cdf20 msgr2=0x55b50a0d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 shutdown_connections 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 1 -- 172.21.15.2:0/3325765238 wait complete. 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.775+0000 7f1b7f973740 20 client.16950 trim_cache size 0 max 16384 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 Processor -- start 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 -- start start 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0d0a10 0x55b50a0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 0x55b50a0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781ac1e0 con 0x55b50a0dc9a0 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781add20 con 0x55b50a0d0a10 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b7f973740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781ac8b0 con 0x55b50a0d00f0 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 0x55b50a0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 0x55b50a0cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55916/0 (socket says 172.21.15.2:55916) 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 -- 172.21.15.2:0/2012654740 learned_addr learned my addr 172.21.15.2:0/2012654740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0d0a10 0x55b50a0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 -- 172.21.15.2:0/2012654740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 msgr2=0x55b50a0d8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 -- 172.21.15.2:0/2012654740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0d0a10 msgr2=0x55b50a0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0d0a10 0x55b50a0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b767fc640 1 -- 172.21.15.2:0/2012654740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50a0d93f0 con 0x55b50a0dc9a0 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.789+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0d0a10 0x55b50a0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b767fc640 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 0x55b50a0cf4b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005d00 tx=0x7f1b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427c29674114f791 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b5cff9640 1 -- 172.21.15.2:0/2012654740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c01b040 con 0x55b50a0dc9a0 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b5cff9640 1 -- 172.21.15.2:0/2012654740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b6c0047a0 con 0x55b50a0dc9a0 2024-09-10T23:28:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b5cff9640 1 -- 172.21.15.2:0/2012654740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c003910 con 0x55b50a0dc9a0 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 -- 172.21.15.2:0/2012654740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 msgr2=0x55b50a0cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 0x55b50a0cf4b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005d00 tx=0x7f1b6c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 -- 172.21.15.2:0/2012654740 shutdown_connections 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0dc9a0 0x55b50a0cf4b0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0d0a10 0x55b50a0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 --2- 172.21.15.2:0/2012654740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0d8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 -- 172.21.15.2:0/2012654740 >> 172.21.15.2:0/2012654740 conn(0x55b50a0cdf20 msgr2=0x55b50a0d7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 -- 172.21.15.2:0/2012654740 shutdown_connections 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.790+0000 7f1b7f973740 1 -- 172.21.15.2:0/2012654740 wait complete. 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 -- start start 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 Processor -- start 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781ad650 con 0x55b50a0d0a10 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781acf80 con 0x55b50a0dc9a0 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781aa1c0 con 0x55b50a0d00f0 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b7f973740 10 client.0 _ll_register_callbacks cb 0x7f1b68040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0e5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55932/0 (socket says 172.21.15.2:55932) 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3497763906 learned_addr learned my addr 172.21.15.2:0/3497763906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.791+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3497763906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 msgr2=0x55b50a0e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 msgr2=0x55b50a15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b76ffd640 1 -- 172.21.15.2:0/3497763906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50a15c710 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b76ffd640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0e5660 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1b68031a90 tx=0x7f1b68004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a958a0994de1659 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3497763906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68035040 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3497763906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1b680053e0 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b6c0047a0 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3497763906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b68009520 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b7f973740 10 client.16956 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b50a15d990 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3497763906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b6c0047a0 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.792+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3497763906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b68062030 con 0x55b50a0d0a10 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b7f973740 10 client.16956 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:57.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b7f973740 10 client.16956 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b7f973740 20 client.16956 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a15e0a0 0x55b50a1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b7f973740 4 client.16956 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b50a0448a0 con 0x55b50a15e0a0 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a15e0a0 0x55b50a1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b767fc640 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a15e0a0 0x55b50a1604c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f35d2c5386a15667 server_cookie=469e3e34e39427b5 in_seq=0 out_seq=0 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b5aff5640 10 client.16956 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b5aff5640 1 -- 172.21.15.2:0/3497763906 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b50a0448a0 con 0x55b50a15e0a0 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.793+0000 7f1b5aff5640 10 client.16956 handle_command_reply: tid=0 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 client.16956 shutdown 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 msgr2=0x55b50a0e5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0e5660 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1b68031a90 tx=0x7f1b68004e80 comp rx=0 tx=0).stop 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 shutdown_connections 2024-09-10T23:28:57.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55b50a15e0a0 0x55b50a1604c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b50a0dc9a0 0x55b50a15c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b50a0d0a10 0x55b50a0e5660 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b5aff5640 0 client.16956 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 --2- 172.21.15.2:0/3497763906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b50a0d00f0 0x55b50a0e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 >> 172.21.15.2:0/3497763906 conn(0x55b50a0cdf20 msgr2=0x55b50a0d7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 shutdown_connections 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 1 -- 172.21.15.2:0/3497763906 wait complete. 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7f973740 20 client.16956 trim_cache size 0 max 16384 2024-09-10T23:28:57.802 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b600b52e0 msgr2=0x7f1b600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b600b52e0 0x7f1b600b77a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1b700ac330 tx=0x7f1b70078860 comp rx=0 tx=0).stop 2024-09-10T23:28:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78109150 msgr2=0x7f1b7819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78109150 0x7f1b7819ebe0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000ca30 tx=0x7f1b7000cef0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 shutdown_connections 2024-09-10T23:28:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1b600b52e0 0x7f1b600b77a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b78109150 0x7f1b7819ebe0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b781087d0 0x7f1b78199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.794+0000 7f1b7d59e640 1 --2- 172.21.15.2:0/1107600817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b78102dc0 0x7f1b78199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:57.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.795+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 >> 172.21.15.2:0/1107600817 conn(0x7f1b780fe830 msgr2=0x7f1b78100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:57.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.795+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 shutdown_connections 2024-09-10T23:28:57.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:57.795+0000 7f1b7d59e640 1 -- 172.21.15.2:0/1107600817 wait complete. 2024-09-10T23:28:58.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:28:58.819 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 -- 172.21.15.2:0/1071784648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa670101cd0 msgr2=0x7fa6701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 --2- 172.21.15.2:0/1071784648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa670101cd0 0x7fa6701020b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009900 tx=0x7fa66c02a410 comp rx=0 tx=0).stop 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 -- 172.21.15.2:0/1071784648 shutdown_connections 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 --2- 172.21.15.2:0/1071784648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670108060 0x7fa67010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 --2- 172.21.15.2:0/1071784648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6701076e0 0x7fa670107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 --2- 172.21.15.2:0/1071784648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa670101cd0 0x7fa6701020b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.298+0000 7fa677aa2640 1 -- 172.21.15.2:0/1071784648 >> 172.21.15.2:0/1071784648 conn(0x7fa6700fd700 msgr2=0x7fa6700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 -- 172.21.15.2:0/1071784648 shutdown_connections 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 -- 172.21.15.2:0/1071784648 wait complete. 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 Processor -- start 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 -- start start 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670101cd0 0x7fa67019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 0x7fa67019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa670108060 0x7fa67019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa670111ce0 con 0x7fa6701076e0 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa670111b60 con 0x7fa670101cd0 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa677aa2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa670111e60 con 0x7fa670108060 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa67503d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 0x7fa67019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa67503d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 0x7fa67019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55946/0 (socket says 172.21.15.2:55946) 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.299+0000 7fa67503d640 1 -- 172.21.15.2:0/3741127716 learned_addr learned my addr 172.21.15.2:0/3741127716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67603f640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa670108060 0x7fa67019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67583e640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670101cd0 0x7fa67019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67503d640 1 -- 172.21.15.2:0/3741127716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa670108060 msgr2=0x7fa67019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67503d640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa670108060 0x7fa67019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67503d640 1 -- 172.21.15.2:0/3741127716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670101cd0 msgr2=0x7fa67019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67503d640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670101cd0 0x7fa67019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67503d640 1 -- 172.21.15.2:0/3741127716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6701a5490 con 0x7fa6701076e0 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67583e640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670101cd0 0x7fa67019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa67503d640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 0x7fa67019a5f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa66000d950 tx=0x7fa66000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa666ffd640 1 -- 172.21.15.2:0/3741127716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa660017070 con 0x7fa6701076e0 2024-09-10T23:28:59.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6701a5780 con 0x7fa6701076e0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa666ffd640 1 -- 172.21.15.2:0/3741127716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa660009c30 con 0x7fa6701076e0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa666ffd640 1 -- 172.21.15.2:0/3741127716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66000f620 con 0x7fa6701076e0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.300+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6701a5cc0 con 0x7fa6701076e0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 Processor -- start 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa666ffd640 1 -- 172.21.15.2:0/3741127716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa660010460 con 0x7fa6701076e0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 -- start start 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e04648b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0474c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0477580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6e03daea0 con 0x55b6e0464df0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6e03ca2d0 con 0x55b6e04644d0 2024-09-10T23:28:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa679e77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6e03ce0e0 con 0x55b6e0475190 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa67583e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0474c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa67583e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0474c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55948/0 (socket says 172.21.15.2:55948) 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa67583e640 1 -- 172.21.15.2:0/2308778828 learned_addr learned my addr 172.21.15.2:0/2308778828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa67603f640 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e04648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.303+0000 7fa67503d640 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0477580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67583e640 1 -- 172.21.15.2:0/2308778828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 msgr2=0x55b6e0477580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67583e640 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0477580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67583e640 1 -- 172.21.15.2:0/2308778828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 msgr2=0x55b6e04648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67583e640 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e04648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67583e640 1 -- 172.21.15.2:0/2308778828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6e0128650 con 0x55b6e0464df0 2024-09-10T23:28:59.338 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:28:59.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa666ffd640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa65c0b52e0 0x7fa65c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67583e640 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0474c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009900 tx=0x7fa66c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19f86a95a09216b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa67603f640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa65c0b52e0 0x7fa65c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa65bfff640 1 -- 172.21.15.2:0/2308778828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c03f070 con 0x55b6e0464df0 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa666ffd640 1 -- 172.21.15.2:0/3741127716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa6600e58c0 con 0x7fa6701076e0 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa65bfff640 1 -- 172.21.15.2:0/2308778828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa66c0316a0 con 0x55b6e0464df0 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.304+0000 7fa65bfff640 1 -- 172.21.15.2:0/2308778828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c035070 con 0x55b6e0464df0 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 -- 172.21.15.2:0/2308778828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 msgr2=0x55b6e0474c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa67603f640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa65c0b52e0 0x7fa65c0b77a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa67019b090 tx=0x7fa668009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0474c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009900 tx=0x7fa66c032cd0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 -- 172.21.15.2:0/2308778828 shutdown_connections 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0477580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0474c50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 --2- 172.21.15.2:0/2308778828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e04648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 -- 172.21.15.2:0/2308778828 >> 172.21.15.2:0/2308778828 conn(0x55b6e0462300 msgr2=0x55b6e04634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 -- 172.21.15.2:0/2308778828 shutdown_connections 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 -- 172.21.15.2:0/2308778828 wait complete. 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 -- start start 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.305+0000 7fa679e77740 1 Processor -- start 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0474a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0471e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0472440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6e022b700 con 0x55b6e0464df0 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6e0365160 con 0x55b6e04644d0 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6e0477de0 con 0x55b6e0475190 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa679e77740 10 client.0 _ll_register_callbacks cb 0x55b6e037e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0471e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0471e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55952/0 (socket says 172.21.15.2:55952) 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 -- 172.21.15.2:0/1420761086 learned_addr learned my addr 172.21.15.2:0/1420761086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67583e640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0474a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67603f640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0472440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 -- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 msgr2=0x55b6e0472440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0472440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 -- 172.21.15.2:0/1420761086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 msgr2=0x55b6e0474a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0474a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 -- 172.21.15.2:0/1420761086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6e0392c90 con 0x55b6e0464df0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67583e640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0474a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa67503d640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0471e80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa6600abfc0 tx=0x7fa6600e9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ee53c961c76d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.306+0000 7fa6597fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa6597fa640 1 -- 172.21.15.2:0/1420761086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa660020070 con 0x55b6e0464df0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa6597fa640 1 -- 172.21.15.2:0/1420761086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa660010780 con 0x55b6e0464df0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa66c0316a0 con 0x55b6e0464df0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa6597fa640 1 -- 172.21.15.2:0/1420761086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa6600a7ed0 con 0x55b6e0464df0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 10 client.16968 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6e0483720 con 0x55b6e0464df0 2024-09-10T23:28:59.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa6597fa640 1 -- 172.21.15.2:0/1420761086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa66c0316a0 con 0x55b6e0464df0 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa6597fa640 1 -- 172.21.15.2:0/1420761086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa6600aad00 con 0x55b6e0464df0 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 10 client.16968 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 10 client.16968 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 20 client.16968 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e0484c30 0x55b6e04870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 4 client.16968 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.307+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6e03dcdf0 con 0x55b6e0484c30 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.308+0000 7fa67583e640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e0484c30 0x55b6e04870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.308+0000 7fa6597fa640 10 client.16968 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.308+0000 7fa67583e640 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e0484c30 0x55b6e04870a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa472b2023a6931a server_cookie=cb719f11734150bb in_seq=0 out_seq=0 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa6597fa640 1 -- 172.21.15.2:0/1420761086 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6e03dcdf0 con 0x55b6e0484c30 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa6597fa640 10 client.16968 handle_command_reply: tid=0 2024-09-10T23:28:59.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 client.16968 shutdown 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 msgr2=0x55b6e0471e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0471e80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa6600abfc0 tx=0x7fa6600e9040 comp rx=0 tx=0).stop 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 shutdown_connections 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e0484c30 0x55b6e04870a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0475190 0x55b6e0472440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0464df0 0x55b6e0471e80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa6597fa640 0 client.16968 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 --2- 172.21.15.2:0/1420761086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0474a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 >> 172.21.15.2:0/1420761086 conn(0x55b6e0462300 msgr2=0x55b6e0467e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 shutdown_connections 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 1 -- 172.21.15.2:0/1420761086 wait complete. 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.309+0000 7fa679e77740 20 client.16968 trim_cache size 0 max 16384 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 Processor -- start 2024-09-10T23:28:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 -- start start 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0481010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0464df0 0x55b6e04638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e048c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701ac060 con 0x55b6e0475190 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701adba0 con 0x55b6e04644d0 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.322+0000 7fa679e77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701ac730 con 0x55b6e0464df0 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e048c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e048c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55968/0 (socket says 172.21.15.2:55968) 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 -- 172.21.15.2:0/1037795090 learned_addr learned my addr 172.21.15.2:0/1037795090 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67583e640 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0481010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67503d640 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0464df0 0x55b6e04638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 -- 172.21.15.2:0/1037795090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0464df0 msgr2=0x55b6e04638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0464df0 0x55b6e04638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 -- 172.21.15.2:0/1037795090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 msgr2=0x55b6e0481010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0481010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 -- 172.21.15.2:0/1037795090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6e0487720 con 0x55b6e0475190 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa67603f640 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e048c970 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa6680117a0 tx=0x7fa668016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf8e2fc1c1bf395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa65b7fe640 1 -- 172.21.15.2:0/1037795090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668011e50 con 0x55b6e0475190 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa65b7fe640 1 -- 172.21.15.2:0/1037795090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa668003e20 con 0x55b6e0475190 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.323+0000 7fa65b7fe640 1 -- 172.21.15.2:0/1037795090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66801d690 con 0x55b6e0475190 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 -- 172.21.15.2:0/1037795090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 msgr2=0x55b6e048c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e048c970 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa6680117a0 tx=0x7fa668016000 comp rx=0 tx=0).stop 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 -- 172.21.15.2:0/1037795090 shutdown_connections 2024-09-10T23:28:59.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e048c970 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e0464df0 0x55b6e04638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 --2- 172.21.15.2:0/1037795090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e04644d0 0x55b6e0481010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 -- 172.21.15.2:0/1037795090 >> 172.21.15.2:0/1037795090 conn(0x55b6e0462300 msgr2=0x55b6e04631a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 -- 172.21.15.2:0/1037795090 shutdown_connections 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 -- 172.21.15.2:0/1037795090 wait complete. 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 -- start start 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.324+0000 7fa679e77740 1 Processor -- start 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e04644d0 0x55b6e047d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e0464df0 0x55b6e047d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e047a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701ad4d0 con 0x55b6e0475190 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701ace00 con 0x55b6e0464df0 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6701aa040 con 0x55b6e04644d0 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa679e77740 10 client.0 _ll_register_callbacks cb 0x7fa66000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e047a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e047a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55982/0 (socket says 172.21.15.2:55982) 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 -- 172.21.15.2:0/1280476183 learned_addr learned my addr 172.21.15.2:0/1280476183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67583e640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e04644d0 0x55b6e047d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67503d640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e0464df0 0x55b6e047d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 -- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e04644d0 msgr2=0x55b6e047d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e04644d0 0x55b6e047d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 -- 172.21.15.2:0/1280476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e0464df0 msgr2=0x55b6e047d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e0464df0 0x55b6e047d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 -- 172.21.15.2:0/1280476183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6e047a6b0 con 0x55b6e0475190 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67503d640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e0464df0 0x55b6e047d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa67603f640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e047a040 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa6680049d0 tx=0x7fa668004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea79e6e4288d623 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.325+0000 7fa6597fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa6597fa640 1 -- 172.21.15.2:0/1280476183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668004470 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa6597fa640 1 -- 172.21.15.2:0/1280476183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa668026040 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa668003e20 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa6597fa640 1 -- 172.21.15.2:0/1280476183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa668004a40 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 10 client.16974 fetch_fsmap learned FSMap version 28 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6e04f24e0 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa6597fa640 1 -- 172.21.15.2:0/1280476183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa668003e20 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa6597fa640 1 -- 172.21.15.2:0/1280476183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa66800f040 con 0x55b6e0475190 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 10 client.16974 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 10 client.16974 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 20 client.16974 populate_metadata read hostname 'smithi002' 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e04f2ba0 0x55b6e04f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 4 client.16974 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:28:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.326+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b6e03d88a0 con 0x55b6e04f2ba0 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa67583e640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e04f2ba0 0x55b6e04f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa67583e640 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e04f2ba0 0x55b6e04f4fc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3a770befd18602a5 server_cookie=d019e8f169b5154 in_seq=0 out_seq=0 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa6597fa640 10 client.16974 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa6597fa640 1 -- 172.21.15.2:0/1280476183 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b6e03d88a0 con 0x55b6e04f2ba0 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa6597fa640 10 client.16974 handle_command_reply: tid=0 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 client.16974 shutdown 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 msgr2=0x55b6e047a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e047a040 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa6680049d0 tx=0x7fa668004000 comp rx=0 tx=0).stop 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 shutdown_connections 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b6e04f2ba0 0x55b6e04f4fc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6e0475190 0x55b6e047a040 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6e0464df0 0x55b6e047d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 --2- 172.21.15.2:0/1280476183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6e04644d0 0x55b6e047d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa6597fa640 0 client.16974 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 >> 172.21.15.2:0/1280476183 conn(0x55b6e0462300 msgr2=0x55b6e0473cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.327+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 shutdown_connections 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa679e77740 1 -- 172.21.15.2:0/1280476183 wait complete. 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa679e77740 20 client.16974 trim_cache size 0 max 16384 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa65c0b52e0 msgr2=0x7fa65c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa65c0b52e0 0x7fa65c0b77a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa67019b090 tx=0x7fa668009600 comp rx=0 tx=0).stop 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 msgr2=0x7fa67019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 0x7fa67019a5f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa66000d950 tx=0x7fa66000de10 comp rx=0 tx=0).stop 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 shutdown_connections 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa65c0b52e0 0x7fa65c0b77a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa670108060 0x7fa67019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6701076e0 0x7fa67019a5f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 --2- 172.21.15.2:0/3741127716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa670101cd0 0x7fa67019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 >> 172.21.15.2:0/3741127716 conn(0x7fa6700fd700 msgr2=0x7fa6700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 shutdown_connections 2024-09-10T23:28:59.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:28:59.328+0000 7fa677aa2640 1 -- 172.21.15.2:0/3741127716 wait complete. 2024-09-10T23:28:59.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:28:59 smithi002 ceph-mon[31150]: pgmap v491: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:28:59.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:28:59 smithi177 ceph-mon[35760]: pgmap v491: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:28:59.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:28:59 smithi154 ceph-mon[35136]: pgmap v491: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:29:00.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:29:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 -- 172.21.15.2:0/841909376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 msgr2=0x7f8f5410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/841909376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f5410f5a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009ca0 tx=0x7f8f4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 -- 172.21.15.2:0/841909376 shutdown_connections 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/841909376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f5410f5a0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/841909376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f54104600 0x7f8f5410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/841909376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f54103ce0 0x7f8f541040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.817+0000 7f8f5b76d640 1 -- 172.21.15.2:0/841909376 >> 172.21.15.2:0/841909376 conn(0x7f8f540fd700 msgr2=0x7f8f540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 -- 172.21.15.2:0/841909376 shutdown_connections 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 -- 172.21.15.2:0/841909376 wait complete. 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 Processor -- start 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 -- start start 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f54103ce0 0x7f8f54101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f54104600 0x7f8f54101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f54102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54112db0 con 0x7f8f5410d140 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54112c30 con 0x7f8f54104600 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.818+0000 7f8f5b76d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54112f30 con 0x7f8f54103ce0 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f54102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f54102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55988/0 (socket says 172.21.15.2:55988) 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 -- 172.21.15.2:0/1574158915 learned_addr learned my addr 172.21.15.2:0/1574158915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f58d08640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f54104600 0x7f8f54101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59509640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f54103ce0 0x7f8f54101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 -- 172.21.15.2:0/1574158915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f54103ce0 msgr2=0x7f8f54101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f54103ce0 0x7f8f54101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 -- 172.21.15.2:0/1574158915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f54104600 msgr2=0x7f8f54101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f54104600 0x7f8f54101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 -- 172.21.15.2:0/1574158915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f541a75e0 con 0x7f8f5410d140 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f54102410 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c005cc0 tx=0x7f8f4c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f467fc640 1 -- 172.21.15.2:0/1574158915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c003bf0 con 0x7f8f5410d140 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f467fc640 1 -- 172.21.15.2:0/1574158915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4c003d90 con 0x7f8f5410d140 2024-09-10T23:29:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f541a7870 con 0x7f8f5410d140 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f467fc640 1 -- 172.21.15.2:0/1574158915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c02fb20 con 0x7f8f5410d140 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.819+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f541a7e00 con 0x7f8f5410d140 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.822+0000 7f8f5db42740 1 Processor -- start 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.822+0000 7f8f467fc640 1 -- 172.21.15.2:0/1574158915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8f4c004580 con 0x7f8f5410d140 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.822+0000 7f8f5db42740 1 -- start start 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f5db42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bbee658ea0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f5db42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bbee6482d0 con 0x55bbee6e20f0 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f5db42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bbee64c0e0 con 0x55bbee6e2a10 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55998/0 (socket says 172.21.15.2:55998) 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 -- 172.21.15.2:0/4197064879 learned_addr learned my addr 172.21.15.2:0/4197064879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f59509640 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 -- 172.21.15.2:0/4197064879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 msgr2=0x55bbee6ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 -- 172.21.15.2:0/4197064879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 msgr2=0x55bbee6e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 -- 172.21.15.2:0/4197064879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbee3a6650 con 0x55bbee6ee9a0 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f467fc640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f400b5360 0x7f8f400b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f58d08640 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f0d90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8f48012560 tx=0x7f8f4800b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccadd3181d49395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.823+0000 7f8f59509640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f400b5360 0x7f8f400b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f467fc640 1 -- 172.21.15.2:0/1574158915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8f4c106e50 con 0x7f8f5410d140 2024-09-10T23:29:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f3f7fe640 1 -- 172.21.15.2:0/4197064879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48004220 con 0x55bbee6ee9a0 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f3f7fe640 1 -- 172.21.15.2:0/4197064879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f480043c0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f3f7fe640 1 -- 172.21.15.2:0/4197064879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48010910 con 0x55bbee6ee9a0 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f5db42740 1 -- 172.21.15.2:0/4197064879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 msgr2=0x55bbee6f0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f59509640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f400b5360 0x7f8f400b7820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55bbee6e0e00 tx=0x7f8f5000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.824+0000 7f8f5db42740 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f0d90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8f48012560 tx=0x7f8f4800b9a0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- 172.21.15.2:0/4197064879 shutdown_connections 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f0d90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 --2- 172.21.15.2:0/4197064879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- 172.21.15.2:0/4197064879 >> 172.21.15.2:0/4197064879 conn(0x55bbee6dff20 msgr2=0x55bbee6e10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- 172.21.15.2:0/4197064879 shutdown_connections 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- 172.21.15.2:0/4197064879 wait complete. 2024-09-10T23:29:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- start start 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 Processor -- start 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 0x55bbee6ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bbee4a9700 con 0x55bbee6e20f0 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bbee5e3160 con 0x55bbee6ee9a0 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bbee6f1620 con 0x55bbee6e2a10 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.825+0000 7f8f5db42740 10 client.0 _ll_register_callbacks cb 0x55bbee5fc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 0x55bbee6ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 0x55bbee6ee2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56004/0 (socket says 172.21.15.2:56004) 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 -- 172.21.15.2:0/3943152166 learned_addr learned my addr 172.21.15.2:0/3943152166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f58d08640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 -- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 msgr2=0x55bbee6eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6eb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 -- 172.21.15.2:0/3943152166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 msgr2=0x55bbee6ebd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6ebd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 -- 172.21.15.2:0/3943152166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbee610c90 con 0x55bbee6e20f0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f59509640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 0x55bbee6ee2b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000a7a0 tx=0x7f8f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138957976d862dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f3cff9640 1 -- 172.21.15.2:0/3943152166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5000f8c0 con 0x55bbee6e20f0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f480043c0 con 0x55bbee6e20f0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.826+0000 7f8f3cff9640 1 -- 172.21.15.2:0/3943152166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8f5000fa60 con 0x55bbee6e20f0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f3cff9640 1 -- 172.21.15.2:0/3943152166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f5000fca0 con 0x55bbee6e20f0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 10 client.16986 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bbee6fd010 con 0x55bbee6e20f0 2024-09-10T23:29:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f3cff9640 1 -- 172.21.15.2:0/3943152166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f480043c0 con 0x55bbee6e20f0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f3cff9640 1 -- 172.21.15.2:0/3943152166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f5001d410 con 0x55bbee6e20f0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 10 client.16986 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 10 client.16986 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 20 client.16986 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee6fe4c0 0x55bbee700920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 4 client.16986 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbee65adf0 con 0x55bbee6fe4c0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.827+0000 7f8f58d08640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee6fe4c0 0x55bbee700920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.828+0000 7f8f3cff9640 10 client.16986 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.828+0000 7f8f58d08640 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee6fe4c0 0x55bbee700920 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8d272cb7d971247 server_cookie=4eb15d2781f17b3c in_seq=0 out_seq=0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.828+0000 7f8f3cff9640 1 -- 172.21.15.2:0/3943152166 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bbee65adf0 con 0x55bbee6fe4c0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.828+0000 7f8f3cff9640 10 client.16986 handle_command_reply: tid=0 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.828+0000 7f8f5db42740 1 client.16986 shutdown 2024-09-10T23:29:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 msgr2=0x55bbee6ee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 0x55bbee6ee2b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000a7a0 tx=0x7f8f500046c0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 shutdown_connections 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee6fe4c0 0x55bbee700920 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6ebd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f3cff9640 0 client.16986 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3943152166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e20f0 0x55bbee6ee2b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 >> 172.21.15.2:0/3943152166 conn(0x55bbee6dff20 msgr2=0x55bbee6e5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 shutdown_connections 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 1 -- 172.21.15.2:0/3943152166 wait complete. 2024-09-10T23:29:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.829+0000 7f8f5db42740 20 client.16986 trim_cache size 0 max 16384 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.842+0000 7f8f5db42740 1 Processor -- start 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.842+0000 7f8f5db42740 1 -- start start 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e20f0 0x55bbee6df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 0x55bbee6efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f5db42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b0480 con 0x55bbee6e2a10 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f5db42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b1fc0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f5db42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b0b50 con 0x55bbee6e20f0 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 0x55bbee6efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 0x55bbee6efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56012/0 (socket says 172.21.15.2:56012) 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 -- 172.21.15.2:0/3409467833 learned_addr learned my addr 172.21.15.2:0/3409467833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f59509640 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e20f0 0x55bbee6df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 -- 172.21.15.2:0/3409467833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e20f0 msgr2=0x55bbee6df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e20f0 0x55bbee6df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 -- 172.21.15.2:0/3409467833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 msgr2=0x55bbee6f02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 -- 172.21.15.2:0/3409467833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbee6ec0a0 con 0x55bbee6e2a10 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f58d08640 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 0x55bbee6efd90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800bec0 tx=0x7f8f48010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a102e30d052d6bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f3effd640 1 -- 172.21.15.2:0/3409467833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48034070 con 0x55bbee6e2a10 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f3effd640 1 -- 172.21.15.2:0/3409467833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4802c070 con 0x55bbee6e2a10 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.843+0000 7f8f3effd640 1 -- 172.21.15.2:0/3409467833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48003c30 con 0x55bbee6e2a10 2024-09-10T23:29:00.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 -- 172.21.15.2:0/3409467833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 msgr2=0x55bbee6efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 0x55bbee6efd90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800bec0 tx=0x7f8f48010430 comp rx=0 tx=0).stop 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 -- 172.21.15.2:0/3409467833 shutdown_connections 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6e2a10 0x55bbee6efd90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 --2- 172.21.15.2:0/3409467833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e20f0 0x55bbee6df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 -- 172.21.15.2:0/3409467833 >> 172.21.15.2:0/3409467833 conn(0x55bbee6dff20 msgr2=0x55bbee6ed550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 -- 172.21.15.2:0/3409467833 shutdown_connections 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.844+0000 7f8f5db42740 1 -- 172.21.15.2:0/3409467833 wait complete. 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 -- start start 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 Processor -- start 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b18f0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b1220 con 0x55bbee6e20f0 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541ae460 con 0x55bbee6e2a10 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f5db42740 10 client.0 _ll_register_callbacks cb 0x7f8f5000a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f59d0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f59d0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56014/0 (socket says 172.21.15.2:56014) 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f59d0a640 1 -- 172.21.15.2:0/794157420 learned_addr learned my addr 172.21.15.2:0/794157420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.845+0000 7f8f58d08640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59509640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59d0a640 1 -- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 msgr2=0x55bbee6f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59d0a640 1 -- 172.21.15.2:0/794157420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 msgr2=0x55bbee6f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59d0a640 1 -- 172.21.15.2:0/794157420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbee6f2520 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f59d0a640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f1de0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0ca890 tx=0x7f8f4c0cce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba430aa0260c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f3cff9640 1 -- 172.21.15.2:0/794157420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c02fed0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f3cff9640 1 -- 172.21.15.2:0/794157420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8f4c0cda80 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f4802c070 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f3cff9640 1 -- 172.21.15.2:0/794157420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f4c0098b0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f5db42740 10 client.16992 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bbee76c3c0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.846+0000 7f8f3cff9640 1 -- 172.21.15.2:0/794157420 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4802c070 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f3cff9640 1 -- 172.21.15.2:0/794157420 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f4c0d67b0 con 0x55bbee6ee9a0 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f5db42740 10 client.16992 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f5db42740 10 client.16992 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:29:00.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f5db42740 20 client.16992 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f5db42740 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee76cb90 0x55bbee76efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f5db42740 4 client.16992 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbee6568a0 con 0x55bbee76cb90 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f59509640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee76cb90 0x55bbee76efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f3cff9640 10 client.16992 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.847+0000 7f8f59509640 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee76cb90 0x55bbee76efb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee947cdff2d67f9c server_cookie=3104be3b98b9f0e in_seq=0 out_seq=0 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f3cff9640 1 -- 172.21.15.2:0/794157420 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbee6568a0 con 0x55bbee76cb90 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f3cff9640 10 client.16992 handle_command_reply: tid=0 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 client.16992 shutdown 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 msgr2=0x55bbee6f1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f1de0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0ca890 tx=0x7f8f4c0cce50 comp rx=0 tx=0).stop 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 shutdown_connections 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55bbee76cb90 0x55bbee76efb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bbee6ee9a0 0x55bbee6f1de0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f3cff9640 0 client.16992 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbee6e2a10 0x55bbee6f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 --2- 172.21.15.2:0/794157420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbee6e20f0 0x55bbee6f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 >> 172.21.15.2:0/794157420 conn(0x55bbee6dff20 msgr2=0x55bbee6e5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 shutdown_connections 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 1 -- 172.21.15.2:0/794157420 wait complete. 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.848+0000 7f8f5db42740 20 client.16992 trim_cache size 0 max 16384 2024-09-10T23:29:00.863 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f400b5360 msgr2=0x7f8f400b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f400b5360 0x7f8f400b7820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55bbee6e0e00 tx=0x7f8f5000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 msgr2=0x7f8f54102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f54102410 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c005cc0 tx=0x7f8f4c02f380 comp rx=0 tx=0).stop 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 shutdown_connections 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8f400b5360 0x7f8f400b7820 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f5410d140 0x7f8f54102410 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f54104600 0x7f8f54101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 --2- 172.21.15.2:0/1574158915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f54103ce0 0x7f8f54101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 >> 172.21.15.2:0/1574158915 conn(0x7f8f540fd700 msgr2=0x7f8f5410f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 shutdown_connections 2024-09-10T23:29:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:00.849+0000 7f8f5b76d640 1 -- 172.21.15.2:0/1574158915 wait complete. 2024-09-10T23:29:01.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:01 smithi002 ceph-mon[31150]: pgmap v492: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:29:01.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:29:01.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:01 smithi177 ceph-mon[35760]: pgmap v492: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:29:01.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:01 smithi154 ceph-mon[35136]: pgmap v492: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:29:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 -- 172.21.15.2:0/3939460290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2414103ce0 msgr2=0x7f24141040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 --2- 172.21.15.2:0/3939460290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2414103ce0 0x7f24141040c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2410009900 tx=0x7f241002a410 comp rx=0 tx=0).stop 2024-09-10T23:29:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 -- 172.21.15.2:0/3939460290 shutdown_connections 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 --2- 172.21.15.2:0/3939460290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f241410d140 0x7f241410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 --2- 172.21.15.2:0/3939460290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414104600 0x7f241410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 --2- 172.21.15.2:0/3939460290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2414103ce0 0x7f24141040c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 -- 172.21.15.2:0/3939460290 >> 172.21.15.2:0/3939460290 conn(0x7f24140fd700 msgr2=0x7f24140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 -- 172.21.15.2:0/3939460290 shutdown_connections 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.453+0000 7f241b905640 1 -- 172.21.15.2:0/3939460290 wait complete. 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 Processor -- start 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 -- start start 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2414103ce0 0x7f2414199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414104600 0x7f24141997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 0x7f241419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2414112e00 con 0x7f241410d140 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2414112c80 con 0x7f2414103ce0 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f241b905640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2414112f80 con 0x7f2414104600 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f2419ea2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 0x7f241419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f2419ea2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 0x7f241419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48378/0 (socket says 172.21.15.2:48378) 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f2419ea2640 1 -- 172.21.15.2:0/882082734 learned_addr learned my addr 172.21.15.2:0/882082734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f2418ea0640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414104600 0x7f24141997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.454+0000 7f24196a1640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2414103ce0 0x7f2414199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.455+0000 7f2419ea2640 1 -- 172.21.15.2:0/882082734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414104600 msgr2=0x7f24141997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.455+0000 7f2419ea2640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414104600 0x7f24141997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.455+0000 7f2419ea2640 1 -- 172.21.15.2:0/882082734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2414103ce0 msgr2=0x7f2414199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.455+0000 7f2419ea2640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2414103ce0 0x7f2414199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.455+0000 7f2419ea2640 1 -- 172.21.15.2:0/882082734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241419f340 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.455+0000 7f2419ea2640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 0x7f241419eb70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f240c00cce0 tx=0x7f240c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.456+0000 7f240a7fc640 1 -- 172.21.15.2:0/882082734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c00f450 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.456+0000 7f240a7fc640 1 -- 172.21.15.2:0/882082734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f240c00faa0 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.456+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241419f630 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.456+0000 7f240a7fc640 1 -- 172.21.15.2:0/882082734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c018b70 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.456+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24141a5cf0 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.458+0000 7f240a7fc640 1 -- 172.21.15.2:0/882082734 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f240c00f5f0 con 0x7f241410d140 2024-09-10T23:29:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 Processor -- start 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 -- start start 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a913704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a9137c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558a912e6ea0 con 0x558a91370a10 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a912d62d0 con 0x558a9137c9a0 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f241dcda740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558a912da0e0 con 0x558a913700f0 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f24196a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a9137c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f24196a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a9137c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48392/0 (socket says 172.21.15.2:48392) 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f24196a1640 1 -- 172.21.15.2:0/2805891941 learned_addr learned my addr 172.21.15.2:0/2805891941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f240a7fc640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24000b5360 0x7f24000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f2418ea0640 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a913704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f2418ea0640 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.459+0000 7f2419ea2640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24000b5360 0x7f24000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f24196a1640 1 -- 172.21.15.2:0/2805891941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 msgr2=0x558a913704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f24196a1640 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a913704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f24196a1640 1 -- 172.21.15.2:0/2805891941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 msgr2=0x558a9137ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f24196a1640 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f24196a1640 1 -- 172.21.15.2:0/2805891941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a91034650 con 0x558a91370a10 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f2418ea0640 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f240a7fc640 1 -- 172.21.15.2:0/882082734 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f240c0e6280 con 0x7f241410d140 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f2419ea2640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24000b5360 0x7f24000b7820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ac6f0 tx=0x7f240c076ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f24196a1640 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a9137c460 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2410009230 tx=0x7f2410004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c336d62f7df57b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f23ff7fe640 1 -- 172.21.15.2:0/2805891941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410035040 con 0x558a91370a10 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f23ff7fe640 1 -- 172.21.15.2:0/2805891941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410004770 con 0x558a91370a10 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.460+0000 7f23ff7fe640 1 -- 172.21.15.2:0/2805891941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410003810 con 0x558a91370a10 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 -- 172.21.15.2:0/2805891941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 msgr2=0x558a9137c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a9137c460 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2410009230 tx=0x7f2410004310 comp rx=0 tx=0).stop 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 -- 172.21.15.2:0/2805891941 shutdown_connections 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a9137c460 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 --2- 172.21.15.2:0/2805891941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a913704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 -- 172.21.15.2:0/2805891941 >> 172.21.15.2:0/2805891941 conn(0x558a9136df20 msgr2=0x558a9136f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 -- 172.21.15.2:0/2805891941 shutdown_connections 2024-09-10T23:29:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 -- 172.21.15.2:0/2805891941 wait complete. 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 -- start start 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.461+0000 7f241dcda740 1 Processor -- start 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9137c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a91379680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a91379c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558a91137700 con 0x558a9137c9a0 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a91271160 con 0x558a913700f0 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558a9137f5c0 con 0x558a91370a10 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f241dcda740 10 client.0 _ll_register_callbacks cb 0x558a9128a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a91379c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a91379c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48396/0 (socket says 172.21.15.2:48396) 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 -- 172.21.15.2:0/3622881981 learned_addr learned my addr 172.21.15.2:0/3622881981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f24196a1640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a91379680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 -- 172.21.15.2:0/3622881981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 msgr2=0x558a91379680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a91379680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 -- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 msgr2=0x558a9137c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9137c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 -- 172.21.15.2:0/3622881981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9129ec90 con 0x558a9137c9a0 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f24196a1640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a91379680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f2418ea0640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a91379c20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2404005850 tx=0x7f2404005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a6d2e5fe27109c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.462+0000 7f23fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f23fcff9640 1 -- 172.21.15.2:0/3622881981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240400dc90 con 0x558a9137c9a0 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2410004770 con 0x558a9137c9a0 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f23fcff9640 1 -- 172.21.15.2:0/3622881981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f240400de30 con 0x558a9137c9a0 2024-09-10T23:29:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f23fcff9640 1 -- 172.21.15.2:0/3622881981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2404005020 con 0x558a9137c9a0 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 10 client.17004 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a9138af70 con 0x558a9137c9a0 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f23fcff9640 1 -- 172.21.15.2:0/3622881981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410004770 con 0x558a9137c9a0 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f23fcff9640 1 -- 172.21.15.2:0/3622881981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2404028070 con 0x558a9137c9a0 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 10 client.17004 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 10 client.17004 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 20 client.17004 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a9138c3d0 0x558a9138e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 4 client.17004 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.463+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a912e8df0 con 0x558a9138c3d0 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.464+0000 7f24196a1640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a9138c3d0 0x558a9138e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.464+0000 7f23fcff9640 10 client.17004 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.464+0000 7f24196a1640 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a9138c3d0 0x558a9138e830 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f7493da7f5c510c server_cookie=7ca899c54f6e4bb4 in_seq=0 out_seq=0 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f23fcff9640 1 -- 172.21.15.2:0/3622881981 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a912e8df0 con 0x558a9138c3d0 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f23fcff9640 10 client.17004 handle_command_reply: tid=0 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 client.17004 shutdown 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 msgr2=0x558a91379c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a91379c20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2404005850 tx=0x7f2404005880 comp rx=0 tx=0).stop 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 shutdown_connections 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a9138c3d0 0x558a9138e830 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a91379c20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a91379680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f23fcff9640 0 client.17004 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 --2- 172.21.15.2:0/3622881981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9137c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 >> 172.21.15.2:0/3622881981 conn(0x558a9136df20 msgr2=0x558a91373ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 shutdown_connections 2024-09-10T23:29:02.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 1 -- 172.21.15.2:0/3622881981 wait complete. 2024-09-10T23:29:02.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.465+0000 7f241dcda740 20 client.17004 trim_cache size 0 max 16384 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 Processor -- start 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 -- start start 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9136d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a9137dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a9137e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24141ae340 con 0x558a9137c9a0 2024-09-10T23:29:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24141afe80 con 0x558a913700f0 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f241dcda740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24141aea10 con 0x558a91370a10 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a9137e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a9137e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48400/0 (socket says 172.21.15.2:48400) 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 -- 172.21.15.2:0/36237933 learned_addr learned my addr 172.21.15.2:0/36237933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f24196a1640 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a9137dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9136d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 -- 172.21.15.2:0/36237933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 msgr2=0x558a9137dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a9137dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 -- 172.21.15.2:0/36237933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 msgr2=0x558a9136d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9136d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.479+0000 7f2418ea0640 1 -- 172.21.15.2:0/36237933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9136f600 con 0x558a9137c9a0 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f2418ea0640 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a9137e2d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2404013fd0 tx=0x7f2404005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3dc92b87d0375a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f23feffd640 1 -- 172.21.15.2:0/36237933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040122b0 con 0x558a9137c9a0 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f23feffd640 1 -- 172.21.15.2:0/36237933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2404025070 con 0x558a9137c9a0 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f23feffd640 1 -- 172.21.15.2:0/36237933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404005420 con 0x558a9137c9a0 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 -- 172.21.15.2:0/36237933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 msgr2=0x558a9137e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a9137e2d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2404013fd0 tx=0x7f2404005f30 comp rx=0 tx=0).stop 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 -- 172.21.15.2:0/36237933 shutdown_connections 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a9137c9a0 0x558a9137e2d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a91370a10 0x558a9137dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 --2- 172.21.15.2:0/36237933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a913700f0 0x558a9136d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 -- 172.21.15.2:0/36237933 >> 172.21.15.2:0/36237933 conn(0x558a9136df20 msgr2=0x558a9137b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 -- 172.21.15.2:0/36237933 shutdown_connections 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.480+0000 7f241dcda740 1 -- 172.21.15.2:0/36237933 wait complete. 2024-09-10T23:29:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 -- start start 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 Processor -- start 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a91384a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a91384fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24141af7b0 con 0x558a91370a10 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24141af0e0 con 0x558a9137c9a0 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24141ac320 con 0x558a913700f0 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f241dcda740 10 client.0 _ll_register_callbacks cb 0x7f240400bd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f24196a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a91384fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f24196a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a91384fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48402/0 (socket says 172.21.15.2:48402) 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.481+0000 7f24196a1640 1 -- 172.21.15.2:0/611048672 learned_addr learned my addr 172.21.15.2:0/611048672 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f2418ea0640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f2418ea0640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a91384a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f24196a1640 1 -- 172.21.15.2:0/611048672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 msgr2=0x558a91384a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f24196a1640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a91384a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f24196a1640 1 -- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 msgr2=0x558a9137f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f24196a1640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f24196a1640 1 -- 172.21.15.2:0/611048672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9137ff30 con 0x558a91370a10 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f2418ea0640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a91384a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f24196a1640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a91384fb0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2410009900 tx=0x7f2410009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200654bfff332200 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f23fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f23fcff9640 1 -- 172.21.15.2:0/611048672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410035040 con 0x558a91370a10 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f23fcff9640 1 -- 172.21.15.2:0/611048672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24100316a0 con 0x558a91370a10 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2404025070 con 0x558a91370a10 2024-09-10T23:29:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f23fcff9640 1 -- 172.21.15.2:0/611048672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24100318a0 con 0x558a91370a10 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f241dcda740 10 client.17010 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.482+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a913fe100 con 0x558a91370a10 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f23fcff9640 1 -- 172.21.15.2:0/611048672 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2404025070 con 0x558a91370a10 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f23fcff9640 1 -- 172.21.15.2:0/611048672 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f241003caf0 con 0x558a91370a10 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f241dcda740 10 client.17010 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f241dcda740 10 client.17010 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f241dcda740 20 client.17010 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f241dcda740 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a913fe440 0x558a91400830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f241dcda740 4 client.17010 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a912e48a0 con 0x558a913fe440 2024-09-10T23:29:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f2418ea0640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a913fe440 0x558a91400830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f2418ea0640 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a913fe440 0x558a91400830 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86928f03658e3572 server_cookie=fe660f38c34e6890 in_seq=0 out_seq=0 2024-09-10T23:29:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.483+0000 7f23fcff9640 10 client.17010 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f23fcff9640 1 -- 172.21.15.2:0/611048672 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a912e48a0 con 0x558a913fe440 2024-09-10T23:29:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f23fcff9640 10 client.17010 handle_command_reply: tid=0 2024-09-10T23:29:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 client.17010 shutdown 2024-09-10T23:29:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 msgr2=0x558a91384fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a91384fb0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2410009900 tx=0x7f2410009260 comp rx=0 tx=0).stop 2024-09-10T23:29:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 shutdown_connections 2024-09-10T23:29:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a9137c9a0 0x558a9137f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558a913fe440 0x558a91400830 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558a91370a10 0x558a91384fb0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 --2- 172.21.15.2:0/611048672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558a913700f0 0x558a91384a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f23fcff9640 0 client.17010 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 >> 172.21.15.2:0/611048672 conn(0x558a9136df20 msgr2=0x558a91373150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 shutdown_connections 2024-09-10T23:29:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 1 -- 172.21.15.2:0/611048672 wait complete. 2024-09-10T23:29:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.484+0000 7f241dcda740 20 client.17010 trim_cache size 0 max 16384 2024-09-10T23:29:02.504 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:02.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24000b5360 msgr2=0x7f24000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24000b5360 0x7f24000b7820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ac6f0 tx=0x7f240c076ac0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 msgr2=0x7f241419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 0x7f241419eb70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f240c00cce0 tx=0x7f240c00a620 comp rx=0 tx=0).stop 2024-09-10T23:29:02.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 shutdown_connections 2024-09-10T23:29:02.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24000b5360 0x7f24000b7820 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241410d140 0x7f241419eb70 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414104600 0x7f24141997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 --2- 172.21.15.2:0/882082734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2414103ce0 0x7f2414199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 >> 172.21.15.2:0/882082734 conn(0x7f24140fd700 msgr2=0x7f241410f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 shutdown_connections 2024-09-10T23:29:02.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:02.485+0000 7f241b905640 1 -- 172.21.15.2:0/882082734 wait complete. 2024-09-10T23:29:03.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:29:03.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:03 smithi002 ceph-mon[31150]: pgmap v493: 97 pgs: 97 active+clean; 3.5 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:29:03.520 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:03.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:03 smithi177 ceph-mon[35760]: pgmap v493: 97 pgs: 97 active+clean; 3.5 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:29:03.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:03 smithi154 ceph-mon[35136]: pgmap v493: 97 pgs: 97 active+clean; 3.5 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 -- 172.21.15.2:0/2944342683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba8102dc0 msgr2=0x7f0ba81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2944342683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba8102dc0 0x7f0ba81031a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009900 tx=0x7f0ba402a410 comp rx=0 tx=0).stop 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 -- 172.21.15.2:0/2944342683 shutdown_connections 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2944342683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ba8109150 0x7f0ba810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2944342683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ba81087d0 0x7f0ba8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2944342683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba8102dc0 0x7f0ba81031a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 -- 172.21.15.2:0/2944342683 >> 172.21.15.2:0/2944342683 conn(0x7f0ba80fe830 msgr2=0x7f0ba8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 -- 172.21.15.2:0/2944342683 shutdown_connections 2024-09-10T23:29:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.996+0000 7f0bb0263640 1 -- 172.21.15.2:0/2944342683 wait complete. 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 Processor -- start 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 -- start start 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ba8102dc0 0x7f0ba8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 0x7f0ba8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ba8109150 0x7f0ba819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8112e10 con 0x7f0ba81087d0 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8112c90 con 0x7f0ba8109150 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bb0263640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8112f90 con 0x7f0ba8102dc0 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 0x7f0ba8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 0x7f0ba8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48418/0 (socket says 172.21.15.2:48418) 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 -- 172.21.15.2:0/2916610739 learned_addr learned my addr 172.21.15.2:0/2916610739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0badfff640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ba8102dc0 0x7f0ba8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bae800640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ba8109150 0x7f0ba819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 -- 172.21.15.2:0/2916610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ba8102dc0 msgr2=0x7f0ba8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ba8102dc0 0x7f0ba8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 -- 172.21.15.2:0/2916610739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ba8109150 msgr2=0x7f0ba819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ba8109150 0x7f0ba819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.997+0000 7f0bad7fe640 1 -- 172.21.15.2:0/2916610739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba819f3b0 con 0x7f0ba81087d0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.998+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 0x7f0ba8199840 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800e9f0 tx=0x7f0b9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.998+0000 7f0b9effd640 1 -- 172.21.15.2:0/2916610739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800cd80 con 0x7f0ba81087d0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.998+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba819f6a0 con 0x7f0ba81087d0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.998+0000 7f0b9effd640 1 -- 172.21.15.2:0/2916610739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b980054d0 con 0x7f0ba81087d0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.998+0000 7f0b9effd640 1 -- 172.21.15.2:0/2916610739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98010690 con 0x7f0ba81087d0 2024-09-10T23:29:04.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:03.998+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba81a5d60 con 0x7f0ba81087d0 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.000+0000 7f0b9effd640 1 -- 172.21.15.2:0/2916610739 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0b98004e90 con 0x7f0ba81087d0 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.000+0000 7f0bb2638740 1 Processor -- start 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 -- start start 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2a9fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aa0200 0x5616c2aabc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5616c2a11ea0 con 0x5616c2a9f8e0 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5616c2a012d0 con 0x5616c2aac190 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bb2638740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5616c2a050e0 con 0x5616c2aa0200 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2a9fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2a9fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48422/0 (socket says 172.21.15.2:48422) 2024-09-10T23:29:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 -- 172.21.15.2:0/1677353223 learned_addr learned my addr 172.21.15.2:0/1677353223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0badfff640 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aa0200 0x5616c2aabc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 -- 172.21.15.2:0/1677353223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aa0200 msgr2=0x5616c2aabc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aa0200 0x5616c2aabc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 -- 172.21.15.2:0/1677353223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 msgr2=0x5616c2aae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bae800640 1 -- 172.21.15.2:0/1677353223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616c275f650 con 0x5616c2a9f8e0 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.001+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0b9effd640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b940b52e0 0x7f0b940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0badfff640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b940b52e0 0x7f0b940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0bae800640 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2a9fcc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009fa0 tx=0x7f0ba000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b5dbd74c118c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0b9effd640 1 -- 172.21.15.2:0/2916610739 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0b980e6190 con 0x7f0ba81087d0 2024-09-10T23:29:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0b93fff640 1 -- 172.21.15.2:0/1677353223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0015070 con 0x5616c2a9f8e0 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0b93fff640 1 -- 172.21.15.2:0/1677353223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba001ab10 con 0x5616c2a9f8e0 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.002+0000 7f0b93fff640 1 -- 172.21.15.2:0/1677353223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0011d70 con 0x5616c2a9f8e0 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0badfff640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b940b52e0 0x7f0b940b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4031440 tx=0x7f0ba4005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 -- 172.21.15.2:0/1677353223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 msgr2=0x5616c2a9fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2a9fcc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009fa0 tx=0x7f0ba000f7f0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 -- 172.21.15.2:0/1677353223 shutdown_connections 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aa0200 0x5616c2aabc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1677353223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2a9fcc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 -- 172.21.15.2:0/1677353223 >> 172.21.15.2:0/1677353223 conn(0x5616c2a9d710 msgr2=0x5616c2a9e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 -- 172.21.15.2:0/1677353223 shutdown_connections 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 -- 172.21.15.2:0/1677353223 wait complete. 2024-09-10T23:29:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 -- start start 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.003+0000 7f0bb2638740 1 Processor -- start 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2a9f8e0 0x5616c2aabac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2aa8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aa9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5616c2862700 con 0x5616c2aa0200 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5616c299c160 con 0x5616c2aac190 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5616c2aaee10 con 0x5616c2a9f8e0 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bb2638740 10 client.0 _ll_register_callbacks cb 0x5616c29b59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2aa8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2aa8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48434/0 (socket says 172.21.15.2:48434) 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 -- 172.21.15.2:0/394721476 learned_addr learned my addr 172.21.15.2:0/394721476 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0badfff640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2a9f8e0 0x5616c2aabac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bae800640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aa9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 -- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2a9f8e0 msgr2=0x5616c2aabac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2a9f8e0 0x5616c2aabac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 -- 172.21.15.2:0/394721476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 msgr2=0x5616c2aa9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aa9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.004+0000 7f0bad7fe640 1 -- 172.21.15.2:0/394721476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616c29c9c90 con 0x5616c2aa0200 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2aa8f10 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f0b980e6430 tx=0x7f0b980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95dc19bbf2cd099b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0b917fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0b917fa640 1 -- 172.21.15.2:0/394721476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b980ac410 con 0x5616c2aa0200 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0b917fa640 1 -- 172.21.15.2:0/394721476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0b980b5a00 con 0x5616c2aa0200 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ba001ab10 con 0x5616c2aa0200 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0b917fa640 1 -- 172.21.15.2:0/394721476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b98005680 con 0x5616c2aa0200 2024-09-10T23:29:04.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 10 client.17022 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616c2aba780 con 0x5616c2aa0200 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0b917fa640 1 -- 172.21.15.2:0/394721476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba001ab10 con 0x5616c2aa0200 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0b917fa640 1 -- 172.21.15.2:0/394721476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0b980abb60 con 0x5616c2aa0200 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 10 client.17022 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 10 client.17022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 20 client.17022 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2abbc40 0x5616c2abe070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 4 client.17022 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.005+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616c2a13df0 con 0x5616c2abbc40 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.006+0000 7f0badfff640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2abbc40 0x5616c2abe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.006+0000 7f0b917fa640 10 client.17022 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:04.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.006+0000 7f0badfff640 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2abbc40 0x5616c2abe070 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f69e794e646e53 server_cookie=59f00090cfabbfc4 in_seq=0 out_seq=0 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0b917fa640 1 -- 172.21.15.2:0/394721476 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616c2a13df0 con 0x5616c2abbc40 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0b917fa640 10 client.17022 handle_command_reply: tid=0 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 client.17022 shutdown 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 msgr2=0x5616c2aa8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2aa8f10 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f0b980e6430 tx=0x7f0b980048f0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 shutdown_connections 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2abbc40 0x5616c2abe070 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aac190 0x5616c2aa9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2aa8f10 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0b917fa640 0 client.17022 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 --2- 172.21.15.2:0/394721476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2a9f8e0 0x5616c2aabac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 >> 172.21.15.2:0/394721476 conn(0x5616c2a9d710 msgr2=0x5616c2a98420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 shutdown_connections 2024-09-10T23:29:04.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 1 -- 172.21.15.2:0/394721476 wait complete. 2024-09-10T23:29:04.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.007+0000 7f0bb2638740 20 client.17022 trim_cache size 0 max 16384 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 Processor -- start 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 -- start start 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aa0200 0x5616c2aa8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2a9e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ac230 con 0x5616c2a9f8e0 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81add70 con 0x5616c2aa0200 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bb2638740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ac900 con 0x5616c2aac190 2024-09-10T23:29:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48448/0 (socket says 172.21.15.2:48448) 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 -- 172.21.15.2:0/3829957869 learned_addr learned my addr 172.21.15.2:0/3829957869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bae800640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2a9e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 -- 172.21.15.2:0/3829957869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 msgr2=0x5616c2a9e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aa0200 0x5616c2aa8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2a9e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 -- 172.21.15.2:0/3829957869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aa0200 msgr2=0x5616c2aa8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aa0200 0x5616c2aa8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0badfff640 1 -- 172.21.15.2:0/3829957869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616c2a94bb0 con 0x5616c2a9f8e0 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bae800640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2a9e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.021+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aa0200 0x5616c2aa8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0badfff640 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab8040 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4032fd0 tx=0x7f0ba403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ef066cb39a321 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0b937fe640 1 -- 172.21.15.2:0/3829957869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4056070 con 0x5616c2a9f8e0 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0b937fe640 1 -- 172.21.15.2:0/3829957869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba4004300 con 0x5616c2a9f8e0 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0b937fe640 1 -- 172.21.15.2:0/3829957869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4035040 con 0x5616c2a9f8e0 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 -- 172.21.15.2:0/3829957869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 msgr2=0x5616c2ab8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab8040 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4032fd0 tx=0x7f0ba403e000 comp rx=0 tx=0).stop 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 -- 172.21.15.2:0/3829957869 shutdown_connections 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2a9e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2aa0200 0x5616c2aa8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 --2- 172.21.15.2:0/3829957869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab8040 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.022+0000 7f0bb2638740 1 -- 172.21.15.2:0/3829957869 >> 172.21.15.2:0/3829957869 conn(0x5616c2a9d710 msgr2=0x5616c2aa7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 -- 172.21.15.2:0/3829957869 shutdown_connections 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 -- 172.21.15.2:0/3829957869 wait complete. 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 -- start start 2024-09-10T23:29:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 Processor -- start 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2ab45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2aaf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ad6a0 con 0x5616c2aa0200 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81acfd0 con 0x5616c2a9f8e0 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81aa210 con 0x5616c2aac190 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.023+0000 7f0bb2638740 10 client.0 _ll_register_callbacks cb 0x7f0b980a8fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2ab45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2ab45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48464/0 (socket says 172.21.15.2:48464) 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 -- 172.21.15.2:0/1190361533 learned_addr learned my addr 172.21.15.2:0/1190361533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0badfff640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bae800640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2aaf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 -- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 msgr2=0x5616c2aaf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2aaf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 -- 172.21.15.2:0/1190361533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2a9f8e0 msgr2=0x5616c2ab40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 -- 172.21.15.2:0/1190361533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616c2ab4d30 con 0x5616c2aa0200 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0badfff640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bad7fe640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2ab45f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0b980a8ed0 tx=0x7f0b98005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2e5cb2dcd71870 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0b917fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0b917fa640 1 -- 172.21.15.2:0/1190361533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b980ac250 con 0x5616c2aa0200 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0b917fa640 1 -- 172.21.15.2:0/1190361533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0b980a8250 con 0x5616c2aa0200 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ba4004300 con 0x5616c2aa0200 2024-09-10T23:29:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0b917fa640 1 -- 172.21.15.2:0/1190361533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b98097030 con 0x5616c2aa0200 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bb2638740 10 client.17028 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.024+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616c2b28ff0 con 0x5616c2aa0200 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0b917fa640 1 -- 172.21.15.2:0/1190361533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba4004300 con 0x5616c2aa0200 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0b917fa640 1 -- 172.21.15.2:0/1190361533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0b980a8450 con 0x5616c2aa0200 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0bb2638740 10 client.17028 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0bb2638740 10 client.17028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0bb2638740 20 client.17028 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2b29700 0x5616c2b2baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0bb2638740 4 client.17028 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616c2a0f8a0 con 0x5616c2b29700 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0badfff640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2b29700 0x5616c2b2baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0b917fa640 10 client.17028 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.025+0000 7f0badfff640 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2b29700 0x5616c2b2baf0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4afebc8e08207e92 server_cookie=9dd4f9d19b6a627 in_seq=0 out_seq=0 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0b917fa640 1 -- 172.21.15.2:0/1190361533 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616c2a0f8a0 con 0x5616c2b29700 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0b917fa640 10 client.17028 handle_command_reply: tid=0 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 client.17028 shutdown 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 msgr2=0x5616c2ab45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2ab45f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0b980a8ed0 tx=0x7f0b98005430 comp rx=0 tx=0).stop 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 shutdown_connections 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5616c2b29700 0x5616c2b2baf0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5616c2aac190 0x5616c2aaf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5616c2aa0200 0x5616c2ab45f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 --2- 172.21.15.2:0/1190361533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616c2a9f8e0 0x5616c2ab40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0b917fa640 0 client.17028 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 >> 172.21.15.2:0/1190361533 conn(0x5616c2a9d710 msgr2=0x5616c2a9e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 shutdown_connections 2024-09-10T23:29:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 1 -- 172.21.15.2:0/1190361533 wait complete. 2024-09-10T23:29:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.026+0000 7f0bb2638740 20 client.17028 trim_cache size 0 max 16384 2024-09-10T23:29:04.044 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b940b52e0 msgr2=0x7f0b940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b940b52e0 0x7f0b940b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4031440 tx=0x7f0ba4005df0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 msgr2=0x7f0ba8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 0x7f0ba8199840 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800e9f0 tx=0x7f0b9800edf0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 shutdown_connections 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b940b52e0 0x7f0b940b77a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ba8109150 0x7f0ba819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ba81087d0 0x7f0ba8199840 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 --2- 172.21.15.2:0/2916610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ba8102dc0 0x7f0ba8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 >> 172.21.15.2:0/2916610739 conn(0x7f0ba80fe830 msgr2=0x7f0ba8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 shutdown_connections 2024-09-10T23:29:04.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:04.027+0000 7f0bb0263640 1 -- 172.21.15.2:0/2916610739 wait complete. 2024-09-10T23:29:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:05 smithi177 ceph-mon[35760]: pgmap v494: 97 pgs: 97 active+clean; 3.5 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:05.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:05 smithi002 ceph-mon[31150]: pgmap v494: 97 pgs: 97 active+clean; 3.5 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:05.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:05 smithi154 ceph-mon[35136]: pgmap v494: 97 pgs: 97 active+clean; 3.5 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:05.879 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:29:05.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:29:06.157 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 -- 172.21.15.2:0/458240306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec90102dc0 msgr2=0x7fec901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 --2- 172.21.15.2:0/458240306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec90102dc0 0x7fec901031a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fec80009ca0 tx=0x7fec8002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 -- 172.21.15.2:0/458240306 shutdown_connections 2024-09-10T23:29:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 --2- 172.21.15.2:0/458240306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec90109150 0x7fec9010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 --2- 172.21.15.2:0/458240306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec901087d0 0x7fec90108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 --2- 172.21.15.2:0/458240306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec90102dc0 0x7fec901031a0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 -- 172.21.15.2:0/458240306 >> 172.21.15.2:0/458240306 conn(0x7fec900fe830 msgr2=0x7fec90100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 -- 172.21.15.2:0/458240306 shutdown_connections 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.667+0000 7fec9791d640 1 -- 172.21.15.2:0/458240306 wait complete. 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 Processor -- start 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 -- start start 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec90102dc0 0x7fec90199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 0x7fec90199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec90109150 0x7fec9019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec90112dd0 con 0x7fec901087d0 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec90112c50 con 0x7fec90102dc0 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec9791d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec90112f50 con 0x7fec90109150 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec94eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 0x7fec90199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec94eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 0x7fec90199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48470/0 (socket says 172.21.15.2:48470) 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec94eb8640 1 -- 172.21.15.2:0/504683211 learned_addr learned my addr 172.21.15.2:0/504683211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec956b9640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec90102dc0 0x7fec90199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec95eba640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec90109150 0x7fec9019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec94eb8640 1 -- 172.21.15.2:0/504683211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec90109150 msgr2=0x7fec9019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.668+0000 7fec94eb8640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec90109150 0x7fec9019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec94eb8640 1 -- 172.21.15.2:0/504683211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec90102dc0 msgr2=0x7fec90199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec94eb8640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec90102dc0 0x7fec90199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec94eb8640 1 -- 172.21.15.2:0/504683211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9019f3b0 con 0x7fec901087d0 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec95eba640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec90109150 0x7fec9019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec94eb8640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 0x7fec90199840 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d950 tx=0x7fec8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec8e7fc640 1 -- 172.21.15.2:0/504683211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84017070 con 0x7fec901087d0 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9019f6a0 con 0x7fec901087d0 2024-09-10T23:29:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec8e7fc640 1 -- 172.21.15.2:0/504683211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec84009c30 con 0x7fec901087d0 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec8e7fc640 1 -- 172.21.15.2:0/504683211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8400f620 con 0x7fec901087d0 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.669+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a5d60 con 0x7fec901087d0 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 Processor -- start 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec8e7fc640 1 -- 172.21.15.2:0/504683211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fec84010460 con 0x7fec901087d0 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 -- start start 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653aee0 0x55e1d653b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653b800 0x55e1d6547250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d6549b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e1d64b1e60 con 0x55e1d6547790 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e1d64a1290 con 0x55e1d653aee0 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec99cf2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e1d64a50a0 con 0x55e1d653b800 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d6549b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d6549b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48482/0 (socket says 172.21.15.2:48482) 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 -- 172.21.15.2:0/3923948766 learned_addr learned my addr 172.21.15.2:0/3923948766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec956b9640 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653b800 0x55e1d6547250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec95eba640 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653aee0 0x55e1d653b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 -- 172.21.15.2:0/3923948766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653b800 msgr2=0x55e1d6547250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653b800 0x55e1d6547250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 -- 172.21.15.2:0/3923948766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653aee0 msgr2=0x55e1d653b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653aee0 0x55e1d653b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.672+0000 7fec94eb8640 1 -- 172.21.15.2:0/3923948766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d61ff930 con 0x55e1d6547790 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec8e7fc640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec780b52e0 0x7fec780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec94eb8640 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d6549b80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fec840ebc40 tx=0x7fec840ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f573558bf8212c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec95eba640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec780b52e0 0x7fec780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec8e7fc640 1 -- 172.21.15.2:0/504683211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fec840e5860 con 0x7fec901087d0 2024-09-10T23:29:06.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec777fe640 1 -- 172.21.15.2:0/3923948766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840a8680 con 0x55e1d6547790 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec777fe640 1 -- 172.21.15.2:0/3923948766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec840e8e50 con 0x55e1d6547790 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.673+0000 7fec777fe640 1 -- 172.21.15.2:0/3923948766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840cf0c0 con 0x55e1d6547790 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 -- 172.21.15.2:0/3923948766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 msgr2=0x55e1d6549b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec95eba640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec780b52e0 0x7fec780b77a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fec8800bba0 tx=0x7fec88005e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d6549b80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fec840ebc40 tx=0x7fec840ed690 comp rx=0 tx=0).stop 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 -- 172.21.15.2:0/3923948766 shutdown_connections 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d6549b80 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653b800 0x55e1d6547250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 --2- 172.21.15.2:0/3923948766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653aee0 0x55e1d653b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 -- 172.21.15.2:0/3923948766 >> 172.21.15.2:0/3923948766 conn(0x55e1d6538d10 msgr2=0x55e1d6539eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 -- 172.21.15.2:0/3923948766 shutdown_connections 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 -- 172.21.15.2:0/3923948766 wait complete. 2024-09-10T23:29:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 -- start start 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.674+0000 7fec99cf2740 1 Processor -- start 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 0x55e1d65447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d6544ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d6547790 0x55e1d6545220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e1d6302890 con 0x55e1d653aee0 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e1d643bd40 con 0x55e1d653b800 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e1d654a440 con 0x55e1d6547790 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 10 client.0 _ll_register_callbacks cb 0x55e1d649fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 0x55e1d65447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 0x55e1d65447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48492/0 (socket says 172.21.15.2:48492) 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 -- 172.21.15.2:0/2884966218 learned_addr learned my addr 172.21.15.2:0/2884966218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec94eb8640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d6544ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec95eba640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d6547790 0x55e1d6545220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 -- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d6547790 msgr2=0x55e1d6545220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d6547790 0x55e1d6545220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 -- 172.21.15.2:0/2884966218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 msgr2=0x55e1d6544ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d6544ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 -- 172.21.15.2:0/2884966218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d6553870 con 0x55e1d653aee0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec95eba640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d6547790 0x55e1d6545220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec956b9640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 0x55e1d65447a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fec80009ca0 tx=0x7fec80031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed62e7f43d1a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec74ff9640 1 -- 172.21.15.2:0/2884966218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80031790 con 0x55e1d653aee0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec74ff9640 1 -- 172.21.15.2:0/2884966218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fec80003970 con 0x55e1d653aee0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.675+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec840e8e50 con 0x55e1d653aee0 2024-09-10T23:29:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec74ff9640 1 -- 172.21.15.2:0/2884966218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec80003b70 con 0x55e1d653aee0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 10 client.17040 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1d6556270 con 0x55e1d653aee0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec74ff9640 1 -- 172.21.15.2:0/2884966218 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec840e8e50 con 0x55e1d653aee0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec74ff9640 1 -- 172.21.15.2:0/2884966218 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec80004560 con 0x55e1d653aee0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 10 client.17040 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 10 client.17040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 20 client.17040 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65576d0 0x55e1d6559b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 4 client.17040 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1d64b3db0 con 0x55e1d65576d0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.676+0000 7fec94eb8640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65576d0 0x55e1d6559b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.677+0000 7fec94eb8640 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65576d0 0x55e1d6559b30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ba80d525d992c0 server_cookie=4f20f1ef3b5493d9 in_seq=0 out_seq=0 2024-09-10T23:29:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.677+0000 7fec74ff9640 10 client.17040 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec74ff9640 1 -- 172.21.15.2:0/2884966218 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1d64b3db0 con 0x55e1d65576d0 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec74ff9640 10 client.17040 handle_command_reply: tid=0 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 client.17040 shutdown 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 msgr2=0x55e1d65447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 0x55e1d65447a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fec80009ca0 tx=0x7fec80031450 comp rx=0 tx=0).stop 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 shutdown_connections 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65576d0 0x55e1d6559b30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d6547790 0x55e1d6545220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d6544ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec74ff9640 0 client.17040 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2884966218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653aee0 0x55e1d65447a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 >> 172.21.15.2:0/2884966218 conn(0x55e1d6538d10 msgr2=0x55e1d6537f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 shutdown_connections 2024-09-10T23:29:06.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 1 -- 172.21.15.2:0/2884966218 wait complete. 2024-09-10T23:29:06.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.678+0000 7fec99cf2740 20 client.17040 trim_cache size 0 max 16384 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 Processor -- start 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 -- start start 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d65419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 0x55e1d6541ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d6547790 0x55e1d655f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ae490 con 0x55e1d653b800 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec901affd0 con 0x55e1d6547790 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.696+0000 7fec99cf2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec901aeb60 con 0x55e1d653aee0 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 0x55e1d6541ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 0x55e1d6541ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48498/0 (socket says 172.21.15.2:48498) 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 -- 172.21.15.2:0/729278222 learned_addr learned my addr 172.21.15.2:0/729278222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec956b9640 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d65419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec95eba640 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d6547790 0x55e1d655f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 -- 172.21.15.2:0/729278222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 msgr2=0x55e1d65419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d65419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 -- 172.21.15.2:0/729278222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d6547790 msgr2=0x55e1d655f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d6547790 0x55e1d655f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 -- 172.21.15.2:0/729278222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d6542ca0 con 0x55e1d653b800 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec94eb8640 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 0x55e1d6541ef0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fec840e33c0 tx=0x7fec84010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd6ca1c95bce1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec76ffd640 1 -- 172.21.15.2:0/729278222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84020070 con 0x55e1d653b800 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec76ffd640 1 -- 172.21.15.2:0/729278222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec84091e50 con 0x55e1d653b800 2024-09-10T23:29:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.697+0000 7fec76ffd640 1 -- 172.21.15.2:0/729278222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840ab7a0 con 0x55e1d653b800 2024-09-10T23:29:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 -- 172.21.15.2:0/729278222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 msgr2=0x55e1d6541ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 0x55e1d6541ef0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fec840e33c0 tx=0x7fec84010cb0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 -- 172.21.15.2:0/729278222 shutdown_connections 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d6547790 0x55e1d655f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d653b800 0x55e1d6541ef0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 --2- 172.21.15.2:0/729278222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d65419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 -- 172.21.15.2:0/729278222 >> 172.21.15.2:0/729278222 conn(0x55e1d6538d10 msgr2=0x55e1d65465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 -- 172.21.15.2:0/729278222 shutdown_connections 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.698+0000 7fec99cf2740 1 -- 172.21.15.2:0/729278222 wait complete. 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 -- start start 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 Processor -- start 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d654df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d654e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d65bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec901af900 con 0x55e1d6547790 2024-09-10T23:29:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec901af230 con 0x55e1d653b800 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ac470 con 0x55e1d653aee0 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec99cf2740 10 client.0 _ll_register_callbacks cb 0x7fec8002f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec95eba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d65bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec95eba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d65bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48504/0 (socket says 172.21.15.2:48504) 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec95eba640 1 -- 172.21.15.2:0/2991273631 learned_addr learned my addr 172.21.15.2:0/2991273631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.699+0000 7fec956b9640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d654df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec94eb8640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d654e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec95eba640 1 -- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 msgr2=0x55e1d654df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec95eba640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d654df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec95eba640 1 -- 172.21.15.2:0/2991273631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 msgr2=0x55e1d654e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec95eba640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d654e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec95eba640 1 -- 172.21.15.2:0/2991273631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d65bdcf0 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec95eba640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d65bd5e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fec8801ee00 tx=0x7fec880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2c27e2f12e69df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec74ff9640 1 -- 172.21.15.2:0/2991273631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88027640 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec74ff9640 1 -- 172.21.15.2:0/2991273631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fec880263e0 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec84091e50 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec74ff9640 1 -- 172.21.15.2:0/2991273631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec880277e0 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec99cf2740 10 client.17046 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1d65c5150 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.700+0000 7fec74ff9640 1 -- 172.21.15.2:0/2991273631 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec84091e50 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec74ff9640 1 -- 172.21.15.2:0/2991273631 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec88025070 con 0x55e1d6547790 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec99cf2740 10 client.17046 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec99cf2740 10 client.17046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec99cf2740 20 client.17046 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65c5930 0x55e1d65c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec99cf2740 4 client.17046 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:29:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e1d64af860 con 0x55e1d65c5930 2024-09-10T23:29:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.701+0000 7fec956b9640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65c5930 0x55e1d65c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.702+0000 7fec956b9640 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65c5930 0x55e1d65c7d50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab32bf9af4ba709a server_cookie=448c42b016aca3c9 in_seq=0 out_seq=0 2024-09-10T23:29:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.702+0000 7fec74ff9640 10 client.17046 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec74ff9640 1 -- 172.21.15.2:0/2991273631 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e1d64af860 con 0x55e1d65c5930 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec74ff9640 10 client.17046 handle_command_reply: tid=0 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 client.17046 shutdown 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 msgr2=0x55e1d65bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d65bd5e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fec8801ee00 tx=0x7fec880046c0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 shutdown_connections 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e1d65c5930 0x55e1d65c7d50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1d6547790 0x55e1d65bd5e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1d653b800 0x55e1d654e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec74ff9640 0 client.17046 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 --2- 172.21.15.2:0/2991273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e1d653aee0 0x55e1d654df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.703+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 >> 172.21.15.2:0/2991273631 conn(0x55e1d6538d10 msgr2=0x55e1d6545dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 shutdown_connections 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec99cf2740 1 -- 172.21.15.2:0/2991273631 wait complete. 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec99cf2740 20 client.17046 trim_cache size 0 max 16384 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:29:06.708 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:29:06.709 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "6461a3b2-cafe-4c21-a837-2340144cd956", 2024-09-10T23:29:06.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:29:06.709 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:29:06.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec780b52e0 msgr2=0x7fec780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec780b52e0 0x7fec780b77a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fec8800bba0 tx=0x7fec88005e10 comp rx=0 tx=0).stop 2024-09-10T23:29:06.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 msgr2=0x7fec90199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 0x7fec90199840 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d950 tx=0x7fec8400de10 comp rx=0 tx=0).stop 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 shutdown_connections 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fec780b52e0 0x7fec780b77a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec90109150 0x7fec9019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901087d0 0x7fec90199840 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 --2- 172.21.15.2:0/504683211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec90102dc0 0x7fec90199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.704+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 >> 172.21.15.2:0/504683211 conn(0x7fec900fe830 msgr2=0x7fec90100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.705+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 shutdown_connections 2024-09-10T23:29:06.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:06.705+0000 7fec9791d640 1 -- 172.21.15.2:0/504683211 wait complete. 2024-09-10T23:29:07.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:07 smithi002 ceph-mon[31150]: pgmap v495: 97 pgs: 97 active+clean; 3.6 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:07.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:07 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:29:07.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:07.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:07 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:29:07.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:07.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:29:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:07 smithi177 ceph-mon[35760]: pgmap v495: 97 pgs: 97 active+clean; 3.6 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:07 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:29:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:07 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:29:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:07 smithi154 ceph-mon[35136]: pgmap v495: 97 pgs: 97 active+clean; 3.6 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:07 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:29:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:07 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:29:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:07.848 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 -- 172.21.15.2:0/512025714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470101c90 msgr2=0x7fa470102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 --2- 172.21.15.2:0/512025714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470101c90 0x7fa470102070 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa460009900 tx=0x7fa46002a410 comp rx=0 tx=0).stop 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 -- 172.21.15.2:0/512025714 shutdown_connections 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 --2- 172.21.15.2:0/512025714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa470108020 0x7fa47010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 --2- 172.21.15.2:0/512025714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4701076a0 0x7fa470107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 --2- 172.21.15.2:0/512025714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470101c90 0x7fa470102070 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 -- 172.21.15.2:0/512025714 >> 172.21.15.2:0/512025714 conn(0x7fa4700fd700 msgr2=0x7fa4700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 -- 172.21.15.2:0/512025714 shutdown_connections 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 -- 172.21.15.2:0/512025714 wait complete. 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 Processor -- start 2024-09-10T23:29:08.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.353+0000 7fa47603b640 1 -- start start 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa47603b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa470101c90 0x7fa470199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa47603b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4701076a0 0x7fa4701998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa47603b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 0x7fa47019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa47603b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa470111ce0 con 0x7fa470108020 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa47603b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa470111b60 con 0x7fa470101c90 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa47603b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa470111e60 con 0x7fa4701076a0 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 0x7fa47019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4701076a0 0x7fa4701998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 0x7fa47019ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48534/0 (socket says 172.21.15.2:48534) 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 -- 172.21.15.2:0/3910750969 learned_addr learned my addr 172.21.15.2:0/3910750969 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa470101c90 0x7fa470199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 -- 172.21.15.2:0/3910750969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4701076a0 msgr2=0x7fa4701998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4701076a0 0x7fa4701998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 -- 172.21.15.2:0/3910750969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa470101c90 msgr2=0x7fa470199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa470101c90 0x7fa470199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 -- 172.21.15.2:0/3910750969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47019f420 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.354+0000 7fa46ffff640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 0x7fa47019ec50 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b970 tx=0x7fa46800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.355+0000 7fa46cff9640 1 -- 172.21.15.2:0/3910750969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468019070 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.355+0000 7fa46cff9640 1 -- 172.21.15.2:0/3910750969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa468014440 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.355+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47019f710 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.355+0000 7fa46cff9640 1 -- 172.21.15.2:0/3910750969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680075d0 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.355+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4701a5dd0 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa46cff9640 1 -- 172.21.15.2:0/3910750969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa46800cb40 con 0x7fa470108020 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 Processor -- start 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 -- start start 2024-09-10T23:29:08.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c552901530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c552864e50 con 0x55c5528ee480 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c552854280 con 0x55c5528eeda0 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.357+0000 7fa478410740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c552858090 con 0x55c5528ff140 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528ee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48540/0 (socket says 172.21.15.2:48540) 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 -- 172.21.15.2:0/3293848952 learned_addr learned my addr 172.21.15.2:0/3293848952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c552901530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 -- 172.21.15.2:0/3293848952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 msgr2=0x55c552901530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c552901530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 -- 172.21.15.2:0/3293848952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 msgr2=0x55c5528fec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 -- 172.21.15.2:0/3293848952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5525b2650 con 0x55c5528ee480 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46cff9640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4580b52e0 0x7fa4580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46effd640 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528ee860 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa464013500 tx=0x7fa46400a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a945845000cfe9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4580b52e0 0x7fa4580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa46cff9640 1 -- 172.21.15.2:0/3910750969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa4680e5380 con 0x7fa470108020 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa455ffb640 1 -- 172.21.15.2:0/3293848952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464019030 con 0x55c5528ee480 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa455ffb640 1 -- 172.21.15.2:0/3293848952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4640054d0 con 0x55c5528ee480 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.358+0000 7fa455ffb640 1 -- 172.21.15.2:0/3293848952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46400f640 con 0x55c5528ee480 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 -- 172.21.15.2:0/3293848952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 msgr2=0x55c5528ee860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528ee860 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa464013500 tx=0x7fa46400a670 comp rx=0 tx=0).stop 2024-09-10T23:29:08.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4580b52e0 0x7fa4580b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa460031440 tx=0x7fa460005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 -- 172.21.15.2:0/3293848952 shutdown_connections 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c552901530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 --2- 172.21.15.2:0/3293848952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528ee860 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 -- 172.21.15.2:0/3293848952 >> 172.21.15.2:0/3293848952 conn(0x55c5528ec2b0 msgr2=0x55c5528ed450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 -- 172.21.15.2:0/3293848952 shutdown_connections 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.359+0000 7fa478410740 1 -- 172.21.15.2:0/3293848952 wait complete. 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 -- start start 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 Processor -- start 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c5526b5700 con 0x55c5528ee480 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c5527ef110 con 0x55c5528eeda0 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c552901df0 con 0x55c5528ff140 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa478410740 10 client.0 _ll_register_callbacks cb 0x55c552808990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48552/0 (socket says 172.21.15.2:48552) 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 -- 172.21.15.2:0/700238577 learned_addr learned my addr 172.21.15.2:0/700238577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 -- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 msgr2=0x55c5528fc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46ffff640 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 -- 172.21.15.2:0/700238577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 msgr2=0x55c5528fbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.360+0000 7fa46f7fe640 1 -- 172.21.15.2:0/700238577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c55281cc40 con 0x55c5528ee480 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528fe9f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa460033000 tx=0x7fa460009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80bbff136a1e0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa44effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa44effd640 1 -- 172.21.15.2:0/700238577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46004d030 con 0x55c5528ee480 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa44effd640 1 -- 172.21.15.2:0/700238577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa4600035f0 con 0x55c5528ee480 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4640054d0 con 0x55c5528ee480 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa44effd640 1 -- 172.21.15.2:0/700238577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa460035040 con 0x55c5528ee480 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 10 client.17058 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c55290d710 con 0x55c5528ee480 2024-09-10T23:29:08.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa44effd640 1 -- 172.21.15.2:0/700238577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4640054d0 con 0x55c5528ee480 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa44effd640 1 -- 172.21.15.2:0/700238577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa46003d890 con 0x55c5528ee480 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 10 client.17058 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 20 client.17058 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.361+0000 7fa478410740 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55290ecc0 0x55c552911140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.362+0000 7fa478410740 4 client.17058 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.362+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c552866da0 con 0x55c55290ecc0 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.362+0000 7fa46effd640 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55290ecc0 0x55c552911140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.362+0000 7fa44effd640 10 client.17058 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.362+0000 7fa46effd640 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55290ecc0 0x55c552911140 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48c8a4693622929b server_cookie=c37e3fc41d2313ac in_seq=0 out_seq=0 2024-09-10T23:29:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa44effd640 1 -- 172.21.15.2:0/700238577 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c552866da0 con 0x55c55290ecc0 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa44effd640 10 client.17058 handle_command_reply: tid=0 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 client.17058 shutdown 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 msgr2=0x55c5528fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528fe9f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa460033000 tx=0x7fa460009260 comp rx=0 tx=0).stop 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 shutdown_connections 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55290ecc0 0x55c552911140 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c5528fbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 --2- 172.21.15.2:0/700238577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ee480 0x55c5528fe9f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 >> 172.21.15.2:0/700238577 conn(0x55c5528ec2b0 msgr2=0x55c5528eb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa44effd640 0 client.17058 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 shutdown_connections 2024-09-10T23:29:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 1 -- 172.21.15.2:0/700238577 wait complete. 2024-09-10T23:29:08.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.363+0000 7fa478410740 20 client.17058 trim_cache size 0 max 16384 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 Processor -- start 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 -- start start 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528ee480 0x55c55290b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 0x55c5528ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701ac120 con 0x55c5528eeda0 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701adc60 con 0x55c5528ee480 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa478410740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701ac7f0 con 0x55c5528ff140 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa46effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 0x55c5528ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa46effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 0x55c5528ebbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48556/0 (socket says 172.21.15.2:48556) 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.381+0000 7fa46effd640 1 -- 172.21.15.2:0/2166815465 learned_addr learned my addr 172.21.15.2:0/2166815465 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528ee480 0x55c55290b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46effd640 1 -- 172.21.15.2:0/2166815465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 msgr2=0x55c5528e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46ffff640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46effd640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46effd640 1 -- 172.21.15.2:0/2166815465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528ee480 msgr2=0x55c55290b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46effd640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528ee480 0x55c55290b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46effd640 1 -- 172.21.15.2:0/2166815465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5528f9de0 con 0x55c5528eeda0 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528ee480 0x55c55290b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46ffff640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa46effd640 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 0x55c5528ebbc0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa46400a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7355b58032ddcad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa4557fa640 1 -- 172.21.15.2:0/2166815465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46402b020 con 0x55c5528eeda0 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa4557fa640 1 -- 172.21.15.2:0/2166815465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa46401a040 con 0x55c5528eeda0 2024-09-10T23:29:08.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.382+0000 7fa4557fa640 1 -- 172.21.15.2:0/2166815465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464019040 con 0x55c5528eeda0 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 -- 172.21.15.2:0/2166815465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 msgr2=0x55c5528ebbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 0x55c5528ebbc0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa46400a870 comp rx=0 tx=0).stop 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 -- 172.21.15.2:0/2166815465 shutdown_connections 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ff140 0x55c5528e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528eeda0 0x55c5528ebbc0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 --2- 172.21.15.2:0/2166815465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528ee480 0x55c55290b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 -- 172.21.15.2:0/2166815465 >> 172.21.15.2:0/2166815465 conn(0x55c5528ec2b0 msgr2=0x55c552900ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 -- 172.21.15.2:0/2166815465 shutdown_connections 2024-09-10T23:29:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 -- 172.21.15.2:0/2166815465 wait complete. 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.383+0000 7fa478410740 1 -- start start 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 Processor -- start 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ee480 0x55c552907980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c552916740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 0x55c552916da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701ad590 con 0x55c5528ff140 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701acec0 con 0x55c5528eeda0 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701aa100 con 0x55c5528ee480 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa478410740 10 client.0 _ll_register_callbacks cb 0x7fa460031cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 0x55c552916da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 0x55c552916da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48564/0 (socket says 172.21.15.2:48564) 2024-09-10T23:29:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 -- 172.21.15.2:0/2126075896 learned_addr learned my addr 172.21.15.2:0/2126075896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ee480 0x55c552907980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 -- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ee480 msgr2=0x55c552907980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46effd640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c552916740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ee480 0x55c552907980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 -- 172.21.15.2:0/2126075896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 msgr2=0x55c552916740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c552916740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46ffff640 1 -- 172.21.15.2:0/2126075896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c55297ac10 con 0x55c5528ff140 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.384+0000 7fa46effd640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c552916740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa46ffff640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 0x55c552916da0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa4680e2e30 tx=0x7fa468004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43a1a161428368a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa44effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa44effd640 1 -- 172.21.15.2:0/2126075896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680ab710 con 0x55c5528ff140 2024-09-10T23:29:08.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa44effd640 1 -- 172.21.15.2:0/2126075896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa4680b4c50 con 0x55c5528ff140 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa46401a040 con 0x55c5528ff140 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa44effd640 1 -- 172.21.15.2:0/2126075896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4680abc00 con 0x55c5528ff140 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 10 client.17064 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c55297bda0 con 0x55c5528ff140 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa44effd640 1 -- 172.21.15.2:0/2126075896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa46401a040 con 0x55c5528ff140 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa44effd640 1 -- 172.21.15.2:0/2126075896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4680c6c90 con 0x55c5528ff140 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 10 client.17064 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 20 client.17064 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55297c550 0x55c55297e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 4 client.17064 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.385+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c552862850 con 0x55c55297c550 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.386+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55297c550 0x55c55297e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.386+0000 7fa44effd640 10 client.17064 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.386+0000 7fa46f7fe640 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55297c550 0x55c55297e970 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fbee36adb8fed55 server_cookie=954553b09fdfe72d in_seq=0 out_seq=0 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.386+0000 7fa44effd640 1 -- 172.21.15.2:0/2126075896 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55c552862850 con 0x55c55297c550 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.386+0000 7fa44effd640 10 client.17064 handle_command_reply: tid=0 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.386+0000 7fa478410740 1 client.17064 shutdown 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 msgr2=0x55c552916da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 0x55c552916da0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa4680e2e30 tx=0x7fa468004b50 comp rx=0 tx=0).stop 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 shutdown_connections 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c55297c550 0x55c55297e970 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa44effd640 0 client.17064 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c5528ff140 0x55c552916da0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c5528eeda0 0x55c552916740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 --2- 172.21.15.2:0/2126075896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c5528ee480 0x55c552907980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 >> 172.21.15.2:0/2126075896 conn(0x55c5528ec2b0 msgr2=0x55c5528fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 shutdown_connections 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 1 -- 172.21.15.2:0/2126075896 wait complete. 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa478410740 20 client.17064 trim_cache size 0 max 16384 2024-09-10T23:29:08.393 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4580b52e0 msgr2=0x7fa4580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4580b52e0 0x7fa4580b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa460031440 tx=0x7fa460005e80 comp rx=0 tx=0).stop 2024-09-10T23:29:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 msgr2=0x7fa47019ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 0x7fa47019ec50 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b970 tx=0x7fa46800be30 comp rx=0 tx=0).stop 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 shutdown_connections 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4580b52e0 0x7fa4580b77a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa470108020 0x7fa47019ec50 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4701076a0 0x7fa4701998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 --2- 172.21.15.2:0/3910750969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa470101c90 0x7fa470199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.387+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 >> 172.21.15.2:0/3910750969 conn(0x7fa4700fd700 msgr2=0x7fa47006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.388+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 shutdown_connections 2024-09-10T23:29:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:08.388+0000 7fa47603b640 1 -- 172.21.15.2:0/3910750969 wait complete. 2024-09-10T23:29:08.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:08 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:29:08.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:08 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:29:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 -- 172.21.15.2:0/3607334282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1033c0 msgr2=0x7f1abc109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/3607334282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1033c0 0x7f1abc109d40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009cd0 tx=0x7f1ab402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 -- 172.21.15.2:0/3607334282 shutdown_connections 2024-09-10T23:29:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/3607334282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1033c0 0x7f1abc109d40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/3607334282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc102a00 0x7f1abc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/3607334282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1abc1018b0 0x7f1abc101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.792+0000 7f1ac3f24640 1 -- 172.21.15.2:0/3607334282 >> 172.21.15.2:0/3607334282 conn(0x7f1abc0fd150 msgr2=0x7f1abc0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 -- 172.21.15.2:0/3607334282 shutdown_connections 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 -- 172.21.15.2:0/3607334282 wait complete. 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 Processor -- start 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 -- start start 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 0x7f1abc06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1abc102a00 0x7f1abc19dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc1033c0 0x7f1abc1a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10d520 con 0x7f1abc1018b0 2024-09-10T23:29:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10d3a0 con 0x7f1abc1033c0 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac3f24640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10d6a0 con 0x7f1abc102a00 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac1cc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 0x7f1abc06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac1cc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 0x7f1abc06bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48582/0 (socket says 172.21.15.2:48582) 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.793+0000 7f1ac1cc0640 1 -- 172.21.15.2:0/700323833 learned_addr learned my addr 172.21.15.2:0/700323833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1abc102a00 0x7f1abc19dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc1033c0 0x7f1abc1a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac1cc0640 1 -- 172.21.15.2:0/700323833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1abc102a00 msgr2=0x7f1abc19dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac1cc0640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1abc102a00 0x7f1abc19dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac1cc0640 1 -- 172.21.15.2:0/700323833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc1033c0 msgr2=0x7f1abc1a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac1cc0640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc1033c0 0x7f1abc1a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac1cc0640 1 -- 172.21.15.2:0/700323833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc1a0990 con 0x7f1abc1018b0 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc1033c0 0x7f1abc1a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac1cc0640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 0x7f1abc06bcc0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800d770 tx=0x7f1ab800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ab2ffd640 1 -- 172.21.15.2:0/700323833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8017070 con 0x7f1abc1018b0 2024-09-10T23:29:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ab2ffd640 1 -- 172.21.15.2:0/700323833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab80054d0 con 0x7f1abc1018b0 2024-09-10T23:29:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc1a0c80 con 0x7f1abc1018b0 2024-09-10T23:29:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ab2ffd640 1 -- 172.21.15.2:0/700323833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8004c30 con 0x7f1abc1018b0 2024-09-10T23:29:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.794+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc1a11d0 con 0x7f1abc1018b0 2024-09-10T23:29:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 Processor -- start 2024-09-10T23:29:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 -- start start 2024-09-10T23:29:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ab2ffd640 1 -- 172.21.15.2:0/700323833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1ab8004e10 con 0x7f1abc1018b0 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 0x564b7e122c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e123190 0x564b7e125580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e125bd0 0x564b7e128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b7e0926f0 con 0x564b7e120860 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b7e081b20 con 0x564b7e123190 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564b7e085930 con 0x564b7e125bd0 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac24c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 0x564b7e122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac24c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 0x564b7e122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48590/0 (socket says 172.21.15.2:48590) 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.797+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2495568815 learned_addr learned my addr 172.21.15.2:0/2495568815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac1cc0640 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e123190 0x564b7e125580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e125bd0 0x564b7e128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2495568815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e125bd0 msgr2=0x564b7e128090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e125bd0 0x564b7e128090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2495568815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e123190 msgr2=0x564b7e125580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e123190 0x564b7e125580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2495568815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7e047530 con 0x564b7e120860 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 0x564b7e122c50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009a20 tx=0x7f1ab4005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1b4f7dc39595a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1aa7fff640 1 -- 172.21.15.2:0/2495568815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4031b50 con 0x564b7e120860 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ab2ffd640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1aa80b5360 0x7f1aa80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1aa7fff640 1 -- 172.21.15.2:0/2495568815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab4036040 con 0x564b7e120860 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1aa7fff640 1 -- 172.21.15.2:0/2495568815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40046c0 con 0x564b7e120860 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ac1cc0640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1aa80b5360 0x7f1aa80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.798+0000 7f1ab2ffd640 1 -- 172.21.15.2:0/700323833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1ab80e56f0 con 0x7f1abc1018b0 2024-09-10T23:29:08.807 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2495568815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 msgr2=0x564b7e122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 0x564b7e122c50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009a20 tx=0x7f1ab4005fa0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac1cc0640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1aa80b5360 0x7f1aa80b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800d740 tx=0x7f1ab8093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2495568815 shutdown_connections 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e125bd0 0x564b7e128090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e123190 0x564b7e125580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2495568815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e120860 0x564b7e122c50 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2495568815 >> 172.21.15.2:0/2495568815 conn(0x564b7e11b9b0 msgr2=0x564b7e11c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2495568815 shutdown_connections 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2495568815 wait complete. 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 -- start start 2024-09-10T23:29:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.799+0000 7f1ac6dc9740 1 Processor -- start 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e129e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e12a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e12b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b7dfb9ab0 con 0x564b7e125bd0 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b7e027730 con 0x564b7e120860 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564b7e128b50 con 0x564b7e123190 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac6dc9740 10 client.0 _ll_register_callbacks cb 0x564b7e07b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e12b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e12b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48602/0 (socket says 172.21.15.2:48602) 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 -- 172.21.15.2:0/3457749641 learned_addr learned my addr 172.21.15.2:0/3457749641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e12a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e129e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 -- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 msgr2=0x564b7e12a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e12a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 -- 172.21.15.2:0/3457749641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 msgr2=0x564b7e129e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e129e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.800+0000 7f1ac24c1640 1 -- 172.21.15.2:0/3457749641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7dde3790 con 0x564b7e125bd0 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e12b0d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009960 tx=0x7f1ab4049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5ee9c3e5109610 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1aa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1aa57fa640 1 -- 172.21.15.2:0/3457749641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4004840 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1aa57fa640 1 -- 172.21.15.2:0/3457749641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1ab4003b80 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ab4036040 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1aa57fa640 1 -- 172.21.15.2:0/3457749641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ab4003d80 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 10 client.17076 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b7de5c620 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1aa57fa640 1 -- 172.21.15.2:0/3457749641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab4036040 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1aa57fa640 1 -- 172.21.15.2:0/3457749641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ab4030070 con 0x564b7e125bd0 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 10 client.17076 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:08.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 10 client.17076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 20 client.17076 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e135300 0x564b7e1376f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 4 client.17076 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.801+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b7e094640 con 0x564b7e135300 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.802+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e135300 0x564b7e1376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.802+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e135300 0x564b7e1376f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc62da39ca423551 server_cookie=2277150ae6311b2f in_seq=0 out_seq=0 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.802+0000 7f1aa57fa640 10 client.17076 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1aa57fa640 1 -- 172.21.15.2:0/3457749641 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b7e094640 con 0x564b7e135300 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1aa57fa640 10 client.17076 handle_command_reply: tid=0 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 client.17076 shutdown 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 msgr2=0x564b7e12b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e12b0d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009960 tx=0x7f1ab4049040 comp rx=0 tx=0).stop 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 shutdown_connections 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e135300 0x564b7e1376f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e12b0d0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e12a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/3457749641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1aa57fa640 0 client.17076 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 >> 172.21.15.2:0/3457749641 conn(0x564b7e11b9b0 msgr2=0x564b7e11abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 shutdown_connections 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/3457749641 wait complete. 2024-09-10T23:29:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.803+0000 7f1ac6dc9740 20 client.17076 trim_cache size 0 max 16384 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 Processor -- start 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 -- start start 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e120860 0x564b7e11fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 0x564b7e120200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e125bd0 0x564b7e125fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1a9e40 con 0x564b7e123190 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1ab980 con 0x564b7e125bd0 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1aa510 con 0x564b7e120860 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 0x564b7e120200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 0x564b7e120200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48612/0 (socket says 172.21.15.2:48612) 2024-09-10T23:29:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 -- 172.21.15.2:0/576230461 learned_addr learned my addr 172.21.15.2:0/576230461 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e125bd0 0x564b7e125fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e120860 0x564b7e11fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 -- 172.21.15.2:0/576230461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e120860 msgr2=0x564b7e11fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e120860 0x564b7e11fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 -- 172.21.15.2:0/576230461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e125bd0 msgr2=0x564b7e125fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e125bd0 0x564b7e125fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac14bf640 1 -- 172.21.15.2:0/576230461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7e129c30 con 0x564b7e123190 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.818+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e120860 0x564b7e11fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.819+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 0x564b7e120200 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x564b7e137e30 tx=0x7f1aac00e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf94486ce24540 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.819+0000 7f1aa77fe640 1 -- 172.21.15.2:0/576230461 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac005650 con 0x564b7e123190 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.819+0000 7f1aa77fe640 1 -- 172.21.15.2:0/576230461 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aac01f030 con 0x564b7e123190 2024-09-10T23:29:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.819+0000 7f1aa77fe640 1 -- 172.21.15.2:0/576230461 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac023630 con 0x564b7e123190 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.819+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/576230461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 msgr2=0x564b7e120200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.819+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 0x564b7e120200 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x564b7e137e30 tx=0x7f1aac00e3a0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/576230461 shutdown_connections 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e125bd0 0x564b7e125fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e123190 0x564b7e120200 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/576230461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e120860 0x564b7e11fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/576230461 >> 172.21.15.2:0/576230461 conn(0x564b7e11b9b0 msgr2=0x564b7e116af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/576230461 shutdown_connections 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/576230461 wait complete. 2024-09-10T23:29:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- start start 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 Processor -- start 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e131840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e130540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e130a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1ab2b0 con 0x564b7e125bd0 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.820+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1aabe0 con 0x564b7e120860 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac6dc9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc1a7e20 con 0x564b7e123190 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac6dc9740 10 client.0 _ll_register_callbacks cb 0x7f1ab403f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e130a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e130a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48616/0 (socket says 172.21.15.2:48616) 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2978328348 learned_addr learned my addr 172.21.15.2:0/2978328348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e131840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e130540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 msgr2=0x564b7e130540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e130540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2978328348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 msgr2=0x564b7e131840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e131840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 -- 172.21.15.2:0/2978328348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7e131190 con 0x564b7e125bd0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac24c1640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e130a80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4031da0 tx=0x7f1ab4049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324720da6e600588 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1aa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1aa57fa640 1 -- 172.21.15.2:0/2978328348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4065040 con 0x564b7e125bd0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1aa57fa640 1 -- 172.21.15.2:0/2978328348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1ab402e070 con 0x564b7e125bd0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aac01f030 con 0x564b7e125bd0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1aa57fa640 1 -- 172.21.15.2:0/2978328348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ab4004820 con 0x564b7e125bd0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.821+0000 7f1ac6dc9740 10 client.17082 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b7e1a20c0 con 0x564b7e125bd0 2024-09-10T23:29:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1aa57fa640 1 -- 172.21.15.2:0/2978328348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aac01f030 con 0x564b7e125bd0 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1aa57fa640 1 -- 172.21.15.2:0/2978328348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ab4069060 con 0x564b7e125bd0 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 10 client.17082 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 10 client.17082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 20 client.17082 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e1a2980 0x564b7e1a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 4 client.17082 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b7e0900f0 con 0x564b7e1a2980 2024-09-10T23:29:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.822+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e1a2980 0x564b7e1a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.823+0000 7f1ac14bf640 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e1a2980 0x564b7e1a4da0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef61b10a3015d94 server_cookie=2e57d551578d10e5 in_seq=0 out_seq=0 2024-09-10T23:29:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.823+0000 7f1aa57fa640 10 client.17082 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1aa57fa640 1 -- 172.21.15.2:0/2978328348 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b7e0900f0 con 0x564b7e1a2980 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1aa57fa640 10 client.17082 handle_command_reply: tid=0 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 client.17082 shutdown 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 msgr2=0x564b7e130a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e130a80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4031da0 tx=0x7f1ab4049040 comp rx=0 tx=0).stop 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 shutdown_connections 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564b7e1a2980 0x564b7e1a4da0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b7e125bd0 0x564b7e130a80 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b7e123190 0x564b7e130540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 --2- 172.21.15.2:0/2978328348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b7e120860 0x564b7e131840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1aa57fa640 0 client.17082 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 >> 172.21.15.2:0/2978328348 conn(0x564b7e11b9b0 msgr2=0x564b7e125fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 shutdown_connections 2024-09-10T23:29:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.838+0000 7f1ac6dc9740 1 -- 172.21.15.2:0/2978328348 wait complete. 2024-09-10T23:29:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac6dc9740 20 client.17082 trim_cache size 0 max 16384 2024-09-10T23:29:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:29:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:29:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:29:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1aa80b5360 msgr2=0x7f1aa80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1aa80b5360 0x7f1aa80b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800d740 tx=0x7f1ab8093040 comp rx=0 tx=0).stop 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 msgr2=0x7f1abc06bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 0x7f1abc06bcc0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800d770 tx=0x7f1ab800dc30 comp rx=0 tx=0).stop 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 shutdown_connections 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1aa80b5360 0x7f1aa80b7820 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc1033c0 0x7f1abc1a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1abc102a00 0x7f1abc19dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 --2- 172.21.15.2:0/700323833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1abc1018b0 0x7f1abc06bcc0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 >> 172.21.15.2:0/700323833 conn(0x7f1abc0fd150 msgr2=0x7f1abc105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 shutdown_connections 2024-09-10T23:29:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:08.839+0000 7f1ac3f24640 1 -- 172.21.15.2:0/700323833 wait complete. 2024-09-10T23:29:08.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:08 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:29:09.213 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:29:09.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:29:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:09.731 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:09 smithi002 ceph-mon[31150]: pgmap v496: 97 pgs: 97 active+clean; 3.6 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:09.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:09 smithi154 ceph-mon[35136]: pgmap v496: 97 pgs: 97 active+clean; 3.6 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:09 smithi177 ceph-mon[35760]: pgmap v496: 97 pgs: 97 active+clean; 3.6 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/2042756576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 msgr2=0x7fd4c810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/2042756576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c810f550 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009ca0 tx=0x7fd4c002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/2042756576 shutdown_connections 2024-09-10T23:29:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/2042756576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c810f550 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/2042756576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 0x7fd4c810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/2042756576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 0x7fd4c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/2042756576 >> 172.21.15.2:0/2042756576 conn(0x7fd4c80fd700 msgr2=0x7fd4c80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/2042756576 shutdown_connections 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.962+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/2042756576 wait complete. 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 Processor -- start 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 -- start start 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 0x7fd4c8199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 0x7fd4c8199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112da0 con 0x7fd4c810d140 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112c20 con 0x7fd4c8104590 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4cdcd1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112f20 con 0x7fd4c8103b90 2024-09-10T23:29:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c819eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48628/0 (socket says 172.21.15.2:48628) 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 -- 172.21.15.2:0/565415783 learned_addr learned my addr 172.21.15.2:0/565415783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c77fe640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 0x7fd4c8199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c6ffd640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 0x7fd4c8199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 -- 172.21.15.2:0/565415783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 msgr2=0x7fd4c8199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 0x7fd4c8199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 -- 172.21.15.2:0/565415783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 msgr2=0x7fd4c8199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 0x7fd4c8199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c7fff640 1 -- 172.21.15.2:0/565415783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c819f2c0 con 0x7fd4c810d140 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c77fe640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 0x7fd4c8199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.963+0000 7fd4c6ffd640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 0x7fd4c8199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.964+0000 7fd4c7fff640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c819eaf0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0031a20 tx=0x7fd4c0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.964+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0003cf0 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.964+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c00044f0 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.964+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c819f550 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.964+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c002fce0 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.964+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c81a5cf0 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.965+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c8103f70 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.966+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd4c0004040 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.967+0000 7fd4c4ff9640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4b00b5360 0x7fd4b00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.967+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd4c0107200 con 0x7fd4c810d140 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.967+0000 7fd4c77fe640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4b00b5360 0x7fd4b00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.968+0000 7fd4c77fe640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4b00b5360 0x7fd4b00b7820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800baa0 tx=0x7fd4b8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:09.970+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4c00ce070 con 0x7fd4c810d140 2024-09-10T23:29:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.193+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4c819a340 con 0x7fd4c810d140 2024-09-10T23:29:10.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.194+0000 7fd4c4ff9640 1 -- 172.21.15.2:0/565415783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fd4c819a340 con 0x7fd4c810d140 2024-09-10T23:29:10.195 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:29:10.195 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:29:10.195 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4b00b5360 msgr2=0x7fd4b00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4b00b5360 0x7fd4b00b7820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800baa0 tx=0x7fd4b8005d90 comp rx=0 tx=0).stop 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 msgr2=0x7fd4c819eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c819eaf0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0031a20 tx=0x7fd4c0031a50 comp rx=0 tx=0).stop 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 shutdown_connections 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4b00b5360 0x7fd4b00b7820 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c810d140 0x7fd4c819eaf0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c8104590 0x7fd4c8199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 --2- 172.21.15.2:0/565415783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c8103b90 0x7fd4c8199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 >> 172.21.15.2:0/565415783 conn(0x7fd4c80fd700 msgr2=0x7fd4c80fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:10.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 shutdown_connections 2024-09-10T23:29:10.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:10.196+0000 7fd4cdcd1640 1 -- 172.21.15.2:0/565415783 wait complete. 2024-09-10T23:29:10.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/565415783' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:10.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/565415783' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:10.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:29:10.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/565415783' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:11.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:11 smithi002 ceph-mon[31150]: pgmap v497: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 -- 172.21.15.2:0/2476061510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c1087d0 msgr2=0x7f038c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 --2- 172.21.15.2:0/2476061510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c1087d0 0x7f038c108c10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0380009900 tx=0x7f038002a410 comp rx=0 tx=0).stop 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 -- 172.21.15.2:0/2476061510 shutdown_connections 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 --2- 172.21.15.2:0/2476061510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c109150 0x7f038c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 --2- 172.21.15.2:0/2476061510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c1087d0 0x7f038c108c10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 --2- 172.21.15.2:0/2476061510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038c102dc0 0x7f038c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 -- 172.21.15.2:0/2476061510 >> 172.21.15.2:0/2476061510 conn(0x7f038c0fe830 msgr2=0x7f038c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 -- 172.21.15.2:0/2476061510 shutdown_connections 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.639+0000 7f0391d65640 1 -- 172.21.15.2:0/2476061510 wait complete. 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 Processor -- start 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 -- start start 2024-09-10T23:29:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038c102dc0 0x7f038c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c1087d0 0x7f038c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 0x7f038c19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f038c112e10 con 0x7f038c109150 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f038c112c90 con 0x7f038c1087d0 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.640+0000 7f0391d65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f038c112f90 con 0x7f038c102dc0 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 0x7f038c19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 0x7f038c19eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54202/0 (socket says 172.21.15.2:54202) 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 -- 172.21.15.2:0/987404345 learned_addr learned my addr 172.21.15.2:0/987404345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038b7fe640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038c102dc0 0x7f038c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038affd640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c1087d0 0x7f038c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 -- 172.21.15.2:0/987404345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038c102dc0 msgr2=0x7f038c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038c102dc0 0x7f038c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 -- 172.21.15.2:0/987404345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c1087d0 msgr2=0x7f038c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c1087d0 0x7f038c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 -- 172.21.15.2:0/987404345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c19f370 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038affd640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c1087d0 0x7f038c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f038bfff640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 0x7f038c19eba0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f038400d750 tx=0x7f038400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f0388ff9640 1 -- 172.21.15.2:0/987404345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384017070 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f0388ff9640 1 -- 172.21.15.2:0/987404345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03840054d0 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c19f660 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f0388ff9640 1 -- 172.21.15.2:0/987404345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384004c60 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.641+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c1a5d20 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 Processor -- start 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f0388ff9640 1 -- 172.21.15.2:0/987404345 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0384004e00 con 0x7f038c109150 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 -- start start 2024-09-10T23:29:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a2904d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a29c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a29ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56215a206ea0 con 0x56215a290a10 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56215a1f62d0 con 0x56215a29c9a0 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f039413a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56215a1fa0e0 con 0x56215a2900f0 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a29c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a29c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54206/0 (socket says 172.21.15.2:54206) 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 -- 172.21.15.2:0/3992731819 learned_addr learned my addr 172.21.15.2:0/3992731819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038affd640 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a29ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 -- 172.21.15.2:0/3992731819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 msgr2=0x56215a2904d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a2904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 -- 172.21.15.2:0/3992731819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 msgr2=0x56215a29ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a29ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038b7fe640 1 -- 172.21.15.2:0/3992731819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562159f54650 con 0x56215a290a10 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.645+0000 7f038affd640 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a29ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f0388ff9640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f03740b52e0 0x7f03740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a29c460 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f037c0039f0 tx=0x7f037c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945a74732bbee5f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f038affd640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f03740b52e0 0x7f03740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f0388ff9640 1 -- 172.21.15.2:0/987404345 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f03840e55e0 con 0x7f038c109150 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f0371ffb640 1 -- 172.21.15.2:0/3992731819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c004b20 con 0x56215a290a10 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f0371ffb640 1 -- 172.21.15.2:0/3992731819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037c004cc0 con 0x56215a290a10 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.646+0000 7f0371ffb640 1 -- 172.21.15.2:0/3992731819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0126b0 con 0x56215a290a10 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 -- 172.21.15.2:0/3992731819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 msgr2=0x56215a29c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f038affd640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f03740b52e0 0x7f03740b77a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0380031440 tx=0x7f0380005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a29c460 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f037c0039f0 tx=0x7f037c003eb0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 -- 172.21.15.2:0/3992731819 shutdown_connections 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a29ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a29c460 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 --2- 172.21.15.2:0/3992731819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a2904d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 -- 172.21.15.2:0/3992731819 >> 172.21.15.2:0/3992731819 conn(0x56215a28df20 msgr2=0x56215a28f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 -- 172.21.15.2:0/3992731819 shutdown_connections 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 -- 172.21.15.2:0/3992731819 wait complete. 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 -- start start 2024-09-10T23:29:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 Processor -- start 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 0x56215a29c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.647+0000 7f039413a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a290a10 0x56215a299660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f039413a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a299be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f039413a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56215a057700 con 0x56215a2900f0 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f039413a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56215a191160 con 0x56215a29c9a0 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f039413a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56215a29f620 con 0x56215a290a10 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f039413a740 10 client.0 _ll_register_callbacks cb 0x56215a1aa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 0x56215a29c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 0x56215a29c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54218/0 (socket says 172.21.15.2:54218) 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 -- 172.21.15.2:0/477165598 learned_addr learned my addr 172.21.15.2:0/477165598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038affd640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a290a10 0x56215a299660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038bfff640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a299be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 -- 172.21.15.2:0/477165598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a290a10 msgr2=0x56215a299660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a290a10 0x56215a299660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 -- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 msgr2=0x56215a299be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a299be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 -- 172.21.15.2:0/477165598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56215a1bec90 con 0x56215a2900f0 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038bfff640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a299be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f038b7fe640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 0x56215a29c210 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f037c009dd0 tx=0x7f037c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18e73b65866eba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f036affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f036affd640 1 -- 172.21.15.2:0/477165598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c005280 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f036affd640 1 -- 172.21.15.2:0/477165598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f037c005420 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f037c004cc0 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.648+0000 7f036affd640 1 -- 172.21.15.2:0/477165598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f037c005620 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 10 client.17100 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56215a2aae40 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f036affd640 1 -- 172.21.15.2:0/477165598 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037c004cc0 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f036affd640 1 -- 172.21.15.2:0/477165598 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f037c00f040 con 0x56215a2900f0 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 10 client.17100 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 10 client.17100 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 20 client.17100 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a2ac1f0 0x56215a2ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 4 client.17100 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56215a208df0 con 0x56215a2ac1f0 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.649+0000 7f038affd640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a2ac1f0 0x56215a2ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.650+0000 7f036affd640 10 client.17100 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.650+0000 7f038affd640 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a2ac1f0 0x56215a2ae5e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=717567dbe0175638 server_cookie=c40de74bc963965 in_seq=0 out_seq=0 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.650+0000 7f036affd640 1 -- 172.21.15.2:0/477165598 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56215a208df0 con 0x56215a2ac1f0 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.650+0000 7f036affd640 10 client.17100 handle_command_reply: tid=0 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.650+0000 7f039413a740 1 client.17100 shutdown 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 msgr2=0x56215a29c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 0x56215a29c210 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f037c009dd0 tx=0x7f037c004740 comp rx=0 tx=0).stop 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 shutdown_connections 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a2ac1f0 0x56215a2ae5e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a29c9a0 0x56215a299be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a290a10 0x56215a299660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 --2- 172.21.15.2:0/477165598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a2900f0 0x56215a29c210 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 >> 172.21.15.2:0/477165598 conn(0x56215a28df20 msgr2=0x56215a293ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f036affd640 0 client.17100 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 shutdown_connections 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 1 -- 172.21.15.2:0/477165598 wait complete. 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.651+0000 7f039413a740 20 client.17100 trim_cache size 0 max 16384 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 Processor -- start 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 -- start start 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a28d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a290a10 0x56215a29b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 0x56215a296870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1ae410 con 0x56215a29c9a0 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1aff50 con 0x56215a290a10 2024-09-10T23:29:11.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f039413a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1aeae0 con 0x56215a2900f0 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f038bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 0x56215a296870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f038bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 0x56215a296870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54234/0 (socket says 172.21.15.2:54234) 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.664+0000 7f038bfff640 1 -- 172.21.15.2:0/4093028801 learned_addr learned my addr 172.21.15.2:0/4093028801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038b7fe640 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a28d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038affd640 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a290a10 0x56215a29b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038bfff640 1 -- 172.21.15.2:0/4093028801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 msgr2=0x56215a28d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038bfff640 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a28d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038bfff640 1 -- 172.21.15.2:0/4093028801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a290a10 msgr2=0x56215a29b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038bfff640 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a290a10 0x56215a29b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038bfff640 1 -- 172.21.15.2:0/4093028801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56215a28e9a0 con 0x56215a29c9a0 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038b7fe640 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a28d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f038bfff640 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 0x56215a296870 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f03840abd40 tx=0x7f03840ab8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2859ee99af4c404 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f03717fa640 1 -- 172.21.15.2:0/4093028801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384020040 con 0x56215a29c9a0 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f03717fa640 1 -- 172.21.15.2:0/4093028801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03840af020 con 0x56215a29c9a0 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.665+0000 7f03717fa640 1 -- 172.21.15.2:0/4093028801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384009d30 con 0x56215a29c9a0 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 -- 172.21.15.2:0/4093028801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 msgr2=0x56215a296870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 0x56215a296870 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f03840abd40 tx=0x7f03840ab8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 -- 172.21.15.2:0/4093028801 shutdown_connections 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a29c9a0 0x56215a296870 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a290a10 0x56215a29b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 --2- 172.21.15.2:0/4093028801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a2900f0 0x56215a28d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 -- 172.21.15.2:0/4093028801 >> 172.21.15.2:0/4093028801 conn(0x56215a28df20 msgr2=0x56215a28f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 -- 172.21.15.2:0/4093028801 shutdown_connections 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 -- 172.21.15.2:0/4093028801 wait complete. 2024-09-10T23:29:11.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 -- start start 2024-09-10T23:29:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.666+0000 7f039413a740 1 Processor -- start 2024-09-10T23:29:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a2900f0 0x56215a2a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a2a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a29c9a0 0x56215a317fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1af880 con 0x56215a290a10 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1af1b0 con 0x56215a2900f0 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1ac3f0 con 0x56215a29c9a0 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f039413a740 10 client.0 _ll_register_callbacks cb 0x7f037c009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a2a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a2a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54244/0 (socket says 172.21.15.2:54244) 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 -- 172.21.15.2:0/3530287640 learned_addr learned my addr 172.21.15.2:0/3530287640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a2900f0 0x56215a2a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038bfff640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a29c9a0 0x56215a317fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 -- 172.21.15.2:0/3530287640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a29c9a0 msgr2=0x56215a317fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a29c9a0 0x56215a317fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 -- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a2900f0 msgr2=0x56215a2a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a2900f0 0x56215a2a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 -- 172.21.15.2:0/3530287640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56215a318500 con 0x56215a290a10 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a2900f0 0x56215a2a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f038affd640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a2a12c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f038002a930 tx=0x7f0380005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93247ef235ad2d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.667+0000 7f036affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f036affd640 1 -- 172.21.15.2:0/3530287640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380035040 con 0x56215a290a10 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f036affd640 1 -- 172.21.15.2:0/3530287640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0380004240 con 0x56215a290a10 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03840af020 con 0x56215a290a10 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f036affd640 1 -- 172.21.15.2:0/3530287640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0380004460 con 0x56215a290a10 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 10 client.17106 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56215a319800 con 0x56215a290a10 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f036affd640 1 -- 172.21.15.2:0/3530287640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03840af020 con 0x56215a290a10 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f036affd640 1 -- 172.21.15.2:0/3530287640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0380004b90 con 0x56215a290a10 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 10 client.17106 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 10 client.17106 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 20 client.17106 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a319f50 0x56215a31c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 4 client.17106 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.668+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56215a2048a0 con 0x56215a319f50 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a319f50 0x56215a31c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f038b7fe640 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a319f50 0x56215a31c370 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=346f53581fd4d885 server_cookie=2758694d9d71c48f in_seq=0 out_seq=0 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f036affd640 10 client.17106 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f036affd640 1 -- 172.21.15.2:0/3530287640 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56215a2048a0 con 0x56215a319f50 2024-09-10T23:29:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f036affd640 10 client.17106 handle_command_reply: tid=0 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 client.17106 shutdown 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 msgr2=0x56215a2a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a2a12c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f038002a930 tx=0x7f0380005a20 comp rx=0 tx=0).stop 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 shutdown_connections 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x56215a319f50 0x56215a31c370 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f036affd640 0 client.17106 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56215a29c9a0 0x56215a317fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56215a290a10 0x56215a2a12c0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 --2- 172.21.15.2:0/3530287640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215a2900f0 0x56215a2a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.669+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 >> 172.21.15.2:0/3530287640 conn(0x56215a28df20 msgr2=0x56215a29b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 shutdown_connections 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f039413a740 1 -- 172.21.15.2:0/3530287640 wait complete. 2024-09-10T23:29:11.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f039413a740 20 client.17106 trim_cache size 0 max 16384 2024-09-10T23:29:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f03740b52e0 msgr2=0x7f03740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f03740b52e0 0x7f03740b77a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0380031440 tx=0x7f0380005b50 comp rx=0 tx=0).stop 2024-09-10T23:29:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 msgr2=0x7f038c19eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 0x7f038c19eba0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f038400d750 tx=0x7f038400dc10 comp rx=0 tx=0).stop 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 shutdown_connections 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f03740b52e0 0x7f03740b77a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f038c109150 0x7f038c19eba0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f038c1087d0 0x7f038c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 --2- 172.21.15.2:0/987404345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f038c102dc0 0x7f038c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 >> 172.21.15.2:0/987404345 conn(0x7f038c0fe830 msgr2=0x7f038c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 shutdown_connections 2024-09-10T23:29:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:11.670+0000 7f0391d65640 1 -- 172.21.15.2:0/987404345 wait complete. 2024-09-10T23:29:11.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:11 smithi154 ceph-mon[35136]: pgmap v497: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:11 smithi177 ceph-mon[35760]: pgmap v497: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:12.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:29:12.752 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 -- 172.21.15.2:0/3295176498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 msgr2=0x7faa2010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 --2- 172.21.15.2:0/3295176498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa2010e820 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7faa10009ca0 tx=0x7faa1002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 -- 172.21.15.2:0/3295176498 shutdown_connections 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 --2- 172.21.15.2:0/3295176498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa2010e820 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 --2- 172.21.15.2:0/3295176498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa201076a0 0x7faa20107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 --2- 172.21.15.2:0/3295176498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa20101c90 0x7faa20102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 -- 172.21.15.2:0/3295176498 >> 172.21.15.2:0/3295176498 conn(0x7faa200fd700 msgr2=0x7faa200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 -- 172.21.15.2:0/3295176498 shutdown_connections 2024-09-10T23:29:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 -- 172.21.15.2:0/3295176498 wait complete. 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 Processor -- start 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.242+0000 7faa270e4640 1 -- start start 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa270e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa20101c90 0x7faa200fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa270e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa201076a0 0x7faa200fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa270e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa200fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa270e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa20111ce0 con 0x7faa20108020 2024-09-10T23:29:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa270e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa20111b60 con 0x7faa201076a0 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa270e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa20111e60 con 0x7faa20101c90 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa200fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa200fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54262/0 (socket says 172.21.15.2:54262) 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 -- 172.21.15.2:0/941392363 learned_addr learned my addr 172.21.15.2:0/941392363 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa24e80640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa20101c90 0x7faa200fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa1ffff640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa201076a0 0x7faa200fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 -- 172.21.15.2:0/941392363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa20101c90 msgr2=0x7faa200fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa20101c90 0x7faa200fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 -- 172.21.15.2:0/941392363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa201076a0 msgr2=0x7faa200fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa201076a0 0x7faa200fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 -- 172.21.15.2:0/941392363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa201a7710 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa25681640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa200fe680 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7faa10005cc0 tx=0x7faa1002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.243+0000 7faa1dffb640 1 -- 172.21.15.2:0/941392363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10003bf0 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.244+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa201a79a0 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.244+0000 7faa1dffb640 1 -- 172.21.15.2:0/941392363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa10003d90 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.244+0000 7faa1dffb640 1 -- 172.21.15.2:0/941392363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1002fbc0 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.244+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a7ee0 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa1dffb640 1 -- 172.21.15.2:0/941392363 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faa10004610 con 0x7faa20108020 2024-09-10T23:29:13.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 Processor -- start 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 -- start start 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a37554d0 0x5643a37558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a3761840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a3764170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643a36cbea0 con 0x5643a3761d80 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5643a36bb2d0 con 0x5643a37554d0 2024-09-10T23:29:13.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.246+0000 7faa294b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5643a36bf0e0 con 0x5643a3755df0 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a3764170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a3764170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54274/0 (socket says 172.21.15.2:54274) 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 -- 172.21.15.2:0/3643396831 learned_addr learned my addr 172.21.15.2:0/3643396831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa24e80640 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a3761840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a37554d0 0x5643a37558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 -- 172.21.15.2:0/3643396831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 msgr2=0x5643a3761840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a3761840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 -- 172.21.15.2:0/3643396831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a37554d0 msgr2=0x5643a37558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a37554d0 0x5643a37558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 -- 172.21.15.2:0/3643396831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a3419650 con 0x5643a3761d80 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1ffff640 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a3764170 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7faa0800cf90 tx=0x7faa0800c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11326b3fc57513cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa1dffb640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa0c0b52e0 0x7faa0c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa16ffd640 1 -- 172.21.15.2:0/3643396831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08019030 con 0x5643a3761d80 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa16ffd640 1 -- 172.21.15.2:0/3643396831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa080119d0 con 0x5643a3761d80 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.247+0000 7faa16ffd640 1 -- 172.21.15.2:0/3643396831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0800fa70 con 0x5643a3761d80 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa24e80640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa0c0b52e0 0x7faa0c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa1dffb640 1 -- 172.21.15.2:0/941392363 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa101070c0 con 0x7faa20108020 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa24e80640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa0c0b52e0 0x7faa0c0b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x5643a37541e0 tx=0x7faa1800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 -- 172.21.15.2:0/3643396831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 msgr2=0x5643a3764170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a3764170 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7faa0800cf90 tx=0x7faa0800c630 comp rx=0 tx=0).stop 2024-09-10T23:29:13.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 -- 172.21.15.2:0/3643396831 shutdown_connections 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a3764170 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a3761840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 --2- 172.21.15.2:0/3643396831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a37554d0 0x5643a37558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 -- 172.21.15.2:0/3643396831 >> 172.21.15.2:0/3643396831 conn(0x5643a3753300 msgr2=0x5643a37544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 -- 172.21.15.2:0/3643396831 shutdown_connections 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.248+0000 7faa294b9740 1 -- 172.21.15.2:0/3643396831 wait complete. 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 -- start start 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 Processor -- start 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a3761710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3755df0 0x5643a375eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a375f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643a351c700 con 0x5643a3761d80 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5643a3656160 con 0x5643a3755df0 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5643a3764a00 con 0x5643a37554d0 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa294b9740 10 client.0 _ll_register_callbacks cb 0x5643a366f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa25681640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a375f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa25681640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a375f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54282/0 (socket says 172.21.15.2:54282) 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa25681640 1 -- 172.21.15.2:0/2229170051 learned_addr learned my addr 172.21.15.2:0/2229170051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa24e80640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a3761710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.249+0000 7faa1ffff640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3755df0 0x5643a375eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa25681640 1 -- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 msgr2=0x5643a3761710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa25681640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a3761710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa25681640 1 -- 172.21.15.2:0/2229170051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3755df0 msgr2=0x5643a375eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa25681640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3755df0 0x5643a375eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa25681640 1 -- 172.21.15.2:0/2229170051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a3683c90 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa1ffff640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3755df0 0x5643a375eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa25681640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a375f230 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7faa100cd820 tx=0x7faa100cd0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49afd7dbc84b0a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7fa9fffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7fa9fffff640 1 -- 172.21.15.2:0/2229170051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100cd890 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7fa9fffff640 1 -- 172.21.15.2:0/2229170051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa100d6990 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa080119d0 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7fa9fffff640 1 -- 172.21.15.2:0/2229170051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa100d2370 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa294b9740 10 client.17118 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643a3770400 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.250+0000 7fa9fffff640 1 -- 172.21.15.2:0/2229170051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa080119d0 con 0x5643a3761d80 2024-09-10T23:29:13.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7fa9fffff640 1 -- 172.21.15.2:0/2229170051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa100cebc0 con 0x5643a3761d80 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa294b9740 10 client.17118 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa294b9740 10 client.17118 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa294b9740 20 client.17118 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa294b9740 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a3771900 0x5643a3773d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa294b9740 4 client.17118 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643a36cddf0 con 0x5643a3771900 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa24e80640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a3771900 0x5643a3773d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7fa9fffff640 10 client.17118 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.251+0000 7faa24e80640 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a3771900 0x5643a3773d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1ba86ea82f50943b server_cookie=8f50326b76fdf41f in_seq=0 out_seq=0 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7fa9fffff640 1 -- 172.21.15.2:0/2229170051 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643a36cddf0 con 0x5643a3771900 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7fa9fffff640 10 client.17118 handle_command_reply: tid=0 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 client.17118 shutdown 2024-09-10T23:29:13.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 msgr2=0x5643a375f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a375f230 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7faa100cd820 tx=0x7faa100cd0c0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 shutdown_connections 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a3771900 0x5643a3773d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3761d80 0x5643a375f230 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3755df0 0x5643a375eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7fa9fffff640 0 client.17118 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 --2- 172.21.15.2:0/2229170051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a3761710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 >> 172.21.15.2:0/2229170051 conn(0x5643a3753300 msgr2=0x5643a3758e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 shutdown_connections 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 1 -- 172.21.15.2:0/2229170051 wait complete. 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.252+0000 7faa294b9740 20 client.17118 trim_cache size 0 max 16384 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 Processor -- start 2024-09-10T23:29:13.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 -- start start 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a376dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 0x5643a37608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3763170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa201b04d0 con 0x5643a3755df0 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa201b2010 con 0x5643a3761d80 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa294b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa201b0ba0 con 0x5643a37554d0 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 0x5643a37608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 0x5643a37608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54294/0 (socket says 172.21.15.2:54294) 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 -- 172.21.15.2:0/647928260 learned_addr learned my addr 172.21.15.2:0/647928260 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa24e80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a376dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 -- 172.21.15.2:0/647928260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 msgr2=0x5643a376dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a376dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 -- 172.21.15.2:0/647928260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 msgr2=0x5643a3763170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3763170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.266+0000 7faa1ffff640 1 -- 172.21.15.2:0/647928260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a3755c20 con 0x5643a3755df0 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.267+0000 7faa1ffff640 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 0x5643a37608a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7faa08005cc0 tx=0x7faa08005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2ad41618ea9aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.267+0000 7faa167fc640 1 -- 172.21.15.2:0/647928260 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08019040 con 0x5643a3755df0 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.267+0000 7faa167fc640 1 -- 172.21.15.2:0/647928260 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa080054f0 con 0x5643a3755df0 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.267+0000 7faa167fc640 1 -- 172.21.15.2:0/647928260 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0800f6c0 con 0x5643a3755df0 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.267+0000 7faa294b9740 1 -- 172.21.15.2:0/647928260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 msgr2=0x5643a37608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.267+0000 7faa294b9740 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 0x5643a37608a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7faa08005cc0 tx=0x7faa08005e70 comp rx=0 tx=0).stop 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- 172.21.15.2:0/647928260 shutdown_connections 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3763170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a3755df0 0x5643a37608a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 --2- 172.21.15.2:0/647928260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a37554d0 0x5643a376dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- 172.21.15.2:0/647928260 >> 172.21.15.2:0/647928260 conn(0x5643a3753300 msgr2=0x5643a3760190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- 172.21.15.2:0/647928260 shutdown_connections 2024-09-10T23:29:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- 172.21.15.2:0/647928260 wait complete. 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- start start 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 Processor -- start 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 0x5643a3769cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a376a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3764c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa201b1940 con 0x5643a37554d0 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa201b1270 con 0x5643a3761d80 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.268+0000 7faa294b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa201ae4b0 con 0x5643a3755df0 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa294b9740 10 client.0 _ll_register_callbacks cb 0x7faa10005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 0x5643a3769cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 0x5643a3769cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54302/0 (socket says 172.21.15.2:54302) 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 -- 172.21.15.2:0/312150967 learned_addr learned my addr 172.21.15.2:0/312150967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa1ffff640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a376a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa25681640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3764c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 -- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 msgr2=0x5643a376a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a376a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 -- 172.21.15.2:0/312150967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 msgr2=0x5643a3764c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3764c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 -- 172.21.15.2:0/312150967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a37651c0 con 0x5643a37554d0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa24e80640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 0x5643a3769cd0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7faa1800b010 tx=0x7faa18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9ab3864e991abe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7fa9fffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7fa9fffff640 1 -- 172.21.15.2:0/312150967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1801bd60 con 0x5643a37554d0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7fa9fffff640 1 -- 172.21.15.2:0/312150967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faa18029430 con 0x5643a37554d0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.269+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa080054f0 con 0x5643a37554d0 2024-09-10T23:29:13.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7fa9fffff640 1 -- 172.21.15.2:0/312150967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa18029630 con 0x5643a37554d0 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 10 client.17124 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643a37df000 con 0x5643a37554d0 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7fa9fffff640 1 -- 172.21.15.2:0/312150967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa080054f0 con 0x5643a37554d0 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7fa9fffff640 1 -- 172.21.15.2:0/312150967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa180378f0 con 0x5643a37554d0 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 10 client.17124 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 10 client.17124 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 20 client.17124 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a37df7b0 0x5643a37e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 4 client.17124 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643a36c98a0 con 0x5643a37df7b0 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.270+0000 7faa1ffff640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a37df7b0 0x5643a37e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7fa9fffff640 10 client.17124 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:13.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa1ffff640 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a37df7b0 0x5643a37e1bd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a74910af3eab185e server_cookie=3680201851768bc9 in_seq=0 out_seq=0 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7fa9fffff640 1 -- 172.21.15.2:0/312150967 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7faa0802d020 con 0x5643a37df7b0 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7fa9fffff640 10 client.17124 handle_command_reply: tid=0 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 client.17124 shutdown 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 msgr2=0x5643a3769cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 0x5643a3769cd0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7faa1800b010 tx=0x7faa18015000 comp rx=0 tx=0).stop 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 shutdown_connections 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x5643a37df7b0 0x5643a37e1bd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7fa9fffff640 0 client.17124 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643a3761d80 0x5643a3764c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643a3755df0 0x5643a376a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 --2- 172.21.15.2:0/312150967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a37554d0 0x5643a3769cd0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 >> 172.21.15.2:0/312150967 conn(0x5643a3753300 msgr2=0x5643a37609b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 shutdown_connections 2024-09-10T23:29:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 1 -- 172.21.15.2:0/312150967 wait complete. 2024-09-10T23:29:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.271+0000 7faa294b9740 20 client.17124 trim_cache size 0 max 16384 2024-09-10T23:29:13.291 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa0c0b52e0 msgr2=0x7faa0c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa0c0b52e0 0x7faa0c0b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x5643a37541e0 tx=0x7faa1800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 msgr2=0x7faa200fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa200fe680 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7faa10005cc0 tx=0x7faa1002f380 comp rx=0 tx=0).stop 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 shutdown_connections 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa0c0b52e0 0x7faa0c0b77a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20108020 0x7faa200fe680 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa201076a0 0x7faa200fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 --2- 172.21.15.2:0/941392363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa20101c90 0x7faa200fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 >> 172.21.15.2:0/941392363 conn(0x7faa200fd700 msgr2=0x7faa2006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 shutdown_connections 2024-09-10T23:29:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:13.272+0000 7faa270e4640 1 -- 172.21.15.2:0/941392363 wait complete. 2024-09-10T23:29:13.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:13 smithi002 ceph-mon[31150]: pgmap v498: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:29:13.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:13 smithi177 ceph-mon[35760]: pgmap v498: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:29:13.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:13 smithi154 ceph-mon[35136]: pgmap v498: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:29:13.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:29:14.250 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:14.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 -- 172.21.15.2:0/3983339169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a8101cd0 msgr2=0x7f24a81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 --2- 172.21.15.2:0/3983339169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a8101cd0 0x7f24a81020b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009900 tx=0x7f24a402a410 comp rx=0 tx=0).stop 2024-09-10T23:29:14.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 -- 172.21.15.2:0/3983339169 shutdown_connections 2024-09-10T23:29:14.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 --2- 172.21.15.2:0/3983339169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24a8108060 0x7f24a810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 --2- 172.21.15.2:0/3983339169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a81076e0 0x7f24a8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 --2- 172.21.15.2:0/3983339169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a8101cd0 0x7f24a81020b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 -- 172.21.15.2:0/3983339169 >> 172.21.15.2:0/3983339169 conn(0x7f24a80fd700 msgr2=0x7f24a80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 -- 172.21.15.2:0/3983339169 shutdown_connections 2024-09-10T23:29:14.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.745+0000 7f24af7df640 1 -- 172.21.15.2:0/3983339169 wait complete. 2024-09-10T23:29:14.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 Processor -- start 2024-09-10T23:29:14.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 -- start start 2024-09-10T23:29:14.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24a8101cd0 0x7f24a80fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 0x7f24a80fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a8108060 0x7f24a80fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8111d20 con 0x7f24a81076e0 2024-09-10T23:29:14.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8111ba0 con 0x7f24a8108060 2024-09-10T23:29:14.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24af7df640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8111ea0 con 0x7f24a8101cd0 2024-09-10T23:29:14.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 0x7f24a80fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 0x7f24a80fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54308/0 (socket says 172.21.15.2:54308) 2024-09-10T23:29:14.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 -- 172.21.15.2:0/2013319497 learned_addr learned my addr 172.21.15.2:0/2013319497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:14.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24ad57b640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24a8101cd0 0x7f24a80fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24add7c640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a8108060 0x7f24a80fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 -- 172.21.15.2:0/2013319497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24a8101cd0 msgr2=0x7f24a80fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24a8101cd0 0x7f24a80fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 -- 172.21.15.2:0/2013319497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a8108060 msgr2=0x7f24a80fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a8108060 0x7f24a80fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.746+0000 7f24acd7a640 1 -- 172.21.15.2:0/2013319497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a81a76a0 con 0x7f24a81076e0 2024-09-10T23:29:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.747+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 0x7f24a80fe140 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f249800d950 tx=0x7f249800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.747+0000 7f249e7fc640 1 -- 172.21.15.2:0/2013319497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498017070 con 0x7f24a81076e0 2024-09-10T23:29:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.747+0000 7f249e7fc640 1 -- 172.21.15.2:0/2013319497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2498009c30 con 0x7f24a81076e0 2024-09-10T23:29:14.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.747+0000 7f249e7fc640 1 -- 172.21.15.2:0/2013319497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249800f620 con 0x7f24a81076e0 2024-09-10T23:29:14.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.747+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a81a7990 con 0x7f24a81076e0 2024-09-10T23:29:14.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.747+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a81a7e80 con 0x7f24a81076e0 2024-09-10T23:29:14.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 Processor -- start 2024-09-10T23:29:14.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 -- start start 2024-09-10T23:29:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f249e7fc640 1 -- 172.21.15.2:0/2013319497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2498010460 con 0x7f24a81076e0 2024-09-10T23:29:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf764d0 0x56446bf768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 0x56446bf82840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf85170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56446beecea0 con 0x56446bf76df0 2024-09-10T23:29:14.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56446bedc2d0 con 0x56446bf82d80 2024-09-10T23:29:14.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56446bee00e0 con 0x56446bf764d0 2024-09-10T23:29:14.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24ad57b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 0x56446bf82840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24ad57b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 0x56446bf82840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54322/0 (socket says 172.21.15.2:54322) 2024-09-10T23:29:14.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24ad57b640 1 -- 172.21.15.2:0/289044510 learned_addr learned my addr 172.21.15.2:0/289044510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:14.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.750+0000 7f24add7c640 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf764d0 0x56446bf768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24acd7a640 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf85170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24ad57b640 1 -- 172.21.15.2:0/289044510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf764d0 msgr2=0x56446bf768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24ad57b640 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf764d0 0x56446bf768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24ad57b640 1 -- 172.21.15.2:0/289044510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 msgr2=0x56446bf85170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24ad57b640 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf85170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24ad57b640 1 -- 172.21.15.2:0/289044510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446bc3a650 con 0x56446bf76df0 2024-09-10T23:29:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24acd7a640 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf85170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24ad57b640 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 0x56446bf82840 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009900 tx=0x7f24a4032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828fb5ec47a4abaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f249e7fc640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24940b5360 0x7f24940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24add7c640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24940b5360 0x7f24940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24937fe640 1 -- 172.21.15.2:0/289044510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4040070 con 0x56446bf76df0 2024-09-10T23:29:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24937fe640 1 -- 172.21.15.2:0/289044510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a4004030 con 0x56446bf76df0 2024-09-10T23:29:14.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f24937fe640 1 -- 172.21.15.2:0/289044510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4035040 con 0x56446bf76df0 2024-09-10T23:29:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.751+0000 7f249e7fc640 1 -- 172.21.15.2:0/2013319497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24980e5710 con 0x7f24a81076e0 2024-09-10T23:29:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 -- 172.21.15.2:0/289044510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 msgr2=0x56446bf82840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24add7c640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24940b5360 0x7f24940b7820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f24a80ffcc0 tx=0x7f24a0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 0x56446bf82840 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009900 tx=0x7f24a4032bd0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 -- 172.21.15.2:0/289044510 shutdown_connections 2024-09-10T23:29:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf85170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf76df0 0x56446bf82840 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/289044510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf764d0 0x56446bf768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 -- 172.21.15.2:0/289044510 >> 172.21.15.2:0/289044510 conn(0x56446bf74300 msgr2=0x56446bf754a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 -- 172.21.15.2:0/289044510 shutdown_connections 2024-09-10T23:29:14.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 -- 172.21.15.2:0/289044510 wait complete. 2024-09-10T23:29:14.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.752+0000 7f24b1bb4740 1 -- start start 2024-09-10T23:29:14.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 Processor -- start 2024-09-10T23:29:14.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf82590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf7ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56446bd3d700 con 0x56446bf764d0 2024-09-10T23:29:14.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56446be77160 con 0x56446bf82d80 2024-09-10T23:29:14.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56446bf859a0 con 0x56446bf76df0 2024-09-10T23:29:14.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24b1bb4740 10 client.0 _ll_register_callbacks cb 0x56446be909e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:14.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf82590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf82590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54326/0 (socket says 172.21.15.2:54326) 2024-09-10T23:29:14.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 -- 172.21.15.2:0/3045170334 learned_addr learned my addr 172.21.15.2:0/3045170334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:14.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24acd7a640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24add7c640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf7ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 -- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 msgr2=0x56446bf7f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 -- 172.21.15.2:0/3045170334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 msgr2=0x56446bf7ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf7ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.753+0000 7f24ad57b640 1 -- 172.21.15.2:0/3045170334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446bea4c90 con 0x56446bf764d0 2024-09-10T23:29:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24ad57b640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf82590 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f24a4006010 tx=0x7f24a4005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64db9ca808a6f043 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f2490ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f2490ff9640 1 -- 172.21.15.2:0/3045170334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4035070 con 0x56446bf764d0 2024-09-10T23:29:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f2490ff9640 1 -- 172.21.15.2:0/3045170334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24a4005320 con 0x56446bf764d0 2024-09-10T23:29:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a4004030 con 0x56446bf764d0 2024-09-10T23:29:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f2490ff9640 1 -- 172.21.15.2:0/3045170334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a4040040 con 0x56446bf764d0 2024-09-10T23:29:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 10 client.17136 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56446bf911c0 con 0x56446bf764d0 2024-09-10T23:29:14.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f2490ff9640 1 -- 172.21.15.2:0/3045170334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a4004030 con 0x56446bf764d0 2024-09-10T23:29:14.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f2490ff9640 1 -- 172.21.15.2:0/3045170334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24a4004c70 con 0x56446bf764d0 2024-09-10T23:29:14.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 10 client.17136 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:14.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 10 client.17136 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:29:14.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 20 client.17136 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:14.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446bf92510 0x56446bf94900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 4 client.17136 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:14.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.754+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56446beeedf0 con 0x56446bf92510 2024-09-10T23:29:14.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.755+0000 7f24acd7a640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446bf92510 0x56446bf94900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.755+0000 7f2490ff9640 10 client.17136 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:14.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.755+0000 7f24acd7a640 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446bf92510 0x56446bf94900 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36ae1cf8e728865d server_cookie=e1a229df3452bca in_seq=0 out_seq=0 2024-09-10T23:29:14.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f2490ff9640 1 -- 172.21.15.2:0/3045170334 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56446beeedf0 con 0x56446bf92510 2024-09-10T23:29:14.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f2490ff9640 10 client.17136 handle_command_reply: tid=0 2024-09-10T23:29:14.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 client.17136 shutdown 2024-09-10T23:29:14.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 msgr2=0x56446bf82590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf82590 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f24a4006010 tx=0x7f24a4005db0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 shutdown_connections 2024-09-10T23:29:14.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446bf92510 0x56446bf94900 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bf7ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f2490ff9640 0 client.17136 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:14.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/3045170334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf82590 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 >> 172.21.15.2:0/3045170334 conn(0x56446bf74300 msgr2=0x56446bf79ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 shutdown_connections 2024-09-10T23:29:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 1 -- 172.21.15.2:0/3045170334 wait complete. 2024-09-10T23:29:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.756+0000 7f24b1bb4740 20 client.17136 trim_cache size 0 max 16384 2024-09-10T23:29:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 Processor -- start 2024-09-10T23:29:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 -- start start 2024-09-10T23:29:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf764d0 0x56446bf73310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 0x56446bf7d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24a81b0570 con 0x56446bf82d80 2024-09-10T23:29:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24a81b20b0 con 0x56446bf764d0 2024-09-10T23:29:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24a81b0c40 con 0x56446bf76df0 2024-09-10T23:29:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24add7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 0x56446bf7d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24add7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 0x56446bf7d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54328/0 (socket says 172.21.15.2:54328) 2024-09-10T23:29:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.770+0000 7f24add7c640 1 -- 172.21.15.2:0/2253071991 learned_addr learned my addr 172.21.15.2:0/2253071991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24ad57b640 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf764d0 0x56446bf73310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24add7c640 1 -- 172.21.15.2:0/2253071991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 msgr2=0x56446bf7cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24add7c640 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24add7c640 1 -- 172.21.15.2:0/2253071991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf764d0 msgr2=0x56446bf73310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24add7c640 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf764d0 0x56446bf73310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24add7c640 1 -- 172.21.15.2:0/2253071991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446bf74d80 con 0x56446bf82d80 2024-09-10T23:29:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f24add7c640 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 0x56446bf7d130 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f24a0011660 tx=0x7f24a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f9b17ec203ae04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f2492ffd640 1 -- 172.21.15.2:0/2253071991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0003970 con 0x56446bf82d80 2024-09-10T23:29:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f2492ffd640 1 -- 172.21.15.2:0/2253071991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a0004020 con 0x56446bf82d80 2024-09-10T23:29:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.771+0000 7f2492ffd640 1 -- 172.21.15.2:0/2253071991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a001f670 con 0x56446bf82d80 2024-09-10T23:29:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2253071991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 msgr2=0x56446bf7d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 0x56446bf7d130 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f24a0011660 tx=0x7f24a0016000 comp rx=0 tx=0).stop 2024-09-10T23:29:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2253071991 shutdown_connections 2024-09-10T23:29:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf82d80 0x56446bf7d130 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf7cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2253071991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf764d0 0x56446bf73310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2253071991 >> 172.21.15.2:0/2253071991 conn(0x56446bf74300 msgr2=0x56446bf72c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2253071991 shutdown_connections 2024-09-10T23:29:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2253071991 wait complete. 2024-09-10T23:29:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 -- start start 2024-09-10T23:29:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.772+0000 7f24b1bb4740 1 Processor -- start 2024-09-10T23:29:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf87810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf87db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bff8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24a81b19e0 con 0x56446bf764d0 2024-09-10T23:29:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24a81b1310 con 0x56446bf82d80 2024-09-10T23:29:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24a81ae550 con 0x56446bf76df0 2024-09-10T23:29:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24b1bb4740 10 client.0 _ll_register_callbacks cb 0x7f24a0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf87810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf87810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54344/0 (socket says 172.21.15.2:54344) 2024-09-10T23:29:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 -- 172.21.15.2:0/2479330166 learned_addr learned my addr 172.21.15.2:0/2479330166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf87db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24add7c640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bff8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 -- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 msgr2=0x56446bf87db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf87db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 -- 172.21.15.2:0/2479330166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 msgr2=0x56446bff8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bff8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 -- 172.21.15.2:0/2479330166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446bf7a780 con 0x56446bf764d0 2024-09-10T23:29:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24add7c640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bff8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.773+0000 7f24ad57b640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf87810 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f24a40035f0 tx=0x7f24a4004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f2130663bb29b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f2490ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f2490ff9640 1 -- 172.21.15.2:0/2479330166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a405c040 con 0x56446bf764d0 2024-09-10T23:29:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f2490ff9640 1 -- 172.21.15.2:0/2479330166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f24a4005520 con 0x56446bf764d0 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a0004020 con 0x56446bf764d0 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f2490ff9640 1 -- 172.21.15.2:0/2479330166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a4035040 con 0x56446bf764d0 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 10 client.17142 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56446bfffc50 con 0x56446bf764d0 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f2490ff9640 1 -- 172.21.15.2:0/2479330166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a0004020 con 0x56446bf764d0 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f2490ff9640 1 -- 172.21.15.2:0/2479330166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24a405f070 con 0x56446bf764d0 2024-09-10T23:29:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 10 client.17142 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:14.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 10 client.17142 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:29:14.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 20 client.17142 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:14.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446c000270 0x56446c002690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 4 client.17142 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:14.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.774+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56446beea8a0 con 0x56446c000270 2024-09-10T23:29:14.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446c000270 0x56446c002690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f2490ff9640 10 client.17142 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:14.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f24acd7a640 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446c000270 0x56446c002690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35159468632f1975 server_cookie=3d5f2cb871661915 in_seq=0 out_seq=0 2024-09-10T23:29:14.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f2490ff9640 1 -- 172.21.15.2:0/2479330166 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56446beea8a0 con 0x56446c000270 2024-09-10T23:29:14.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f2490ff9640 10 client.17142 handle_command_reply: tid=0 2024-09-10T23:29:14.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f24b1bb4740 1 client.17142 shutdown 2024-09-10T23:29:14.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 msgr2=0x56446bf87810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.775+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf87810 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f24a40035f0 tx=0x7f24a4004580 comp rx=0 tx=0).stop 2024-09-10T23:29:14.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 shutdown_connections 2024-09-10T23:29:14.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x56446c000270 0x56446c002690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56446bf82d80 0x56446bff8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56446bf76df0 0x56446bf87db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 --2- 172.21.15.2:0/2479330166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446bf764d0 0x56446bf87810 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f2490ff9640 0 client.17142 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:29:14.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 >> 172.21.15.2:0/2479330166 conn(0x56446bf74300 msgr2=0x56446bf73420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 shutdown_connections 2024-09-10T23:29:14.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 1 -- 172.21.15.2:0/2479330166 wait complete. 2024-09-10T23:29:14.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24b1bb4740 20 client.17142 trim_cache size 0 max 16384 2024-09-10T23:29:14.823 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24940b5360 msgr2=0x7f24940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24af7df640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24940b5360 0x7f24940b7820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f24a80ffcc0 tx=0x7f24a0009600 comp rx=0 tx=0).stop 2024-09-10T23:29:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 msgr2=0x7f24a80fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.776+0000 7f24af7df640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 0x7f24a80fe140 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f249800d950 tx=0x7f249800de10 comp rx=0 tx=0).stop 2024-09-10T23:29:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 shutdown_connections 2024-09-10T23:29:14.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f24940b5360 0x7f24940b7820 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a8108060 0x7f24a80fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24a81076e0 0x7f24a80fe140 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 --2- 172.21.15.2:0/2013319497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24a8101cd0 0x7f24a80fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 >> 172.21.15.2:0/2013319497 conn(0x7f24a80fd700 msgr2=0x7f24a806b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 shutdown_connections 2024-09-10T23:29:14.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:14.777+0000 7f24af7df640 1 -- 172.21.15.2:0/2013319497 wait complete. 2024-09-10T23:29:15.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:29:15.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:15 smithi002 ceph-mon[31150]: pgmap v499: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:29:15.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:15 smithi154 ceph-mon[35136]: pgmap v499: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:29:15.846 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:15 smithi177 ceph-mon[35760]: pgmap v499: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 -- 172.21.15.2:0/873022549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c102dc0 msgr2=0x7f676c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 --2- 172.21.15.2:0/873022549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c102dc0 0x7f676c1031a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f675c009900 tx=0x7f675c02a410 comp rx=0 tx=0).stop 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 -- 172.21.15.2:0/873022549 shutdown_connections 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 --2- 172.21.15.2:0/873022549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c109150 0x7f676c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 --2- 172.21.15.2:0/873022549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c1087d0 0x7f676c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 --2- 172.21.15.2:0/873022549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c102dc0 0x7f676c1031a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 -- 172.21.15.2:0/873022549 >> 172.21.15.2:0/873022549 conn(0x7f676c0fe870 msgr2=0x7f676c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 -- 172.21.15.2:0/873022549 shutdown_connections 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.478+0000 7f6772107640 1 -- 172.21.15.2:0/873022549 wait complete. 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.479+0000 7f6772107640 1 Processor -- start 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.479+0000 7f6772107640 1 -- start start 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6772107640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c102dc0 0x7f676c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6772107640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c1087d0 0x7f676c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6772107640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 0x7f676c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6772107640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f676c112e10 con 0x7f676c109150 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6772107640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f676c112c90 con 0x7f676c1087d0 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6772107640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f676c112f90 con 0x7f676c102dc0 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 0x7f676c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 0x7f676c19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54372/0 (socket says 172.21.15.2:54372) 2024-09-10T23:29:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 -- 172.21.15.2:0/1904908736 learned_addr learned my addr 172.21.15.2:0/1904908736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676b7fe640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c102dc0 0x7f676c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676affd640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c1087d0 0x7f676c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 -- 172.21.15.2:0/1904908736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c102dc0 msgr2=0x7f676c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c102dc0 0x7f676c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 -- 172.21.15.2:0/1904908736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c1087d0 msgr2=0x7f676c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c1087d0 0x7f676c199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 -- 172.21.15.2:0/1904908736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c19f3b0 con 0x7f676c109150 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f676bfff640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 0x7f676c19ebe0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f676400cad0 tx=0x7f676400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.480+0000 7f6768ff9640 1 -- 172.21.15.2:0/1904908736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676400ae20 con 0x7f676c109150 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.481+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c19f6a0 con 0x7f676c109150 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.481+0000 7f6768ff9640 1 -- 172.21.15.2:0/1904908736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6764005020 con 0x7f676c109150 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.481+0000 7f6768ff9640 1 -- 172.21.15.2:0/1904908736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676400f6b0 con 0x7f676c109150 2024-09-10T23:29:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.481+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c1a5de0 con 0x7f676c109150 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.483+0000 7f6768ff9640 1 -- 172.21.15.2:0/1904908736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f67640054f0 con 0x7f676c109150 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.483+0000 7f67744dc740 1 Processor -- start 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.483+0000 7f67744dc740 1 -- start start 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f67744dc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f67744dc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf1e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f67744dc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf1e9a0 0x558b6cf20d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f67744dc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6ce88ea0 con 0x558b6cf120f0 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f67744dc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b6ce782d0 con 0x558b6cf12a10 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f67744dc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558b6ce7c0e0 con 0x558b6cf1e9a0 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf124d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54388/0 (socket says 172.21.15.2:54388) 2024-09-10T23:29:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 -- 172.21.15.2:0/1453995019 learned_addr learned my addr 172.21.15.2:0/1453995019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676b7fe640 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf1e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf1e9a0 0x558b6cf20d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 -- 172.21.15.2:0/1453995019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf1e9a0 msgr2=0x558b6cf20d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf1e9a0 0x558b6cf20d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 -- 172.21.15.2:0/1453995019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 msgr2=0x558b6cf1e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf1e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 -- 172.21.15.2:0/1453995019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6cbd6650 con 0x558b6cf120f0 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f6768ff9640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67540b52e0 0x7f67540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676b7fe640 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf1e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676b7fe640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67540b52e0 0x7f67540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.484+0000 7f676affd640 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf124d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6760016580 tx=0x7f6760009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bba9e3442e85fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.485+0000 7f6768ff9640 1 -- 172.21.15.2:0/1904908736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f67640e5c10 con 0x7f676c109150 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.485+0000 7f6751ffb640 1 -- 172.21.15.2:0/1453995019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676001e070 con 0x558b6cf120f0 2024-09-10T23:29:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.485+0000 7f6751ffb640 1 -- 172.21.15.2:0/1453995019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6760010040 con 0x558b6cf120f0 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.485+0000 7f6751ffb640 1 -- 172.21.15.2:0/1453995019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676000f040 con 0x558b6cf120f0 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 -- 172.21.15.2:0/1453995019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 msgr2=0x558b6cf124d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f676b7fe640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67540b52e0 0x7f67540b77a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f675c031440 tx=0x7f675c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf124d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6760016580 tx=0x7f6760009240 comp rx=0 tx=0).stop 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 -- 172.21.15.2:0/1453995019 shutdown_connections 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf1e9a0 0x558b6cf20d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf1e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 --2- 172.21.15.2:0/1453995019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf124d0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 -- 172.21.15.2:0/1453995019 >> 172.21.15.2:0/1453995019 conn(0x558b6cf0ff20 msgr2=0x558b6cf110c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 -- 172.21.15.2:0/1453995019 shutdown_connections 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 -- 172.21.15.2:0/1453995019 wait complete. 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.486+0000 7f67744dc740 1 -- start start 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 Processor -- start 2024-09-10T23:29:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6ccd9700 con 0x558b6cf120f0 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b6ce13160 con 0x558b6cf1e9a0 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558b6cf21620 con 0x558b6cf12a10 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f67744dc740 10 client.0 _ll_register_callbacks cb 0x558b6ce2c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf1e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf1e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54396/0 (socket says 172.21.15.2:54396) 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 -- 172.21.15.2:0/2149675284 learned_addr learned my addr 172.21.15.2:0/2149675284 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676affd640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676bfff640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 -- 172.21.15.2:0/2149675284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 msgr2=0x558b6cf1b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf1b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 -- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 msgr2=0x558b6cf1bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.487+0000 7f676b7fe640 1 -- 172.21.15.2:0/2149675284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6ce40c90 con 0x558b6cf120f0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f676b7fe640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf1e2a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f675c033000 tx=0x7f675c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9a4631208515d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f674affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f674affd640 1 -- 172.21.15.2:0/2149675284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c04d030 con 0x558b6cf120f0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f674affd640 1 -- 172.21.15.2:0/2149675284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f675c0035f0 con 0x558b6cf120f0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6760010040 con 0x558b6cf120f0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f674affd640 1 -- 172.21.15.2:0/2149675284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f675c035040 con 0x558b6cf120f0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f67744dc740 10 client.17154 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b6cf2cf70 con 0x558b6cf120f0 2024-09-10T23:29:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f674affd640 1 -- 172.21.15.2:0/2149675284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6760010040 con 0x558b6cf120f0 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.488+0000 7f674affd640 1 -- 172.21.15.2:0/2149675284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f675c03d750 con 0x558b6cf120f0 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f67744dc740 10 client.17154 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f67744dc740 10 client.17154 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f67744dc740 20 client.17154 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f67744dc740 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf2e520 0x558b6cf30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f67744dc740 4 client.17154 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b6ce8adf0 con 0x558b6cf2e520 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f676affd640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf2e520 0x558b6cf30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f674affd640 10 client.17154 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.489+0000 7f676affd640 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf2e520 0x558b6cf30980 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8e7e3c97c9aaf31 server_cookie=8ca802d8a207f7e7 in_seq=0 out_seq=0 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f674affd640 1 -- 172.21.15.2:0/2149675284 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b6ce8adf0 con 0x558b6cf2e520 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f674affd640 10 client.17154 handle_command_reply: tid=0 2024-09-10T23:29:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 client.17154 shutdown 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 msgr2=0x558b6cf1e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf1e2a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f675c033000 tx=0x7f675c009260 comp rx=0 tx=0).stop 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 shutdown_connections 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf2e520 0x558b6cf30980 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.490+0000 7f67744dc740 1 --2- 172.21.15.2:0/2149675284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf1e2a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.491+0000 7f674affd640 0 client.17154 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.491+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 >> 172.21.15.2:0/2149675284 conn(0x558b6cf0ff20 msgr2=0x558b6cf15ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.491+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 shutdown_connections 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.491+0000 7f67744dc740 1 -- 172.21.15.2:0/2149675284 wait complete. 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.491+0000 7f67744dc740 20 client.17154 trim_cache size 0 max 16384 2024-09-10T23:29:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 Processor -- start 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 -- start start 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf116f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf2a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1ae390 con 0x558b6cf120f0 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1afed0 con 0x558b6cf1e9a0 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f67744dc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1aea60 con 0x558b6cf12a10 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf116f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54398/0 (socket says 172.21.15.2:54398) 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f676b7fe640 1 -- 172.21.15.2:0/675820817 learned_addr learned my addr 172.21.15.2:0/675820817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f676affd640 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf2a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.504+0000 7f676bfff640 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f676b7fe640 1 -- 172.21.15.2:0/675820817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 msgr2=0x558b6cf2a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f676b7fe640 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf2a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f676b7fe640 1 -- 172.21.15.2:0/675820817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 msgr2=0x558b6cf1fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f676b7fe640 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f676b7fe640 1 -- 172.21.15.2:0/675820817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6cf1b4a0 con 0x558b6cf120f0 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f676b7fe640 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf116f0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f675c02a930 tx=0x7f675c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f835127ce7d4f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f67517fa640 1 -- 172.21.15.2:0/675820817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c061020 con 0x558b6cf120f0 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f67517fa640 1 -- 172.21.15.2:0/675820817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f675c03ddd0 con 0x558b6cf120f0 2024-09-10T23:29:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.505+0000 7f67517fa640 1 -- 172.21.15.2:0/675820817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c04d040 con 0x558b6cf120f0 2024-09-10T23:29:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 -- 172.21.15.2:0/675820817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 msgr2=0x558b6cf116f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf116f0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f675c02a930 tx=0x7f675c031a20 comp rx=0 tx=0).stop 2024-09-10T23:29:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 -- 172.21.15.2:0/675820817 shutdown_connections 2024-09-10T23:29:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf1e9a0 0x558b6cf1fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf12a10 0x558b6cf2a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 --2- 172.21.15.2:0/675820817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf120f0 0x558b6cf116f0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 -- 172.21.15.2:0/675820817 >> 172.21.15.2:0/675820817 conn(0x558b6cf0ff20 msgr2=0x558b6cf10fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 -- 172.21.15.2:0/675820817 shutdown_connections 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 -- 172.21.15.2:0/675820817 wait complete. 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.506+0000 7f67744dc740 1 -- start start 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 Processor -- start 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf120f0 0x558b6cf98450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf98990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 0x558b6cf95420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1af800 con 0x558b6cf1e9a0 2024-09-10T23:29:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1af130 con 0x558b6cf12a10 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1ac370 con 0x558b6cf120f0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f67744dc740 10 client.0 _ll_register_callbacks cb 0x7f675c031bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f676bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 0x558b6cf95420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f676bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 0x558b6cf95420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54406/0 (socket says 172.21.15.2:54406) 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf120f0 0x558b6cf98450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.507+0000 7f676bfff640 1 -- 172.21.15.2:0/853343393 learned_addr learned my addr 172.21.15.2:0/853343393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676affd640 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf98990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676bfff640 1 -- 172.21.15.2:0/853343393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf120f0 msgr2=0x558b6cf98450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676bfff640 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf120f0 0x558b6cf98450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676bfff640 1 -- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 msgr2=0x558b6cf98990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676bfff640 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf98990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676bfff640 1 -- 172.21.15.2:0/853343393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6cf95960 con 0x558b6cf1e9a0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f676bfff640 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 0x558b6cf95420 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f67640ac0e0 tx=0x7f67640abc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fb1422a9e48507 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f674affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f674affd640 1 -- 172.21.15.2:0/853343393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67640b0ec0 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f674affd640 1 -- 172.21.15.2:0/853343393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f67640d3170 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f675c03ddd0 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f674affd640 1 -- 172.21.15.2:0/853343393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67640d3370 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f67744dc740 10 client.17160 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.508+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b6cf260a0 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f674affd640 1 -- 172.21.15.2:0/853343393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f675c03ddd0 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f674affd640 1 -- 172.21.15.2:0/853343393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67640a6c00 con 0x558b6cf1e9a0 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f67744dc740 10 client.17160 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f67744dc740 10 client.17160 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f67744dc740 20 client.17160 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f67744dc740 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf26730 0x558b6cf26b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f67744dc740 4 client.17160 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b6ce868a0 con 0x558b6cf26730 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.509+0000 7f676b7fe640 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf26730 0x558b6cf26b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f676b7fe640 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf26730 0x558b6cf26b40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76aa81ee0dc81ac3 server_cookie=d1e214bf5bfb65a2 in_seq=0 out_seq=0 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f674affd640 10 client.17160 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f674affd640 1 -- 172.21.15.2:0/853343393 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b6ce868a0 con 0x558b6cf26730 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f674affd640 10 client.17160 handle_command_reply: tid=0 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 client.17160 shutdown 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 msgr2=0x558b6cf95420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 0x558b6cf95420 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f67640ac0e0 tx=0x7f67640abc80 comp rx=0 tx=0).stop 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 shutdown_connections 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558b6cf26730 0x558b6cf26b40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6cf1e9a0 0x558b6cf95420 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b6cf12a10 0x558b6cf98990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 --2- 172.21.15.2:0/853343393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558b6cf120f0 0x558b6cf98450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 >> 172.21.15.2:0/853343393 conn(0x558b6cf0ff20 msgr2=0x558b6cf1cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f674affd640 0 client.17160 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 shutdown_connections 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 1 -- 172.21.15.2:0/853343393 wait complete. 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.510+0000 7f67744dc740 20 client.17160 trim_cache size 0 max 16384 2024-09-10T23:29:16.525 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67540b52e0 msgr2=0x7f67540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67540b52e0 0x7f67540b77a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f675c031440 tx=0x7f675c005e80 comp rx=0 tx=0).stop 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 msgr2=0x7f676c19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 0x7f676c19ebe0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f676400cad0 tx=0x7f676400cf90 comp rx=0 tx=0).stop 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 shutdown_connections 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67540b52e0 0x7f67540b77a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f676c109150 0x7f676c19ebe0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c1087d0 0x7f676c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 --2- 172.21.15.2:0/1904908736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c102dc0 0x7f676c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 >> 172.21.15.2:0/1904908736 conn(0x7f676c0fe870 msgr2=0x7f676c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 shutdown_connections 2024-09-10T23:29:16.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:16.511+0000 7f6772107640 1 -- 172.21.15.2:0/1904908736 wait complete. 2024-09-10T23:29:17.208 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:29:17.468 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:17.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:17 smithi002 ceph-mon[31150]: pgmap v500: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:29:17.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:17 smithi154 ceph-mon[35136]: pgmap v500: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:29:17.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:17 smithi177 ceph-mon[35760]: pgmap v500: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:29:18.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 -- 172.21.15.2:0/2564295657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08102dc0 msgr2=0x7f2d081031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/2564295657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08102dc0 0x7f2d081031a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009ca0 tx=0x7f2cf802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 -- 172.21.15.2:0/2564295657 shutdown_connections 2024-09-10T23:29:18.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/2564295657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d08109150 0x7f2d0810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/2564295657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d081087d0 0x7f2d08108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/2564295657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08102dc0 0x7f2d081031a0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 -- 172.21.15.2:0/2564295657 >> 172.21.15.2:0/2564295657 conn(0x7f2d080fe830 msgr2=0x7f2d08100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 -- 172.21.15.2:0/2564295657 shutdown_connections 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.155+0000 7f2d0f12c640 1 -- 172.21.15.2:0/2564295657 wait complete. 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 Processor -- start 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 -- start start 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d08102dc0 0x7f2d080754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d081087d0 0x7f2d080759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 0x7f2d08075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08112dd0 con 0x7f2d08109150 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08112c50 con 0x7f2d081087d0 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0f12c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08112f50 con 0x7f2d08102dc0 2024-09-10T23:29:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0d6c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 0x7f2d08075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0d6c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 0x7f2d08075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54434/0 (socket says 172.21.15.2:54434) 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.156+0000 7f2d0d6c9640 1 -- 172.21.15.2:0/1191329860 learned_addr learned my addr 172.21.15.2:0/1191329860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d08102dc0 0x7f2d080754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d07fff640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d081087d0 0x7f2d080759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0d6c9640 1 -- 172.21.15.2:0/1191329860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d08102dc0 msgr2=0x7f2d080754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d08102dc0 0x7f2d080754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0d6c9640 1 -- 172.21.15.2:0/1191329860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d081087d0 msgr2=0x7f2d080759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d081087d0 0x7f2d080759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0d6c9640 1 -- 172.21.15.2:0/1191329860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d081a7660 con 0x7f2d08109150 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 0x7f2d08075f20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000d750 tx=0x7f2d0000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d05ffb640 1 -- 172.21.15.2:0/1191329860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00017070 con 0x7f2d08109150 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d05ffb640 1 -- 172.21.15.2:0/1191329860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d000097c0 con 0x7f2d08109150 2024-09-10T23:29:18.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d081a7950 con 0x7f2d08109150 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d05ffb640 1 -- 172.21.15.2:0/1191329860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00004ba0 con 0x7f2d08109150 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.157+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d081a7e40 con 0x7f2d08109150 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 Processor -- start 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d05ffb640 1 -- 172.21.15.2:0/1191329860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2d00009c90 con 0x7f2d08109150 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 -- start start 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98901e4d0 0x55a98901e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98902a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 0x55a98902d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a988f94ea0 con 0x55a98902ad80 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a988f842d0 con 0x55a98901edf0 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d11501740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a988f880e0 con 0x55a98901e4d0 2024-09-10T23:29:18.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 0x55a98902d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 0x55a98902d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54450/0 (socket says 172.21.15.2:54450) 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d07fff640 1 -- 172.21.15.2:0/2362263462 learned_addr learned my addr 172.21.15.2:0/2362263462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d07fff640 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98901e4d0 0x55a98901e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98902a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d07fff640 1 -- 172.21.15.2:0/2362263462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98901e4d0 msgr2=0x55a98901e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.161+0000 7f2d07fff640 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98901e4d0 0x55a98901e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d07fff640 1 -- 172.21.15.2:0/2362263462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 msgr2=0x55a98902a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d07fff640 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98902a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d07fff640 1 -- 172.21.15.2:0/2362263462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a988ce2650 con 0x55a98902ad80 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d05ffb640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2cf40b52e0 0x7f2cf40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d07fff640 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 0x55a98902d170 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00117e0 tx=0x7f2cf000a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15964beaa64b4914 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2cf40b52e0 0x7f2cf40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2d05ffb640 1 -- 172.21.15.2:0/1191329860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2d000e5580 con 0x7f2d08109150 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2362263462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0011e20 con 0x55a98902ad80 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2362263462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cf000fe80 con 0x55a98902ad80 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.162+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2362263462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0004a00 con 0x55a98902ad80 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 -- 172.21.15.2:0/2362263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 msgr2=0x55a98902d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2cf40b52e0 0x7f2cf40b77a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55a98901d1e0 tx=0x7f2cf8005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 0x55a98902d170 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00117e0 tx=0x7f2cf000a760 comp rx=0 tx=0).stop 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 -- 172.21.15.2:0/2362263462 shutdown_connections 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98902ad80 0x55a98902d170 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98902a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 --2- 172.21.15.2:0/2362263462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98901e4d0 0x55a98901e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 -- 172.21.15.2:0/2362263462 >> 172.21.15.2:0/2362263462 conn(0x55a98901c300 msgr2=0x55a98901d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 -- 172.21.15.2:0/2362263462 shutdown_connections 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 -- 172.21.15.2:0/2362263462 wait complete. 2024-09-10T23:29:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 -- start start 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.163+0000 7f2d11501740 1 Processor -- start 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98902a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989027b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a9890281c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a988de5700 con 0x55a98901e4d0 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a988f1f160 con 0x55a98901edf0 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a98902da00 con 0x55a98902ad80 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d11501740 10 client.0 _ll_register_callbacks cb 0x55a988f389e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98902a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98902a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54456/0 (socket says 172.21.15.2:54456) 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 -- 172.21.15.2:0/1627817111 learned_addr learned my addr 172.21.15.2:0/1627817111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d07fff640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989027b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a9890281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 -- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 msgr2=0x55a9890281c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a9890281c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 -- 172.21.15.2:0/1627817111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 msgr2=0x55a989027b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989027b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 -- 172.21.15.2:0/1627817111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a988f4cc90 con 0x55a98901e4d0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d07fff640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989027b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98902a6f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8035000 tx=0x7f2cf802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b8b34ced27a3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.164+0000 7f2ce7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2ce7fff640 1 -- 172.21.15.2:0/1627817111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004040 con 0x55a98901e4d0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2ce7fff640 1 -- 172.21.15.2:0/1627817111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2cf80041e0 con 0x55a98901e4d0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a988f96df0 con 0x55a98901e4d0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2ce7fff640 1 -- 172.21.15.2:0/1627817111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2cf80043e0 con 0x55a98901e4d0 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 10 client.17172 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9890393e0 con 0x55a98901e4d0 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2ce7fff640 1 -- 172.21.15.2:0/1627817111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a988f96df0 con 0x55a98901e4d0 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2ce7fff640 1 -- 172.21.15.2:0/1627817111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2cf8051070 con 0x55a98901e4d0 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 10 client.17172 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 20 client.17172 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a98903a840 0x55a98903ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 4 client.17172 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.165+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a988f928a0 con 0x55a98903a840 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.166+0000 7f2d07fff640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a98903a840 0x55a98903ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.166+0000 7f2d07fff640 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a98903a840 0x55a98903ccb0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb4f128a3b6726c server_cookie=1cc5211330e8e94d in_seq=0 out_seq=0 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.166+0000 7f2ce7fff640 10 client.17172 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2ce7fff640 1 -- 172.21.15.2:0/1627817111 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a988f928a0 con 0x55a98903a840 2024-09-10T23:29:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2ce7fff640 10 client.17172 handle_command_reply: tid=0 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 client.17172 shutdown 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 msgr2=0x55a98902a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98902a6f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8035000 tx=0x7f2cf802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 shutdown_connections 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a98903a840 0x55a98903ccb0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a9890281c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989027b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 --2- 172.21.15.2:0/1627817111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98902a6f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 >> 172.21.15.2:0/1627817111 conn(0x55a98901c300 msgr2=0x55a989021e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2ce7fff640 0 client.17172 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 shutdown_connections 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 1 -- 172.21.15.2:0/1627817111 wait complete. 2024-09-10T23:29:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.167+0000 7f2d11501740 20 client.17172 trim_cache size 0 max 16384 2024-09-10T23:29:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 Processor -- start 2024-09-10T23:29:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 -- start start 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98901d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98901bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d081b0520 con 0x55a98901e4d0 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d081b2060 con 0x55a98901edf0 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d11501740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d081b0bf0 con 0x55a98902ad80 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98901d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98901d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54470/0 (socket says 172.21.15.2:54470) 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 -- 172.21.15.2:0/2883009496 learned_addr learned my addr 172.21.15.2:0/2883009496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d07fff640 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98901bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 -- 172.21.15.2:0/2883009496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 msgr2=0x55a98902c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 -- 172.21.15.2:0/2883009496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 msgr2=0x55a98901bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.181+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98901bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.182+0000 7f2d0cec8640 1 -- 172.21.15.2:0/2883009496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98901d9e0 con 0x55a98901e4d0 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.182+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.182+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98901d210 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8043040 tx=0x7f2cf8003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430f9c1c5f66bf7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.182+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2883009496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8062070 con 0x55a98901e4d0 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.182+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2883009496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cf8059030 con 0x55a98901e4d0 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.182+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2883009496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8030a50 con 0x55a98901e4d0 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 -- 172.21.15.2:0/2883009496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 msgr2=0x55a98901d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98901d210 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8043040 tx=0x7f2cf8003dc0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 -- 172.21.15.2:0/2883009496 shutdown_connections 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a98901bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 --2- 172.21.15.2:0/2883009496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a98901d210 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 -- 172.21.15.2:0/2883009496 >> 172.21.15.2:0/2883009496 conn(0x55a98901c300 msgr2=0x55a9890263c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 -- 172.21.15.2:0/2883009496 shutdown_connections 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 -- 172.21.15.2:0/2883009496 wait complete. 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 -- start start 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.183+0000 7f2d11501740 1 Processor -- start 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a989032cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989033210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d081b1990 con 0x55a98901e4d0 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d081b12c0 con 0x55a98901edf0 2024-09-10T23:29:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d081ae500 con 0x55a98902ad80 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 10 client.0 _ll_register_callbacks cb 0x7f2cf8031bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a989032cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a989032cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54484/0 (socket says 172.21.15.2:54484) 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 -- 172.21.15.2:0/3399012275 learned_addr learned my addr 172.21.15.2:0/3399012275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d07fff640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989033210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 -- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 msgr2=0x55a98902dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 -- 172.21.15.2:0/3399012275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 msgr2=0x55a989033210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989033210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 -- 172.21.15.2:0/3399012275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98902e1c0 con 0x55a98901e4d0 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0d6c9640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:18.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d0cec8640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a989032cd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8006010 tx=0x7f2cf80315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e566fd04034c703 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2ce7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2ce7fff640 1 -- 172.21.15.2:0/3399012275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8062070 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2ce7fff640 1 -- 172.21.15.2:0/3399012275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2cf802f860 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.184+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cf8059030 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2ce7fff640 1 -- 172.21.15.2:0/3399012275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2cf802fa60 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 10 client.17178 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9890a7e70 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2ce7fff640 1 -- 172.21.15.2:0/3399012275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cf8059030 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2ce7fff640 1 -- 172.21.15.2:0/3399012275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2cf8051040 con 0x55a98901e4d0 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 10 client.17178 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 20 client.17178 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a9890a84b0 0x55a9890aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 4 client.17178 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:18.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a988f8fcd0 con 0x55a9890a84b0 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.185+0000 7f2d07fff640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a9890a84b0 0x55a9890aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d07fff640 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a9890a84b0 0x55a9890aa8d0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f0101cada37c3e9 server_cookie=d05b9b6b9b0655c9 in_seq=0 out_seq=0 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2ce7fff640 10 client.17178 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2ce7fff640 1 -- 172.21.15.2:0/3399012275 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a988f8fcd0 con 0x55a9890a84b0 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2ce7fff640 10 client.17178 handle_command_reply: tid=0 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 client.17178 shutdown 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 msgr2=0x55a989032cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a989032cd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8006010 tx=0x7f2cf80315d0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 shutdown_connections 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a9890a84b0 0x55a9890aa8d0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a98902ad80 0x55a98902dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a98901edf0 0x55a989033210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 --2- 172.21.15.2:0/3399012275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98901e4d0 0x55a989032cd0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 >> 172.21.15.2:0/3399012275 conn(0x55a98901c300 msgr2=0x55a989029170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2ce7fff640 0 client.17178 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 shutdown_connections 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 1 -- 172.21.15.2:0/3399012275 wait complete. 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.186+0000 7f2d11501740 20 client.17178 trim_cache size 0 max 16384 2024-09-10T23:29:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:18.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2cf40b52e0 msgr2=0x7f2cf40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2cf40b52e0 0x7f2cf40b77a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55a98901d1e0 tx=0x7f2cf8005fa0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 msgr2=0x7f2d08075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 0x7f2d08075f20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000d750 tx=0x7f2d0000db50 comp rx=0 tx=0).stop 2024-09-10T23:29:18.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 shutdown_connections 2024-09-10T23:29:18.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2cf40b52e0 0x7f2cf40b77a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d08109150 0x7f2d08075f20 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d081087d0 0x7f2d080759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 --2- 172.21.15.2:0/1191329860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d08102dc0 0x7f2d080754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 >> 172.21.15.2:0/1191329860 conn(0x7f2d080fe830 msgr2=0x7f2d08100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 shutdown_connections 2024-09-10T23:29:18.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:18.187+0000 7f2d0f12c640 1 -- 172.21.15.2:0/1191329860 wait complete. 2024-09-10T23:29:19.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:19 smithi154 ceph-mon[35136]: pgmap v501: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-10T23:29:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:19 smithi177 ceph-mon[35760]: pgmap v501: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-10T23:29:19.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:19 smithi002 ceph-mon[31150]: pgmap v501: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-10T23:29:20.027 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:29:20.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:29:20.298 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 -- 172.21.15.2:0/1619042398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 msgr2=0x7f47c4107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 --2- 172.21.15.2:0/1619042398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c4107380 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009ca0 tx=0x7f47bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 -- 172.21.15.2:0/1619042398 shutdown_connections 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 --2- 172.21.15.2:0/1619042398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c4107380 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 --2- 172.21.15.2:0/1619042398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c4101d50 0x7f47c4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 --2- 172.21.15.2:0/1619042398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47c406ac00 0x7f47c4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.820+0000 7f47cbaec640 1 -- 172.21.15.2:0/1619042398 >> 172.21.15.2:0/1619042398 conn(0x7f47c4076f50 msgr2=0x7f47c4077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 -- 172.21.15.2:0/1619042398 shutdown_connections 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 -- 172.21.15.2:0/1619042398 wait complete. 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 Processor -- start 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 -- start start 2024-09-10T23:29:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47c406ac00 0x7f47c4199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c4101d50 0x7f47c419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c41a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4111c90 con 0x7f47c4102190 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4111b10 con 0x7f47c406ac00 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.821+0000 7f47cbaec640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4111e10 con 0x7f47c4101d50 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c41a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c41a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54510/0 (socket says 172.21.15.2:54510) 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 -- 172.21.15.2:0/2646034867 learned_addr learned my addr 172.21.15.2:0/2646034867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47c9888640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47c406ac00 0x7f47c4199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47c9087640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c4101d50 0x7f47c419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 -- 172.21.15.2:0/2646034867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c4101d50 msgr2=0x7f47c419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c4101d50 0x7f47c419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 -- 172.21.15.2:0/2646034867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47c406ac00 msgr2=0x7f47c4199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47c406ac00 0x7f47c4199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 -- 172.21.15.2:0/2646034867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c41a5500 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47ca089640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c41a4fc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f47bc031a20 tx=0x7f47bc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47baffd640 1 -- 172.21.15.2:0/2646034867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003cf0 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47baffd640 1 -- 172.21.15.2:0/2646034867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47bc0044f0 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47baffd640 1 -- 172.21.15.2:0/2646034867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc02fce0 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c41a56d0 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.822+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c41a5bb0 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.825+0000 7f47cdec1740 1 Processor -- start 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47baffd640 1 -- 172.21.15.2:0/2646034867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f47bc004040 con 0x7f47c4102190 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 -- start start 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c82c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c82ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f91c792e60 con 0x55f91c82cba0 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f91c782290 con 0x55f91c81bee0 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47cdec1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f91c7860a0 con 0x55f91c81c800 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47c9087640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c82ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47c9087640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c82ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54522/0 (socket says 172.21.15.2:54522) 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47c9087640 1 -- 172.21.15.2:0/1420682239 learned_addr learned my addr 172.21.15.2:0/1420682239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.826+0000 7f47c9888640 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c82c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47baffd640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47b00b5360 0x7f47b00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 -- 172.21.15.2:0/1420682239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 msgr2=0x55f91c82c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c82c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 -- 172.21.15.2:0/1420682239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 msgr2=0x55f91c81c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 -- 172.21.15.2:0/1420682239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91c4e0930 con 0x55f91c82cba0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47ca089640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47b00b5360 0x7f47b00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47c9087640 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c82ef90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f47b400afc0 tx=0x7f47b400a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f253981fd30623f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47baffd640 1 -- 172.21.15.2:0/2646034867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f47bc106e80 con 0x7f47c4102190 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47affff640 1 -- 172.21.15.2:0/1420682239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400f910 con 0x55f91c82cba0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47affff640 1 -- 172.21.15.2:0/1420682239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b401b390 con 0x55f91c82cba0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.827+0000 7f47affff640 1 -- 172.21.15.2:0/1420682239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400c590 con 0x55f91c82cba0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 -- 172.21.15.2:0/1420682239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 msgr2=0x55f91c82ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47ca089640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47b00b5360 0x7f47b00b7820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f47bc005cc0 tx=0x7f47bc09adb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c82ef90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f47b400afc0 tx=0x7f47b400a790 comp rx=0 tx=0).stop 2024-09-10T23:29:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 -- 172.21.15.2:0/1420682239 shutdown_connections 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c82ef90 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c82c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1420682239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 -- 172.21.15.2:0/1420682239 >> 172.21.15.2:0/1420682239 conn(0x55f91c819d10 msgr2=0x55f91c81aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 -- 172.21.15.2:0/1420682239 shutdown_connections 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.828+0000 7f47cdec1740 1 -- 172.21.15.2:0/1420682239 wait complete. 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 -- start start 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 Processor -- start 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c829c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c82a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c82a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f91c5e3890 con 0x55f91c81c800 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f91c71cd40 con 0x55f91c81bee0 2024-09-10T23:29:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f91c82f850 con 0x55f91c82cba0 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47cdec1740 10 client.0 _ll_register_callbacks cb 0x55f91c780c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47c9888640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c82a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47c9888640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c82a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54526/0 (socket says 172.21.15.2:54526) 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47c9888640 1 -- 172.21.15.2:0/340010204 learned_addr learned my addr 172.21.15.2:0/340010204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47c9888640 1 -- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 msgr2=0x55f91c82a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.829+0000 7f47c9087640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c82a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47c9888640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c82a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47c9087640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c829c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47c9888640 1 -- 172.21.15.2:0/340010204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 msgr2=0x55f91c829c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47c9888640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c829c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47c9888640 1 -- 172.21.15.2:0/340010204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f91c838ce0 con 0x55f91c81c800 2024-09-10T23:29:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47c9888640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c82a190 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f47c0010a50 tx=0x7f47c0010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2864c26e3c9f2a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47ad7fa640 1 -- 172.21.15.2:0/340010204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c001e060 con 0x55f91c81c800 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47ad7fa640 1 -- 172.21.15.2:0/340010204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f47c000fbd0 con 0x55f91c81c800 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b401b390 con 0x55f91c81c800 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47ad7fa640 1 -- 172.21.15.2:0/340010204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f47c000fdd0 con 0x55f91c81c800 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47cdec1740 10 client.17190 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f91c83b6d0 con 0x55f91c81c800 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47ad7fa640 1 -- 172.21.15.2:0/340010204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b401b390 con 0x55f91c81c800 2024-09-10T23:29:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47ad7fa640 1 -- 172.21.15.2:0/340010204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f47c000e4d0 con 0x55f91c81c800 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47cdec1740 10 client.17190 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47cdec1740 10 client.17190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.830+0000 7f47cdec1740 20 client.17190 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.831+0000 7f47cdec1740 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c83cb90 0x55f91c83f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.831+0000 7f47cdec1740 4 client.17190 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.831+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f91c794db0 con 0x55f91c83cb90 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.831+0000 7f47c9087640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c83cb90 0x55f91c83f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.831+0000 7f47c9087640 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c83cb90 0x55f91c83f000 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67e19c2a7a5b849 server_cookie=d3836547e0d28843 in_seq=0 out_seq=0 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.831+0000 7f47ad7fa640 10 client.17190 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47ad7fa640 1 -- 172.21.15.2:0/340010204 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f91c794db0 con 0x55f91c83cb90 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47ad7fa640 10 client.17190 handle_command_reply: tid=0 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 client.17190 shutdown 2024-09-10T23:29:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 msgr2=0x55f91c82a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c82a190 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f47c0010a50 tx=0x7f47c0010f10 comp rx=0 tx=0).stop 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 shutdown_connections 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c83cb90 0x55f91c83f000 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c82a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c82a190 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47ad7fa640 0 client.17190 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 --2- 172.21.15.2:0/340010204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c829c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 >> 172.21.15.2:0/340010204 conn(0x55f91c819d10 msgr2=0x55f91c818f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 shutdown_connections 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 1 -- 172.21.15.2:0/340010204 wait complete. 2024-09-10T23:29:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.832+0000 7f47cdec1740 20 client.17190 trim_cache size 0 max 16384 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 Processor -- start 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 -- start start 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c827630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c81df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41abfc0 con 0x55f91c81c800 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41adb00 con 0x55f91c81bee0 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.850+0000 7f47cdec1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41ac690 con 0x55f91c82cba0 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c827630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c827630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54532/0 (socket says 172.21.15.2:54532) 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 -- 172.21.15.2:0/1168791283 learned_addr learned my addr 172.21.15.2:0/1168791283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9087640 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9087640 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c81df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 -- 172.21.15.2:0/1168791283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 msgr2=0x55f91c81df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c81df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 -- 172.21.15.2:0/1168791283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 msgr2=0x55f91c81b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 -- 172.21.15.2:0/1168791283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91c8393b0 con 0x55f91c81c800 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9087640 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c81df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47c9888640 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c827630 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f47c000adf0 tx=0x7f47c000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bca10162ebaf87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47af7fe640 1 -- 172.21.15.2:0/1168791283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0029030 con 0x55f91c81c800 2024-09-10T23:29:20.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47af7fe640 1 -- 172.21.15.2:0/1168791283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47c000fbd0 con 0x55f91c81c800 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.851+0000 7f47af7fe640 1 -- 172.21.15.2:0/1168791283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0004660 con 0x55f91c81c800 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 -- 172.21.15.2:0/1168791283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 msgr2=0x55f91c827630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c827630 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f47c000adf0 tx=0x7f47c000ef00 comp rx=0 tx=0).stop 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 -- 172.21.15.2:0/1168791283 shutdown_connections 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c82cba0 0x55f91c81df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c81c800 0x55f91c827630 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 --2- 172.21.15.2:0/1168791283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c81b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 -- 172.21.15.2:0/1168791283 >> 172.21.15.2:0/1168791283 conn(0x55f91c819d10 msgr2=0x55f91c81ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 -- 172.21.15.2:0/1168791283 shutdown_connections 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 -- 172.21.15.2:0/1168791283 wait complete. 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 -- start start 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.852+0000 7f47cdec1740 1 Processor -- start 2024-09-10T23:29:20.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c844d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c845290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c834d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41ad430 con 0x55f91c82cba0 2024-09-10T23:29:20.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41acd60 con 0x55f91c81bee0 2024-09-10T23:29:20.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41a9fc0 con 0x55f91c81c800 2024-09-10T23:29:20.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47cdec1740 10 client.0 _ll_register_callbacks cb 0x7f47c000a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c834d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c834d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54540/0 (socket says 172.21.15.2:54540) 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 -- 172.21.15.2:0/625988650 learned_addr learned my addr 172.21.15.2:0/625988650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9888640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c845290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c844d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 -- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 msgr2=0x55f91c845290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c845290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 -- 172.21.15.2:0/625988650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 msgr2=0x55f91c844d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c844d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.853+0000 7f47c9087640 1 -- 172.21.15.2:0/625988650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f91c835560 con 0x55f91c82cba0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47c9087640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c834d30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f47b4013010 tx=0x7f47b400a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c3050e6df842c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:20.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47ad7fa640 1 -- 172.21.15.2:0/625988650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4033070 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47c000fbd0 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47ad7fa640 1 -- 172.21.15.2:0/625988650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f47b4005040 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47ad7fa640 1 -- 172.21.15.2:0/625988650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f47b403f050 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 10 client.17196 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f91c8446f0 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47ad7fa640 1 -- 172.21.15.2:0/625988650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47c000fbd0 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47ad7fa640 1 -- 172.21.15.2:0/625988650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f47b402c040 con 0x55f91c82cba0 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 10 client.17196 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 10 client.17196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 20 client.17196 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c8aae60 0x55f91c8ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 4 client.17196 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.854+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f91c790860 con 0x55f91c8aae60 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.855+0000 7f47c9888640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c8aae60 0x55f91c8ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.855+0000 7f47c9888640 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c8aae60 0x55f91c8ad280 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c5bbbfae3cf68b server_cookie=5e9071723fcfca32 in_seq=0 out_seq=0 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.855+0000 7f47ad7fa640 10 client.17196 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.856+0000 7f47ad7fa640 1 -- 172.21.15.2:0/625988650 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f91c790860 con 0x55f91c8aae60 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.856+0000 7f47ad7fa640 10 client.17196 handle_command_reply: tid=0 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 client.17196 shutdown 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 msgr2=0x55f91c834d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c834d30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f47b4013010 tx=0x7f47b400a790 comp rx=0 tx=0).stop 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 shutdown_connections 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f91c8aae60 0x55f91c8ad280 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f91c82cba0 0x55f91c834d30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f91c81c800 0x55f91c845290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 --2- 172.21.15.2:0/625988650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f91c81bee0 0x55f91c844d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47ad7fa640 0 client.17196 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 >> 172.21.15.2:0/625988650 conn(0x55f91c819d10 msgr2=0x55f91c82a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 shutdown_connections 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 1 -- 172.21.15.2:0/625988650 wait complete. 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.857+0000 7f47cdec1740 20 client.17196 trim_cache size 0 max 16384 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "8bf5845a-755e-46de-a436-3072cf7bd949", 2024-09-10T23:29:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:29:20.872 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:29:20.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47b00b5360 msgr2=0x7f47b00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47b00b5360 0x7f47b00b7820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f47bc005cc0 tx=0x7f47bc09adb0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 msgr2=0x7f47c41a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c41a4fc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f47bc031a20 tx=0x7f47bc031a50 comp rx=0 tx=0).stop 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 shutdown_connections 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f47b00b5360 0x7f47b00b7820 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47c4102190 0x7f47c41a4fc0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c4101d50 0x7f47c419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 --2- 172.21.15.2:0/2646034867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47c406ac00 0x7f47c4199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 >> 172.21.15.2:0/2646034867 conn(0x7f47c4076f50 msgr2=0x7f47c41005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 shutdown_connections 2024-09-10T23:29:20.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:20.858+0000 7f47cbaec640 1 -- 172.21.15.2:0/2646034867 wait complete. 2024-09-10T23:29:21.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:29:21.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:21 smithi002 ceph-mon[31150]: pgmap v502: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:21.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:29:21.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:21.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:29:21.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:21 smithi154 ceph-mon[35136]: pgmap v502: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:29:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:29:21.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 -- 172.21.15.2:0/2760283047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b8102a00 msgr2=0x7f85b8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 --2- 172.21.15.2:0/2760283047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b8102a00 0x7f85b8102e80 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009930 tx=0x7f85a002a420 comp rx=0 tx=0).stop 2024-09-10T23:29:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 -- 172.21.15.2:0/2760283047 shutdown_connections 2024-09-10T23:29:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 --2- 172.21.15.2:0/2760283047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b81033c0 0x7f85b8109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 --2- 172.21.15.2:0/2760283047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b8102a00 0x7f85b8102e80 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 --2- 172.21.15.2:0/2760283047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81018b0 0x7f85b8101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 -- 172.21.15.2:0/2760283047 >> 172.21.15.2:0/2760283047 conn(0x7f85b80fd150 msgr2=0x7f85b80ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 -- 172.21.15.2:0/2760283047 shutdown_connections 2024-09-10T23:29:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.934+0000 7f85bf189640 1 -- 172.21.15.2:0/2760283047 wait complete. 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 Processor -- start 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 -- start start 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 0x7f85b8198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b8102a00 0x7f85b8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81033c0 0x7f85b819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85b810d500 con 0x7f85b81018b0 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85b810d380 con 0x7f85b81033c0 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.935+0000 7f85bf189640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f85b810d680 con 0x7f85b8102a00 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 0x7f85b8198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 0x7f85b8198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39344/0 (socket says 172.21.15.2:39344) 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 -- 172.21.15.2:0/3268190572 learned_addr learned my addr 172.21.15.2:0/3268190572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bd726640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81033c0 0x7f85b819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85b7fff640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b8102a00 0x7f85b8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 -- 172.21.15.2:0/3268190572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b8102a00 msgr2=0x7f85b8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b8102a00 0x7f85b8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 -- 172.21.15.2:0/3268190572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81033c0 msgr2=0x7f85b819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81033c0 0x7f85b819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 -- 172.21.15.2:0/3268190572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b819a940 con 0x7f85b81018b0 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85b7fff640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b8102a00 0x7f85b8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bd726640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81033c0 0x7f85b819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bcf25640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 0x7f85b8198e00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f85a800db80 tx=0x7f85a800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85b5ffb640 1 -- 172.21.15.2:0/3268190572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8017070 con 0x7f85b81018b0 2024-09-10T23:29:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85b5ffb640 1 -- 172.21.15.2:0/3268190572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a8003b70 con 0x7f85b81018b0 2024-09-10T23:29:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85b5ffb640 1 -- 172.21.15.2:0/3268190572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a80106c0 con 0x7f85b81018b0 2024-09-10T23:29:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.936+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b819ac30 con 0x7f85b81018b0 2024-09-10T23:29:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.937+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b81a1300 con 0x7f85b81018b0 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.939+0000 7f85b5ffb640 1 -- 172.21.15.2:0/3268190572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f85a8004020 con 0x7f85b81018b0 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.939+0000 7f85c2034740 1 Processor -- start 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.939+0000 7f85c2034740 1 -- start start 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85c2034740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85c2034740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85c2034740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85c2034740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aae28626f0 con 0x55aae28f0860 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85c2034740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aae2851b20 con 0x55aae28f3190 2024-09-10T23:29:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85c2034740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55aae2855930 con 0x55aae28f5bd0 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85b5ffb640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f85a40b52e0 0x7f85a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39352/0 (socket says 172.21.15.2:39352) 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 -- 172.21.15.2:0/4228015147 learned_addr learned my addr 172.21.15.2:0/4228015147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bcf25640 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85b7fff640 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f85a40b52e0 0x7f85a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85b5ffb640 1 -- 172.21.15.2:0/3268190572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f85a80e5a30 con 0x7f85b81018b0 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 -- 172.21.15.2:0/4228015147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 msgr2=0x55aae28f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 -- 172.21.15.2:0/4228015147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 msgr2=0x55aae28f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85bd726640 1 -- 172.21.15.2:0/4228015147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae2817530 con 0x55aae28f0860 2024-09-10T23:29:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.940+0000 7f85b7fff640 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.941+0000 7f85bd726640 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f2c50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f85b0014c10 tx=0x7f85b0011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4989df734f33c245 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.941+0000 7f85bd726640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f85a40b52e0 0x7f85a40b77a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f85b0011c50 tx=0x7f85b001c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.941+0000 7f85aeffd640 1 -- 172.21.15.2:0/4228015147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0014050 con 0x55aae28f0860 2024-09-10T23:29:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.941+0000 7f85aeffd640 1 -- 172.21.15.2:0/4228015147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85b000b9d0 con 0x55aae28f0860 2024-09-10T23:29:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.941+0000 7f85aeffd640 1 -- 172.21.15.2:0/4228015147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b00047a0 con 0x55aae28f0860 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 -- 172.21.15.2:0/4228015147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 msgr2=0x55aae28f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f2c50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f85b0014c10 tx=0x7f85b0011750 comp rx=0 tx=0).stop 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 -- 172.21.15.2:0/4228015147 shutdown_connections 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 --2- 172.21.15.2:0/4228015147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f2c50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 -- 172.21.15.2:0/4228015147 >> 172.21.15.2:0/4228015147 conn(0x55aae28eb9b0 msgr2=0x55aae28ec740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 -- 172.21.15.2:0/4228015147 shutdown_connections 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 -- 172.21.15.2:0/4228015147 wait complete. 2024-09-10T23:29:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 -- start start 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.942+0000 7f85c2034740 1 Processor -- start 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f0860 0x55aae28f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 0x55aae28fa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aae2789ab0 con 0x55aae28f3190 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aae27f7730 con 0x55aae28f0860 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55aae28f8b50 con 0x55aae28f5bd0 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 0x55aae28fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 0x55aae28fa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39360/0 (socket says 172.21.15.2:39360) 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85b7fff640 1 -- 172.21.15.2:0/502468006 learned_addr learned my addr 172.21.15.2:0/502468006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85c2034740 10 client.0 _ll_register_callbacks cb 0x55aae284b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85bcf25640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f0860 0x55aae28f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.943+0000 7f85bd726640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85b7fff640 1 -- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 msgr2=0x55aae28fb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85b7fff640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85b7fff640 1 -- 172.21.15.2:0/502468006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f0860 msgr2=0x55aae28f9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85b7fff640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f0860 0x55aae28f9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85b7fff640 1 -- 172.21.15.2:0/502468006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae25b3790 con 0x55aae28f3190 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85bcf25640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f0860 0x55aae28f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85bd726640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85b7fff640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 0x55aae28fa650 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f85a002a940 tx=0x7f85a0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e8e919a49d1ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f8597fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f8597fff640 1 -- 172.21.15.2:0/502468006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0035040 con 0x55aae28f3190 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f8597fff640 1 -- 172.21.15.2:0/502468006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f85a0004140 con 0x55aae28f3190 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b000b9d0 con 0x55aae28f3190 2024-09-10T23:29:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f8597fff640 1 -- 172.21.15.2:0/502468006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f85a0004380 con 0x55aae28f3190 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85c2034740 10 client.17208 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.944+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aae262c620 con 0x55aae28f3190 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f8597fff640 1 -- 172.21.15.2:0/502468006 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85b000b9d0 con 0x55aae28f3190 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f8597fff640 1 -- 172.21.15.2:0/502468006 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f85a0004be0 con 0x55aae28f3190 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85c2034740 10 client.17208 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85c2034740 10 client.17208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85c2034740 20 client.17208 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85c2034740 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2909c80 0x55aae290c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85c2034740 4 client.17208 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aae2864640 con 0x55aae2909c80 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.945+0000 7f85bcf25640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2909c80 0x55aae290c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.946+0000 7f8597fff640 10 client.17208 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.946+0000 7f85bcf25640 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2909c80 0x55aae290c070 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f84b808468a5069 server_cookie=c665f90687ebab60 in_seq=0 out_seq=0 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.946+0000 7f8597fff640 1 -- 172.21.15.2:0/502468006 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aae2864640 con 0x55aae2909c80 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.946+0000 7f8597fff640 10 client.17208 handle_command_reply: tid=0 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.946+0000 7f85c2034740 1 client.17208 shutdown 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 msgr2=0x55aae28fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 0x55aae28fa650 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f85a002a940 tx=0x7f85a0031a50 comp rx=0 tx=0).stop 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 shutdown_connections 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2909c80 0x55aae290c070 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f3190 0x55aae28fa650 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 --2- 172.21.15.2:0/502468006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f0860 0x55aae28f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 >> 172.21.15.2:0/502468006 conn(0x55aae28eb9b0 msgr2=0x55aae28eabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f8597fff640 0 client.17208 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 shutdown_connections 2024-09-10T23:29:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 1 -- 172.21.15.2:0/502468006 wait complete. 2024-09-10T23:29:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.947+0000 7f85c2034740 20 client.17208 trim_cache size 0 max 16384 2024-09-10T23:29:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 Processor -- start 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 -- start start 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81a7cd0 con 0x55aae28f0860 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81a9810 con 0x55aae28f3190 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85c2034740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81a83a0 con 0x55aae28f5bd0 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85bcf25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85bcf25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39368/0 (socket says 172.21.15.2:39368) 2024-09-10T23:29:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85bcf25640 1 -- 172.21.15.2:0/1741009170 learned_addr learned my addr 172.21.15.2:0/1741009170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85b7fff640 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.962+0000 7f85bd726640 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:21 smithi177 ceph-mon[35760]: pgmap v502: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:29:21.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:21.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:29:21.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:29:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85bcf25640 1 -- 172.21.15.2:0/1741009170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 msgr2=0x55aae28f9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85bcf25640 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85bcf25640 1 -- 172.21.15.2:0/1741009170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 msgr2=0x55aae28f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85bcf25640 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85bcf25640 1 -- 172.21.15.2:0/1741009170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae28f2fc0 con 0x55aae28f0860 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85bcf25640 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f5fb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f85a80a8770 tx=0x7f85a80e33b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894d776254d98e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85ae7fc640 1 -- 172.21.15.2:0/1741009170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a80abcb0 con 0x55aae28f0860 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85ae7fc640 1 -- 172.21.15.2:0/1741009170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a80ac8a0 con 0x55aae28f0860 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.963+0000 7f85ae7fc640 1 -- 172.21.15.2:0/1741009170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a80cf0b0 con 0x55aae28f0860 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 -- 172.21.15.2:0/1741009170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 msgr2=0x55aae28f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f5fb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f85a80a8770 tx=0x7f85a80e33b0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 -- 172.21.15.2:0/1741009170 shutdown_connections 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 --2- 172.21.15.2:0/1741009170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28f5fb0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 -- 172.21.15.2:0/1741009170 >> 172.21.15.2:0/1741009170 conn(0x55aae28eb9b0 msgr2=0x55aae28efe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 -- 172.21.15.2:0/1741009170 shutdown_connections 2024-09-10T23:29:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 -- 172.21.15.2:0/1741009170 wait complete. 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 -- start start 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.964+0000 7f85c2034740 1 Processor -- start 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28fed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81a9140 con 0x55aae28f0860 2024-09-10T23:29:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81a8a70 con 0x55aae28f3190 2024-09-10T23:29:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81a5cb0 con 0x55aae28f5bd0 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85c2034740 10 client.0 _ll_register_callbacks cb 0x7f85a00316e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39378/0 (socket says 172.21.15.2:39378) 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 -- 172.21.15.2:0/3287150722 learned_addr learned my addr 172.21.15.2:0/3287150722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85b7fff640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bd726640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 -- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 msgr2=0x55aae28fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 -- 172.21.15.2:0/3287150722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 msgr2=0x55aae28ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 -- 172.21.15.2:0/3287150722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae29007b0 con 0x55aae28f0860 2024-09-10T23:29:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85b7fff640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bd726640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f85bcf25640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28fed10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f85a800db50 tx=0x7f85a80e3480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cec3b899edb095 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.965+0000 7f8597fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f8597fff640 1 -- 172.21.15.2:0/3287150722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a80abcb0 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f8597fff640 1 -- 172.21.15.2:0/3287150722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f85a80a8410 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a80ac8a0 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f8597fff640 1 -- 172.21.15.2:0/3287150722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f85a80abaf0 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 10 client.17214 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aae2901b90 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f8597fff640 1 -- 172.21.15.2:0/3287150722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a80ac8a0 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f8597fff640 1 -- 172.21.15.2:0/3287150722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f85a80cdb80 con 0x55aae28f0860 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 10 client.17214 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 10 client.17214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 20 client.17214 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2976cb0 0x55aae29790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 4 client.17214 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aae28600f0 con 0x55aae2976cb0 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.966+0000 7f85b7fff640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2976cb0 0x55aae29790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.967+0000 7f85b7fff640 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2976cb0 0x55aae29790d0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11705df88a91a6df server_cookie=9ce58137cb796eab in_seq=0 out_seq=0 2024-09-10T23:29:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.967+0000 7f8597fff640 10 client.17214 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f8597fff640 1 -- 172.21.15.2:0/3287150722 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aae28600f0 con 0x55aae2976cb0 2024-09-10T23:29:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f8597fff640 10 client.17214 handle_command_reply: tid=0 2024-09-10T23:29:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 client.17214 shutdown 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 msgr2=0x55aae28fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28fed10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f85a800db50 tx=0x7f85a80e3480 comp rx=0 tx=0).stop 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 shutdown_connections 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55aae2976cb0 0x55aae29790d0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aae28f5bd0 0x55aae28fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f8597fff640 0 client.17214 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aae28f3190 0x55aae28ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 --2- 172.21.15.2:0/3287150722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aae28f0860 0x55aae28fed10 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.981+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 >> 172.21.15.2:0/3287150722 conn(0x55aae28eb9b0 msgr2=0x55aae28f5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 shutdown_connections 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85c2034740 1 -- 172.21.15.2:0/3287150722 wait complete. 2024-09-10T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85c2034740 20 client.17214 trim_cache size 0 max 16384 2024-09-10T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f85a40b52e0 msgr2=0x7f85a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f85a40b52e0 0x7f85a40b77a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f85b0011c50 tx=0x7f85b001c000 comp rx=0 tx=0).stop 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 msgr2=0x7f85b8198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 0x7f85b8198e00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f85a800db80 tx=0x7f85a800b630 comp rx=0 tx=0).stop 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 shutdown_connections 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f85a40b52e0 0x7f85a40b77a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85b81033c0 0x7f85b819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85b8102a00 0x7f85b8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 --2- 172.21.15.2:0/3268190572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b81018b0 0x7f85b8198e00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 >> 172.21.15.2:0/3268190572 conn(0x7f85b80fd150 msgr2=0x7f85b80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 shutdown_connections 2024-09-10T23:29:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:21.982+0000 7f85bf189640 1 -- 172.21.15.2:0/3268190572 wait complete. 2024-09-10T23:29:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.461+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/2275106738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f58103ca0 msgr2=0x7f5f58104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.461+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/2275106738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f58103ca0 0x7f5f58104080 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c02a410 comp rx=0 tx=0).stop 2024-09-10T23:29:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.461+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/2275106738 shutdown_connections 2024-09-10T23:29:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.461+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/2275106738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5810d100 0x7f5f5810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.461+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/2275106738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f581045c0 0x7f5f5810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.461+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/2275106738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f58103ca0 0x7f5f58104080 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/2275106738 >> 172.21.15.2:0/2275106738 conn(0x7f5f580fd700 msgr2=0x7f5f580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/2275106738 shutdown_connections 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/2275106738 wait complete. 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 Processor -- start 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 -- start start 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f58103ca0 0x7f5f58199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 0x7f5f58199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.462+0000 7f5f5ee4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5810d100 0x7f5f5819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5ee4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f58112df0 con 0x7f5f581045c0 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5ee4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f58112c70 con 0x7f5f58103ca0 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5ee4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f58112f70 con 0x7f5f5810d100 2024-09-10T23:29:22.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 0x7f5f58199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5cbe7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f58103ca0 0x7f5f58199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 0x7f5f58199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39402/0 (socket says 172.21.15.2:39402) 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 -- 172.21.15.2:0/1085217527 learned_addr learned my addr 172.21.15.2:0/1085217527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f58103ca0 0x7f5f58199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:42542/0 (socket says 172.21.15.2:42542) 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5810d100 0x7f5f5819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 -- 172.21.15.2:0/1085217527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5810d100 msgr2=0x7f5f5819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5810d100 0x7f5f5819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 -- 172.21.15.2:0/1085217527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f58103ca0 msgr2=0x7f5f58199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f58103ca0 0x7f5f58199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 -- 172.21.15.2:0/1085217527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5819f3d0 con 0x7f5f581045c0 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f57fff640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 0x7f5f58199860 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b3c0 tx=0x7f5f4400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f55ffb640 1 -- 172.21.15.2:0/1085217527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011830 con 0x7f5f581045c0 2024-09-10T23:29:22.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5819f6c0 con 0x7f5f581045c0 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f55ffb640 1 -- 172.21.15.2:0/1085217527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f44016070 con 0x7f5f581045c0 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.463+0000 7f5f55ffb640 1 -- 172.21.15.2:0/1085217527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44010de0 con 0x7f5f581045c0 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.464+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f581a5e00 con 0x7f5f581045c0 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.466+0000 7f5f55ffb640 1 -- 172.21.15.2:0/1085217527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5f440119d0 con 0x7f5f581045c0 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.466+0000 7f5f61220740 1 Processor -- start 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.466+0000 7f5f61220740 1 -- start start 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f61220740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb82480 0x5610feb82860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f61220740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb8e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f61220740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 0x5610feb91120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f61220740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5610feaf8e50 con 0x5610feb8ed30 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f61220740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610feae8280 con 0x5610feb82da0 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f61220740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5610feaec090 con 0x5610feb82480 2024-09-10T23:29:22.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 0x5610feb91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f5d3e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb82480 0x5610feb82860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 0x5610feb91120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39406/0 (socket says 172.21.15.2:39406) 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 -- 172.21.15.2:0/505150902 learned_addr learned my addr 172.21.15.2:0/505150902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb8e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 -- 172.21.15.2:0/505150902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb82480 msgr2=0x5610feb82860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb82480 0x5610feb82860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 -- 172.21.15.2:0/505150902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 msgr2=0x5610feb8e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb8e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f57fff640 1 -- 172.21.15.2:0/505150902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610fe846650 con 0x5610feb8ed30 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb82480 0x5610feb82860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:22.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.467+0000 7f5f55ffb640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.468+0000 7f5f57fff640 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 0x5610feb91120 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5f440ed190 tx=0x7f5f440ed650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb1c81ed8cd1db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.468+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.468+0000 7f5f55ffb640 1 -- 172.21.15.2:0/1085217527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5f440e5160 con 0x7f5f581045c0 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.468+0000 7f5f42ffd640 1 -- 172.21.15.2:0/505150902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440a7f20 con 0x5610feb8ed30 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.468+0000 7f5f42ffd640 1 -- 172.21.15.2:0/505150902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f440ab3e0 con 0x5610feb8ed30 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.468+0000 7f5f42ffd640 1 -- 172.21.15.2:0/505150902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ab040 con 0x5610feb8ed30 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 -- 172.21.15.2:0/505150902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 msgr2=0x5610feb91120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f500083e0 tx=0x7f5f50008370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 0x5610feb91120 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5f440ed190 tx=0x7f5f440ed650 comp rx=0 tx=0).stop 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 -- 172.21.15.2:0/505150902 shutdown_connections 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb8ed30 0x5610feb91120 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb8e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 --2- 172.21.15.2:0/505150902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb82480 0x5610feb82860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 -- 172.21.15.2:0/505150902 >> 172.21.15.2:0/505150902 conn(0x5610feb802b0 msgr2=0x5610feb81450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 -- 172.21.15.2:0/505150902 shutdown_connections 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 -- 172.21.15.2:0/505150902 wait complete. 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 -- start start 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.469+0000 7f5f61220740 1 Processor -- start 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82480 0x5610feb8e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 0x5610feb8bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5610fe949700 con 0x5610feb82da0 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610fea83110 con 0x5610feb82480 2024-09-10T23:29:22.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5610feb91830 con 0x5610feb8ed30 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f61220740 10 client.0 _ll_register_callbacks cb 0x5610fea9c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 0x5610feb8bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 0x5610feb8bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39414/0 (socket says 172.21.15.2:39414) 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 -- 172.21.15.2:0/2759076360 learned_addr learned my addr 172.21.15.2:0/2759076360 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82480 0x5610feb8e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 -- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 msgr2=0x5610feb8c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 -- 172.21.15.2:0/2759076360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82480 msgr2=0x5610feb8e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82480 0x5610feb8e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 -- 172.21.15.2:0/2759076360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610feab0c40 con 0x5610feb82da0 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:22.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f57fff640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 0x5610feb8bac0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5f44004810 tx=0x7f5f44010700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d269b968ef90c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f37fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.470+0000 7f5f37fff640 1 -- 172.21.15.2:0/2759076360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ab220 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f37fff640 1 -- 172.21.15.2:0/2759076360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5f440a7b40 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f440ab3e0 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f37fff640 1 -- 172.21.15.2:0/2759076360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f440ab6a0 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 10 client.17226 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610feb9d1b0 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f37fff640 1 -- 172.21.15.2:0/2759076360 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f440ab3e0 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f37fff640 1 -- 172.21.15.2:0/2759076360 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f440abb30 con 0x5610feb82da0 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 10 client.17226 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 20 client.17226 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610feb9e500 0x5610feba08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 4 client.17226 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610feafada0 con 0x5610feb9e500 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.471+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610feb9e500 0x5610feba08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.472+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610feb9e500 0x5610feba08f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1d377531d33c12e server_cookie=19744a595da9a622 in_seq=0 out_seq=0 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.472+0000 7f5f37fff640 10 client.17226 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f37fff640 1 -- 172.21.15.2:0/2759076360 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5610feafada0 con 0x5610feb9e500 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f37fff640 10 client.17226 handle_command_reply: tid=0 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 client.17226 shutdown 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 msgr2=0x5610feb8bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 0x5610feb8bac0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5f44004810 tx=0x7f5f44010700 comp rx=0 tx=0).stop 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 shutdown_connections 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610feb9e500 0x5610feba08f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82da0 0x5610feb8bac0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f37fff640 0 client.17226 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 --2- 172.21.15.2:0/2759076360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82480 0x5610feb8e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 >> 172.21.15.2:0/2759076360 conn(0x5610feb802b0 msgr2=0x5610feb85e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 shutdown_connections 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 1 -- 172.21.15.2:0/2759076360 wait complete. 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.473+0000 7f5f61220740 20 client.17226 trim_cache size 0 max 16384 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.491+0000 7f5f61220740 1 Processor -- start 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.491+0000 7f5f61220740 1 -- start start 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f61220740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feb9aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f61220740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb86da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f61220740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f61220740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581ae410 con 0x5610feb82480 2024-09-10T23:29:22.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f61220740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581aff50 con 0x5610feb82da0 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f61220740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581aeae0 con 0x5610feb8ed30 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feb9aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feb9aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39420/0 (socket says 172.21.15.2:39420) 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/816097431 learned_addr learned my addr 172.21.15.2:0/816097431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f57fff640 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb86da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/816097431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 msgr2=0x5610feb8a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/816097431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 msgr2=0x5610feb86da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb86da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/816097431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610feb89fc0 con 0x5610feb82480 2024-09-10T23:29:22.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.492+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feb9aad0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c02a930 tx=0x7f5f4c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2bfa553bd1b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.494+0000 7f5f427fc640 1 -- 172.21.15.2:0/816097431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c04a070 con 0x5610feb82480 2024-09-10T23:29:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.494+0000 7f5f427fc640 1 -- 172.21.15.2:0/816097431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c005020 con 0x5610feb82480 2024-09-10T23:29:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.494+0000 7f5f427fc640 1 -- 172.21.15.2:0/816097431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c035040 con 0x5610feb82480 2024-09-10T23:29:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 -- 172.21.15.2:0/816097431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 msgr2=0x5610feb9aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feb9aad0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c02a930 tx=0x7f5f4c005e80 comp rx=0 tx=0).stop 2024-09-10T23:29:22.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 -- 172.21.15.2:0/816097431 shutdown_connections 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feb8a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feb86da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 --2- 172.21.15.2:0/816097431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feb9aad0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 -- 172.21.15.2:0/816097431 >> 172.21.15.2:0/816097431 conn(0x5610feb802b0 msgr2=0x5610feb8a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 -- 172.21.15.2:0/816097431 shutdown_connections 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.495+0000 7f5f61220740 1 -- 172.21.15.2:0/816097431 wait complete. 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.496+0000 7f5f61220740 1 -- start start 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.496+0000 7f5f61220740 1 Processor -- start 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.496+0000 7f5f61220740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feba42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f61220740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feba0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f61220740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feba0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f61220740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581af880 con 0x5610feb82480 2024-09-10T23:29:22.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f61220740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581af1b0 con 0x5610feb82da0 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f61220740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581ac3f0 con 0x5610feb8ed30 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f61220740 10 client.0 _ll_register_callbacks cb 0x7f5f4c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feba0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feba42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feba0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:42570/0 (socket says 172.21.15.2:42570) 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f57fff640 1 -- 172.21.15.2:0/1583212310 learned_addr learned my addr 172.21.15.2:0/1583212310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feba0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 msgr2=0x5610feba0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feba0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/1583212310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 msgr2=0x5610feba0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feba0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 -- 172.21.15.2:0/1583212310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610fec0b070 con 0x5610feb82480 2024-09-10T23:29:22.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5d3e8640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feba0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f5cbe7640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feba42d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c02a450 tx=0x7f5f4c031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dac6e1df032e76a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.497+0000 7f5f37fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.498+0000 7f5f37fff640 1 -- 172.21.15.2:0/1583212310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c052070 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.498+0000 7f5f37fff640 1 -- 172.21.15.2:0/1583212310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5f4c004040 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.498+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f4c005020 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f37fff640 1 -- 172.21.15.2:0/1583212310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f4c035070 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 10 client.17232 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610fec0c2e0 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f37fff640 1 -- 172.21.15.2:0/1583212310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c004da0 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f37fff640 1 -- 172.21.15.2:0/1583212310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f4c003950 con 0x5610feb82480 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 10 client.17232 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 10 client.17232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:22.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 20 client.17232 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610fec0c9a0 0x5610fec0ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 4 client.17232 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5f4c005020 con 0x5610fec0c9a0 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.499+0000 7f5f57fff640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610fec0c9a0 0x5610fec0ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f57fff640 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610fec0c9a0 0x5610fec0ed90 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff1ac2faef86a55d server_cookie=af193caa075947f0 in_seq=0 out_seq=0 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f37fff640 10 client.17232 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f37fff640 1 -- 172.21.15.2:0/1583212310 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x7f5f4c005020 con 0x5610fec0c9a0 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f37fff640 10 client.17232 handle_command_reply: tid=0 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 client.17232 shutdown 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 msgr2=0x5610feba42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feba42d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c02a450 tx=0x7f5f4c031af0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 shutdown_connections 2024-09-10T23:29:22.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5610fec0c9a0 0x5610fec0ed90 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5610feb8ed30 0x5610feba0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f37fff640 0 client.17232 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610feb82da0 0x5610feba0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 --2- 172.21.15.2:0/1583212310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610feb82480 0x5610feba42d0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.500+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 >> 172.21.15.2:0/1583212310 conn(0x5610feb802b0 msgr2=0x5610feb8aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 shutdown_connections 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f61220740 1 -- 172.21.15.2:0/1583212310 wait complete. 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f61220740 20 client.17232 trim_cache size 0 max 16384 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:29:22.514 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "8bf5845a-755e-46de-a436-3072cf7bd949", 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.515 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:29:22.516 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.517 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:29:22.519 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.520 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:22.521 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:22.522 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:22.522 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:22.522 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:29:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 msgr2=0x7f5f480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f500083e0 tx=0x7f5f50008370 comp rx=0 tx=0).stop 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 msgr2=0x7f5f58199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 0x7f5f58199860 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b3c0 tx=0x7f5f4400b880 comp rx=0 tx=0).stop 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 shutdown_connections 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5f480b52e0 0x7f5f480b77a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f5810d100 0x7f5f5819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f581045c0 0x7f5f58199860 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 --2- 172.21.15.2:0/1085217527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f58103ca0 0x7f5f58199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.501+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 >> 172.21.15.2:0/1085217527 conn(0x7f5f580fd700 msgr2=0x7f5f580fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.502+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 shutdown_connections 2024-09-10T23:29:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:22.502+0000 7f5f5ee4b640 1 -- 172.21.15.2:0/1085217527 wait complete. 2024-09-10T23:29:23.417 INFO:tasks.cephfs.filesystem:scrub status for tag:8bf5845a-755e-46de-a436-3072cf7bd949 - {'path': '/', 'tag': '8bf5845a-755e-46de-a436-3072cf7bd949', 'options': 'recursive,force'} 2024-09-10T23:29:23.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:23 smithi002 ceph-mon[31150]: pgmap v503: 97 pgs: 97 active+clean; 3.8 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:23.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:23 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:29:23.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:23 smithi154 ceph-mon[35136]: pgmap v503: 97 pgs: 97 active+clean; 3.8 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:23.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:23 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:29:23.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:23 smithi177 ceph-mon[35760]: pgmap v503: 97 pgs: 97 active+clean; 3.8 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:23.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:23 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:29:25.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:25 smithi154 ceph-mon[35136]: pgmap v504: 97 pgs: 97 active+clean; 3.8 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:29:25.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:25 smithi177 ceph-mon[35760]: pgmap v504: 97 pgs: 97 active+clean; 3.8 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:29:25.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:25 smithi002 ceph-mon[31150]: pgmap v504: 97 pgs: 97 active+clean; 3.8 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:29:27.367 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.367 INFO:tasks.workunit.client.0.smithi002.stdout:189/600: open fd = 3 2024-09-10T23:29:27.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.368 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.368 INFO:tasks.workunit.client.0.smithi002.stdout:190/600: open fd = 3 2024-09-10T23:29:27.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.368 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:191/600: open fd = 3 2024-09-10T23:29:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:192/600: open fd = 3 2024-09-10T23:29:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.370 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.370 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.370 INFO:tasks.workunit.client.0.smithi002.stdout:193/600: open fd = 3 2024-09-10T23:29:27.370 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.370 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.370 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:194/600: open fd = 3 2024-09-10T23:29:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:195/600: open fd = 3 2024-09-10T23:29:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.372 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.372 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.372 INFO:tasks.workunit.client.0.smithi002.stdout:196/600: open fd = 3 2024-09-10T23:29:27.372 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.372 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:197/600: open fd = 3 2024-09-10T23:29:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:198/600: open fd = 3 2024-09-10T23:29:27.374 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.374 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.374 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.374 INFO:tasks.workunit.client.0.smithi002.stdout:199/600: open fd = 3 2024-09-10T23:29:27.374 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.374 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.375 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.375 INFO:tasks.workunit.client.0.smithi002.stdout:200/600: open fd = 3 2024-09-10T23:29:27.375 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.375 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.375 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.375 INFO:tasks.workunit.client.0.smithi002.stdout:201/600: open fd = 3 2024-09-10T23:29:27.376 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.376 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.376 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.376 INFO:tasks.workunit.client.0.smithi002.stdout:202/600: open fd = 3 2024-09-10T23:29:27.376 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.377 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.377 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.377 INFO:tasks.workunit.client.0.smithi002.stdout:203/600: open fd = 3 2024-09-10T23:29:27.377 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.377 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.377 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.378 INFO:tasks.workunit.client.0.smithi002.stdout:204/600: open fd = 3 2024-09-10T23:29:27.378 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.378 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.378 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.378 INFO:tasks.workunit.client.0.smithi002.stdout:205/600: open fd = 3 2024-09-10T23:29:27.378 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.379 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.379 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.379 INFO:tasks.workunit.client.0.smithi002.stdout:206/600: open fd = 3 2024-09-10T23:29:27.379 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.379 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.379 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.380 INFO:tasks.workunit.client.0.smithi002.stdout:207/600: open fd = 3 2024-09-10T23:29:27.380 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.380 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.380 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.380 INFO:tasks.workunit.client.0.smithi002.stdout:208/600: open fd = 3 2024-09-10T23:29:27.380 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.381 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.381 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.381 INFO:tasks.workunit.client.0.smithi002.stdout:209/600: open fd = 3 2024-09-10T23:29:27.381 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.381 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.381 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.382 INFO:tasks.workunit.client.0.smithi002.stdout:210/600: open fd = 3 2024-09-10T23:29:27.382 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.382 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.382 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.382 INFO:tasks.workunit.client.0.smithi002.stdout:211/600: open fd = 3 2024-09-10T23:29:27.382 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.383 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.383 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.383 INFO:tasks.workunit.client.0.smithi002.stdout:212/600: open fd = 3 2024-09-10T23:29:27.383 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.383 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.384 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.384 INFO:tasks.workunit.client.0.smithi002.stdout:213/600: open fd = 3 2024-09-10T23:29:27.384 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.384 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.384 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.384 INFO:tasks.workunit.client.0.smithi002.stdout:214/600: open fd = 3 2024-09-10T23:29:27.385 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.385 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.385 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.385 INFO:tasks.workunit.client.0.smithi002.stdout:215/600: open fd = 3 2024-09-10T23:29:27.385 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.385 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.386 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.386 INFO:tasks.workunit.client.0.smithi002.stdout:216/600: open fd = 3 2024-09-10T23:29:27.386 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.386 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.386 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.386 INFO:tasks.workunit.client.0.smithi002.stdout:217/600: open fd = 3 2024-09-10T23:29:27.387 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.387 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.387 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.387 INFO:tasks.workunit.client.0.smithi002.stdout:218/600: open fd = 3 2024-09-10T23:29:27.387 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.387 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:219/600: open fd = 3 2024-09-10T23:29:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.388 INFO:tasks.workunit.client.0.smithi002.stdout:220/600: open fd = 3 2024-09-10T23:29:27.389 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.389 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.389 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.389 INFO:tasks.workunit.client.0.smithi002.stdout:221/600: open fd = 3 2024-09-10T23:29:27.389 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.390 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.390 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.390 INFO:tasks.workunit.client.0.smithi002.stdout:222/600: open fd = 3 2024-09-10T23:29:27.390 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.390 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.390 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:223/600: open fd = 3 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:224/600: open fd = 3 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.391 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:225/600: open fd = 3 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:226/600: open fd = 3 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.392 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:227/600: open fd = 3 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:228/600: open fd = 3 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.393 INFO:tasks.workunit.client.0.smithi002.stdout:229/600: open fd = 3 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:230/600: open fd = 3 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:231/600: open fd = 3 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.394 INFO:tasks.workunit.client.0.smithi002.stdout:232/600: open fd = 3 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:233/600: open fd = 3 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:234/600: open fd = 3 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:235/600: open fd = 3 2024-09-10T23:29:27.395 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:236/600: open fd = 3 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:237/600: open fd = 3 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.396 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:238/600: open fd = 3 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:239/600: open fd = 3 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.397 INFO:tasks.workunit.client.0.smithi002.stdout:240/600: open fd = 3 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:241/600: open fd = 3 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:242/600: open fd = 3 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.398 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:243/600: open fd = 3 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:244/600: open fd = 3 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:245/600: open fd = 3 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:246/600: open fd = 3 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:247/600: open fd = 3 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:248/600: open fd = 3 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:249/600: open fd = 3 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:250/600: open fd = 3 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:29:27.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:27 smithi154 ceph-mon[35136]: pgmap v505: 97 pgs: 97 active+clean; 3.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:27 smithi177 ceph-mon[35760]: pgmap v505: 97 pgs: 97 active+clean; 3.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:27.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:27 smithi002 ceph-mon[31150]: pgmap v505: 97 pgs: 97 active+clean; 3.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:29 smithi154 ceph-mon[35136]: pgmap v506: 97 pgs: 97 active+clean; 3.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:29:29.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:29:29.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:29 smithi177 ceph-mon[35760]: pgmap v506: 97 pgs: 97 active+clean; 3.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:29:29.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:29:29.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:29 smithi002 ceph-mon[31150]: pgmap v506: 97 pgs: 97 active+clean; 3.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:29:29.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:29:30.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:30 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:30.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:30 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:29:30.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:30 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:29:30.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:30 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:30.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:30 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:29:30.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:30 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:29:30.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:30 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:30.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:30 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:29:30.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:30 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:29:32.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:31 smithi177 ceph-mon[35760]: pgmap v507: 97 pgs: 97 active+clean; 3.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:31 smithi002 ceph-mon[31150]: pgmap v507: 97 pgs: 97 active+clean; 3.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:31 smithi154 ceph-mon[35136]: pgmap v507: 97 pgs: 97 active+clean; 3.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:34.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:33 smithi002 ceph-mon[31150]: pgmap v508: 97 pgs: 97 active+clean; 3.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:29:34.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:33 smithi177 ceph-mon[35760]: pgmap v508: 97 pgs: 97 active+clean; 3.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:29:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:33 smithi154 ceph-mon[35136]: pgmap v508: 97 pgs: 97 active+clean; 3.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:29:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- 172.21.15.2:0/295229242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 msgr2=0x7ff84010ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- 172.21.15.2:0/295229242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff84010ab30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff838009ca0 tx=0x7ff83802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- 172.21.15.2:0/295229242 shutdown_connections 2024-09-10T23:29:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- 172.21.15.2:0/295229242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff84010ab30 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- 172.21.15.2:0/295229242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 0x7ff840107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- 172.21.15.2:0/295229242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff84006b470 0x7ff840105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- 172.21.15.2:0/295229242 >> 172.21.15.2:0/295229242 conn(0x7ff8400fd140 msgr2=0x7ff8400ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- 172.21.15.2:0/295229242 shutdown_connections 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- 172.21.15.2:0/295229242 wait complete. 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 Processor -- start 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- start start 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff84006b470 0x7ff840198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 0x7ff840199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff840199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010e5c0 con 0x7ff840108670 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010e440 con 0x7ff84006b470 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.074+0000 7ff84747f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010e740 con 0x7ff840105ac0 2024-09-10T23:29:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff840199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff840199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47726/0 (socket says 172.21.15.2:47726) 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 -- 172.21.15.2:0/2076084572 learned_addr learned my addr 172.21.15.2:0/2076084572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff844a1a640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 0x7ff840199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff84521b640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff84006b470 0x7ff840198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 -- 172.21.15.2:0/2076084572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 msgr2=0x7ff840199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 0x7ff840199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 -- 172.21.15.2:0/2076084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff84006b470 msgr2=0x7ff840198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff84006b470 0x7ff840198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 -- 172.21.15.2:0/2076084572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84019a850 con 0x7ff840108670 2024-09-10T23:29:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff844a1a640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 0x7ff840199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff845a1c640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff840199f90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff8380097b0 tx=0x7ff838003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff8367fc640 1 -- 172.21.15.2:0/2076084572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838004240 con 0x7ff840108670 2024-09-10T23:29:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84019aae0 con 0x7ff840108670 2024-09-10T23:29:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff8367fc640 1 -- 172.21.15.2:0/2076084572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8380317c0 con 0x7ff840108670 2024-09-10T23:29:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff8367fc640 1 -- 172.21.15.2:0/2076084572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83802fd80 con 0x7ff840108670 2024-09-10T23:29:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.075+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401a1210 con 0x7ff840108670 2024-09-10T23:29:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.078+0000 7ff8367fc640 1 -- 172.21.15.2:0/2076084572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff8380043e0 con 0x7ff840108670 2024-09-10T23:29:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff8367fc640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84521b640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff8367fc640 1 -- 172.21.15.2:0/2076084572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff8381072e0 con 0x7ff840108670 2024-09-10T23:29:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 Processor -- start 2024-09-10T23:29:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 -- start start 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84521b640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00bbe0 tx=0x7ff83c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b54c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b57580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564443ac46f0 con 0x564443b57bd0 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564443ab3b20 con 0x564443b55190 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff84a24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564443ab7930 con 0x564443b52860 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47732/0 (socket says 172.21.15.2:47732) 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.079+0000 7ff845a1c640 1 -- 172.21.15.2:0/672017532 learned_addr learned my addr 172.21.15.2:0/672017532 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff84521b640 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b54c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff844a1a640 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b57580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff845a1c640 1 -- 172.21.15.2:0/672017532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 msgr2=0x564443b54c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff845a1c640 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b54c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff845a1c640 1 -- 172.21.15.2:0/672017532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 msgr2=0x564443b57580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff845a1c640 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b57580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff845a1c640 1 -- 172.21.15.2:0/672017532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564443a79530 con 0x564443b57bd0 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff845a1c640 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5a090 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff8380cd9e0 tx=0x7ff8380cd8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520c3caf7a98b3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff82b7fe640 1 -- 172.21.15.2:0/672017532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380098d0 con 0x564443b57bd0 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff82b7fe640 1 -- 172.21.15.2:0/672017532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff838036040 con 0x564443b57bd0 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.080+0000 7ff82b7fe640 1 -- 172.21.15.2:0/672017532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380d2530 con 0x564443b57bd0 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 -- 172.21.15.2:0/672017532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 msgr2=0x564443b5a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5a090 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff8380cd9e0 tx=0x7ff8380cd8a0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 -- 172.21.15.2:0/672017532 shutdown_connections 2024-09-10T23:29:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5a090 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b57580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 --2- 172.21.15.2:0/672017532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b54c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 -- 172.21.15.2:0/672017532 >> 172.21.15.2:0/672017532 conn(0x564443b4d9b0 msgr2=0x564443b4e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 -- 172.21.15.2:0/672017532 shutdown_connections 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 -- 172.21.15.2:0/672017532 wait complete. 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 -- start start 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.081+0000 7ff84a24e740 1 Processor -- start 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b55190 0x564443b5c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5644439ebab0 con 0x564443b57bd0 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564443a59730 con 0x564443b52860 2024-09-10T23:29:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564443ac46f0 con 0x564443b55190 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84a24e740 10 client.0 _ll_register_callbacks cb 0x564443aad6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47746/0 (socket says 172.21.15.2:47746) 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 -- 172.21.15.2:0/497180769 learned_addr learned my addr 172.21.15.2:0/497180769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff844a1a640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b55190 0x564443b5c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff84521b640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 -- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b55190 msgr2=0x564443b5c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b55190 0x564443b5c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 -- 172.21.15.2:0/497180769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b52860 msgr2=0x564443b5baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 -- 172.21.15.2:0/497180769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564443815790 con 0x564443b57bd0 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff844a1a640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b55190 0x564443b5c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff845a1c640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5cd10 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff83802f880 tx=0x7ff83802ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5ea3bf8b280c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.082+0000 7ff828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff828ff9640 1 -- 172.21.15.2:0/497180769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380f4020 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff828ff9640 1 -- 172.21.15.2:0/497180769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff8380c9cc0 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838036040 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff828ff9640 1 -- 172.21.15.2:0/497180769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff838003e10 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 10 client.17244 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56444388e620 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff828ff9640 1 -- 172.21.15.2:0/497180769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff838036040 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff828ff9640 1 -- 172.21.15.2:0/497180769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8380d6b50 con 0x564443b57bd0 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 10 client.17244 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 10 client.17244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 20 client.17244 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443b67300 0x564443b69720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 4 client.17244 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:35.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564443ac6640 con 0x564443b67300 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.083+0000 7ff84521b640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443b67300 0x564443b69720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.084+0000 7ff828ff9640 10 client.17244 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.084+0000 7ff84521b640 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443b67300 0x564443b69720 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77c1e8dad8386bb server_cookie=27c89d49287a7e35 in_seq=0 out_seq=0 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.084+0000 7ff828ff9640 1 -- 172.21.15.2:0/497180769 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564443ac6640 con 0x564443b67300 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.084+0000 7ff828ff9640 10 client.17244 handle_command_reply: tid=0 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 client.17244 shutdown 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 msgr2=0x564443b5cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5cd10 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff83802f880 tx=0x7ff83802ff20 comp rx=0 tx=0).stop 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 shutdown_connections 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443b67300 0x564443b69720 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5cd10 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff828ff9640 0 client.17244 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b55190 0x564443b5c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 --2- 172.21.15.2:0/497180769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 >> 172.21.15.2:0/497180769 conn(0x564443b4d9b0 msgr2=0x564443b4cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 shutdown_connections 2024-09-10T23:29:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 1 -- 172.21.15.2:0/497180769 wait complete. 2024-09-10T23:29:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.085+0000 7ff84a24e740 20 client.17244 trim_cache size 0 max 16384 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 Processor -- start 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 -- start start 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b63610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401a9e80 con 0x564443b57bd0 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401ab9c0 con 0x564443b55190 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84a24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401aa550 con 0x564443b52860 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47750/0 (socket says 172.21.15.2:47750) 2024-09-10T23:29:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 -- 172.21.15.2:0/1750928362 learned_addr learned my addr 172.21.15.2:0/1750928362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff844a1a640 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b63610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff84521b640 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 -- 172.21.15.2:0/1750928362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 msgr2=0x564443b5baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 -- 172.21.15.2:0/1750928362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 msgr2=0x564443b63610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b63610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 -- 172.21.15.2:0/1750928362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564443b54fc0 con 0x564443b57bd0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff844a1a640 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b63610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.100+0000 7ff845a1c640 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5ad00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff8380cd750 tx=0x7ff8380cd8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71965d24c75a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff82affd640 1 -- 172.21.15.2:0/1750928362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380f4070 con 0x564443b57bd0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff82affd640 1 -- 172.21.15.2:0/1750928362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff838036070 con 0x564443b57bd0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff82affd640 1 -- 172.21.15.2:0/1750928362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380ca0a0 con 0x564443b57bd0 2024-09-10T23:29:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 -- 172.21.15.2:0/1750928362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 msgr2=0x564443b5ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5ad00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff8380cd750 tx=0x7ff8380cd8a0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 -- 172.21.15.2:0/1750928362 shutdown_connections 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b5ad00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b63610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 --2- 172.21.15.2:0/1750928362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b5baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 -- 172.21.15.2:0/1750928362 >> 172.21.15.2:0/1750928362 conn(0x564443b4d9b0 msgr2=0x564443b58020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 -- 172.21.15.2:0/1750928362 shutdown_connections 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.101+0000 7ff84a24e740 1 -- 172.21.15.2:0/1750928362 wait complete. 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 -- start start 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 Processor -- start 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b60ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b61160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b61ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401ab2f0 con 0x564443b57bd0 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401aac20 con 0x564443b55190 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401a7e60 con 0x564443b52860 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84a24e740 10 client.0 _ll_register_callbacks cb 0x7ff83000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b61ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff845a1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b61ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47754/0 (socket says 172.21.15.2:47754) 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff845a1c640 1 -- 172.21.15.2:0/759836518 learned_addr learned my addr 172.21.15.2:0/759836518 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff84521b640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b60ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.102+0000 7ff844a1a640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b61160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff845a1c640 1 -- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 msgr2=0x564443b60ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff845a1c640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b60ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff845a1c640 1 -- 172.21.15.2:0/759836518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 msgr2=0x564443b61160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff845a1c640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b61160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff845a1c640 1 -- 172.21.15.2:0/759836518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564443b62510 con 0x564443b57bd0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84521b640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b60ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff845a1c640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b61ce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff8380cd9e0 tx=0x7ff8380c9ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5438018501205a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff828ff9640 1 -- 172.21.15.2:0/759836518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380f4040 con 0x564443b57bd0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838036070 con 0x564443b57bd0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff828ff9640 1 -- 172.21.15.2:0/759836518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff838004d50 con 0x564443b57bd0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff828ff9640 1 -- 172.21.15.2:0/759836518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8380ca0a0 con 0x564443b57bd0 2024-09-10T23:29:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84a24e740 10 client.17250 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564443b62510 con 0x564443b57bd0 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff828ff9640 1 -- 172.21.15.2:0/759836518 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff838036070 con 0x564443b57bd0 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff828ff9640 1 -- 172.21.15.2:0/759836518 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8380cc720 con 0x564443b57bd0 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84a24e740 10 client.17250 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84a24e740 10 client.17250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.103+0000 7ff84a24e740 20 client.17250 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.104+0000 7ff84a24e740 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443bd41d0 0x564443bd65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.104+0000 7ff84a24e740 4 client.17250 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.104+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564443ac20f0 con 0x564443bd41d0 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.104+0000 7ff84521b640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443bd41d0 0x564443bd65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.104+0000 7ff828ff9640 10 client.17250 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.104+0000 7ff84521b640 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443bd41d0 0x564443bd65c0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e722d4c3a47363 server_cookie=10b0983b30f284d3 in_seq=0 out_seq=0 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff828ff9640 1 -- 172.21.15.2:0/759836518 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564443ac20f0 con 0x564443bd41d0 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff828ff9640 10 client.17250 handle_command_reply: tid=0 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 client.17250 shutdown 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 msgr2=0x564443b61ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b61ce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff8380cd9e0 tx=0x7ff8380c9ef0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 shutdown_connections 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564443bd41d0 0x564443bd65c0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564443b57bd0 0x564443b61ce0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564443b55190 0x564443b61160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff828ff9640 0 client.17250 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 --2- 172.21.15.2:0/759836518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564443b52860 0x564443b60ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 >> 172.21.15.2:0/759836518 conn(0x564443b4d9b0 msgr2=0x564443b4c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 shutdown_connections 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 1 -- 172.21.15.2:0/759836518 wait complete. 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.120+0000 7ff84a24e740 20 client.17250 trim_cache size 0 max 16384 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:29:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:29:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:29:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff82c0b52e0 msgr2=0x7ff82c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00bbe0 tx=0x7ff83c00b390 comp rx=0 tx=0).stop 2024-09-10T23:29:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 msgr2=0x7ff840199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff840199f90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff8380097b0 tx=0x7ff838003c20 comp rx=0 tx=0).stop 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 shutdown_connections 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840108670 0x7ff840199f90 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840105ac0 0x7ff840199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 --2- 172.21.15.2:0/2076084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff84006b470 0x7ff840198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 >> 172.21.15.2:0/2076084572 conn(0x7ff8400fd140 msgr2=0x7ff840103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 shutdown_connections 2024-09-10T23:29:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:35.121+0000 7ff84747f640 1 -- 172.21.15.2:0/2076084572 wait complete. 2024-09-10T23:29:36.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:35 smithi177 ceph-mon[35760]: pgmap v509: 97 pgs: 97 active+clean; 3.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:35 smithi002 ceph-mon[31150]: pgmap v509: 97 pgs: 97 active+clean; 3.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:36.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:35 smithi154 ceph-mon[35136]: pgmap v509: 97 pgs: 97 active+clean; 3.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:29:38.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:37 smithi177 ceph-mon[35760]: pgmap v510: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:29:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:37 smithi002 ceph-mon[31150]: pgmap v510: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:29:38.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:37 smithi154 ceph-mon[35136]: pgmap v510: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:29:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:39 smithi177 ceph-mon[35760]: pgmap v511: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:40.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:39 smithi002 ceph-mon[31150]: pgmap v511: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:40.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:39 smithi154 ceph-mon[35136]: pgmap v511: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:42.081 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:41 smithi154 ceph-mon[35136]: pgmap v512: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:41 smithi177 ceph-mon[35760]: pgmap v512: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:42.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:41 smithi002 ceph-mon[31150]: pgmap v512: 97 pgs: 97 active+clean; 4.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:43 smithi177 ceph-mon[35760]: pgmap v513: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:29:44.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:43 smithi002 ceph-mon[31150]: pgmap v513: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:29:44.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:43 smithi154 ceph-mon[35136]: pgmap v513: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:29:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:45 smithi177 ceph-mon[35760]: pgmap v514: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:46.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:45 smithi002 ceph-mon[31150]: pgmap v514: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:46.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:45 smithi154 ceph-mon[35136]: pgmap v514: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:29:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:47 smithi177 ceph-mon[35760]: pgmap v515: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 -- 172.21.15.2:0/1263261195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518108680 msgr2=0x7f351810ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 --2- 172.21.15.2:0/1263261195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518108680 0x7f351810ab40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3510009900 tx=0x7f351002a410 comp rx=0 tx=0).stop 2024-09-10T23:29:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 -- 172.21.15.2:0/1263261195 shutdown_connections 2024-09-10T23:29:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 --2- 172.21.15.2:0/1263261195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518108680 0x7f351810ab40 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 --2- 172.21.15.2:0/1263261195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3518105b30 0x7f3518107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 --2- 172.21.15.2:0/1263261195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f351806b3b0 0x7f35181055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 -- 172.21.15.2:0/1263261195 >> 172.21.15.2:0/1263261195 conn(0x7f35180fd140 msgr2=0x7f35180ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 -- 172.21.15.2:0/1263261195 shutdown_connections 2024-09-10T23:29:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 -- 172.21.15.2:0/1263261195 wait complete. 2024-09-10T23:29:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.220+0000 7f351d47f640 1 Processor -- start 2024-09-10T23:29:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 -- start start 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f351806b3b0 0x7f351819af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 0x7f351819b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3518108680 0x7f351819c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f351810e5f0 con 0x7f3518105b30 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f351810e470 con 0x7f351806b3b0 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f351d47f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f351810e770 con 0x7f3518108680 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 0x7f351819b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 0x7f351819b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43918/0 (socket says 172.21.15.2:43918) 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 -- 172.21.15.2:0/4289902953 learned_addr learned my addr 172.21.15.2:0/4289902953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f3516ffd640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f351806b3b0 0x7f351819af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35177fe640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3518108680 0x7f351819c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 -- 172.21.15.2:0/4289902953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3518108680 msgr2=0x7f351819c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3518108680 0x7f351819c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 -- 172.21.15.2:0/4289902953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f351806b3b0 msgr2=0x7f351819af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f351806b3b0 0x7f351819af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.221+0000 7f35167fc640 1 -- 172.21.15.2:0/4289902953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351819ca90 con 0x7f3518105b30 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.222+0000 7f35167fc640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 0x7f351819b5a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f350c00e9f0 tx=0x7f350c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.222+0000 7f34fffff640 1 -- 172.21.15.2:0/4289902953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c00ccc0 con 0x7f3518105b30 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.222+0000 7f34fffff640 1 -- 172.21.15.2:0/4289902953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f350c0054d0 con 0x7f3518105b30 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.222+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351819cd80 con 0x7f3518105b30 2024-09-10T23:29:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.222+0000 7f34fffff640 1 -- 172.21.15.2:0/4289902953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c010430 con 0x7f3518105b30 2024-09-10T23:29:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.222+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35181a3450 con 0x7f3518105b30 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.224+0000 7f352024b740 1 Processor -- start 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.224+0000 7f352024b740 1 -- start start 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.224+0000 7f34fffff640 1 -- 172.21.15.2:0/4289902953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f350c0046c0 con 0x7f3518105b30 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f352024b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 0x55769a780c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f352024b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a783580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f352024b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a786090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f352024b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55769a6f06f0 con 0x55769a783bd0 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f352024b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55769a6dfb20 con 0x55769a781190 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f352024b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55769a6e3930 con 0x55769a77e860 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35167fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a786090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 0x55769a780c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 0x55769a780c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:42474/0 (socket says 172.21.15.2:42474) 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 -- 172.21.15.2:0/566279149 learned_addr learned my addr 172.21.15.2:0/566279149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f3516ffd640 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a783580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 -- 172.21.15.2:0/566279149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 msgr2=0x55769a783580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a783580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 -- 172.21.15.2:0/566279149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 msgr2=0x55769a786090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a786090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.225+0000 7f35177fe640 1 -- 172.21.15.2:0/566279149 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769a6a5530 con 0x55769a77e860 2024-09-10T23:29:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f35177fe640 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 0x55769a780c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3510009900 tx=0x7f3510032ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f5b9e6232916ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f34fffff640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f35000b52e0 0x7f35000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f34fd7fa640 1 -- 172.21.15.2:0/566279149 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351003f070 con 0x55769a77e860 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f34fd7fa640 1 -- 172.21.15.2:0/566279149 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3510004040 con 0x55769a77e860 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f3516ffd640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f35000b52e0 0x7f35000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f34fd7fa640 1 -- 172.21.15.2:0/566279149 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510035070 con 0x55769a77e860 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.226+0000 7f34fffff640 1 -- 172.21.15.2:0/4289902953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f350c0e5f60 con 0x7f3518105b30 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- 172.21.15.2:0/566279149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 msgr2=0x55769a780c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f3516ffd640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f35000b52e0 0x7f35000b77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3508005fd0 tx=0x7f3508009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 0x55769a780c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3510009900 tx=0x7f3510032ba0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- 172.21.15.2:0/566279149 shutdown_connections 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a786090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a783580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- 172.21.15.2:0/566279149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a77e860 0x55769a780c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- 172.21.15.2:0/566279149 >> 172.21.15.2:0/566279149 conn(0x55769a7799b0 msgr2=0x55769a77a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- 172.21.15.2:0/566279149 shutdown_connections 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- 172.21.15.2:0/566279149 wait complete. 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- start start 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 Processor -- start 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a787e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a788530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a789100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55769a617ab0 con 0x55769a77e860 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55769a685730 con 0x55769a781190 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55769a786b50 con 0x55769a783bd0 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.227+0000 7f352024b740 10 client.0 _ll_register_callbacks cb 0x55769a6d96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a787e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a787e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43948/0 (socket says 172.21.15.2:43948) 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 -- 172.21.15.2:0/116925380 learned_addr learned my addr 172.21.15.2:0/116925380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f35177fe640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a789100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f35167fc640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a788530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 -- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 msgr2=0x55769a789100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a789100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 -- 172.21.15.2:0/116925380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 msgr2=0x55769a788530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a788530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 -- 172.21.15.2:0/116925380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769a441790 con 0x55769a77e860 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f3516ffd640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a787e90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3508005f40 tx=0x7f3508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2a008c4c6d63dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f34faff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:48.236 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f34faff5640 1 -- 172.21.15.2:0/116925380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35080109b0 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f34faff5640 1 -- 172.21.15.2:0/116925380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3508010b50 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.228+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3510004040 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f34faff5640 1 -- 172.21.15.2:0/116925380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3508010d50 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 10 client.17262 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55769a4ba620 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f34faff5640 1 -- 172.21.15.2:0/116925380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3510004040 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f34faff5640 1 -- 172.21.15.2:0/116925380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3508024070 con 0x55769a77e860 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 10 client.17262 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 10 client.17262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 20 client.17262 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a795c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 4 client.17262 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55769a6f2640 con 0x55769a793840 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.229+0000 7f35167fc640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a795c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.230+0000 7f35167fc640 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a795c90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e994f26abd7899 server_cookie=f0c7a316c22db2c4 in_seq=0 out_seq=0 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.230+0000 7f34faff5640 10 client.17262 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.230+0000 7f34faff5640 1 -- 172.21.15.2:0/116925380 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55769a6f2640 con 0x55769a793840 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.230+0000 7f34faff5640 10 client.17262 handle_command_reply: tid=0 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.230+0000 7f352024b740 1 client.17262 shutdown 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 msgr2=0x55769a787e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a787e90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3508005f40 tx=0x7f3508004a40 comp rx=0 tx=0).stop 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 shutdown_connections 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a795c90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a789100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a788530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f34faff5640 0 client.17262 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 --2- 172.21.15.2:0/116925380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a787e90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 >> 172.21.15.2:0/116925380 conn(0x55769a7799b0 msgr2=0x55769a778bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 shutdown_connections 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 1 -- 172.21.15.2:0/116925380 wait complete. 2024-09-10T23:29:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.231+0000 7f352024b740 20 client.17262 trim_cache size 0 max 16384 2024-09-10T23:29:48.239 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:47 smithi002 ceph-mon[31150]: pgmap v515: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 Processor -- start 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 -- start start 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a77dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a77e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a77ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35181ac0b0 con 0x55769a77e860 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35181adbf0 con 0x55769a781190 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f352024b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f35181ac780 con 0x55769a783bd0 2024-09-10T23:29:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a77dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a77dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43964/0 (socket says 172.21.15.2:43964) 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 -- 172.21.15.2:0/1632074736 learned_addr learned my addr 172.21.15.2:0/1632074736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f35167fc640 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a77e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f35177fe640 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a77ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 -- 172.21.15.2:0/1632074736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 msgr2=0x55769a77ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a77ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 -- 172.21.15.2:0/1632074736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 msgr2=0x55769a77e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a77e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 -- 172.21.15.2:0/1632074736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769a789470 con 0x55769a77e860 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.246+0000 7f3516ffd640 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a77dcf0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3508000f80 tx=0x7f3508009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77861a4bac3a40d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f34fcff9640 1 -- 172.21.15.2:0/1632074736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35080109b0 con 0x55769a77e860 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f34fcff9640 1 -- 172.21.15.2:0/1632074736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f350802c030 con 0x55769a77e860 2024-09-10T23:29:48.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f34fcff9640 1 -- 172.21.15.2:0/1632074736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350801b850 con 0x55769a77e860 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 -- 172.21.15.2:0/1632074736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 msgr2=0x55769a77dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a77dcf0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3508000f80 tx=0x7f3508009520 comp rx=0 tx=0).stop 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 -- 172.21.15.2:0/1632074736 shutdown_connections 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a783bd0 0x55769a77ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a781190 0x55769a77e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 --2- 172.21.15.2:0/1632074736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a77e860 0x55769a77dcf0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 -- 172.21.15.2:0/1632074736 >> 172.21.15.2:0/1632074736 conn(0x55769a7799b0 msgr2=0x55769a77a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 -- 172.21.15.2:0/1632074736 shutdown_connections 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.247+0000 7f352024b740 1 -- 172.21.15.2:0/1632074736 wait complete. 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 -- start start 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 Processor -- start 2024-09-10T23:29:48.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a77e860 0x55769a78fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a781190 0x55769a78e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a78ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35181ad520 con 0x55769a783bd0 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35181ace50 con 0x55769a77e860 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f35181aa090 con 0x55769a781190 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f352024b740 10 client.0 _ll_register_callbacks cb 0x7f3508009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a78ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a78ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43974/0 (socket says 172.21.15.2:43974) 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 -- 172.21.15.2:0/2497908498 learned_addr learned my addr 172.21.15.2:0/2497908498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35167fc640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a781190 0x55769a78e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f3516ffd640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a77e860 0x55769a78fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 -- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a781190 msgr2=0x55769a78e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a781190 0x55769a78e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 -- 172.21.15.2:0/2497908498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a77e860 msgr2=0x55769a78fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a77e860 0x55769a78fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.248+0000 7f35177fe640 1 -- 172.21.15.2:0/2497908498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769a7838f0 con 0x55769a783bd0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f35177fe640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a78ef30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f351002a930 tx=0x7f3510032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f237b1ec8442e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f34faff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f34faff5640 1 -- 172.21.15.2:0/2497908498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351004c020 con 0x55769a783bd0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f34faff5640 1 -- 172.21.15.2:0/2497908498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3510005040 con 0x55769a783bd0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f350802c030 con 0x55769a783bd0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f34faff5640 1 -- 172.21.15.2:0/2497908498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f351003f040 con 0x55769a783bd0 2024-09-10T23:29:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 10 client.17268 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55769a8008a0 con 0x55769a783bd0 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f34faff5640 1 -- 172.21.15.2:0/2497908498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f350802c030 con 0x55769a783bd0 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f34faff5640 1 -- 172.21.15.2:0/2497908498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f35100035f0 con 0x55769a783bd0 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 10 client.17268 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 10 client.17268 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 20 client.17268 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a802e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 4 client.17268 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.249+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55769a6ee0f0 con 0x55769a793840 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.250+0000 7f3516ffd640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a802e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.250+0000 7f3516ffd640 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a802e90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82c6a16272021e03 server_cookie=fa1f26073d7aa75e in_seq=0 out_seq=0 2024-09-10T23:29:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.250+0000 7f34faff5640 10 client.17268 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f34faff5640 1 -- 172.21.15.2:0/2497908498 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55769a6ee0f0 con 0x55769a793840 2024-09-10T23:29:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f34faff5640 10 client.17268 handle_command_reply: tid=0 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 client.17268 shutdown 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 msgr2=0x55769a78ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a78ef30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f351002a930 tx=0x7f3510032fc0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 shutdown_connections 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55769a793840 0x55769a802e90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55769a783bd0 0x55769a78ef30 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55769a781190 0x55769a78e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f34faff5640 0 client.17268 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 --2- 172.21.15.2:0/2497908498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769a77e860 0x55769a78fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 >> 172.21.15.2:0/2497908498 conn(0x55769a7799b0 msgr2=0x55769a77dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 shutdown_connections 2024-09-10T23:29:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.266+0000 7f352024b740 1 -- 172.21.15.2:0/2497908498 wait complete. 2024-09-10T23:29:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f352024b740 20 client.17268 trim_cache size 0 max 16384 2024-09-10T23:29:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:29:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:29:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:29:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:29:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f35000b52e0 msgr2=0x7f35000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f35000b52e0 0x7f35000b77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3508005fd0 tx=0x7f3508009760 comp rx=0 tx=0).stop 2024-09-10T23:29:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 msgr2=0x7f351819b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 0x7f351819b5a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f350c00e9f0 tx=0x7f350c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 shutdown_connections 2024-09-10T23:29:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f35000b52e0 0x7f35000b77a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3518108680 0x7f351819c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3518105b30 0x7f351819b5a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 --2- 172.21.15.2:0/4289902953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f351806b3b0 0x7f351819af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 >> 172.21.15.2:0/4289902953 conn(0x7f35180fd140 msgr2=0x7f35180ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 shutdown_connections 2024-09-10T23:29:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:29:48.267+0000 7f351d47f640 1 -- 172.21.15.2:0/4289902953 wait complete. 2024-09-10T23:29:48.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:47 smithi154 ceph-mon[35136]: pgmap v515: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:50.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:49 smithi177 ceph-mon[35760]: pgmap v516: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:29:50.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:49 smithi002 ceph-mon[31150]: pgmap v516: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:29:50.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:49 smithi154 ceph-mon[35136]: pgmap v516: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:29:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:51 smithi177 ceph-mon[35760]: pgmap v517: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:29:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:51 smithi002 ceph-mon[31150]: pgmap v517: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:29:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:51 smithi154 ceph-mon[35136]: pgmap v517: 97 pgs: 97 active+clean; 4.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:29:53.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:29:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:54.095 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:53 smithi002 ceph-mon[31150]: pgmap v518: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2839691097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 msgr2=0x7fd4dc111800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2839691097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc111800 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009ca0 tx=0x7fd4d402a950 comp rx=0 tx=0).stop 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2839691097 shutdown_connections 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2839691097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc111800 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2839691097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4dc102180 0x7fd4dc10eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2839691097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4dc101860 0x7fd4dc101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2839691097 >> 172.21.15.2:0/2839691097 conn(0x7fd4dc0fd770 msgr2=0x7fd4dc0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2839691097 shutdown_connections 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.183+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2839691097 wait complete. 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 Processor -- start 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 -- start start 2024-09-10T23:29:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4dc101860 0x7fd4dc19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4dc102180 0x7fd4dc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc114f50 con 0x7fd4dc10f410 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc114dd0 con 0x7fd4dc101860 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.184+0000 7fd4e3de0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1150d0 con 0x7fd4dc102180 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc1a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55110/0 (socket says 172.21.15.2:55110) 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 -- 172.21.15.2:0/2182351024 learned_addr learned my addr 172.21.15.2:0/2182351024 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4dc101860 0x7fd4dc19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e137b640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4dc102180 0x7fd4dc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 -- 172.21.15.2:0/2182351024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4dc102180 msgr2=0x7fd4dc19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4dc102180 0x7fd4dc19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 -- 172.21.15.2:0/2182351024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4dc101860 msgr2=0x7fd4dc19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4dc101860 0x7fd4dc19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 -- 172.21.15.2:0/2182351024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc1a1570 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e237d640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc1a0da0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd4d402ae70 tx=0x7fd4d402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4d2ffd640 1 -- 172.21.15.2:0/2182351024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4034040 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4d2ffd640 1 -- 172.21.15.2:0/2182351024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d40308f0 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4dc1a1800 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.185+0000 7fd4d2ffd640 1 -- 172.21.15.2:0/2182351024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40047f0 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.186+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4dc1a7f20 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.188+0000 7fd4e61b5740 1 Processor -- start 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.188+0000 7fd4d2ffd640 1 -- 172.21.15.2:0/2182351024 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd4d404d030 con 0x7fd4dc10f410 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 -- start start 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a54f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 0x55af5a55e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55af5a4c5e50 con 0x55af5a55bd30 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af5a4b5280 con 0x55af5a54f480 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55af5a4b9090 con 0x55af5a54fda0 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 0x55af5a55e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 0x55af5a55e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55116/0 (socket says 172.21.15.2:55116) 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 -- 172.21.15.2:0/3161815064 learned_addr learned my addr 172.21.15.2:0/3161815064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a54f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 -- 172.21.15.2:0/3161815064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 msgr2=0x55af5a55b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 -- 172.21.15.2:0/3161815064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 msgr2=0x55af5a54f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a54f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.189+0000 7fd4e137b640 1 -- 172.21.15.2:0/3161815064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af5a213650 con 0x55af5a55bd30 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4d2ffd640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4c80b5360 0x7fd4c80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 0x55af5a55e120 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0138d0 tx=0x7fd4cc00e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f645ef7efa6ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4c80b5360 0x7fd4c80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4d2ffd640 1 -- 172.21.15.2:0/2182351024 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd4d4106a80 con 0x7fd4dc10f410 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4c7fff640 1 -- 172.21.15.2:0/3161815064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc004020 con 0x55af5a55bd30 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4c7fff640 1 -- 172.21.15.2:0/3161815064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc00bd80 con 0x55af5a55bd30 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.190+0000 7fd4c7fff640 1 -- 172.21.15.2:0/3161815064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc005280 con 0x55af5a55bd30 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3161815064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 msgr2=0x55af5a55e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4c80b5360 0x7fd4c80b7820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55af5a54e190 tx=0x7fd4d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 0x55af5a55e120 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0138d0 tx=0x7fd4cc00e3f0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3161815064 shutdown_connections 2024-09-10T23:29:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a55bd30 0x55af5a55e120 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3161815064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a54f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3161815064 >> 172.21.15.2:0/3161815064 conn(0x55af5a54d2b0 msgr2=0x55af5a54e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3161815064 shutdown_connections 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3161815064 wait complete. 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 -- start start 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.191+0000 7fd4e61b5740 1 Processor -- start 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a55b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a558ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a559130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55af5a316700 con 0x55af5a54f480 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af5a450110 con 0x55af5a55bd30 2024-09-10T23:29:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55af5a55e9b0 con 0x55af5a54fda0 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e61b5740 10 client.0 _ll_register_callbacks cb 0x55af5a469990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a55b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a55b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55132/0 (socket says 172.21.15.2:55132) 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/1523790214 learned_addr learned my addr 172.21.15.2:0/1523790214 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e137b640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a558ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e237d640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a559130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 msgr2=0x55af5a558ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a558ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/1523790214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 msgr2=0x55af5a559130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a559130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/1523790214 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af5a47dc40 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.192+0000 7fd4e237d640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a559130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a55b660 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd4d801f520 tx=0x7fd4d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ba3fc80a7b17fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4c57fa640 1 -- 172.21.15.2:0/1523790214 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d802c060 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4cc00bd80 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4c57fa640 1 -- 172.21.15.2:0/1523790214 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd4d8017030 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4c57fa640 1 -- 172.21.15.2:0/1523790214 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4d801c6c0 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4e61b5740 10 client.17280 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af5a56a3b0 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4c57fa640 1 -- 172.21.15.2:0/1523790214 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc00bd80 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.193+0000 7fd4c57fa640 1 -- 172.21.15.2:0/1523790214 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4d80109c0 con 0x55af5a54f480 2024-09-10T23:29:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e61b5740 10 client.17280 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e61b5740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e61b5740 20 client.17280 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a56b8c0 0x55af5a56dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e61b5740 4 client.17280 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af5a4c7da0 con 0x55af5a56b8c0 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e137b640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a56b8c0 0x55af5a56dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4c57fa640 10 client.17280 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.194+0000 7fd4e137b640 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a56b8c0 0x55af5a56dd00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e85897e282d3f2 server_cookie=24143da0c966efb in_seq=0 out_seq=0 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.195+0000 7fd4c57fa640 1 -- 172.21.15.2:0/1523790214 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af5a4c7da0 con 0x55af5a56b8c0 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.195+0000 7fd4c57fa640 10 client.17280 handle_command_reply: tid=0 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.195+0000 7fd4e61b5740 1 client.17280 shutdown 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 msgr2=0x55af5a55b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a55b660 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd4d801f520 tx=0x7fd4d8004730 comp rx=0 tx=0).stop 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 shutdown_connections 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a56b8c0 0x55af5a56dd00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a559130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a558ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4c57fa640 0 client.17280 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/1523790214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a55b660 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 >> 172.21.15.2:0/1523790214 conn(0x55af5a54d2b0 msgr2=0x55af5a552e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 shutdown_connections 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 1 -- 172.21.15.2:0/1523790214 wait complete. 2024-09-10T23:29:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.196+0000 7fd4e61b5740 20 client.17280 trim_cache size 0 max 16384 2024-09-10T23:29:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:53 smithi177 ceph-mon[35760]: pgmap v518: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 Processor -- start 2024-09-10T23:29:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 -- start start 2024-09-10T23:29:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a567c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a55d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1b0540 con 0x55af5a54f480 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1b2080 con 0x55af5a55bd30 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1b0c10 con 0x55af5a54fda0 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a567c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a567c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55148/0 (socket says 172.21.15.2:55148) 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/2830107243 learned_addr learned my addr 172.21.15.2:0/2830107243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e237d640 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a55d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e137b640 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/2830107243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 msgr2=0x55af5a55d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/2830107243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 msgr2=0x55af5a55d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a55d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.214+0000 7fd4e1b7c640 1 -- 172.21.15.2:0/2830107243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af5a559a00 con 0x55af5a54f480 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.215+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a567c10 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80325b0 tx=0x7fd4d80325e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42776818d0c9eb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.215+0000 7fd4c77fe640 1 -- 172.21.15.2:0/2830107243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8037020 con 0x55af5a54f480 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.215+0000 7fd4c77fe640 1 -- 172.21.15.2:0/2830107243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d801f230 con 0x55af5a54f480 2024-09-10T23:29:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.215+0000 7fd4c77fe640 1 -- 172.21.15.2:0/2830107243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80054a0 con 0x55af5a54f480 2024-09-10T23:29:54.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 -- 172.21.15.2:0/2830107243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 msgr2=0x55af5a567c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a567c10 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80325b0 tx=0x7fd4d80325e0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 -- 172.21.15.2:0/2830107243 shutdown_connections 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a55bd30 0x55af5a55d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a54fda0 0x55af5a55d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/2830107243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54f480 0x55af5a567c10 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 -- 172.21.15.2:0/2830107243 >> 172.21.15.2:0/2830107243 conn(0x55af5a54d2b0 msgr2=0x55af5a55a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 -- 172.21.15.2:0/2830107243 shutdown_connections 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 -- 172.21.15.2:0/2830107243 wait complete. 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 -- start start 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.216+0000 7fd4e61b5740 1 Processor -- start 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a563f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 0x55af5a564500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a55bd30 0x55af5a55ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1b19b0 con 0x55af5a54fda0 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1b12e0 con 0x55af5a54f480 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc1ae520 con 0x55af5a55bd30 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e61b5740 10 client.0 _ll_register_callbacks cb 0x7fd4d800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 0x55af5a564500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e237d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a55bd30 0x55af5a55ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 0x55af5a564500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55158/0 (socket says 172.21.15.2:55158) 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 -- 172.21.15.2:0/3096182067 learned_addr learned my addr 172.21.15.2:0/3096182067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a563f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 -- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a55bd30 msgr2=0x55af5a55ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a55bd30 0x55af5a55ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 -- 172.21.15.2:0/3096182067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 msgr2=0x55af5a563f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a563f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 -- 172.21.15.2:0/3096182067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af5a55f500 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4e137b640 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 0x55af5a564500 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0138a0 tx=0x7fd4cc015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9675b9d5bc4cefc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.217+0000 7fd4c57fa640 1 -- 172.21.15.2:0/3096182067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0132b0 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4c57fa640 1 -- 172.21.15.2:0/3096182067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd4cc00b8d0 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d801f230 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4c57fa640 1 -- 172.21.15.2:0/3096182067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4cc013550 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 10 client.17286 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af5a5d93a0 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4c57fa640 1 -- 172.21.15.2:0/3096182067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d801f230 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4c57fa640 1 -- 172.21.15.2:0/3096182067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4cc0319e0 con 0x55af5a54fda0 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 10 client.17286 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 20 client.17286 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a5d97b0 0x55af5a5dbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 4 client.17286 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.218+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55af5a4c3850 con 0x55af5a5d97b0 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a5d97b0 0x55af5a5dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e1b7c640 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a5d97b0 0x55af5a5dbbd0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2af2d5122d3a7c8e server_cookie=35cf01737b954061 in_seq=0 out_seq=0 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4c57fa640 10 client.17286 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4c57fa640 1 -- 172.21.15.2:0/3096182067 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55af5a4c3850 con 0x55af5a5d97b0 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4c57fa640 10 client.17286 handle_command_reply: tid=0 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 client.17286 shutdown 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 msgr2=0x55af5a564500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 0x55af5a564500 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0138a0 tx=0x7fd4cc015040 comp rx=0 tx=0).stop 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 shutdown_connections 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55af5a5d97b0 0x55af5a5dbbd0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55af5a55bd30 0x55af5a55ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55af5a54fda0 0x55af5a564500 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 --2- 172.21.15.2:0/3096182067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af5a54f480 0x55af5a563f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.219+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 >> 172.21.15.2:0/3096182067 conn(0x55af5a54d2b0 msgr2=0x55af5a54bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4c57fa640 0 client.17286 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 shutdown_connections 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e61b5740 1 -- 172.21.15.2:0/3096182067 wait complete. 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e61b5740 20 client.17286 trim_cache size 0 max 16384 2024-09-10T23:29:54.225 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.226 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.227 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:29:54.228 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.229 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.230 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.231 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:29:54.232 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:29:54.233 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:54.233 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:29:54.233 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:29:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4c80b5360 msgr2=0x7fd4c80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4c80b5360 0x7fd4c80b7820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55af5a54e190 tx=0x7fd4d800b410 comp rx=0 tx=0).stop 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 msgr2=0x7fd4dc1a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.220+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc1a0da0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd4d402ae70 tx=0x7fd4d402f5d0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 shutdown_connections 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd4c80b5360 0x7fd4c80b7820 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4dc10f410 0x7fd4dc1a0da0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4dc102180 0x7fd4dc19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 --2- 172.21.15.2:0/2182351024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4dc101860 0x7fd4dc19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 >> 172.21.15.2:0/2182351024 conn(0x7fd4dc0fd770 msgr2=0x7fd4dc110710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 shutdown_connections 2024-09-10T23:29:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:54.221+0000 7fd4e3de0640 1 -- 172.21.15.2:0/2182351024 wait complete. 2024-09-10T23:29:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:53 smithi154 ceph-mon[35136]: pgmap v518: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:29:55.131 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:29:55.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:29:55.399 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:55.925 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:55 smithi002 ceph-mon[31150]: pgmap v519: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:55.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 -- 172.21.15.2:0/2025134126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c108060 msgr2=0x7fe65c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 --2- 172.21.15.2:0/2025134126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c108060 0x7fe65c10e860 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fe654009ca0 tx=0x7fe65402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 -- 172.21.15.2:0/2025134126 shutdown_connections 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 --2- 172.21.15.2:0/2025134126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c108060 0x7fe65c10e860 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 --2- 172.21.15.2:0/2025134126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c1076e0 0x7fe65c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 --2- 172.21.15.2:0/2025134126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 0x7fe65c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 -- 172.21.15.2:0/2025134126 >> 172.21.15.2:0/2025134126 conn(0x7fe65c0fd720 msgr2=0x7fe65c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 -- 172.21.15.2:0/2025134126 shutdown_connections 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.916+0000 7fe6643e3640 1 -- 172.21.15.2:0/2025134126 wait complete. 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 Processor -- start 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 -- start start 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 0x7fe65c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 0x7fe65c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c108060 0x7fe65c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c112e70 con 0x7fe65c1076e0 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c112cf0 con 0x7fe65c108060 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe6643e3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c112ff0 con 0x7fe65c101cd0 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe66197e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 0x7fe65c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe66197e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 0x7fe65c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55182/0 (socket says 172.21.15.2:55182) 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.917+0000 7fe66197e640 1 -- 172.21.15.2:0/543692132 learned_addr learned my addr 172.21.15.2:0/543692132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe662980640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c108060 0x7fe65c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66217f640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 0x7fe65c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66197e640 1 -- 172.21.15.2:0/543692132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 msgr2=0x7fe65c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66197e640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 0x7fe65c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66197e640 1 -- 172.21.15.2:0/543692132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c108060 msgr2=0x7fe65c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66197e640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c108060 0x7fe65c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66197e640 1 -- 172.21.15.2:0/543692132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c19f390 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66217f640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 0x7fe65c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe662980640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c108060 0x7fe65c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe66197e640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 0x7fe65c199820 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fe65000d950 tx=0x7fe65000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650017070 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c19f680 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe650009c30 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65000f620 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.918+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c1a5d40 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.919+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c1020b0 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.921+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe650010460 con 0x7fe65c1076e0 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.921+0000 7fe64f7fe640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6480b52e0 0x7fe6480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.922+0000 7fe66217f640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6480b52e0 0x7fe6480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:55.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.922+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe6500e5840 con 0x7fe65c1076e0 2024-09-10T23:29:55.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.922+0000 7fe66217f640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6480b52e0 0x7fe6480b77a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe65800baa0 tx=0x7fe658005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:55.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:55.925+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe6500ac710 con 0x7fe65c1076e0 2024-09-10T23:29:56.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.147+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe65c19a410 con 0x7fe65c1076e0 2024-09-10T23:29:56.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.148+0000 7fe64f7fe640 1 -- 172.21.15.2:0/543692132 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fe65c19a410 con 0x7fe65c1076e0 2024-09-10T23:29:56.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:29:56.149 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:29:56.149 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:29:56.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6480b52e0 msgr2=0x7fe6480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6480b52e0 0x7fe6480b77a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe65800baa0 tx=0x7fe658005d90 comp rx=0 tx=0).stop 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 msgr2=0x7fe65c199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 0x7fe65c199820 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fe65000d950 tx=0x7fe65000de10 comp rx=0 tx=0).stop 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 shutdown_connections 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6480b52e0 0x7fe6480b77a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c108060 0x7fe65c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1076e0 0x7fe65c199820 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 --2- 172.21.15.2:0/543692132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c101cd0 0x7fe65c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 >> 172.21.15.2:0/543692132 conn(0x7fe65c0fd720 msgr2=0x7fe65c0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 shutdown_connections 2024-09-10T23:29:56.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:56.151+0000 7fe6643e3640 1 -- 172.21.15.2:0/543692132 wait complete. 2024-09-10T23:29:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:55 smithi177 ceph-mon[35760]: pgmap v519: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:55 smithi154 ceph-mon[35136]: pgmap v519: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:29:56.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:29:57.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/543692132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:57.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/543692132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:57.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/543692132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 -- 172.21.15.2:0/3641476390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c1087d0 msgr2=0x7f783c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 --2- 172.21.15.2:0/3641476390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c1087d0 0x7f783c108c10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f7824009900 tx=0x7f782402a410 comp rx=0 tx=0).stop 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 -- 172.21.15.2:0/3641476390 shutdown_connections 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 --2- 172.21.15.2:0/3641476390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f783c109150 0x7f783c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 --2- 172.21.15.2:0/3641476390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c1087d0 0x7f783c108c10 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 --2- 172.21.15.2:0/3641476390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c102dc0 0x7f783c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 -- 172.21.15.2:0/3641476390 >> 172.21.15.2:0/3641476390 conn(0x7f783c0fe830 msgr2=0x7f783c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:57.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 -- 172.21.15.2:0/3641476390 shutdown_connections 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 -- 172.21.15.2:0/3641476390 wait complete. 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 Processor -- start 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.725+0000 7f7841f44640 1 -- start start 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f7841f44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 0x7f783c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f7841f44640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1087d0 0x7f783c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f7841f44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f783c109150 0x7f783c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f7841f44640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f783c112dd0 con 0x7f783c102dc0 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f7841f44640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f783c112c50 con 0x7f783c109150 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f7841f44640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f783c112f50 con 0x7f783c1087d0 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 0x7f783c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 0x7f783c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55194/0 (socket says 172.21.15.2:55194) 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 -- 172.21.15.2:0/3526853673 learned_addr learned my addr 172.21.15.2:0/3526853673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783bfff640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f783c109150 0x7f783c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783affd640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1087d0 0x7f783c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 -- 172.21.15.2:0/3526853673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1087d0 msgr2=0x7f783c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1087d0 0x7f783c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 -- 172.21.15.2:0/3526853673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f783c109150 msgr2=0x7f783c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f783c109150 0x7f783c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 -- 172.21.15.2:0/3526853673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c1a76e0 con 0x7f783c102dc0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.726+0000 7f783b7fe640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 0x7f783c0754a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f782c00c970 tx=0x7f782c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.727+0000 7f7838ff9640 1 -- 172.21.15.2:0/3526853673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c007bb0 con 0x7f783c102dc0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.727+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c1a79d0 con 0x7f783c102dc0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.727+0000 7f7838ff9640 1 -- 172.21.15.2:0/3526853673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f782c007d50 con 0x7f783c102dc0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.727+0000 7f7838ff9640 1 -- 172.21.15.2:0/3526853673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c00f450 con 0x7f783c102dc0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.727+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c1a7ee0 con 0x7f783c102dc0 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.729+0000 7f7844319740 1 Processor -- start 2024-09-10T23:29:57.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.729+0000 7f7838ff9640 1 -- 172.21.15.2:0/3526853673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f782c004f20 con 0x7f783c102dc0 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.729+0000 7f7844319740 1 -- start start 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7844319740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7844319740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7844319740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7844319740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562fe9134ea0 con 0x562fe91be4d0 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7844319740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562fe91242d0 con 0x562fe91cad80 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7844319740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562fe91280e0 con 0x562fe91bedf0 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91be8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55198/0 (socket says 172.21.15.2:55198) 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 -- 172.21.15.2:0/2166976185 learned_addr learned my addr 172.21.15.2:0/2166976185 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783b7fe640 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783affd640 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 -- 172.21.15.2:0/2166976185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 msgr2=0x562fe91ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 -- 172.21.15.2:0/2166976185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 msgr2=0x562fe91cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 -- 172.21.15.2:0/2166976185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe8e82650 con 0x562fe91be4d0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783bfff640 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91be8b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7834009fd0 tx=0x7f7834010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9718cc22dda351a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7838ff9640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78280b52e0 0x7f78280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f7831ffb640 1 -- 172.21.15.2:0/2166976185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834016070 con 0x562fe91be4d0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.730+0000 7f783b7fe640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78280b52e0 0x7f78280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7831ffb640 1 -- 172.21.15.2:0/2166976185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834012bc0 con 0x562fe91be4d0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7831ffb640 1 -- 172.21.15.2:0/2166976185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783401bc40 con 0x562fe91be4d0 2024-09-10T23:29:57.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7838ff9640 1 -- 172.21.15.2:0/3526853673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f782c0e5910 con 0x7f783c102dc0 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 -- 172.21.15.2:0/2166976185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 msgr2=0x562fe91be8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f783b7fe640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78280b52e0 0x7f78280b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f782c0e3790 tx=0x7f782c004980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91be8b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7834009fd0 tx=0x7f7834010800 comp rx=0 tx=0).stop 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 -- 172.21.15.2:0/2166976185 shutdown_connections 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 --2- 172.21.15.2:0/2166976185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91be8b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 -- 172.21.15.2:0/2166976185 >> 172.21.15.2:0/2166976185 conn(0x562fe91bc300 msgr2=0x562fe91bd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 -- 172.21.15.2:0/2166976185 shutdown_connections 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.731+0000 7f7844319740 1 -- 172.21.15.2:0/2166976185 wait complete. 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 -- start start 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 Processor -- start 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 0x562fe91c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91cad80 0x562fe91c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562fe8f85700 con 0x562fe91bedf0 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562fe90bf160 con 0x562fe91be4d0 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562fe91cda00 con 0x562fe91cad80 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f7844319740 10 client.0 _ll_register_callbacks cb 0x562fe90d89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f783affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 0x562fe91c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f783affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 0x562fe91c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55200/0 (socket says 172.21.15.2:55200) 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f783affd640 1 -- 172.21.15.2:0/261583043 learned_addr learned my addr 172.21.15.2:0/261583043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f783bfff640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.732+0000 7f783bfff640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91cad80 0x562fe91c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783affd640 1 -- 172.21.15.2:0/261583043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91cad80 msgr2=0x562fe91c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783affd640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91cad80 0x562fe91c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783affd640 1 -- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 msgr2=0x562fe91ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783affd640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783affd640 1 -- 172.21.15.2:0/261583043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe90ecc90 con 0x562fe91bedf0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783bfff640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91cad80 0x562fe91c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f783affd640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 0x562fe91c7ac0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f782402a930 tx=0x7f7824031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd281274cf25433 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f781affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f781affd640 1 -- 172.21.15.2:0/261583043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824035070 con 0x562fe91bedf0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7834012bc0 con 0x562fe91bedf0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f781affd640 1 -- 172.21.15.2:0/261583043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7824004240 con 0x562fe91bedf0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f781affd640 1 -- 172.21.15.2:0/261583043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7824004440 con 0x562fe91bedf0 2024-09-10T23:29:57.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f7844319740 10 client.17304 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fe91d93b0 con 0x562fe91bedf0 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.733+0000 7f781affd640 1 -- 172.21.15.2:0/261583043 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834012bc0 con 0x562fe91bedf0 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f781affd640 1 -- 172.21.15.2:0/261583043 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7824004aa0 con 0x562fe91bedf0 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f7844319740 10 client.17304 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f7844319740 10 client.17304 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f7844319740 20 client.17304 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f7844319740 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe91dab60 0x562fe91dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f7844319740 4 client.17304 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fe9136df0 con 0x562fe91dab60 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f783bfff640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe91dab60 0x562fe91dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f781affd640 10 client.17304 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.734+0000 7f783bfff640 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe91dab60 0x562fe91dcfe0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4934cb262d387cac server_cookie=158a460cfbd13e81 in_seq=0 out_seq=0 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f781affd640 1 -- 172.21.15.2:0/261583043 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562fe9136df0 con 0x562fe91dab60 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f781affd640 10 client.17304 handle_command_reply: tid=0 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 client.17304 shutdown 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 msgr2=0x562fe91c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 0x562fe91c7ac0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f782402a930 tx=0x7f7824031740 comp rx=0 tx=0).stop 2024-09-10T23:29:57.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 shutdown_connections 2024-09-10T23:29:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe91dab60 0x562fe91dcfe0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91cad80 0x562fe91c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91bedf0 0x562fe91c7ac0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 --2- 172.21.15.2:0/261583043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 >> 172.21.15.2:0/261583043 conn(0x562fe91bc300 msgr2=0x562fe91c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:57.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f781affd640 0 client.17304 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 shutdown_connections 2024-09-10T23:29:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 1 -- 172.21.15.2:0/261583043 wait complete. 2024-09-10T23:29:57.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.735+0000 7f7844319740 20 client.17304 trim_cache size 0 max 16384 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 Processor -- start 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 -- start start 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1b0590 con 0x562fe91be4d0 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1b20d0 con 0x562fe91cad80 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f7844319740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1b0c60 con 0x562fe91bedf0 2024-09-10T23:29:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f783bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f783bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91bdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55204/0 (socket says 172.21.15.2:55204) 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f783bfff640 1 -- 172.21.15.2:0/2095002560 learned_addr learned my addr 172.21.15.2:0/2095002560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.749+0000 7f783affd640 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783bfff640 1 -- 172.21.15.2:0/2095002560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 msgr2=0x562fe91cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783bfff640 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783bfff640 1 -- 172.21.15.2:0/2095002560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 msgr2=0x562fe91cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783bfff640 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783bfff640 1 -- 172.21.15.2:0/2095002560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe91bcfe0 con 0x562fe91be4d0 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783affd640 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f783bfff640 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91bdad0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7834015040 tx=0x7f7834009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1a9dfeaa8c8bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f78317fa640 1 -- 172.21.15.2:0/2095002560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834016040 con 0x562fe91be4d0 2024-09-10T23:29:57.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f78317fa640 1 -- 172.21.15.2:0/2095002560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834009920 con 0x562fe91be4d0 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f78317fa640 1 -- 172.21.15.2:0/2095002560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834012510 con 0x562fe91be4d0 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f7844319740 1 -- 172.21.15.2:0/2095002560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 msgr2=0x562fe91bdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.750+0000 7f7844319740 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91bdad0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7834015040 tx=0x7f7834009600 comp rx=0 tx=0).stop 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- 172.21.15.2:0/2095002560 shutdown_connections 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91cad80 0x562fe91cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 --2- 172.21.15.2:0/2095002560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91be4d0 0x562fe91bdad0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- 172.21.15.2:0/2095002560 >> 172.21.15.2:0/2095002560 conn(0x562fe91bc300 msgr2=0x562fe91bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- 172.21.15.2:0/2095002560 shutdown_connections 2024-09-10T23:29:57.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- 172.21.15.2:0/2095002560 wait complete. 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- start start 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 Processor -- start 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91cad80 0x562fe91cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1b1a00 con 0x562fe91cad80 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1b1330 con 0x562fe91be4d0 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.751+0000 7f7844319740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1ae570 con 0x562fe91bedf0 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f7844319740 10 client.0 _ll_register_callbacks cb 0x7f7824009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91cad80 0x562fe91cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91d2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:43866/0 (socket says 172.21.15.2:43866) 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 -- 172.21.15.2:0/1749313331 learned_addr learned my addr 172.21.15.2:0/1749313331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783affd640 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 -- 172.21.15.2:0/1749313331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 msgr2=0x562fe91d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 -- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 msgr2=0x562fe91d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91d2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 -- 172.21.15.2:0/1749313331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe91ce320 con 0x562fe91cad80 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f783bfff640 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91cad80 0x562fe91cdc80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f78340039a0 tx=0x7f78340096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35428110ed45bbd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f781affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f781affd640 1 -- 172.21.15.2:0/1749313331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834016040 con 0x562fe91cad80 2024-09-10T23:29:57.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7834009920 con 0x562fe91cad80 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.752+0000 7f781affd640 1 -- 172.21.15.2:0/1749313331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7834012510 con 0x562fe91cad80 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f781affd640 1 -- 172.21.15.2:0/1749313331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7834012710 con 0x562fe91cad80 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 10 client.17310 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fe9248470 con 0x562fe91cad80 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f781affd640 1 -- 172.21.15.2:0/1749313331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834009920 con 0x562fe91cad80 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f781affd640 1 -- 172.21.15.2:0/1749313331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f783400f040 con 0x562fe91cad80 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 10 client.17310 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 10 client.17310 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 20 client.17310 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe9248a90 0x562fe924aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 4 client.17310 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fe91328a0 con 0x562fe9248a90 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.753+0000 7f783affd640 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe9248a90 0x562fe924aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f783affd640 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe9248a90 0x562fe924aeb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c36848b6d980e4 server_cookie=1d3390c153fb3c0a in_seq=0 out_seq=0 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f781affd640 10 client.17310 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f781affd640 1 -- 172.21.15.2:0/1749313331 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fe91328a0 con 0x562fe9248a90 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f781affd640 10 client.17310 handle_command_reply: tid=0 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 client.17310 shutdown 2024-09-10T23:29:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91cad80 msgr2=0x562fe91cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91cad80 0x562fe91cdc80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f78340039a0 tx=0x7f78340096f0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 shutdown_connections 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x562fe9248a90 0x562fe924aeb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f781affd640 0 client.17310 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562fe91cad80 0x562fe91cdc80 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562fe91bedf0 0x562fe91d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 --2- 172.21.15.2:0/1749313331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562fe91be4d0 0x562fe91d2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 >> 172.21.15.2:0/1749313331 conn(0x562fe91bc300 msgr2=0x562fe91c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 shutdown_connections 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 1 -- 172.21.15.2:0/1749313331 wait complete. 2024-09-10T23:29:57.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.754+0000 7f7844319740 20 client.17310 trim_cache size 0 max 16384 2024-09-10T23:29:57.767 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78280b52e0 msgr2=0x7f78280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78280b52e0 0x7f78280b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f782c0e3790 tx=0x7f782c004980 comp rx=0 tx=0).stop 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 msgr2=0x7f783c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 0x7f783c0754a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f782c00c970 tx=0x7f782c00ce30 comp rx=0 tx=0).stop 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 shutdown_connections 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78280b52e0 0x7f78280b77a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f783c109150 0x7f783c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1087d0 0x7f783c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 --2- 172.21.15.2:0/3526853673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f783c102dc0 0x7f783c0754a0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 >> 172.21.15.2:0/3526853673 conn(0x7f783c0fe830 msgr2=0x7f783c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 shutdown_connections 2024-09-10T23:29:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:57.755+0000 7f7841f44640 1 -- 172.21.15.2:0/3526853673 wait complete. 2024-09-10T23:29:57.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:57 smithi002 ceph-mon[31150]: pgmap v520: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:57 smithi177 ceph-mon[35760]: pgmap v520: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:57 smithi154 ceph-mon[35136]: pgmap v520: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-10T23:29:58.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:29:58.857 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 -- 172.21.15.2:0/903655481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f10101cd0 msgr2=0x7f2f101020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 --2- 172.21.15.2:0/903655481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f10101cd0 0x7f2f101020b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009900 tx=0x7f2f0c02a410 comp rx=0 tx=0).stop 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 -- 172.21.15.2:0/903655481 shutdown_connections 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 --2- 172.21.15.2:0/903655481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 0x7f2f1010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 --2- 172.21.15.2:0/903655481 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f101076e0 0x7f2f10107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 --2- 172.21.15.2:0/903655481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f10101cd0 0x7f2f101020b0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 -- 172.21.15.2:0/903655481 >> 172.21.15.2:0/903655481 conn(0x7f2f100fd700 msgr2=0x7f2f100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 -- 172.21.15.2:0/903655481 shutdown_connections 2024-09-10T23:29:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.360+0000 7f2f17267640 1 -- 172.21.15.2:0/903655481 wait complete. 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 Processor -- start 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 -- start start 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f10101cd0 0x7f2f1019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 0x7f2f1019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 0x7f2f101a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111d20 con 0x7f2f101076e0 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111ba0 con 0x7f2f10108060 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f17267640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111ea0 con 0x7f2f10101cd0 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f14802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 0x7f2f1019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f14802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 0x7f2f1019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55246/0 (socket says 172.21.15.2:55246) 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.361+0000 7f2f14802640 1 -- 172.21.15.2:0/2830940740 learned_addr learned my addr 172.21.15.2:0/2830940740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f15003640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f10101cd0 0x7f2f1019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f15804640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 0x7f2f101a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f14802640 1 -- 172.21.15.2:0/2830940740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f10101cd0 msgr2=0x7f2f1019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f14802640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f10101cd0 0x7f2f1019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f14802640 1 -- 172.21.15.2:0/2830940740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 msgr2=0x7f2f101a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f14802640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 0x7f2f101a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f14802640 1 -- 172.21.15.2:0/2830940740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f101a1560 con 0x7f2f101076e0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f15804640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 0x7f2f101a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f14802640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 0x7f2f1019b9f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f067fc640 1 -- 172.21.15.2:0/2830940740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000cd80 con 0x7f2f101076e0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f067fc640 1 -- 172.21.15.2:0/2830940740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f000054d0 con 0x7f2f101076e0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f101a1850 con 0x7f2f101076e0 2024-09-10T23:29:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f067fc640 1 -- 172.21.15.2:0/2830940740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00010690 con 0x7f2f101076e0 2024-09-10T23:29:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.362+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f101a7f10 con 0x7f2f101076e0 2024-09-10T23:29:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 Processor -- start 2024-09-10T23:29:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 -- start start 2024-09-10T23:29:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f067fc640 1 -- 172.21.15.2:0/2830940740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2f00004e90 con 0x7f2f101076e0 2024-09-10T23:29:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c10f0 0x55d3253c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c1a10 0x55d3253cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 0x55d3253cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d325337ea0 con 0x55d3253cd9a0 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d3253272d0 con 0x55d3253c1a10 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f1963c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d32532b0e0 con 0x55d3253c10f0 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.365+0000 7f2f14802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 0x55d3253cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c1a10 0x55d3253cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f14802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 0x55d3253cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55250/0 (socket says 172.21.15.2:55250) 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f14802640 1 -- 172.21.15.2:0/2725642948 learned_addr learned my addr 172.21.15.2:0/2725642948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15804640 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c10f0 0x55d3253c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 -- 172.21.15.2:0/2725642948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c10f0 msgr2=0x55d3253c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c10f0 0x55d3253c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 -- 172.21.15.2:0/2725642948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 msgr2=0x55d3253cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 0x55d3253cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 -- 172.21.15.2:0/2725642948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d325085650 con 0x55d3253c1a10 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f14802640 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 0x55d3253cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f067fc640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2efc0b5360 0x7f2efc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15003640 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c1a10 0x55d3253cd460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009230 tx=0x7f2f0c032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a2f9a706dce6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f15804640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2efc0b5360 0x7f2efc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2f067fc640 1 -- 172.21.15.2:0/2830940740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f000e6000 con 0x7f2f101076e0 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.366+0000 7f2efb7fe640 1 -- 172.21.15.2:0/2725642948 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c040070 con 0x55d3253c1a10 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2efb7fe640 1 -- 172.21.15.2:0/2725642948 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c004030 con 0x55d3253c1a10 2024-09-10T23:29:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2efb7fe640 1 -- 172.21.15.2:0/2725642948 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c035040 con 0x55d3253c1a10 2024-09-10T23:29:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 -- 172.21.15.2:0/2725642948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c1a10 msgr2=0x55d3253cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f15804640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2efc0b5360 0x7f2efc0b7820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005fd0 tx=0x7f2f080098a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c1a10 0x55d3253cd460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009230 tx=0x7f2f0c032bd0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 -- 172.21.15.2:0/2725642948 shutdown_connections 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253cd9a0 0x55d3253cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c1a10 0x55d3253cd460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2725642948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c10f0 0x55d3253c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 -- 172.21.15.2:0/2725642948 >> 172.21.15.2:0/2725642948 conn(0x55d3253bef20 msgr2=0x55d3253c00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 -- 172.21.15.2:0/2725642948 shutdown_connections 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.367+0000 7f2f1963c740 1 -- 172.21.15.2:0/2725642948 wait complete. 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 -- start start 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 Processor -- start 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 0x55d3253cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253cd9a0 0x55d3253cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d325188700 con 0x55d3253c10f0 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d3252c2160 con 0x55d3253cd9a0 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d3253d05c0 con 0x55d3253c1a10 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f1963c740 10 client.0 _ll_register_callbacks cb 0x55d3252db9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f15003640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 0x55d3253cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f15003640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 0x55d3253cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55258/0 (socket says 172.21.15.2:55258) 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.368+0000 7f2f15003640 1 -- 172.21.15.2:0/4010034056 learned_addr learned my addr 172.21.15.2:0/4010034056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15804640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253cd9a0 0x55d3253cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f14802640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15003640 1 -- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 msgr2=0x55d3253ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15003640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15003640 1 -- 172.21.15.2:0/4010034056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253cd9a0 msgr2=0x55d3253cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15003640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253cd9a0 0x55d3253cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15003640 1 -- 172.21.15.2:0/4010034056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3252efc90 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f15003640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 0x55d3253cd240 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c032fa0 tx=0x7f2f0c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd14a1b7f6bb5a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2ef8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/4010034056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c052060 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/4010034056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f0c0052d0 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0c004030 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/4010034056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c035070 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f1963c740 10 client.17322 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.369+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3253dbeb0 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/4010034056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c004030 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/4010034056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f0c004cf0 con 0x55d3253c10f0 2024-09-10T23:29:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f1963c740 10 client.17322 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f1963c740 10 client.17322 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f1963c740 20 client.17322 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f1963c740 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253dd200 0x55d3253df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f1963c740 4 client.17322 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d325339df0 con 0x55d3253dd200 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.370+0000 7f2f14802640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253dd200 0x55d3253df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.371+0000 7f2f14802640 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253dd200 0x55d3253df5f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b8848cd32a63ba19 server_cookie=33952475bac5a452 in_seq=0 out_seq=0 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.371+0000 7f2ef8ff9640 10 client.17322 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.371+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/4010034056 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d325339df0 con 0x55d3253dd200 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.371+0000 7f2ef8ff9640 10 client.17322 handle_command_reply: tid=0 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.371+0000 7f2f1963c740 1 client.17322 shutdown 2024-09-10T23:29:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 msgr2=0x55d3253cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 0x55d3253cd240 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c032fa0 tx=0x7f2f0c009260 comp rx=0 tx=0).stop 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 shutdown_connections 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253dd200 0x55d3253df5f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253cd9a0 0x55d3253cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 --2- 172.21.15.2:0/4010034056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c10f0 0x55d3253cd240 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 >> 172.21.15.2:0/4010034056 conn(0x55d3253bef20 msgr2=0x55d3253c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2ef8ff9640 0 client.17322 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 shutdown_connections 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 1 -- 172.21.15.2:0/4010034056 wait complete. 2024-09-10T23:29:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.372+0000 7f2f1963c740 20 client.17322 trim_cache size 0 max 16384 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 Processor -- start 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 -- start start 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 0x55d3253b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101b04f0 con 0x55d3253bef20 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101b2030 con 0x55d3253c10f0 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f1963c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101b0bc0 con 0x55d3253c1a10 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f15003640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 0x55d3253b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f15003640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 0x55d3253b9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55260/0 (socket says 172.21.15.2:55260) 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.385+0000 7f2f15003640 1 -- 172.21.15.2:0/1604669501 learned_addr learned my addr 172.21.15.2:0/1604669501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15003640 1 -- 172.21.15.2:0/1604669501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 msgr2=0x55d3253cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15804640 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f14802640 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15003640 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15003640 1 -- 172.21.15.2:0/1604669501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 msgr2=0x55d3253ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15003640 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15003640 1 -- 172.21.15.2:0/1604669501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3253d0500 con 0x55d3253bef20 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15804640 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2f15003640 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 0x55d3253b9e70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c000c00 tx=0x7f2f0c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0afa7dc75af1daa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2efaffd640 1 -- 172.21.15.2:0/1604669501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c05d070 con 0x55d3253bef20 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2efaffd640 1 -- 172.21.15.2:0/1604669501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c003960 con 0x55d3253bef20 2024-09-10T23:29:59.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.386+0000 7f2efaffd640 1 -- 172.21.15.2:0/1604669501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c052040 con 0x55d3253bef20 2024-09-10T23:29:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 -- 172.21.15.2:0/1604669501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 msgr2=0x55d3253b9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 0x55d3253b9e70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c000c00 tx=0x7f2f0c031400 comp rx=0 tx=0).stop 2024-09-10T23:29:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 -- 172.21.15.2:0/1604669501 shutdown_connections 2024-09-10T23:29:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253c1a10 0x55d3253cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 --2- 172.21.15.2:0/1604669501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253bef20 0x55d3253b9e70 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 -- 172.21.15.2:0/1604669501 >> 172.21.15.2:0/1604669501 conn(0x55d3253c6030 msgr2=0x55d3253c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 -- 172.21.15.2:0/1604669501 shutdown_connections 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 -- 172.21.15.2:0/1604669501 wait complete. 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 -- start start 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.387+0000 7f2f1963c740 1 Processor -- start 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253bef20 0x55d3253df270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253df7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 0x55d3253dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101b1960 con 0x55d3253c1a10 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101b1290 con 0x55d3253c10f0 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101ae4d0 con 0x55d3253bef20 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 0x55d3253dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 10 client.0 _ll_register_callbacks cb 0x7f2f000e99b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 0x55d3253dfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55274/0 (socket says 172.21.15.2:55274) 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 -- 172.21.15.2:0/2116491951 learned_addr learned my addr 172.21.15.2:0/2116491951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15003640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253bef20 0x55d3253df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f14802640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253df7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 -- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253bef20 msgr2=0x55d3253df270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253bef20 0x55d3253df270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 -- 172.21.15.2:0/2116491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 msgr2=0x55d3253df7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253df7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 -- 172.21.15.2:0/2116491951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3253bf9a0 con 0x55d3253c1a10 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15003640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253bef20 0x55d3253df270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f15804640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 0x55d3253dfcf0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f2f08010a60 tx=0x7f2f08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ed79aeb3eeed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2ef8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/2116491951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08004b20 con 0x55d3253c1a10 2024-09-10T23:29:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/2116491951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f08004cc0 con 0x55d3253c1a10 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.388+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0c003960 con 0x55d3253c1a10 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/2116491951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f08020700 con 0x55d3253c1a10 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 10 client.17328 fetch_fsmap learned FSMap version 28 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3253bf7a0 con 0x55d3253c1a10 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/2116491951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c003960 con 0x55d3253c1a10 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/2116491951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f080055a0 con 0x55d3253c1a10 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 10 client.17328 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 10 client.17328 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 20 client.17328 populate_metadata read hostname 'smithi002' 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253cd9a0 0x55d32544d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 4 client.17328 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3253358a0 con 0x55d3253cd9a0 2024-09-10T23:29:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.389+0000 7f2f15003640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253cd9a0 0x55d32544d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f15003640 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253cd9a0 0x55d32544d4f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c223375223804b54 server_cookie=5f6bd19fc173f49 in_seq=0 out_seq=0 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2ef8ff9640 10 client.17328 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2ef8ff9640 1 -- 172.21.15.2:0/2116491951 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3253358a0 con 0x55d3253cd9a0 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2ef8ff9640 10 client.17328 handle_command_reply: tid=0 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 client.17328 shutdown 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 msgr2=0x55d3253dfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 0x55d3253dfcf0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f2f08010a60 tx=0x7f2f08004a40 comp rx=0 tx=0).stop 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 shutdown_connections 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d3253cd9a0 0x55d32544d4f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3253c1a10 0x55d3253dfcf0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d3253c10f0 0x55d3253df7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 --2- 172.21.15.2:0/2116491951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d3253bef20 0x55d3253df270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 >> 172.21.15.2:0/2116491951 conn(0x55d3253c6030 msgr2=0x55d3253bdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2ef8ff9640 0 client.17328 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:29:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 shutdown_connections 2024-09-10T23:29:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.390+0000 7f2f1963c740 1 -- 172.21.15.2:0/2116491951 wait complete. 2024-09-10T23:29:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f1963c740 20 client.17328 trim_cache size 0 max 16384 2024-09-10T23:29:59.397 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2efc0b5360 msgr2=0x7f2efc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2efc0b5360 0x7f2efc0b7820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005fd0 tx=0x7f2f080098a0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 msgr2=0x7f2f1019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 0x7f2f1019b9f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000edf0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 shutdown_connections 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2efc0b5360 0x7f2efc0b7820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10108060 0x7f2f101a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f101076e0 0x7f2f1019b9f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 --2- 172.21.15.2:0/2830940740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f10101cd0 0x7f2f1019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:59.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 >> 172.21.15.2:0/2830940740 conn(0x7f2f100fd700 msgr2=0x7f2f1006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:59.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 shutdown_connections 2024-09-10T23:29:59.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:29:59.391+0000 7f2f17267640 1 -- 172.21.15.2:0/2830940740 wait complete. 2024-09-10T23:30:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:29:59 smithi177 ceph-mon[35760]: pgmap v521: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:00.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:29:59 smithi002 ceph-mon[31150]: pgmap v521: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:00.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:30:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:29:59 smithi154 ceph-mon[35136]: pgmap v521: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:00.963 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:00 smithi002 ceph-mon[31150]: overall HEALTH_OK 2024-09-10T23:30:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 -- 172.21.15.2:0/3518081353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd078109150 msgr2=0x7fd07810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 --2- 172.21.15.2:0/3518081353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd078109150 0x7fd07810f950 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fd070009900 tx=0x7fd07002a410 comp rx=0 tx=0).stop 2024-09-10T23:30:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 -- 172.21.15.2:0/3518081353 shutdown_connections 2024-09-10T23:30:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 --2- 172.21.15.2:0/3518081353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd078109150 0x7fd07810f950 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 --2- 172.21.15.2:0/3518081353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0781087d0 0x7fd078108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 --2- 172.21.15.2:0/3518081353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078102dc0 0x7fd0781031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 -- 172.21.15.2:0/3518081353 >> 172.21.15.2:0/3518081353 conn(0x7fd0780fe830 msgr2=0x7fd078100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 -- 172.21.15.2:0/3518081353 shutdown_connections 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.047+0000 7fd08025c640 1 -- 172.21.15.2:0/3518081353 wait complete. 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 Processor -- start 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 -- start start 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078102dc0 0x7fd078199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 0x7fd0781997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078109150 0x7fd07819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd078112e10 con 0x7fd0781087d0 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd078112c90 con 0x7fd078102dc0 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd08025c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd078112f90 con 0x7fd078109150 2024-09-10T23:30:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd07d7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 0x7fd0781997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd07d7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 0x7fd0781997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44364/0 (socket says 172.21.15.2:44364) 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd07d7f7640 1 -- 172.21.15.2:0/4090528395 learned_addr learned my addr 172.21.15.2:0/4090528395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.048+0000 7fd07dff8640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078102dc0 0x7fd078199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078109150 0x7fd07819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07d7f7640 1 -- 172.21.15.2:0/4090528395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078109150 msgr2=0x7fd07819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078109150 0x7fd07819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07d7f7640 1 -- 172.21.15.2:0/4090528395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078102dc0 msgr2=0x7fd078199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078102dc0 0x7fd078199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07d7f7640 1 -- 172.21.15.2:0/4090528395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07819f310 con 0x7fd0781087d0 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078109150 0x7fd07819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 0x7fd0781997a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd06800c920 tx=0x7fd06800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd06effd640 1 -- 172.21.15.2:0/4090528395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068007c70 con 0x7fd0781087d0 2024-09-10T23:30:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07819f600 con 0x7fd0781087d0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd06effd640 1 -- 172.21.15.2:0/4090528395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd068007e10 con 0x7fd0781087d0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd06effd640 1 -- 172.21.15.2:0/4090528395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068018820 con 0x7fd0781087d0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.049+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0781a5e90 con 0x7fd0781087d0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd06effd640 1 -- 172.21.15.2:0/4090528395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd06800f450 con 0x7fd0781087d0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 Processor -- start 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 -- start start 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf8967870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf896a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbf88cdea0 con 0x55fbf8957a10 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbf88bd2d0 con 0x55fbf89570f0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd082631740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fbf88c10e0 con 0x55fbf8967db0 2024-09-10T23:30:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd07dff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf8967870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd07dff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf8967870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44374/0 (socket says 172.21.15.2:44374) 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.052+0000 7fd07dff8640 1 -- 172.21.15.2:0/1202829771 learned_addr learned my addr 172.21.15.2:0/1202829771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd06effd640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0640b5360 0x7fd0640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf896a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07dff8640 1 -- 172.21.15.2:0/1202829771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 msgr2=0x55fbf896a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07dff8640 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf896a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07dff8640 1 -- 172.21.15.2:0/1202829771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 msgr2=0x55fbf89574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07dff8640 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07dff8640 1 -- 172.21.15.2:0/1202829771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbf861b650 con 0x55fbf8957a10 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf896a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0640b5360 0x7fd0640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd06effd640 1 -- 172.21.15.2:0/4090528395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd0680e5d20 con 0x7fd0781087d0 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd07dff8640 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf8967870 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd07400a4b0 tx=0x7fd0740096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f509e612e59bc66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd063fff640 1 -- 172.21.15.2:0/1202829771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074018020 con 0x55fbf8957a10 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd063fff640 1 -- 172.21.15.2:0/1202829771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd074014cc0 con 0x55fbf8957a10 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.053+0000 7fd063fff640 1 -- 172.21.15.2:0/1202829771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074013d20 con 0x55fbf8957a10 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 -- 172.21.15.2:0/1202829771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 msgr2=0x55fbf8967870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0640b5360 0x7fd0640b7820 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd070031440 tx=0x7fd070009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf8967870 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd07400a4b0 tx=0x7fd0740096d0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 -- 172.21.15.2:0/1202829771 shutdown_connections 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf896a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf8967870 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 --2- 172.21.15.2:0/1202829771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 -- 172.21.15.2:0/1202829771 >> 172.21.15.2:0/1202829771 conn(0x55fbf8954f20 msgr2=0x55fbf89560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 -- 172.21.15.2:0/1202829771 shutdown_connections 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.054+0000 7fd082631740 1 -- 172.21.15.2:0/1202829771 wait complete. 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 -- start start 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 Processor -- start 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8957a10 0x55fbf8964a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 0x55fbf8964f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbf871e700 con 0x55fbf8967db0 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbf8858160 con 0x55fbf89570f0 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fbf896aa60 con 0x55fbf8957a10 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd082631740 10 client.0 _ll_register_callbacks cb 0x55fbf88719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd07e7f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 0x55fbf8964f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd07e7f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 0x55fbf8964f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44386/0 (socket says 172.21.15.2:44386) 2024-09-10T23:30:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd07e7f9640 1 -- 172.21.15.2:0/1850669498 learned_addr learned my addr 172.21.15.2:0/1850669498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8957a10 0x55fbf8964a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.055+0000 7fd07dff8640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd07e7f9640 1 -- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8957a10 msgr2=0x55fbf8964a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8957a10 0x55fbf8964a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd07e7f9640 1 -- 172.21.15.2:0/1850669498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 msgr2=0x55fbf89675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd07e7f9640 1 -- 172.21.15.2:0/1850669498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbf8885c90 con 0x55fbf8967db0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 0x55fbf8964f70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd0700319c0 tx=0x7fd070005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1f95f1e8deff30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd0617fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd0617fa640 1 -- 172.21.15.2:0/1850669498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070035040 con 0x55fbf8967db0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd0617fa640 1 -- 172.21.15.2:0/1850669498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd070005030 con 0x55fbf8967db0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd074014cc0 con 0x55fbf8967db0 2024-09-10T23:30:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd0617fa640 1 -- 172.21.15.2:0/1850669498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd070005230 con 0x55fbf8967db0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd082631740 10 client.17340 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.056+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbf8976240 con 0x55fbf8967db0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd0617fa640 1 -- 172.21.15.2:0/1850669498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd074014cc0 con 0x55fbf8967db0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd0617fa640 1 -- 172.21.15.2:0/1850669498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0700035f0 con 0x55fbf8967db0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd082631740 10 client.17340 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd082631740 10 client.17340 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd082631740 20 client.17340 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd082631740 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89777a0 0x55fbf8979c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd082631740 4 client.17340 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbf88cfdf0 con 0x55fbf89777a0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.057+0000 7fd07dff8640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89777a0 0x55fbf8979c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd07dff8640 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89777a0 0x55fbf8979c00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c17e37bf850672d2 server_cookie=aeb37db55938f75b in_seq=0 out_seq=0 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd0617fa640 10 client.17340 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd0617fa640 1 -- 172.21.15.2:0/1850669498 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fbf88cfdf0 con 0x55fbf89777a0 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd0617fa640 10 client.17340 handle_command_reply: tid=0 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 client.17340 shutdown 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 msgr2=0x55fbf8964f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 0x55fbf8964f70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd0700319c0 tx=0x7fd070005a20 comp rx=0 tx=0).stop 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 shutdown_connections 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89777a0 0x55fbf8979c00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8967db0 0x55fbf8964f70 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8957a10 0x55fbf8964a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd0617fa640 0 client.17340 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 --2- 172.21.15.2:0/1850669498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf89675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.058+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 >> 172.21.15.2:0/1850669498 conn(0x55fbf8954f20 msgr2=0x55fbf895aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.059+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 shutdown_connections 2024-09-10T23:30:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.059+0000 7fd082631740 1 -- 172.21.15.2:0/1850669498 wait complete. 2024-09-10T23:30:01.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.059+0000 7fd082631740 20 client.17340 trim_cache size 0 max 16384 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 Processor -- start 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 -- start start 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf8956660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf897f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf897fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ac130 con 0x55fbf8957a10 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781adc70 con 0x55fbf89570f0 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd082631740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ac800 con 0x55fbf8967db0 2024-09-10T23:30:01.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf897f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf897f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44398/0 (socket says 172.21.15.2:44398) 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 -- 172.21.15.2:0/2101807895 learned_addr learned my addr 172.21.15.2:0/2101807895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 -- 172.21.15.2:0/2101807895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 msgr2=0x55fbf897fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf897fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 -- 172.21.15.2:0/2101807895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 msgr2=0x55fbf8956660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf8956660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.072+0000 7fd07d7f7640 1 -- 172.21.15.2:0/2101807895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbf897a280 con 0x55fbf8957a10 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf897f4d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd068000c00 tx=0x7fd0680b5420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92dbe5aafa50691 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd0637fe640 1 -- 172.21.15.2:0/2101807895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680ac490 con 0x55fbf8957a10 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd0637fe640 1 -- 172.21.15.2:0/2101807895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0680b5a20 con 0x55fbf8957a10 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd0637fe640 1 -- 172.21.15.2:0/2101807895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680ac950 con 0x55fbf8957a10 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 -- 172.21.15.2:0/2101807895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 msgr2=0x55fbf897f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf897f4d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd068000c00 tx=0x7fd0680b5420 comp rx=0 tx=0).stop 2024-09-10T23:30:01.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 -- 172.21.15.2:0/2101807895 shutdown_connections 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf8967db0 0x55fbf897fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf897f4d0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 --2- 172.21.15.2:0/2101807895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf89570f0 0x55fbf8956660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 -- 172.21.15.2:0/2101807895 >> 172.21.15.2:0/2101807895 conn(0x55fbf8954f20 msgr2=0x55fbf8955f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.073+0000 7fd082631740 1 -- 172.21.15.2:0/2101807895 shutdown_connections 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 -- 172.21.15.2:0/2101807895 wait complete. 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 -- start start 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 Processor -- start 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf89570f0 0x55fbf8970370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf896ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf8967db0 0x55fbf896d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ad5a0 con 0x55fbf8957a10 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781aced0 con 0x55fbf8967db0 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781aa110 con 0x55fbf89570f0 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.074+0000 7fd082631740 10 client.0 _ll_register_callbacks cb 0x7fd070031670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf896ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf896ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44412/0 (socket says 172.21.15.2:44412) 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 -- 172.21.15.2:0/343399031 learned_addr learned my addr 172.21.15.2:0/343399031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07dff8640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf89570f0 0x55fbf8970370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07e7f9640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf8967db0 0x55fbf896d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 -- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf89570f0 msgr2=0x55fbf8970370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf89570f0 0x55fbf8970370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 -- 172.21.15.2:0/343399031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf8967db0 msgr2=0x55fbf896d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf8967db0 0x55fbf896d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 -- 172.21.15.2:0/343399031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbf896d940 con 0x55fbf8957a10 2024-09-10T23:30:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd07d7f7640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf896ccc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd0680ac190 tx=0x7fd0680a84f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a81dfb29f27032 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd0617fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd0617fa640 1 -- 172.21.15.2:0/343399031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680d3070 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd0617fa640 1 -- 172.21.15.2:0/343399031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd0680a6b90 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0680b5a20 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.075+0000 7fd0617fa640 1 -- 172.21.15.2:0/343399031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd0680b0f70 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 10 client.17346 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbf89e5640 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd0617fa640 1 -- 172.21.15.2:0/343399031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0680b5a20 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd0617fa640 1 -- 172.21.15.2:0/343399031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0680b5040 con 0x55fbf8957a10 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 10 client.17346 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 10 client.17346 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 20 client.17346 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89e5d40 0x55fbf89e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 4 client.17346 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbf88cb8a0 con 0x55fbf89e5d40 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.076+0000 7fd07dff8640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89e5d40 0x55fbf89e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd07dff8640 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89e5d40 0x55fbf89e8160 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d11df5a0c763f22 server_cookie=e23a03099456776f in_seq=0 out_seq=0 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd0617fa640 10 client.17346 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd0617fa640 1 -- 172.21.15.2:0/343399031 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbf88cb8a0 con 0x55fbf89e5d40 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd0617fa640 10 client.17346 handle_command_reply: tid=0 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 client.17346 shutdown 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 msgr2=0x55fbf896ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf896ccc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd0680ac190 tx=0x7fd0680a84f0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 shutdown_connections 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55fbf89e5d40 0x55fbf89e8160 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbf8967db0 0x55fbf896d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbf8957a10 0x55fbf896ccc0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 --2- 172.21.15.2:0/343399031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fbf89570f0 0x55fbf8970370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd0617fa640 0 client.17346 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 >> 172.21.15.2:0/343399031 conn(0x55fbf8954f20 msgr2=0x55fbf895a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 shutdown_connections 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 1 -- 172.21.15.2:0/343399031 wait complete. 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.077+0000 7fd082631740 20 client.17346 trim_cache size 0 max 16384 2024-09-10T23:30:01.092 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0640b5360 msgr2=0x7fd0640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0640b5360 0x7fd0640b7820 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd070031440 tx=0x7fd070009260 comp rx=0 tx=0).stop 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 msgr2=0x7fd0781997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 0x7fd0781997a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd06800c920 tx=0x7fd06800cde0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 shutdown_connections 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd0640b5360 0x7fd0640b7820 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd078109150 0x7fd07819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0781087d0 0x7fd0781997a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 --2- 172.21.15.2:0/4090528395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078102dc0 0x7fd078199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 >> 172.21.15.2:0/4090528395 conn(0x7fd0780fe830 msgr2=0x7fd078100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 shutdown_connections 2024-09-10T23:30:01.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:01.078+0000 7fd08025c640 1 -- 172.21.15.2:0/4090528395 wait complete. 2024-09-10T23:30:01.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:00 smithi177 ceph-mon[35760]: overall HEALTH_OK 2024-09-10T23:30:01.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:00 smithi154 ceph-mon[35136]: overall HEALTH_OK 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 -- 172.21.15.2:0/2024130582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810a8a0 msgr2=0x7fe37810cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 --2- 172.21.15.2:0/2024130582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810a8a0 0x7fe37810cd60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe370009900 tx=0x7fe37002a480 comp rx=0 tx=0).stop 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 -- 172.21.15.2:0/2024130582 shutdown_connections 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 --2- 172.21.15.2:0/2024130582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37810a8a0 0x7fe37810cd60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 --2- 172.21.15.2:0/2024130582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378107ef0 0x7fe37810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 --2- 172.21.15.2:0/2024130582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37806b2e0 0x7fe3781079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 -- 172.21.15.2:0/2024130582 >> 172.21.15.2:0/2024130582 conn(0x7fe3780fd140 msgr2=0x7fe3780ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 -- 172.21.15.2:0/2024130582 shutdown_connections 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.360+0000 7fe38015d640 1 -- 172.21.15.2:0/2024130582 wait complete. 2024-09-10T23:30:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 Processor -- start 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 -- start start 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 0x7fe37819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378107ef0 0x7fe37819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810a8a0 0x7fe37819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781107f0 con 0x7fe37806b2e0 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe378110670 con 0x7fe37810a8a0 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe38015d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe378110970 con 0x7fe378107ef0 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 0x7fe37819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 0x7fe37819ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44416/0 (socket says 172.21.15.2:44416) 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 -- 172.21.15.2:0/2813448736 learned_addr learned my addr 172.21.15.2:0/2813448736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378107ef0 0x7fe37819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810a8a0 0x7fe37819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 -- 172.21.15.2:0/2813448736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378107ef0 msgr2=0x7fe37819b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378107ef0 0x7fe37819b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 -- 172.21.15.2:0/2813448736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810a8a0 msgr2=0x7fe37819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810a8a0 0x7fe37819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 -- 172.21.15.2:0/2813448736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37819c9c0 con 0x7fe37806b2e0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810a8a0 0x7fe37819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.361+0000 7fe37def9640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 0x7fe37819ae80 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe37400eab0 tx=0x7fe37400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.362+0000 7fe36effd640 1 -- 172.21.15.2:0/2813448736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37400cd80 con 0x7fe37806b2e0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.362+0000 7fe36effd640 1 -- 172.21.15.2:0/2813448736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe374011920 con 0x7fe37806b2e0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.362+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37819ccb0 con 0x7fe37806b2e0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.362+0000 7fe36effd640 1 -- 172.21.15.2:0/2813448736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374010930 con 0x7fe37806b2e0 2024-09-10T23:30:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.362+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3781a3380 con 0x7fe37806b2e0 2024-09-10T23:30:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.364+0000 7fe36effd640 1 -- 172.21.15.2:0/2813448736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe37400f040 con 0x7fe37806b2e0 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.364+0000 7fe383007740 1 Processor -- start 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.364+0000 7fe383007740 1 -- start start 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe383007740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0ceedc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe383007740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceee190 0x55ad0cef0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe383007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe383007740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ad0ce5d6f0 con 0x55ad0ceeb860 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe383007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad0ce4cb20 con 0x55ad0cef0bd0 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe383007740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad0ce50930 con 0x55ad0ceee190 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0ceedc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0ceedc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44430/0 (socket says 172.21.15.2:44430) 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 -- 172.21.15.2:0/4100674846 learned_addr learned my addr 172.21.15.2:0/4100674846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37def9640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceee190 0x55ad0cef0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 -- 172.21.15.2:0/4100674846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceee190 msgr2=0x55ad0cef0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceee190 0x55ad0cef0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 -- 172.21.15.2:0/4100674846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0cef0bd0 msgr2=0x55ad0cef3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 -- 172.21.15.2:0/4100674846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0ce12530 con 0x55ad0ceeb860 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37def9640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceee190 0x55ad0cef0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe36effd640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b5360 0x7fe3640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0ceedc50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe370009900 tx=0x7fe370032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b6bbf5b7023e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.365+0000 7fe37def9640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b5360 0x7fe3640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe36effd640 1 -- 172.21.15.2:0/2813448736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe3740e5e10 con 0x7fe37806b2e0 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe363fff640 1 -- 172.21.15.2:0/4100674846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37003f070 con 0x55ad0ceeb860 2024-09-10T23:30:01.373 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe363fff640 1 -- 172.21.15.2:0/4100674846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3700317a0 con 0x55ad0ceeb860 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe363fff640 1 -- 172.21.15.2:0/4100674846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370035070 con 0x55ad0ceeb860 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 -- 172.21.15.2:0/4100674846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 msgr2=0x55ad0ceedc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe37def9640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b5360 0x7fe3640b7820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3740ac2e0 tx=0x7fe3740094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0ceedc50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe370009900 tx=0x7fe370032e70 comp rx=0 tx=0).stop 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 -- 172.21.15.2:0/4100674846 shutdown_connections 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceee190 0x55ad0cef0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 --2- 172.21.15.2:0/4100674846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0ceedc50 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.366+0000 7fe383007740 1 -- 172.21.15.2:0/4100674846 >> 172.21.15.2:0/4100674846 conn(0x55ad0cee69b0 msgr2=0x55ad0cee7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 -- 172.21.15.2:0/4100674846 shutdown_connections 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 -- 172.21.15.2:0/4100674846 wait complete. 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 -- start start 2024-09-10T23:30:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 Processor -- start 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceeb860 0x55ad0cef4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 0x55ad0cef5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ad0cd84ab0 con 0x55ad0ceee190 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad0cdf2730 con 0x55ad0ceeb860 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad0cef3b50 con 0x55ad0cef0bd0 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe383007740 10 client.0 _ll_register_callbacks cb 0x55ad0ce466b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe37d6f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 0x55ad0cef5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe37d6f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 0x55ad0cef5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44440/0 (socket says 172.21.15.2:44440) 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.367+0000 7fe37d6f8640 1 -- 172.21.15.2:0/4117240946 learned_addr learned my addr 172.21.15.2:0/4117240946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceeb860 0x55ad0cef4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37d6f8640 1 -- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 msgr2=0x55ad0cef6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37d6f8640 1 -- 172.21.15.2:0/4117240946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceeb860 msgr2=0x55ad0cef4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceeb860 0x55ad0cef4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37d6f8640 1 -- 172.21.15.2:0/4117240946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0cbae790 con 0x55ad0ceee190 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceeb860 0x55ad0cef4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 0x55ad0cef5530 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe3680128e0 tx=0x7fe368012da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecb6a669e40ef05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe3617fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe3617fa640 1 -- 172.21.15.2:0/4117240946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368010c80 con 0x55ad0ceee190 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe3617fa640 1 -- 172.21.15.2:0/4117240946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe368010e20 con 0x55ad0ceee190 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3700317a0 con 0x55ad0ceee190 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe3617fa640 1 -- 172.21.15.2:0/4117240946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe368005020 con 0x55ad0ceee190 2024-09-10T23:30:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe383007740 10 client.17358 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad0cc27620 con 0x55ad0ceee190 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.368+0000 7fe3617fa640 1 -- 172.21.15.2:0/4117240946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3700317a0 con 0x55ad0ceee190 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe3617fa640 1 -- 172.21.15.2:0/4117240946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe36801a410 con 0x55ad0ceee190 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe383007740 10 client.17358 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe383007740 10 client.17358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe383007740 20 client.17358 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe383007740 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf00890 0x55ad0cf02ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe383007740 4 client.17358 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad0ce5f640 con 0x55ad0cf00890 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf00890 0x55ad0cf02ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf00890 0x55ad0cf02ca0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=180316c5058bbe3a server_cookie=54627972c89e5166 in_seq=0 out_seq=0 2024-09-10T23:30:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.369+0000 7fe3617fa640 10 client.17358 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe3617fa640 1 -- 172.21.15.2:0/4117240946 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad0ce5f640 con 0x55ad0cf00890 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe3617fa640 10 client.17358 handle_command_reply: tid=0 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 client.17358 shutdown 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 msgr2=0x55ad0cef5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 0x55ad0cef5530 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe3680128e0 tx=0x7fe368012da0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 shutdown_connections 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf00890 0x55ad0cf02ca0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cef6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceee190 0x55ad0cef5530 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 --2- 172.21.15.2:0/4117240946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceeb860 0x55ad0cef4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe3617fa640 0 client.17358 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 >> 172.21.15.2:0/4117240946 conn(0x55ad0cee69b0 msgr2=0x55ad0cee5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 shutdown_connections 2024-09-10T23:30:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 1 -- 172.21.15.2:0/4117240946 wait complete. 2024-09-10T23:30:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.370+0000 7fe383007740 20 client.17358 trim_cache size 0 max 16384 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 Processor -- start 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 -- start start 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceeb860 0x55ad0ceead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0ceeb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 0x55ad0cee9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781abfa0 con 0x55ad0cef0bd0 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781adae0 con 0x55ad0ceee190 2024-09-10T23:30:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe383007740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781ac670 con 0x55ad0ceeb860 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe37e6fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 0x55ad0cee9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe37e6fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 0x55ad0cee9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44452/0 (socket says 172.21.15.2:44452) 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe37e6fa640 1 -- 172.21.15.2:0/574830159 learned_addr learned my addr 172.21.15.2:0/574830159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0ceeb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.385+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceeb860 0x55ad0ceead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37e6fa640 1 -- 172.21.15.2:0/574830159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceeb860 msgr2=0x55ad0ceead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceeb860 0x55ad0ceead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37e6fa640 1 -- 172.21.15.2:0/574830159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 msgr2=0x55ad0ceeb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0ceeb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37e6fa640 1 -- 172.21.15.2:0/574830159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0cef6470 con 0x55ad0cef0bd0 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0ceeb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 0x55ad0cee9a00 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe370000c00 tx=0x7fe370005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0ef766baf2966 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe3637fe640 1 -- 172.21.15.2:0/574830159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370035040 con 0x55ad0cef0bd0 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe3637fe640 1 -- 172.21.15.2:0/574830159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3700044d0 con 0x55ad0cef0bd0 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe3637fe640 1 -- 172.21.15.2:0/574830159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37003f040 con 0x55ad0cef0bd0 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe383007740 1 -- 172.21.15.2:0/574830159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 msgr2=0x55ad0cee9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.386+0000 7fe383007740 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 0x55ad0cee9a00 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe370000c00 tx=0x7fe370005a40 comp rx=0 tx=0).stop 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- 172.21.15.2:0/574830159 shutdown_connections 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0cef0bd0 0x55ad0cee9a00 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0ceeb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 --2- 172.21.15.2:0/574830159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0ceeb860 0x55ad0ceead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- 172.21.15.2:0/574830159 >> 172.21.15.2:0/574830159 conn(0x55ad0cee69b0 msgr2=0x55ad0cee7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- 172.21.15.2:0/574830159 shutdown_connections 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- 172.21.15.2:0/574830159 wait complete. 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- start start 2024-09-10T23:30:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 Processor -- start 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0cef9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0cefa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cefaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781ad410 con 0x55ad0ceeb860 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781acd40 con 0x55ad0ceee190 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781a9f80 con 0x55ad0cef0bd0 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe383007740 10 client.0 _ll_register_callbacks cb 0x7fe36800a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe37e6fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0cef9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe37e6fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0cef9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44464/0 (socket says 172.21.15.2:44464) 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.387+0000 7fe37e6fa640 1 -- 172.21.15.2:0/1975991344 learned_addr learned my addr 172.21.15.2:0/1975991344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0cefa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cefaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 -- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 msgr2=0x55ad0cefaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cefaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 -- 172.21.15.2:0/1975991344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 msgr2=0x55ad0cefa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0cefa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 -- 172.21.15.2:0/1975991344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0cef08f0 con 0x55ad0ceeb860 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe37e6fa640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0cef9c40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe3700038b0 tx=0x7fe370005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1f5c7e8d67d357 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe3617fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe3617fa640 1 -- 172.21.15.2:0/1975991344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370035030 con 0x55ad0ceeb860 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe3617fa640 1 -- 172.21.15.2:0/1975991344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe370004160 con 0x55ad0ceeb860 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3700044d0 con 0x55ad0ceeb860 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe3617fa640 1 -- 172.21.15.2:0/1975991344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe37003f070 con 0x55ad0ceeb860 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe383007740 10 client.17364 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad0cefc8d0 con 0x55ad0ceeb860 2024-09-10T23:30:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe3617fa640 1 -- 172.21.15.2:0/1975991344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3700044d0 con 0x55ad0ceeb860 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.388+0000 7fe3617fa640 1 -- 172.21.15.2:0/1975991344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe37005a4c0 con 0x55ad0ceeb860 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe383007740 10 client.17364 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe383007740 10 client.17364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe383007740 20 client.17364 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe383007740 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf6d7b0 0x55ad0cf6fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe383007740 4 client.17364 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad0ce5b0f0 con 0x55ad0cf6d7b0 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf6d7b0 0x55ad0cf6fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe3617fa640 10 client.17364 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.389+0000 7fe37d6f8640 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf6d7b0 0x55ad0cf6fba0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b5313afe93d129 server_cookie=a37981fd6ea6bf01 in_seq=0 out_seq=0 2024-09-10T23:30:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe3617fa640 1 -- 172.21.15.2:0/1975991344 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad0ce5b0f0 con 0x55ad0cf6d7b0 2024-09-10T23:30:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe3617fa640 10 client.17364 handle_command_reply: tid=0 2024-09-10T23:30:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 client.17364 shutdown 2024-09-10T23:30:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 msgr2=0x55ad0cef9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0cef9c40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe3700038b0 tx=0x7fe370005990 comp rx=0 tx=0).stop 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 shutdown_connections 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ad0cf6d7b0 0x55ad0cf6fba0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad0cef0bd0 0x55ad0cefaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad0ceee190 0x55ad0cefa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe3617fa640 0 client.17364 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 --2- 172.21.15.2:0/1975991344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ad0ceeb860 0x55ad0cef9c40 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 >> 172.21.15.2:0/1975991344 conn(0x55ad0cee69b0 msgr2=0x55ad0cee7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 shutdown_connections 2024-09-10T23:30:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.405+0000 7fe383007740 1 -- 172.21.15.2:0/1975991344 wait complete. 2024-09-10T23:30:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe383007740 20 client.17364 trim_cache size 0 max 16384 2024-09-10T23:30:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:30:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:30:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:30:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:30:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b5360 msgr2=0x7fe3640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b5360 0x7fe3640b7820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3740ac2e0 tx=0x7fe3740094a0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 msgr2=0x7fe37819ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 0x7fe37819ae80 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe37400eab0 tx=0x7fe37400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 shutdown_connections 2024-09-10T23:30:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3640b5360 0x7fe3640b7820 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe37810a8a0 0x7fe37819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378107ef0 0x7fe37819b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 --2- 172.21.15.2:0/2813448736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe37806b2e0 0x7fe37819ae80 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 >> 172.21.15.2:0/2813448736 conn(0x7fe3780fd140 msgr2=0x7fe378108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 shutdown_connections 2024-09-10T23:30:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:01.406+0000 7fe38015d640 1 -- 172.21.15.2:0/2813448736 wait complete. 2024-09-10T23:30:01.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:30:02.144 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:01 smithi177 ceph-mon[35760]: pgmap v522: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:30:02.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:01 smithi002 ceph-mon[31150]: pgmap v522: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:30:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:01 smithi154 ceph-mon[35136]: pgmap v522: 97 pgs: 97 active+clean; 4.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 -- 172.21.15.2:0/1235119080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c10d140 msgr2=0x7fee7c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 --2- 172.21.15.2:0/1235119080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c10d140 0x7fee7c10f5a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fee74009ca0 tx=0x7fee7402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 -- 172.21.15.2:0/1235119080 shutdown_connections 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 --2- 172.21.15.2:0/1235119080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c10d140 0x7fee7c10f5a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 --2- 172.21.15.2:0/1235119080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c104600 0x7fee7c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 --2- 172.21.15.2:0/1235119080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c103ce0 0x7fee7c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 -- 172.21.15.2:0/1235119080 >> 172.21.15.2:0/1235119080 conn(0x7fee7c0fd700 msgr2=0x7fee7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 -- 172.21.15.2:0/1235119080 shutdown_connections 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.624+0000 7fee81253640 1 -- 172.21.15.2:0/1235119080 wait complete. 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 Processor -- start 2024-09-10T23:30:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 -- start start 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c103ce0 0x7fee7c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 0x7fee7c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c10d140 0x7fee7c19ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c112db0 con 0x7fee7c104600 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c112c30 con 0x7fee7c10d140 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee81253640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c112f30 con 0x7fee7c103ce0 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 0x7fee7c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 0x7fee7c1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44476/0 (socket says 172.21.15.2:44476) 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7a59c640 1 -- 172.21.15.2:0/1796541451 learned_addr learned my addr 172.21.15.2:0/1796541451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c10d140 0x7fee7c19ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c103ce0 0x7fee7c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7a59c640 1 -- 172.21.15.2:0/1796541451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c103ce0 msgr2=0x7fee7c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.625+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c103ce0 0x7fee7c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee7a59c640 1 -- 172.21.15.2:0/1796541451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c10d140 msgr2=0x7fee7c19ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c10d140 0x7fee7c19ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee7a59c640 1 -- 172.21.15.2:0/1796541451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c19f250 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c103ce0 0x7fee7c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 0x7fee7c1996e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c970 tx=0x7fee7000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee63fff640 1 -- 172.21.15.2:0/1796541451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70004220 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee63fff640 1 -- 172.21.15.2:0/1796541451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee700043c0 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c19f540 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee63fff640 1 -- 172.21.15.2:0/1796541451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70003e30 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.626+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c1a5c00 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.628+0000 7fee63fff640 1 -- 172.21.15.2:0/1796541451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fee700079b0 con 0x7fee7c104600 2024-09-10T23:30:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 Processor -- start 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 -- start start 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 0x564f739ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564f73930ea0 con 0x564f739baa10 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564f739202d0 con 0x564f739cadb0 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee83628740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564f739240e0 con 0x564f739ba0f0 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 0x564f739ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 0x564f739ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44478/0 (socket says 172.21.15.2:44478) 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1916631232 learned_addr learned my addr 172.21.15.2:0/1916631232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1916631232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 msgr2=0x564f739ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee63fff640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee640b52e0 0x7fee640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1916631232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 msgr2=0x564f739cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1916631232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7367e650 con 0x564f739baa10 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.629+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.630+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee640b52e0 0x7fee640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.630+0000 7fee63fff640 1 -- 172.21.15.2:0/1796541451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fee700e5c40 con 0x7fee7c104600 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.630+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 0x564f739ca870 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fee6c008c90 tx=0x7fee6c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854148aeed12e3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.630+0000 7fee617fa640 1 -- 172.21.15.2:0/1916631232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c014070 con 0x564f739baa10 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.630+0000 7fee617fa640 1 -- 172.21.15.2:0/1916631232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee6c0047a0 con 0x564f739baa10 2024-09-10T23:30:02.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.630+0000 7fee617fa640 1 -- 172.21.15.2:0/1916631232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c010630 con 0x564f739baa10 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 -- 172.21.15.2:0/1916631232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 msgr2=0x564f739ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee640b52e0 0x7fee640b77a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fee7402f500 tx=0x7fee7402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 0x564f739ca870 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fee6c008c90 tx=0x7fee6c00e720 comp rx=0 tx=0).stop 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 -- 172.21.15.2:0/1916631232 shutdown_connections 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739baa10 0x564f739ca870 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- 172.21.15.2:0/1916631232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 -- 172.21.15.2:0/1916631232 >> 172.21.15.2:0/1916631232 conn(0x564f739b7f20 msgr2=0x564f739b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 -- 172.21.15.2:0/1916631232 shutdown_connections 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 -- 172.21.15.2:0/1916631232 wait complete. 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 -- start start 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 Processor -- start 2024-09-10T23:30:02.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739baa10 0x564f739c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.631+0000 7fee83628740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee83628740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564f73781700 con 0x564f739cadb0 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee83628740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564f738bb160 con 0x564f739baa10 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee83628740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564f739cda60 con 0x564f739ba0f0 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee83628740 10 client.0 _ll_register_callbacks cb 0x564f738d49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739baa10 0x564f739c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44486/0 (socket says 172.21.15.2:44486) 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 -- 172.21.15.2:0/3476805715 learned_addr learned my addr 172.21.15.2:0/3476805715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 -- 172.21.15.2:0/3476805715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 msgr2=0x564f739ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 -- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739baa10 msgr2=0x564f739c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739baa10 0x564f739c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 -- 172.21.15.2:0/3476805715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f738e8c90 con 0x564f739cadb0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7a59c640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739baa10 0x564f739c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee7b59e640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739c8110 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fee74035000 tx=0x7fee740095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8421e6ff0b0395ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee5eff5640 1 -- 172.21.15.2:0/3476805715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74045070 con 0x564f739cadb0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee5eff5640 1 -- 172.21.15.2:0/3476805715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fee74004450 con 0x564f739cadb0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.632+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee6c0047a0 con 0x564f739cadb0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee5eff5640 1 -- 172.21.15.2:0/3476805715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee74004650 con 0x564f739cadb0 2024-09-10T23:30:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 10 client.17376 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f739d93b0 con 0x564f739cadb0 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee5eff5640 1 -- 172.21.15.2:0/3476805715 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee6c0047a0 con 0x564f739cadb0 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee5eff5640 1 -- 172.21.15.2:0/3476805715 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee74030630 con 0x564f739cadb0 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 10 client.17376 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 10 client.17376 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 20 client.17376 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f739da8c0 0x564f739dccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 4 client.17376 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f73932df0 con 0x564f739da8c0 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.633+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f739da8c0 0x564f739dccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.634+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f739da8c0 0x564f739dccb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=314774cb4f6c9b2c server_cookie=75a5dcc6e1ed6772 in_seq=0 out_seq=0 2024-09-10T23:30:02.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.634+0000 7fee5eff5640 10 client.17376 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee5eff5640 1 -- 172.21.15.2:0/3476805715 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f73932df0 con 0x564f739da8c0 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee5eff5640 10 client.17376 handle_command_reply: tid=0 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 client.17376 shutdown 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 msgr2=0x564f739c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739c8110 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fee74035000 tx=0x7fee740095c0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 shutdown_connections 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f739da8c0 0x564f739dccb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739c8110 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739baa10 0x564f739c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 --2- 172.21.15.2:0/3476805715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739ba0f0 0x564f739ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee5eff5640 0 client.17376 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:02.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 >> 172.21.15.2:0/3476805715 conn(0x564f739b7f20 msgr2=0x564f739bdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 shutdown_connections 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 1 -- 172.21.15.2:0/3476805715 wait complete. 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.635+0000 7fee83628740 20 client.17376 trim_cache size 0 max 16384 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 Processor -- start 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 -- start start 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 0x564f739d6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1ac180 con 0x564f739ba0f0 2024-09-10T23:30:02.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1adcc0 con 0x564f739cadb0 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee83628740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1ac850 con 0x564f739baa10 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee7ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 0x564f739d6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee7ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 0x564f739d6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44498/0 (socket says 172.21.15.2:44498) 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1435212301 learned_addr learned my addr 172.21.15.2:0/1435212301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.649+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1435212301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 msgr2=0x564f739ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1435212301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 msgr2=0x564f739cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee7ad9d640 1 -- 172.21.15.2:0/1435212301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f739c6000 con 0x564f739ba0f0 2024-09-10T23:30:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 0x564f739d6c90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00ec20 tx=0x7fee6c008550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedea9df1d4d4a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee60ff9640 1 -- 172.21.15.2:0/1435212301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c014070 con 0x564f739ba0f0 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee60ff9640 1 -- 172.21.15.2:0/1435212301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee6c005380 con 0x564f739ba0f0 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.650+0000 7fee60ff9640 1 -- 172.21.15.2:0/1435212301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0246d0 con 0x564f739ba0f0 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- 172.21.15.2:0/1435212301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 msgr2=0x564f739d6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 0x564f739d6c90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00ec20 tx=0x7fee6c008550 comp rx=0 tx=0).stop 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- 172.21.15.2:0/1435212301 shutdown_connections 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739cadb0 0x564f739cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- 172.21.15.2:0/1435212301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739ba0f0 0x564f739d6c90 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- 172.21.15.2:0/1435212301 >> 172.21.15.2:0/1435212301 conn(0x564f739b7f20 msgr2=0x564f739c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- 172.21.15.2:0/1435212301 shutdown_connections 2024-09-10T23:30:02.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- 172.21.15.2:0/1435212301 wait complete. 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- start start 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 Processor -- start 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739ba0f0 0x564f739d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739e2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1ad5f0 con 0x564f739cadb0 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1acf20 con 0x564f739ba0f0 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1aa160 con 0x564f739baa10 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee83628740 10 client.0 _ll_register_callbacks cb 0x7fee74005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee7b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee7b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739e2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44506/0 (socket says 172.21.15.2:44506) 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee7b59e640 1 -- 172.21.15.2:0/1297443835 learned_addr learned my addr 172.21.15.2:0/1297443835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee7a59c640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.651+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739ba0f0 0x564f739d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee7b59e640 1 -- 172.21.15.2:0/1297443835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 msgr2=0x564f739e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee7b59e640 1 -- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739ba0f0 msgr2=0x564f739d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739ba0f0 0x564f739d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee7b59e640 1 -- 172.21.15.2:0/1297443835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f739d2240 con 0x564f739cadb0 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee7b59e640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739e2a60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fee7403f040 tx=0x7fee740317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcadf33d4dc43b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:02.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee5eff5640 1 -- 172.21.15.2:0/1297443835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740307c0 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee5eff5640 1 -- 172.21.15.2:0/1297443835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fee74004b40 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee6c005380 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee5eff5640 1 -- 172.21.15.2:0/1297443835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee7406e050 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee83628740 10 client.17382 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f73a479d0 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.652+0000 7fee5eff5640 1 -- 172.21.15.2:0/1297443835 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee6c005380 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee5eff5640 1 -- 172.21.15.2:0/1297443835 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee7405f450 con 0x564f739cadb0 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee83628740 10 client.17382 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee83628740 10 client.17382 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:30:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee83628740 20 client.17382 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee83628740 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f73a48170 0x564f73a4a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee83628740 4 client.17382 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f7392e8a0 con 0x564f73a48170 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f73a48170 0x564f73a4a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee7ad9d640 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f73a48170 0x564f73a4a590 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2c463d12bd8ecf8f server_cookie=66df4061fa7c7418 in_seq=0 out_seq=0 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee5eff5640 10 client.17382 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee5eff5640 1 -- 172.21.15.2:0/1297443835 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f7392e8a0 con 0x564f73a48170 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.653+0000 7fee5eff5640 10 client.17382 handle_command_reply: tid=0 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 client.17382 shutdown 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 msgr2=0x564f739e2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739e2a60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fee7403f040 tx=0x7fee740317f0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 shutdown_connections 2024-09-10T23:30:02.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564f73a48170 0x564f73a4a590 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564f739cadb0 0x564f739e2a60 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564f739baa10 0x564f739e2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee5eff5640 0 client.17382 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:02.705 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:02.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 --2- 172.21.15.2:0/1297443835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f739ba0f0 0x564f739d3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 >> 172.21.15.2:0/1297443835 conn(0x564f739b7f20 msgr2=0x564f739c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 shutdown_connections 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 1 -- 172.21.15.2:0/1297443835 wait complete. 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee83628740 20 client.17382 trim_cache size 0 max 16384 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee640b52e0 msgr2=0x7fee640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee640b52e0 0x7fee640b77a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fee7402f500 tx=0x7fee7402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 msgr2=0x7fee7c1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 0x7fee7c1996e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c970 tx=0x7fee7000ce30 comp rx=0 tx=0).stop 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 shutdown_connections 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee640b52e0 0x7fee640b77a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c10d140 0x7fee7c19ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee7c104600 0x7fee7c1996e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 --2- 172.21.15.2:0/1796541451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee7c103ce0 0x7fee7c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 >> 172.21.15.2:0/1796541451 conn(0x7fee7c0fd700 msgr2=0x7fee7c10f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.654+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 shutdown_connections 2024-09-10T23:30:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:02.655+0000 7fee81253640 1 -- 172.21.15.2:0/1796541451 wait complete. 2024-09-10T23:30:03.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:30:03.803 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:04.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:03 smithi002 ceph-mon[31150]: pgmap v523: 97 pgs: 97 active+clean; 4.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:30:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:03 smithi177 ceph-mon[35760]: pgmap v523: 97 pgs: 97 active+clean; 4.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:30:04.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:03 smithi154 ceph-mon[35136]: pgmap v523: 97 pgs: 97 active+clean; 4.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 -- 172.21.15.2:0/2992944304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8108120 msgr2=0x7fc1a810e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 --2- 172.21.15.2:0/2992944304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8108120 0x7fc1a810e870 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009ca0 tx=0x7fc1a002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 -- 172.21.15.2:0/2992944304 shutdown_connections 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 --2- 172.21.15.2:0/2992944304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8108120 0x7fc1a810e870 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 --2- 172.21.15.2:0/2992944304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8107780 0x7fc1a8107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 --2- 172.21.15.2:0/2992944304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a8102920 0x7fc1a8102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.319+0000 7fc1ae501640 1 -- 172.21.15.2:0/2992944304 >> 172.21.15.2:0/2992944304 conn(0x7fc1a8076f50 msgr2=0x7fc1a8077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.320+0000 7fc1ae501640 1 -- 172.21.15.2:0/2992944304 shutdown_connections 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.320+0000 7fc1ae501640 1 -- 172.21.15.2:0/2992944304 wait complete. 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.320+0000 7fc1ae501640 1 Processor -- start 2024-09-10T23:30:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.320+0000 7fc1ae501640 1 -- start start 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1ae501640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a8102920 0x7fc1a8199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1ae501640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 0x7fc1a8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1ae501640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8108120 0x7fc1a819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1ae501640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8111ca0 con 0x7fc1a8107780 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1ae501640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8111b20 con 0x7fc1a8108120 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1ae501640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8111e20 con 0x7fc1a8102920 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 0x7fc1a8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 0x7fc1a8199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44534/0 (socket says 172.21.15.2:44534) 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 -- 172.21.15.2:0/4235408683 learned_addr learned my addr 172.21.15.2:0/4235408683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a8102920 0x7fc1a8199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8108120 0x7fc1a819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 -- 172.21.15.2:0/4235408683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a8102920 msgr2=0x7fc1a8199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a8102920 0x7fc1a8199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 -- 172.21.15.2:0/4235408683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8108120 msgr2=0x7fc1a819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8108120 0x7fc1a819eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 -- 172.21.15.2:0/4235408683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a819f2d0 con 0x7fc1a8107780 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 0x7fc1a8199760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c920 tx=0x7fc19c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.321+0000 7fc1a57fa640 1 -- 172.21.15.2:0/4235408683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c007c70 con 0x7fc1a8107780 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.322+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a819f5c0 con 0x7fc1a8107780 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.322+0000 7fc1a57fa640 1 -- 172.21.15.2:0/4235408683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc19c007e10 con 0x7fc1a8107780 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.322+0000 7fc1a57fa640 1 -- 172.21.15.2:0/4235408683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c018820 con 0x7fc1a8107780 2024-09-10T23:30:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.322+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a81a5c80 con 0x7fc1a8107780 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 Processor -- start 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 -- start start 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1a57fa640 1 -- 172.21.15.2:0/4235408683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc19c00f450 con 0x7fc1a8107780 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2b7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d0f21dea0 con 0x560d0f2a7a10 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d0f20d2d0 con 0x560d0f2b7db0 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.324+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d0f2110e0 con 0x560d0f2a70f0 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44546/0 (socket says 172.21.15.2:44546) 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 -- 172.21.15.2:0/2861505021 learned_addr learned my addr 172.21.15.2:0/2861505021 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 -- 172.21.15.2:0/2861505021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 msgr2=0x560d0f2a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 -- 172.21.15.2:0/2861505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 msgr2=0x560d0f2ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 -- 172.21.15.2:0/2861505021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0ef6b650 con 0x560d0f2a7a10 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2b7870 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b760 tx=0x7fc19800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8552917fca54a1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a57fa640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc1900b52e0 0x7fc1900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc18e7fc640 1 -- 172.21.15.2:0/2861505021 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198003dd0 con 0x560d0f2a7a10 2024-09-10T23:30:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc18e7fc640 1 -- 172.21.15.2:0/2861505021 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc198015070 con 0x560d0f2a7a10 2024-09-10T23:30:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc18e7fc640 1 -- 172.21.15.2:0/2861505021 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198004e00 con 0x560d0f2a7a10 2024-09-10T23:30:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc1900b52e0 0x7fc1900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.325+0000 7fc1a57fa640 1 -- 172.21.15.2:0/4235408683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc19c0e5c80 con 0x7fc1a8107780 2024-09-10T23:30:04.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2861505021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 msgr2=0x560d0f2b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc1900b52e0 0x7fc1900b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0006010 tx=0x7fc1a00093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2b7870 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b760 tx=0x7fc19800bc20 comp rx=0 tx=0).stop 2024-09-10T23:30:04.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2861505021 shutdown_connections 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2b7870 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2861505021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2861505021 >> 172.21.15.2:0/2861505021 conn(0x560d0f2a4f20 msgr2=0x560d0f2a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2861505021 shutdown_connections 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.326+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2861505021 wait complete. 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 -- start start 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 Processor -- start 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2b7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d0f06e700 con 0x560d0f2a70f0 2024-09-10T23:30:04.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d0f1a8160 con 0x560d0f2a7a10 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d0f2baa60 con 0x560d0f2b7db0 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1b08d6740 10 client.0 _ll_register_callbacks cb 0x560d0f1c19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2b7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44550/0 (socket says 172.21.15.2:44550) 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1a7fff640 1 -- 172.21.15.2:0/715088514 learned_addr learned my addr 172.21.15.2:0/715088514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.327+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a7fff640 1 -- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 msgr2=0x560d0f2b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a7fff640 1 -- 172.21.15.2:0/715088514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 msgr2=0x560d0f2b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a7fff640 1 -- 172.21.15.2:0/715088514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0f1d5c90 con 0x560d0f2a70f0 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:04.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2b7690 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc198004a80 tx=0x7fc1980043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ae6fe629b27314 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1877fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1877fe640 1 -- 172.21.15.2:0/715088514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198003fa0 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1877fe640 1 -- 172.21.15.2:0/715088514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc198011440 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc198015070 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1877fe640 1 -- 172.21.15.2:0/715088514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc198011640 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1b08d6740 10 client.17394 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.328+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d0f2c6410 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1877fe640 1 -- 172.21.15.2:0/715088514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc198015070 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1877fe640 1 -- 172.21.15.2:0/715088514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc1980258c0 con 0x560d0f2a70f0 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1b08d6740 10 client.17394 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1b08d6740 10 client.17394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1b08d6740 20 client.17394 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:04.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f2c7810 0x560d0f2c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1b08d6740 4 client.17394 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0f21fdf0 con 0x560d0f2c7810 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f2c7810 0x560d0f2c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f2c7810 0x560d0f2c9c00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=405e4dcd5d13ace1 server_cookie=3aa6da5455f661b in_seq=0 out_seq=0 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.329+0000 7fc1877fe640 10 client.17394 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1877fe640 1 -- 172.21.15.2:0/715088514 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d0f21fdf0 con 0x560d0f2c7810 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1877fe640 10 client.17394 handle_command_reply: tid=0 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1b08d6740 1 client.17394 shutdown 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 msgr2=0x560d0f2b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2b7690 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc198004a80 tx=0x7fc1980043a0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 shutdown_connections 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f2c7810 0x560d0f2c9c00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.330+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/715088514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2b7690 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 >> 172.21.15.2:0/715088514 conn(0x560d0f2a4f20 msgr2=0x560d0f2aaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1877fe640 0 client.17394 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 shutdown_connections 2024-09-10T23:30:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1b08d6740 1 -- 172.21.15.2:0/715088514 wait complete. 2024-09-10T23:30:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.331+0000 7fc1b08d6740 20 client.17394 trim_cache size 0 max 16384 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 Processor -- start 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 -- start start 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81ac140 con 0x560d0f2a70f0 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.344+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81adc80 con 0x560d0f2a7a10 2024-09-10T23:30:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81ac810 con 0x560d0f2b7db0 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44552/0 (socket says 172.21.15.2:44552) 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 -- 172.21.15.2:0/421053559 learned_addr learned my addr 172.21.15.2:0/421053559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 -- 172.21.15.2:0/421053559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 msgr2=0x560d0f2b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 -- 172.21.15.2:0/421053559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 msgr2=0x560d0f2c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 -- 172.21.15.2:0/421053559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0f2a4b40 con 0x560d0f2a70f0 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2c3d20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc198004370 tx=0x7fc198004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf7849f54a05d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc18dffb640 1 -- 172.21.15.2:0/421053559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198034040 con 0x560d0f2a70f0 2024-09-10T23:30:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc18dffb640 1 -- 172.21.15.2:0/421053559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc198015070 con 0x560d0f2a70f0 2024-09-10T23:30:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.345+0000 7fc18dffb640 1 -- 172.21.15.2:0/421053559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198025430 con 0x560d0f2a70f0 2024-09-10T23:30:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 -- 172.21.15.2:0/421053559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 msgr2=0x560d0f2c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2c3d20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc198004370 tx=0x7fc198004490 comp rx=0 tx=0).stop 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 -- 172.21.15.2:0/421053559 shutdown_connections 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2b7db0 0x560d0f2b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2a7a10 0x560d0f2c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/421053559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a70f0 0x560d0f2c3d20 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 -- 172.21.15.2:0/421053559 >> 172.21.15.2:0/421053559 conn(0x560d0f2a4f20 msgr2=0x560d0f2b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 -- 172.21.15.2:0/421053559 shutdown_connections 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 -- 172.21.15.2:0/421053559 wait complete. 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.346+0000 7fc1b08d6740 1 -- start start 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 Processor -- start 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2bcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81ad5b0 con 0x560d0f2a7a10 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81acee0 con 0x560d0f2b7db0 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81aa120 con 0x560d0f2a70f0 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1b08d6740 10 client.0 _ll_register_callbacks cb 0x7fc198004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44568/0 (socket says 172.21.15.2:44568) 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 -- 172.21.15.2:0/2859447110 learned_addr learned my addr 172.21.15.2:0/2859447110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1aca9e640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2bcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 -- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 msgr2=0x560d0f2bfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2bfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 -- 172.21.15.2:0/2859447110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 msgr2=0x560d0f2bcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:04.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2bcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.347+0000 7fc1a77fe640 1 -- 172.21.15.2:0/2859447110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0f2c09b0 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1a77fe640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2c02c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0ac150 tx=0x7fc19c00fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2b04657baff8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1877fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1877fe640 1 -- 172.21.15.2:0/2859447110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0ac450 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1877fe640 1 -- 172.21.15.2:0/2859447110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc19c0a86c0 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc198015070 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1877fe640 1 -- 172.21.15.2:0/2859447110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc19c0b0f30 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 10 client.17400 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d0f334a30 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1877fe640 1 -- 172.21.15.2:0/2859447110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc198015070 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1877fe640 1 -- 172.21.15.2:0/2859447110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc19c093be0 con 0x560d0f2a7a10 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 10 client.17400 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 20 client.17400 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f335110 0x560d0f337530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 4 client.17400 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.348+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d0f21b8a0 con 0x560d0f335110 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f335110 0x560d0f337530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1a7fff640 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f335110 0x560d0f337530 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b4607541816c42 server_cookie=5135b81ef6c06fdc in_seq=0 out_seq=0 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1877fe640 10 client.17400 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1877fe640 1 -- 172.21.15.2:0/2859447110 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d0f21b8a0 con 0x560d0f335110 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1877fe640 10 client.17400 handle_command_reply: tid=0 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1b08d6740 1 client.17400 shutdown 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 msgr2=0x560d0f2c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.349+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2c02c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0ac150 tx=0x7fc19c00fe60 comp rx=0 tx=0).stop 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 shutdown_connections 2024-09-10T23:30:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0f335110 0x560d0f337530 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0f2b7db0 0x560d0f2bcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1877fe640 0 client.17400 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0f2a7a10 0x560d0f2c02c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 --2- 172.21.15.2:0/2859447110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0f2a70f0 0x560d0f2bfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 >> 172.21.15.2:0/2859447110 conn(0x560d0f2a4f20 msgr2=0x560d0f2b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 shutdown_connections 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 1 -- 172.21.15.2:0/2859447110 wait complete. 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1b08d6740 20 client.17400 trim_cache size 0 max 16384 2024-09-10T23:30:04.356 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc1900b52e0 msgr2=0x7fc1900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc1900b52e0 0x7fc1900b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0006010 tx=0x7fc1a00093f0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 msgr2=0x7fc1a8199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 0x7fc1a8199760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c920 tx=0x7fc19c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 shutdown_connections 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc1900b52e0 0x7fc1900b77a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a8108120 0x7fc1a819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a8107780 0x7fc1a8199760 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 --2- 172.21.15.2:0/4235408683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a8102920 0x7fc1a8199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.350+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 >> 172.21.15.2:0/4235408683 conn(0x7fc1a8076f50 msgr2=0x7fc1a8105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.351+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 shutdown_connections 2024-09-10T23:30:04.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:04.351+0000 7fc1ae501640 1 -- 172.21.15.2:0/4235408683 wait complete. 2024-09-10T23:30:06.173 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:30:06.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:30:06.203 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:05 smithi002 ceph-mon[31150]: pgmap v524: 97 pgs: 97 active+clean; 4.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:06.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:05 smithi177 ceph-mon[35760]: pgmap v524: 97 pgs: 97 active+clean; 4.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:05 smithi154 ceph-mon[35136]: pgmap v524: 97 pgs: 97 active+clean; 4.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:06.450 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 -- 172.21.15.2:0/4248418826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 msgr2=0x7f114c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 --2- 172.21.15.2:0/4248418826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c10caf0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f113c009900 tx=0x7f113c02a410 comp rx=0 tx=0).stop 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 -- 172.21.15.2:0/4248418826 shutdown_connections 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 --2- 172.21.15.2:0/4248418826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 0x7f114c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 --2- 172.21.15.2:0/4248418826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c10caf0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 --2- 172.21.15.2:0/4248418826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f114c103ce0 0x7f114c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 -- 172.21.15.2:0/4248418826 >> 172.21.15.2:0/4248418826 conn(0x7f114c0fd700 msgr2=0x7f114c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 -- 172.21.15.2:0/4248418826 shutdown_connections 2024-09-10T23:30:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.982+0000 7f1152ddf640 1 -- 172.21.15.2:0/4248418826 wait complete. 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 Processor -- start 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 -- start start 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f114c103ce0 0x7f114c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 0x7f114c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f114c112e70 con 0x7f114c104600 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f114c112cf0 con 0x7f114c103ce0 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1152ddf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f114c112ff0 con 0x7f114c10d140 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f114bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f114bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44588/0 (socket says 172.21.15.2:44588) 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f114bfff640 1 -- 172.21.15.2:0/3805149782 learned_addr learned my addr 172.21.15.2:0/3805149782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.983+0000 7f1150b7b640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f114c103ce0 0x7f114c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f115137c640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 0x7f114c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f114bfff640 1 -- 172.21.15.2:0/3805149782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 msgr2=0x7f114c19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f114bfff640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 0x7f114c19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f114bfff640 1 -- 172.21.15.2:0/3805149782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f114c103ce0 msgr2=0x7f114c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f114bfff640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f114c103ce0 0x7f114c199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f114bfff640 1 -- 172.21.15.2:0/3805149782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c19f4b0 con 0x7f114c104600 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f115137c640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 0x7f114c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f114bfff640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c199940 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f113c004270 tx=0x7f113c0042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f1149ffb640 1 -- 172.21.15.2:0/3805149782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c03f030 con 0x7f114c104600 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114c19f740 con 0x7f114c104600 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f1149ffb640 1 -- 172.21.15.2:0/3805149782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c0044c0 con 0x7f114c104600 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f1149ffb640 1 -- 172.21.15.2:0/3805149782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c035070 con 0x7f114c104600 2024-09-10T23:30:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.984+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114c1a5e60 con 0x7f114c104600 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f1149ffb640 1 -- 172.21.15.2:0/3805149782 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f113c03bbe0 con 0x7f114c104600 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 Processor -- start 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 -- start start 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd27ee0 0x55f07fd282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd34250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 0x55f07fd36b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f07fc9ee60 con 0x55f07fd34790 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f07fc8e290 con 0x55f07fd28800 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f11551b4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f07fc920a0 con 0x55f07fd27ee0 2024-09-10T23:30:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f114bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 0x55f07fd36b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f114bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 0x55f07fd36b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44594/0 (socket says 172.21.15.2:44594) 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f114bfff640 1 -- 172.21.15.2:0/551631756 learned_addr learned my addr 172.21.15.2:0/551631756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f115137c640 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd27ee0 0x55f07fd282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.987+0000 7f1150b7b640 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd34250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f1149ffb640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f114bfff640 1 -- 172.21.15.2:0/551631756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd27ee0 msgr2=0x55f07fd282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f114bfff640 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd27ee0 0x55f07fd282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f114bfff640 1 -- 172.21.15.2:0/551631756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 msgr2=0x55f07fd34250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f114bfff640 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd34250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f114bfff640 1 -- 172.21.15.2:0/551631756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f07f9ec930 con 0x55f07fd34790 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f115137c640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f1149ffb640 1 -- 172.21.15.2:0/3805149782 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f113c106480 con 0x7f114c104600 2024-09-10T23:30:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f114bfff640 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 0x55f07fd36b80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f113c0ea600 tx=0x7f113c0c8af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd7fe343387db15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f1142ffd640 1 -- 172.21.15.2:0/551631756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c049020 con 0x55f07fd34790 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f1142ffd640 1 -- 172.21.15.2:0/551631756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c0cc760 con 0x55f07fd34790 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.988+0000 7f1142ffd640 1 -- 172.21.15.2:0/551631756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c0cc5a0 con 0x55f07fd34790 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 -- 172.21.15.2:0/551631756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 msgr2=0x55f07fd36b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f115137c640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f114400f410 tx=0x7f1144004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 0x55f07fd36b80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f113c0ea600 tx=0x7f113c0c8af0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 -- 172.21.15.2:0/551631756 shutdown_connections 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd34790 0x55f07fd36b80 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd34250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 --2- 172.21.15.2:0/551631756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd27ee0 0x55f07fd282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 -- 172.21.15.2:0/551631756 >> 172.21.15.2:0/551631756 conn(0x55f07fd25d10 msgr2=0x55f07fd26eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 -- 172.21.15.2:0/551631756 shutdown_connections 2024-09-10T23:30:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 -- 172.21.15.2:0/551631756 wait complete. 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 -- start start 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.989+0000 7f11551b4740 1 Processor -- start 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd31780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd31cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd32200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f07faef890 con 0x55f07fd27ee0 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f07fc28d40 con 0x55f07fd28800 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd37200 con 0x55f07fd34790 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f11551b4740 10 client.0 _ll_register_callbacks cb 0x55f07fc8cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd31780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd31780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44600/0 (socket says 172.21.15.2:44600) 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 -- 172.21.15.2:0/459950860 learned_addr learned my addr 172.21.15.2:0/459950860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f114bfff640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd31cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f115137c640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd32200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 -- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 msgr2=0x55f07fd32200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd32200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 -- 172.21.15.2:0/459950860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 msgr2=0x55f07fd31cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd31cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 -- 172.21.15.2:0/459950860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f07fd40540 con 0x55f07fd27ee0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f115137c640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f1150b7b640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd31780 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f11340104d0 tx=0x7f1134010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ecae58c7a2ad64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.990+0000 7f112bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f112bfff640 1 -- 172.21.15.2:0/459950860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113401a020 con 0x55f07fd27ee0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f112bfff640 1 -- 172.21.15.2:0/459950860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1134016690 con 0x55f07fd27ee0 2024-09-10T23:30:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f113c0cc760 con 0x55f07fd27ee0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f112bfff640 1 -- 172.21.15.2:0/459950860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1134016890 con 0x55f07fd27ee0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 10 client.17412 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f07fd42f50 con 0x55f07fd27ee0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f112bfff640 1 -- 172.21.15.2:0/459950860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c0cc760 con 0x55f07fd27ee0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f112bfff640 1 -- 172.21.15.2:0/459950860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1134014b30 con 0x55f07fd27ee0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 10 client.17412 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 10 client.17412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 20 client.17412 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fd444b0 0x55f07fd468f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 4 client.17412 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.991+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f07fca0db0 con 0x55f07fd444b0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.992+0000 7f114bfff640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fd444b0 0x55f07fd468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.992+0000 7f114bfff640 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fd444b0 0x55f07fd468f0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=623874c24812b312 server_cookie=ab3312841f3fa2f4 in_seq=0 out_seq=0 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.992+0000 7f112bfff640 10 client.17412 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f112bfff640 1 -- 172.21.15.2:0/459950860 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f07fca0db0 con 0x55f07fd444b0 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f112bfff640 10 client.17412 handle_command_reply: tid=0 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 client.17412 shutdown 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 msgr2=0x55f07fd31780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd31780 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f11340104d0 tx=0x7f1134010990 comp rx=0 tx=0).stop 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 shutdown_connections 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fd444b0 0x55f07fd468f0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd31cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f112bfff640 0 client.17412 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 --2- 172.21.15.2:0/459950860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd31780 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 >> 172.21.15.2:0/459950860 conn(0x55f07fd25d10 msgr2=0x55f07fd24f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 shutdown_connections 2024-09-10T23:30:07.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 1 -- 172.21.15.2:0/459950860 wait complete. 2024-09-10T23:30:07.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:06.993+0000 7f11551b4740 20 client.17412 trim_cache size 0 max 16384 2024-09-10T23:30:07.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.011+0000 7f11551b4740 1 Processor -- start 2024-09-10T23:30:07.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 -- start start 2024-09-10T23:30:07.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd27ee0 0x55f07fd33420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 0x55f07fd3faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd2e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1ae4e0 con 0x55f07fd28800 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1b0020 con 0x55f07fd27ee0 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f11551b4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1aebb0 con 0x55f07fd34790 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 0x55f07fd3faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 0x55f07fd3faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44602/0 (socket says 172.21.15.2:44602) 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 -- 172.21.15.2:0/18419622 learned_addr learned my addr 172.21.15.2:0/18419622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f115137c640 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd2e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f1150b7b640 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd27ee0 0x55f07fd33420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 -- 172.21.15.2:0/18419622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 msgr2=0x55f07fd2e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd2e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 -- 172.21.15.2:0/18419622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd27ee0 msgr2=0x55f07fd33420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd27ee0 0x55f07fd33420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 -- 172.21.15.2:0/18419622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f07fd26790 con 0x55f07fd28800 2024-09-10T23:30:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.012+0000 7f114bfff640 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 0x55f07fd3faf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f113c0c9ec0 tx=0x7f113c031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6992f294369d8f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11427fc640 1 -- 172.21.15.2:0/18419622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c049040 con 0x55f07fd28800 2024-09-10T23:30:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11427fc640 1 -- 172.21.15.2:0/18419622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c0cc760 con 0x55f07fd28800 2024-09-10T23:30:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11427fc640 1 -- 172.21.15.2:0/18419622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c003e60 con 0x55f07fd28800 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 -- 172.21.15.2:0/18419622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 msgr2=0x55f07fd3faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 0x55f07fd3faf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f113c0c9ec0 tx=0x7f113c031a10 comp rx=0 tx=0).stop 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 -- 172.21.15.2:0/18419622 shutdown_connections 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd2e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd28800 0x55f07fd3faf0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 --2- 172.21.15.2:0/18419622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd27ee0 0x55f07fd33420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 -- 172.21.15.2:0/18419622 >> 172.21.15.2:0/18419622 conn(0x55f07fd25d10 msgr2=0x55f07fd3f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.013+0000 7f11551b4740 1 -- 172.21.15.2:0/18419622 shutdown_connections 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 -- 172.21.15.2:0/18419622 wait complete. 2024-09-10T23:30:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 -- start start 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 Processor -- start 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd3ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd39190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1af950 con 0x55f07fd27ee0 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1af280 con 0x55f07fd28800 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1ac4c0 con 0x55f07fd34790 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f11551b4740 10 client.0 _ll_register_callbacks cb 0x7f113400b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f1150b7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd3ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f1150b7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd3ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44618/0 (socket says 172.21.15.2:44618) 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.014+0000 7f1150b7b640 1 -- 172.21.15.2:0/1798616795 learned_addr learned my addr 172.21.15.2:0/1798616795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f114bfff640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd39190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f115137c640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f1150b7b640 1 -- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 msgr2=0x55f07fd397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f1150b7b640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f1150b7b640 1 -- 172.21.15.2:0/1798616795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 msgr2=0x55f07fd39190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f1150b7b640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd39190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f1150b7b640 1 -- 172.21.15.2:0/1798616795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f07fdb57e0 con 0x55f07fd27ee0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f1150b7b640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd3ccb0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1134017ca0 tx=0x7f1134017cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f174d6cc95b79a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f112bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f112bfff640 1 -- 172.21.15.2:0/1798616795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113401a040 con 0x55f07fd27ee0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f112bfff640 1 -- 172.21.15.2:0/1798616795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1134016690 con 0x55f07fd27ee0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f113c0cc760 con 0x55f07fd27ee0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f112bfff640 1 -- 172.21.15.2:0/1798616795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1134010e90 con 0x55f07fd27ee0 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f11551b4740 10 client.17418 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:07.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.015+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f07fdb6960 con 0x55f07fd27ee0 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f112bfff640 1 -- 172.21.15.2:0/1798616795 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c0cc760 con 0x55f07fd27ee0 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f112bfff640 1 -- 172.21.15.2:0/1798616795 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f11340148e0 con 0x55f07fd27ee0 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f11551b4740 10 client.17418 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f11551b4740 10 client.17418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f11551b4740 20 client.17418 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f11551b4740 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fdb7160 0x55f07fdb9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f11551b4740 4 client.17418 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f07fc9c860 con 0x55f07fdb7160 2024-09-10T23:30:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.016+0000 7f114bfff640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fdb7160 0x55f07fdb9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.017+0000 7f114bfff640 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fdb7160 0x55f07fdb9580 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e7f423fefeb844 server_cookie=6f520d5f2a9134e4 in_seq=0 out_seq=0 2024-09-10T23:30:07.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.017+0000 7f112bfff640 10 client.17418 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f112bfff640 1 -- 172.21.15.2:0/1798616795 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f07fc9c860 con 0x55f07fdb7160 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f112bfff640 10 client.17418 handle_command_reply: tid=0 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 client.17418 shutdown 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 msgr2=0x55f07fd3ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd3ccb0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1134017ca0 tx=0x7f1134017cd0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 shutdown_connections 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55f07fdb7160 0x55f07fdb9580 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f07fd34790 0x55f07fd397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f07fd28800 0x55f07fd39190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f112bfff640 0 client.17418 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 --2- 172.21.15.2:0/1798616795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f07fd27ee0 0x55f07fd3ccb0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.018+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 >> 172.21.15.2:0/1798616795 conn(0x55f07fd25d10 msgr2=0x55f07fd2fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 shutdown_connections 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f11551b4740 1 -- 172.21.15.2:0/1798616795 wait complete. 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f11551b4740 20 client.17418 trim_cache size 0 max 16384 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b", 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:30:07.024 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 msgr2=0x7f11380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f114400f410 tx=0x7f1144004b50 comp rx=0 tx=0).stop 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 msgr2=0x7f114c199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c199940 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f113c004270 tx=0x7f113c0042a0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 shutdown_connections 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f11380b52e0 0x7f11380b77a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c10d140 0x7f114c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114c104600 0x7f114c199940 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 --2- 172.21.15.2:0/3805149782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f114c103ce0 0x7f114c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 >> 172.21.15.2:0/3805149782 conn(0x7f114c0fd700 msgr2=0x7f114c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 shutdown_connections 2024-09-10T23:30:07.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:07.019+0000 7f1152ddf640 1 -- 172.21.15.2:0/3805149782 wait complete. 2024-09-10T23:30:07.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:30:08.127 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:07 smithi177 ceph-mon[35760]: pgmap v525: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:30:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:07 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:30:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:07 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:30:08.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:07 smithi002 ceph-mon[31150]: pgmap v525: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:30:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:07 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:30:08.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:07 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:30:08.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:07 smithi154 ceph-mon[35136]: pgmap v525: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:30:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:07 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:30:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:07 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:30:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.623+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/4128433996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d54102dc0 msgr2=0x7f7d541031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.623+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/4128433996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d54102dc0 0x7f7d541031a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009900 tx=0x7f7d5002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/4128433996 shutdown_connections 2024-09-10T23:30:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/4128433996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d54109150 0x7f7d5410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/4128433996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d541087d0 0x7f7d54108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/4128433996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d54102dc0 0x7f7d541031a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/4128433996 >> 172.21.15.2:0/4128433996 conn(0x7f7d540fe830 msgr2=0x7f7d54100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/4128433996 shutdown_connections 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/4128433996 wait complete. 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 Processor -- start 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- start start 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d54102dc0 0x7f7d540754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 0x7f7d540759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d54109150 0x7f7d54075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54112e10 con 0x7f7d541087d0 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54112c90 con 0x7f7d54109150 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.624+0000 7f7d5c2fa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54112f90 con 0x7f7d54102dc0 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 0x7f7d540759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 0x7f7d540759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44634/0 (socket says 172.21.15.2:44634) 2024-09-10T23:30:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 -- 172.21.15.2:0/3572695410 learned_addr learned my addr 172.21.15.2:0/3572695410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d54109150 0x7f7d54075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d54102dc0 0x7f7d540754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 -- 172.21.15.2:0/3572695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d54102dc0 msgr2=0x7f7d540754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d54102dc0 0x7f7d540754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 -- 172.21.15.2:0/3572695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d54109150 msgr2=0x7f7d54075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d54109150 0x7f7d54075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 -- 172.21.15.2:0/3572695410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d541a7700 con 0x7f7d541087d0 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d59895640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 0x7f7d540759e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c970 tx=0x7f7d4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d4b7fe640 1 -- 172.21.15.2:0/3572695410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44007bb0 con 0x7f7d541087d0 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d4b7fe640 1 -- 172.21.15.2:0/3572695410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d44007d50 con 0x7f7d541087d0 2024-09-10T23:30:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d4b7fe640 1 -- 172.21.15.2:0/3572695410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400f450 con 0x7f7d541087d0 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d541a79f0 con 0x7f7d541087d0 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.625+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d541a7fb0 con 0x7f7d541087d0 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.628+0000 7f7d4b7fe640 1 -- 172.21.15.2:0/3572695410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7d44004f20 con 0x7f7d541087d0 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 Processor -- start 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 -- start start 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a18e4c1e50 con 0x55a18e54b480 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a18e4b1280 con 0x55a18e557d30 2024-09-10T23:30:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a18e4b5090 con 0x55a18e54bda0 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5a897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5a897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44646/0 (socket says 172.21.15.2:44646) 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5a897640 1 -- 172.21.15.2:0/1863167541 learned_addr learned my addr 172.21.15.2:0/1863167541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.629+0000 7f7d5a096640 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d59895640 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d4b7fe640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d400b5360 0x7f7d400b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 -- 172.21.15.2:0/1863167541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e5577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 -- 172.21.15.2:0/1863167541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e55a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 -- 172.21.15.2:0/1863167541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a18e20f650 con 0x55a18e54b480 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d59895640 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d4b7fe640 1 -- 172.21.15.2:0/3572695410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7d440e5940 con 0x7f7d541087d0 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e54b860 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009ef0 tx=0x7f7d4c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3308c4313ceec275 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d400b5360 0x7f7d400b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d48de6640 1 -- 172.21.15.2:0/1863167541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c01a070 con 0x55a18e54b480 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d48de6640 1 -- 172.21.15.2:0/1863167541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d4c007b30 con 0x55a18e54b480 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.630+0000 7f7d48de6640 1 -- 172.21.15.2:0/1863167541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c015e20 con 0x55a18e54b480 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1863167541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e54b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d400b5360 0x7f7d400b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c017000 tx=0x7f7d4c00a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e54b860 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009ef0 tx=0x7f7d4c00c7f0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1863167541 shutdown_connections 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1863167541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1863167541 >> 172.21.15.2:0/1863167541 conn(0x55a18e5492b0 msgr2=0x55a18e54a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1863167541 shutdown_connections 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1863167541 wait complete. 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 -- start start 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.631+0000 7f7d5e6cf740 1 Processor -- start 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54b480 0x55a18e557600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54bda0 0x55a18e554a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e555030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a18e312700 con 0x55a18e557d30 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a18e44c110 con 0x55a18e54bda0 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a18e55a9b0 con 0x55a18e54b480 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5e6cf740 10 client.0 _ll_register_callbacks cb 0x55a18e465990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e555030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e555030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44660/0 (socket says 172.21.15.2:44660) 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 -- 172.21.15.2:0/3311759669 learned_addr learned my addr 172.21.15.2:0/3311759669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54b480 0x55a18e557600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d59895640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54bda0 0x55a18e554a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 -- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e557600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54b480 0x55a18e557600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 -- 172.21.15.2:0/3311759669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e554a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54bda0 0x55a18e554a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 -- 172.21.15.2:0/3311759669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a18e479c40 con 0x55a18e557d30 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e555030 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c015920 tx=0x7f7d4c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6a2611682d57ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.632+0000 7f7d3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d3dffb640 1 -- 172.21.15.2:0/3311759669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c031060 con 0x55a18e557d30 2024-09-10T23:30:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d3dffb640 1 -- 172.21.15.2:0/3311759669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7d4c02c440 con 0x55a18e557d30 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d4c007b30 con 0x55a18e557d30 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d3dffb640 1 -- 172.21.15.2:0/3311759669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d4c01a040 con 0x55a18e557d30 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 10 client.17430 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a18e566230 con 0x55a18e557d30 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d3dffb640 1 -- 172.21.15.2:0/3311759669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d4c007b30 con 0x55a18e557d30 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d3dffb640 1 -- 172.21.15.2:0/3311759669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d4c029070 con 0x55a18e557d30 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 10 client.17430 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 10 client.17430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 20 client.17430 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e569a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 4 client.17430 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.633+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a18e4c3da0 con 0x55a18e567690 2024-09-10T23:30:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.634+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e569a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.634+0000 7f7d3dffb640 10 client.17430 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.634+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e569a80 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74ff56c87b6d3cc server_cookie=a033d21bd3817ff7 in_seq=0 out_seq=0 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d3dffb640 1 -- 172.21.15.2:0/3311759669 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a18e4c3da0 con 0x55a18e567690 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d3dffb640 10 client.17430 handle_command_reply: tid=0 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 client.17430 shutdown 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e555030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e555030 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c015920 tx=0x7f7d4c015000 comp rx=0 tx=0).stop 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 shutdown_connections 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e569a80 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e555030 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d3dffb640 0 client.17430 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54bda0 0x55a18e554a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3311759669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54b480 0x55a18e557600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 >> 172.21.15.2:0/3311759669 conn(0x55a18e5492b0 msgr2=0x55a18e54ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 shutdown_connections 2024-09-10T23:30:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3311759669 wait complete. 2024-09-10T23:30:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.635+0000 7f7d5e6cf740 20 client.17430 trim_cache size 0 max 16384 2024-09-10T23:30:08.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 Processor -- start 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 -- start start 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e563be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e559120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e559660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541b05e0 con 0x55a18e54b480 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541b2120 con 0x55a18e557d30 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.653+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541b0cb0 con 0x55a18e54bda0 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e563be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e563be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44662/0 (socket says 172.21.15.2:44662) 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 -- 172.21.15.2:0/3661116684 learned_addr learned my addr 172.21.15.2:0/3661116684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:08.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d59895640 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e559120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e559660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 -- 172.21.15.2:0/3661116684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e559120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e559120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 -- 172.21.15.2:0/3661116684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e559660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e559660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 -- 172.21.15.2:0/3661116684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a18e54ade0 con 0x55a18e54b480 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a897640 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e559660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d5a096640 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e563be0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005ab0 tx=0x7f7d5002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c791c0f749a092 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d3ffff640 1 -- 172.21.15.2:0/3661116684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50049030 con 0x55a18e54b480 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d3ffff640 1 -- 172.21.15.2:0/3661116684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d500318c0 con 0x55a18e54b480 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.654+0000 7f7d3ffff640 1 -- 172.21.15.2:0/3661116684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50035040 con 0x55a18e54b480 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3661116684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e563be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e563be0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005ab0 tx=0x7f7d5002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3661116684 shutdown_connections 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e557d30 0x55a18e559660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e559120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/3661116684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e54b480 0x55a18e563be0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3661116684 >> 172.21.15.2:0/3661116684 conn(0x55a18e5492b0 msgr2=0x55a18e54fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3661116684 shutdown_connections 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/3661116684 wait complete. 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 -- start start 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.655+0000 7f7d5e6cf740 1 Processor -- start 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54b480 0x55a18e55fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e560190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e55ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541b1a50 con 0x55a18e557d30 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541b1380 con 0x55a18e54b480 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541ae5c0 con 0x55a18e54bda0 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5e6cf740 10 client.0 _ll_register_callbacks cb 0x7f7d4c018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5a897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e55ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d59895640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e560190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5a897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e55ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44666/0 (socket says 172.21.15.2:44666) 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5a897640 1 -- 172.21.15.2:0/1208150839 learned_addr learned my addr 172.21.15.2:0/1208150839 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5a096640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54b480 0x55a18e55fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d59895640 1 -- 172.21.15.2:0/1208150839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e55fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d59895640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54b480 0x55a18e55fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d59895640 1 -- 172.21.15.2:0/1208150839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e55ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d59895640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e55ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d59895640 1 -- 172.21.15.2:0/1208150839 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a18e560900 con 0x55a18e54bda0 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5a897640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e55ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.656+0000 7f7d5a096640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54b480 0x55a18e55fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d59895640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e560190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d440e34a0 tx=0x7f7d440048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ce904fc38e91635 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d3dffb640 1 -- 172.21.15.2:0/1208150839 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4401d040 con 0x55a18e54bda0 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d500318c0 con 0x55a18e54bda0 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d3dffb640 1 -- 172.21.15.2:0/1208150839 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7d44005240 con 0x55a18e54bda0 2024-09-10T23:30:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d3dffb640 1 -- 172.21.15.2:0/1208150839 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d440055f0 con 0x55a18e54bda0 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d5e6cf740 10 client.26695 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a18e5d48c0 con 0x55a18e54bda0 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d3dffb640 1 -- 172.21.15.2:0/1208150839 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d500318c0 con 0x55a18e54bda0 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.657+0000 7f7d3dffb640 1 -- 172.21.15.2:0/1208150839 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d440cdaf0 con 0x55a18e54bda0 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 10 client.26695 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 10 client.26695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 20 client.26695 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e5d6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 4 client.26695 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a18e4bf850 con 0x55a18e567690 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5a096640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e5d6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5a096640 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e5d6fa0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1df77fec50caf0 server_cookie=1aab86b6fb84f2e8 in_seq=0 out_seq=0 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d3dffb640 10 client.26695 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:08.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d3dffb640 1 -- 172.21.15.2:0/1208150839 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55a18e4bf850 con 0x55a18e567690 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d3dffb640 10 client.26695 handle_command_reply: tid=0 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.658+0000 7f7d5e6cf740 1 client.26695 shutdown 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e560190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e560190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d440e34a0 tx=0x7f7d440048f0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 shutdown_connections 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a18e567690 0x55a18e5d6fa0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a18e557d30 0x55a18e55ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a18e54bda0 0x55a18e560190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 --2- 172.21.15.2:0/1208150839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a18e54b480 0x55a18e55fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d3dffb640 0 client.26695 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 >> 172.21.15.2:0/1208150839 conn(0x55a18e5492b0 msgr2=0x55a18e547bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 shutdown_connections 2024-09-10T23:30:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 1 -- 172.21.15.2:0/1208150839 wait complete. 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5e6cf740 20 client.26695 trim_cache size 0 max 16384 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:30:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:30:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:08.679 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:30:08.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d400b5360 msgr2=0x7f7d400b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d400b5360 0x7f7d400b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c017000 tx=0x7f7d4c00a8e0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 msgr2=0x7f7d540759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 0x7f7d540759e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c970 tx=0x7f7d4400ce30 comp rx=0 tx=0).stop 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 shutdown_connections 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7d400b5360 0x7f7d400b7820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d54109150 0x7f7d54075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.659+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d541087d0 0x7f7d540759e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.660+0000 7f7d5c2fa640 1 --2- 172.21.15.2:0/3572695410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d54102dc0 0x7f7d540754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.660+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 >> 172.21.15.2:0/3572695410 conn(0x7f7d540fe830 msgr2=0x7f7d54100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.660+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 shutdown_connections 2024-09-10T23:30:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:08.660+0000 7f7d5c2fa640 1 -- 172.21.15.2:0/3572695410 wait complete. 2024-09-10T23:30:09.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:08 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:30:09.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:08 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:30:09.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:08 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:30:09.527 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:30:09.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:30:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:09 smithi177 ceph-mon[35760]: pgmap v526: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:30:10.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:09 smithi002 ceph-mon[31150]: pgmap v526: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:30:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:09 smithi154 ceph-mon[35136]: pgmap v526: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 -- 172.21.15.2:0/2860688574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c103b00 msgr2=0x7efe0c103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 --2- 172.21.15.2:0/2860688574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c103b00 0x7efe0c103ee0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7efdfc009900 tx=0x7efdfc02a410 comp rx=0 tx=0).stop 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 -- 172.21.15.2:0/2860688574 shutdown_connections 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 --2- 172.21.15.2:0/2860688574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe0c10cf60 0x7efe0c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 --2- 172.21.15.2:0/2860688574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c104420 0x7efe0c10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 --2- 172.21.15.2:0/2860688574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c103b00 0x7efe0c103ee0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.323+0000 7efe1179d640 1 -- 172.21.15.2:0/2860688574 >> 172.21.15.2:0/2860688574 conn(0x7efe0c0fd560 msgr2=0x7efe0c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.324+0000 7efe1179d640 1 -- 172.21.15.2:0/2860688574 shutdown_connections 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.324+0000 7efe1179d640 1 -- 172.21.15.2:0/2860688574 wait complete. 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.324+0000 7efe1179d640 1 Processor -- start 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.324+0000 7efe1179d640 1 -- start start 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.324+0000 7efe1179d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c103b00 0x7efe0c198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe0c104420 0x7efe0c1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 0x7efe0c19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c112bd0 con 0x7efe0c10cf60 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c112a50 con 0x7efe0c104420 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c112d50 con 0x7efe0c103b00 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 0x7efe0c19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 0x7efe0c19e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44680/0 (socket says 172.21.15.2:44680) 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 -- 172.21.15.2:0/693294309 learned_addr learned my addr 172.21.15.2:0/693294309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe0b7fe640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe0c104420 0x7efe0c1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe0bfff640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c103b00 0x7efe0c198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 -- 172.21.15.2:0/693294309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c103b00 msgr2=0x7efe0c198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c103b00 0x7efe0c198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 -- 172.21.15.2:0/693294309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe0c104420 msgr2=0x7efe0c1994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe0c104420 0x7efe0c1994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 -- 172.21.15.2:0/693294309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c19f010 con 0x7efe0c10cf60 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe0bfff640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c103b00 0x7efe0c198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe10f9c640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 0x7efe0c19e840 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efe0400eaa0 tx=0x7efe0400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400cdb0 con 0x7efe0c10cf60 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe04005020 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c19f300 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040116d0 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.325+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c1a59c0 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.326+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0c103ee0 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.328+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7efe0400f040 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.329+0000 7efe097fa640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efdf80b5390 0x7efdf80b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.329+0000 7efe0bfff640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efdf80b5390 0x7efdf80b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.329+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efe040e5e40 con 0x7efe0c10cf60 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.329+0000 7efe0bfff640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efdf80b5390 0x7efdf80b7850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efdfc031440 tx=0x7efdfc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:10.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.332+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe04016030 con 0x7efe0c10cf60 2024-09-10T23:30:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.554+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe0c19a090 con 0x7efe0c10cf60 2024-09-10T23:30:10.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.555+0000 7efe097fa640 1 -- 172.21.15.2:0/693294309 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7efe0c19a090 con 0x7efe0c10cf60 2024-09-10T23:30:10.556 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:30:10.557 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:30:10.557 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:30:10.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efdf80b5390 msgr2=0x7efdf80b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efdf80b5390 0x7efdf80b7850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efdfc031440 tx=0x7efdfc005a20 comp rx=0 tx=0).stop 2024-09-10T23:30:10.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 msgr2=0x7efe0c19e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 0x7efe0c19e840 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efe0400eaa0 tx=0x7efe0400ef60 comp rx=0 tx=0).stop 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 shutdown_connections 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efdf80b5390 0x7efdf80b7850 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe0c10cf60 0x7efe0c19e840 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe0c104420 0x7efe0c1994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 --2- 172.21.15.2:0/693294309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe0c103b00 0x7efe0c198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.557+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 >> 172.21.15.2:0/693294309 conn(0x7efe0c0fd560 msgr2=0x7efe0c104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.558+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 shutdown_connections 2024-09-10T23:30:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:10.558+0000 7efe1179d640 1 -- 172.21.15.2:0/693294309 wait complete. 2024-09-10T23:30:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/693294309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:30:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/693294309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:30:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/693294309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:30:11.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:30:11.620 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:12.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:11 smithi002 ceph-mon[31150]: pgmap v527: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:30:12.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 -- 172.21.15.2:0/1950864020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01021d0 msgr2=0x7f5ca010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/1950864020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01021d0 0x7f5ca010ef20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009900 tx=0x7f5c8802a480 comp rx=0 tx=0).stop 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 -- 172.21.15.2:0/1950864020 shutdown_connections 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/1950864020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca010f460 0x7f5ca0111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/1950864020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01021d0 0x7f5ca010ef20 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/1950864020 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca01018b0 0x7f5ca0101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.093+0000 7f5ca6d86640 1 -- 172.21.15.2:0/1950864020 >> 172.21.15.2:0/1950864020 conn(0x7f5ca00fd700 msgr2=0x7f5ca00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 -- 172.21.15.2:0/1950864020 shutdown_connections 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 -- 172.21.15.2:0/1950864020 wait complete. 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 Processor -- start 2024-09-10T23:30:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 -- start start 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 0x7f5ca019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca01021d0 0x7f5ca019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca010f460 0x7f5ca01a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0115000 con 0x7f5ca01018b0 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0114e80 con 0x7f5ca01021d0 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca6d86640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0115180 con 0x7f5ca010f460 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.094+0000 7f5ca4b22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 0x7f5ca019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 0x7f5ca019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60034/0 (socket says 172.21.15.2:60034) 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 -- 172.21.15.2:0/218099501 learned_addr learned my addr 172.21.15.2:0/218099501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca01021d0 0x7f5ca019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca5323640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca010f460 0x7f5ca01a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 -- 172.21.15.2:0/218099501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca010f460 msgr2=0x7f5ca01a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca010f460 0x7f5ca01a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 -- 172.21.15.2:0/218099501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca01021d0 msgr2=0x7f5ca019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca01021d0 0x7f5ca019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 -- 172.21.15.2:0/218099501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01a1560 con 0x7f5ca01018b0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca4b22640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 0x7f5ca019b4b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000b4a0 tx=0x7f5c9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5c9dffb640 1 -- 172.21.15.2:0/218099501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90014070 con 0x7f5ca01018b0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5c9dffb640 1 -- 172.21.15.2:0/218099501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c90010ac0 con 0x7f5ca01018b0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5c9dffb640 1 -- 172.21.15.2:0/218099501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90017c30 con 0x7f5ca01018b0 2024-09-10T23:30:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca01a1850 con 0x7f5ca01018b0 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.095+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a80e0 con 0x7f5ca01018b0 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.098+0000 7f5c9dffb640 1 -- 172.21.15.2:0/218099501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5c90010610 con 0x7f5ca01018b0 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.098+0000 7f5ca915b740 1 Processor -- start 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.098+0000 7f5ca915b740 1 -- start start 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 0x5605b03068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0306df0 0x5605b0312840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0315170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca915b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605b027cea0 con 0x5605b03064d0 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca915b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605b026c2d0 con 0x5605b0312d80 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca915b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5605b02700e0 con 0x5605b0306df0 2024-09-10T23:30:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 0x5605b03068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 0x5605b03068b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60044/0 (socket says 172.21.15.2:60044) 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 -- 172.21.15.2:0/299821131 learned_addr learned my addr 172.21.15.2:0/299821131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca4b22640 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0306df0 0x5605b0312840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0315170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 -- 172.21.15.2:0/299821131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0306df0 msgr2=0x5605b0312840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0306df0 0x5605b0312840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 -- 172.21.15.2:0/299821131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 msgr2=0x5605b0315170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0315170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 -- 172.21.15.2:0/299821131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605affca650 con 0x5605b03064d0 2024-09-10T23:30:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5c9dffb640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5c8c0b5360 0x7f5c8c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca5323640 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 0x5605b03068b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5c98007e50 tx=0x7f5c9800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffe994f480fd834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.099+0000 7f5ca4b22640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5c8c0b5360 0x7f5c8c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5c9dffb640 1 -- 172.21.15.2:0/218099501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5c900e54a0 con 0x7f5ca01018b0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5c96ffd640 1 -- 172.21.15.2:0/299821131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98014070 con 0x5605b03064d0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5c96ffd640 1 -- 172.21.15.2:0/299821131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c9800ee90 con 0x5605b03064d0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5c96ffd640 1 -- 172.21.15.2:0/299821131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980053a0 con 0x5605b03064d0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5ca915b740 1 -- 172.21.15.2:0/299821131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 msgr2=0x5605b03068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5ca4b22640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5c8c0b5360 0x7f5c8c0b7820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c900e3320 tx=0x7f5c90010f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5ca915b740 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 0x5605b03068b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5c98007e50 tx=0x7f5c9800e720 comp rx=0 tx=0).stop 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.100+0000 7f5ca915b740 1 -- 172.21.15.2:0/299821131 shutdown_connections 2024-09-10T23:30:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0315170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0306df0 0x5605b0312840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 --2- 172.21.15.2:0/299821131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b03064d0 0x5605b03068b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- 172.21.15.2:0/299821131 >> 172.21.15.2:0/299821131 conn(0x5605b0304300 msgr2=0x5605b03054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- 172.21.15.2:0/299821131 shutdown_connections 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- 172.21.15.2:0/299821131 wait complete. 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- start start 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 Processor -- start 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b03064d0 0x5605b0312670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b030fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0312d80 0x5605b03100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605b00cd700 con 0x5605b0306df0 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605b0207160 con 0x5605b03064d0 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5605b0315a00 con 0x5605b0312d80 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.101+0000 7f5ca915b740 10 client.0 _ll_register_callbacks cb 0x5605b02209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b030fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b030fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60054/0 (socket says 172.21.15.2:60054) 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 -- 172.21.15.2:0/3675761347 learned_addr learned my addr 172.21.15.2:0/3675761347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5ca5323640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b03064d0 0x5605b0312670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5ca5323640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0312d80 0x5605b03100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 -- 172.21.15.2:0/3675761347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0312d80 msgr2=0x5605b03100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0312d80 0x5605b03100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 -- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b03064d0 msgr2=0x5605b0312670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b03064d0 0x5605b0312670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 -- 172.21.15.2:0/3675761347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b0234c90 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b030fac0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5c88005ab0 tx=0x7f5c88003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe3e5864e56a83d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c7ffff640 1 -- 172.21.15.2:0/3675761347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88035040 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c9800ee90 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c7ffff640 1 -- 172.21.15.2:0/3675761347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5c88003c80 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5c7ffff640 1 -- 172.21.15.2:0/3675761347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5c88005020 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5ca915b740 10 client.17454 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.102+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5605b0321360 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5c7ffff640 1 -- 172.21.15.2:0/3675761347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c9800ee90 con 0x5605b0306df0 2024-09-10T23:30:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5c7ffff640 1 -- 172.21.15.2:0/3675761347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5c880314a0 con 0x5605b0306df0 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca915b740 10 client.17454 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca915b740 10 client.17454 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca915b740 20 client.17454 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca915b740 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0322820 0x5605b0324c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca915b740 4 client.17454 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605b027edf0 con 0x5605b0322820 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.103+0000 7f5ca5323640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0322820 0x5605b0324c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5ca5323640 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0322820 0x5605b0324c10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=16d23fd5af714eec server_cookie=76b6a027c4c08594 in_seq=0 out_seq=0 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5c7ffff640 10 client.17454 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5c7ffff640 1 -- 172.21.15.2:0/3675761347 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605b027edf0 con 0x5605b0322820 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5c7ffff640 10 client.17454 handle_command_reply: tid=0 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5ca915b740 1 client.17454 shutdown 2024-09-10T23:30:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 msgr2=0x5605b030fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.104+0000 7f5ca915b740 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b030fac0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5c88005ab0 tx=0x7f5c88003890 comp rx=0 tx=0).stop 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 shutdown_connections 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0322820 0x5605b0324c10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b0312d80 0x5605b03100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b030fac0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5c7ffff640 0 client.17454 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 --2- 172.21.15.2:0/3675761347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b03064d0 0x5605b0312670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 >> 172.21.15.2:0/3675761347 conn(0x5605b0304300 msgr2=0x5605b0309e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 shutdown_connections 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 1 -- 172.21.15.2:0/3675761347 wait complete. 2024-09-10T23:30:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.105+0000 7f5ca915b740 20 client.17454 trim_cache size 0 max 16384 2024-09-10T23:30:12.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 Processor -- start 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 -- start start 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b03053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0305900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0314170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01b05b0 con 0x5605b0306df0 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01b20f0 con 0x5605b0312d80 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5ca915b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01b0c80 con 0x5605b03064d0 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0305900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.118+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0305900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60062/0 (socket says 172.21.15.2:60062) 2024-09-10T23:30:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 -- 172.21.15.2:0/242544763 learned_addr learned my addr 172.21.15.2:0/242544763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5ca5323640 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b03053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 -- 172.21.15.2:0/242544763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 msgr2=0x5605b03053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b03053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 -- 172.21.15.2:0/242544763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 msgr2=0x5605b0314170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0314170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 -- 172.21.15.2:0/242544763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b02ff990 con 0x5605b0306df0 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5ca5323640 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b03053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0305900 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5c880318f0 tx=0x7f5c8802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba61e67c794121dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c967fc640 1 -- 172.21.15.2:0/242544763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88035030 con 0x5605b0306df0 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c967fc640 1 -- 172.21.15.2:0/242544763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c88031ce0 con 0x5605b0306df0 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.119+0000 7f5c967fc640 1 -- 172.21.15.2:0/242544763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88004a00 con 0x5605b0306df0 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 -- 172.21.15.2:0/242544763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 msgr2=0x5605b0305900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0305900 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5c880318f0 tx=0x7f5c8802a480 comp rx=0 tx=0).stop 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 -- 172.21.15.2:0/242544763 shutdown_connections 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b0314170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0305900 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 --2- 172.21.15.2:0/242544763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b03053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 -- 172.21.15.2:0/242544763 >> 172.21.15.2:0/242544763 conn(0x5605b0304300 msgr2=0x5605b030acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 -- 172.21.15.2:0/242544763 shutdown_connections 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 -- 172.21.15.2:0/242544763 wait complete. 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 -- start start 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.120+0000 7f5ca915b740 1 Processor -- start 2024-09-10T23:30:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b031b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0315c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b03161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01b1a20 con 0x5605b0306df0 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01b1350 con 0x5605b0312d80 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01ae590 con 0x5605b03064d0 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca915b740 10 client.0 _ll_register_callbacks cb 0x7f5c88004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0315c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0315c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60064/0 (socket says 172.21.15.2:60064) 2024-09-10T23:30:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 -- 172.21.15.2:0/557703747 learned_addr learned my addr 172.21.15.2:0/557703747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca5323640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b031b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca5323640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b03161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 -- 172.21.15.2:0/557703747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 msgr2=0x5605b031b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b031b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 -- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 msgr2=0x5605b03161c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b03161c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 -- 172.21.15.2:0/557703747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b0316930 con 0x5605b0306df0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5ca5323640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b031b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c9ffff640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0315c80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5c88004650 tx=0x7f5c88005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b7008c0a309721 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c7ffff640 1 -- 172.21.15.2:0/557703747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88035040 con 0x5605b0306df0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.121+0000 7f5c7ffff640 1 -- 172.21.15.2:0/557703747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5c88031ae0 con 0x5605b0306df0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c88031ce0 con 0x5605b0306df0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5c7ffff640 1 -- 172.21.15.2:0/557703747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5c880049b0 con 0x5605b0306df0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 10 client.17460 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5605b03905f0 con 0x5605b0306df0 2024-09-10T23:30:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5c7ffff640 1 -- 172.21.15.2:0/557703747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c88031ce0 con 0x5605b0306df0 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5c7ffff640 1 -- 172.21.15.2:0/557703747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5c88056070 con 0x5605b0306df0 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 10 client.17460 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 10 client.17460 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 20 client.17460 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0390c70 0x5605b0393090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 4 client.17460 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.122+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605b027a8a0 con 0x5605b0390c70 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca5323640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0390c70 0x5605b0393090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca5323640 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0390c70 0x5605b0393090 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=feb02a1444787ecf server_cookie=869d58426da7e059 in_seq=0 out_seq=0 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5c7ffff640 10 client.17460 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5c7ffff640 1 -- 172.21.15.2:0/557703747 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605b027a8a0 con 0x5605b0390c70 2024-09-10T23:30:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5c7ffff640 10 client.17460 handle_command_reply: tid=0 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 client.17460 shutdown 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 msgr2=0x5605b0315c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0315c80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5c88004650 tx=0x7f5c88005470 comp rx=0 tx=0).stop 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 shutdown_connections 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5605b0390c70 0x5605b0393090 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605b0312d80 0x5605b03161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605b0306df0 0x5605b0315c80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5c7ffff640 0 client.17460 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 --2- 172.21.15.2:0/557703747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5605b03064d0 0x5605b031b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.123+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 >> 172.21.15.2:0/557703747 conn(0x5605b0304300 msgr2=0x5605b030df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 shutdown_connections 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca915b740 1 -- 172.21.15.2:0/557703747 wait complete. 2024-09-10T23:30:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca915b740 20 client.17460 trim_cache size 0 max 16384 2024-09-10T23:30:12.137 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5c8c0b5360 msgr2=0x7f5c8c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5c8c0b5360 0x7f5c8c0b7820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c900e3320 tx=0x7f5c90010f90 comp rx=0 tx=0).stop 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 msgr2=0x7f5ca019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 0x7f5ca019b4b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000b4a0 tx=0x7f5c9000b960 comp rx=0 tx=0).stop 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 shutdown_connections 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5c8c0b5360 0x7f5c8c0b7820 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca010f460 0x7f5ca01a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca01021d0 0x7f5ca019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 --2- 172.21.15.2:0/218099501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca01018b0 0x7f5ca019b4b0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 >> 172.21.15.2:0/218099501 conn(0x7f5ca00fd700 msgr2=0x7f5ca0111700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 shutdown_connections 2024-09-10T23:30:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:12.124+0000 7f5ca6d86640 1 -- 172.21.15.2:0/218099501 wait complete. 2024-09-10T23:30:12.180 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:11 smithi154 ceph-mon[35136]: pgmap v527: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:30:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:11 smithi177 ceph-mon[35760]: pgmap v527: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:30:12.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:30:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 -- 172.21.15.2:0/1367320943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8104590 msgr2=0x7f94e810cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/1367320943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8104590 0x7f94e810cb70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:30:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 -- 172.21.15.2:0/1367320943 shutdown_connections 2024-09-10T23:30:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/1367320943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e810d140 0x7f94e810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/1367320943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e8104590 0x7f94e810cb70 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/1367320943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8103b90 0x7f94e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 -- 172.21.15.2:0/1367320943 >> 172.21.15.2:0/1367320943 conn(0x7f94e80fd700 msgr2=0x7f94e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.705+0000 7f94ed0f7640 1 -- 172.21.15.2:0/1367320943 shutdown_connections 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.706+0000 7f94ed0f7640 1 -- 172.21.15.2:0/1367320943 wait complete. 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.706+0000 7f94ed0f7640 1 Processor -- start 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.706+0000 7f94ed0f7640 1 -- start start 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94ed0f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e8103b90 0x7f94e8101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94ed0f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8104590 0x7f94e8101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94ed0f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 0x7f94e8102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94ed0f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8112dc0 con 0x7f94e810d140 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94ed0f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8112c40 con 0x7f94e8103b90 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94ed0f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8112f40 con 0x7f94e8104590 2024-09-10T23:30:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 0x7f94e8102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 0x7f94e8102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60076/0 (socket says 172.21.15.2:60076) 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 -- 172.21.15.2:0/313317287 learned_addr learned my addr 172.21.15.2:0/313317287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e659c640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8104590 0x7f94e8101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e8103b90 0x7f94e8101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 -- 172.21.15.2:0/313317287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8104590 msgr2=0x7f94e8101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8104590 0x7f94e8101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 -- 172.21.15.2:0/313317287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e8103b90 msgr2=0x7f94e8101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e8103b90 0x7f94e8101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 -- 172.21.15.2:0/313317287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e81a7670 con 0x7f94e810d140 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.707+0000 7f94e759e640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 0x7f94e8102490 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f94e000b9e0 tx=0x7f94e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.708+0000 7f94cffff640 1 -- 172.21.15.2:0/313317287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0019070 con 0x7f94e810d140 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.708+0000 7f94cffff640 1 -- 172.21.15.2:0/313317287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0014440 con 0x7f94e810d140 2024-09-10T23:30:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.708+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e81a7960 con 0x7f94e810d140 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.708+0000 7f94cffff640 1 -- 172.21.15.2:0/313317287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e00125a0 con 0x7f94e810d140 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.708+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81a7ea0 con 0x7f94e810d140 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 Processor -- start 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94cffff640 1 -- 172.21.15.2:0/313317287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f94e00145f0 con 0x7f94e810d140 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 -- start start 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2107394d0 0x55e2107398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210745840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e210745d80 0x55e210748170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e2106afea0 con 0x55e210739df0 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e21069f2d0 con 0x55e2107394d0 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.710+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e2106a30e0 con 0x55e210745d80 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210745840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210745840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60086/0 (socket says 172.21.15.2:60086) 2024-09-10T23:30:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 -- 172.21.15.2:0/1818510169 learned_addr learned my addr 172.21.15.2:0/1818510169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e659c640 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2107394d0 0x55e2107398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e659c640 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e210745d80 0x55e210748170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 -- 172.21.15.2:0/1818510169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e210745d80 msgr2=0x55e210748170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e210745d80 0x55e210748170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 -- 172.21.15.2:0/1818510169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2107394d0 msgr2=0x55e2107398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2107394d0 0x55e2107398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 -- 172.21.15.2:0/1818510169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2103fd650 con 0x55e210739df0 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94cffff640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b52e0 0x7f94d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210745840 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f94d800cc60 tx=0x7f94d800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef4a76064629b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94e659c640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b52e0 0x7f94d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94cd7fa640 1 -- 172.21.15.2:0/1818510169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8014070 con 0x55e210739df0 2024-09-10T23:30:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94cffff640 1 -- 172.21.15.2:0/313317287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f94e00e5300 con 0x7f94e810d140 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94cd7fa640 1 -- 172.21.15.2:0/1818510169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d80047a0 con 0x55e210739df0 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.711+0000 7f94cd7fa640 1 -- 172.21.15.2:0/1818510169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8010690 con 0x55e210739df0 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1818510169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 msgr2=0x55e210745840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94e659c640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b52e0 0x7f94d00b77a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f94dc031440 tx=0x7f94dc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210745840 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f94d800cc60 tx=0x7f94d800e720 comp rx=0 tx=0).stop 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1818510169 shutdown_connections 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e210745d80 0x55e210748170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210745840 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1818510169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2107394d0 0x55e2107398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1818510169 >> 172.21.15.2:0/1818510169 conn(0x55e210737300 msgr2=0x55e2107384a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1818510169 shutdown_connections 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.712+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1818510169 wait complete. 2024-09-10T23:30:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 -- start start 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 Processor -- start 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e210745690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e210742ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210743110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e210500700 con 0x55e210745d80 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e21063a160 con 0x55e210739df0 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e210748a00 con 0x55e2107394d0 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94ef4cc740 10 client.0 _ll_register_callbacks cb 0x55e2106539e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210743110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210743110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60102/0 (socket says 172.21.15.2:60102) 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 -- 172.21.15.2:0/1253518033 learned_addr learned my addr 172.21.15.2:0/1253518033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e659c640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e210742ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e210745690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 -- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 msgr2=0x55e210745690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e210745690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 -- 172.21.15.2:0/1253518033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 msgr2=0x55e210742ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e210742ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e759e640 1 -- 172.21.15.2:0/1253518033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e210667c90 con 0x55e210745d80 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.713+0000 7f94e659c640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e210742ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94e759e640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210743110 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f94e00abb10 tx=0x7f94e00ab750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d5c40b211e9be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94caff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94caff5640 1 -- 172.21.15.2:0/1253518033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e00b5060 con 0x55e210745d80 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94caff5640 1 -- 172.21.15.2:0/1253518033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f94e00b4bd0 con 0x55e210745d80 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94d80047a0 con 0x55e210745d80 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94caff5640 1 -- 172.21.15.2:0/1253518033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94e00b4dd0 con 0x55e210745d80 2024-09-10T23:30:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 10 client.17472 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e2107543f0 con 0x55e210745d80 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94caff5640 1 -- 172.21.15.2:0/1253518033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d80047a0 con 0x55e210745d80 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94caff5640 1 -- 172.21.15.2:0/1253518033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94e00a74d0 con 0x55e210745d80 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 10 client.17472 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 10 client.17472 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 20 client.17472 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107558b0 0x55e210757d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 4 client.17472 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.714+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2106b1df0 con 0x55e2107558b0 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.715+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107558b0 0x55e210757d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.715+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107558b0 0x55e210757d30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a869c50f4e6c5d46 server_cookie=37a73618a7052a9d in_seq=0 out_seq=0 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.715+0000 7f94caff5640 10 client.17472 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94caff5640 1 -- 172.21.15.2:0/1253518033 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2106b1df0 con 0x55e2107558b0 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94caff5640 10 client.17472 handle_command_reply: tid=0 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 client.17472 shutdown 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 msgr2=0x55e210743110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210743110 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f94e00abb10 tx=0x7f94e00ab750 comp rx=0 tx=0).stop 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 shutdown_connections 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107558b0 0x55e210757d30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210743110 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e210742ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94caff5640 0 client.17472 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1253518033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e210745690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 >> 172.21.15.2:0/1253518033 conn(0x55e210737300 msgr2=0x55e21073cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 shutdown_connections 2024-09-10T23:30:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1253518033 wait complete. 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.716+0000 7f94ef4cc740 20 client.17472 trim_cache size 0 max 16384 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.729+0000 7f94ef4cc740 1 Processor -- start 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.729+0000 7f94ef4cc740 1 -- start start 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e2107419d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210751c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210745d80 0x55e210744820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b0570 con 0x55e210739df0 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b20b0 con 0x55e210745d80 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b0c40 con 0x55e2107394d0 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210751c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210751c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60110/0 (socket says 172.21.15.2:60110) 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 -- 172.21.15.2:0/1864379729 learned_addr learned my addr 172.21.15.2:0/1864379729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e2107419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e759e640 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210745d80 0x55e210744820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 -- 172.21.15.2:0/1864379729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 msgr2=0x55e2107419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e2107419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 -- 172.21.15.2:0/1864379729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210745d80 msgr2=0x55e210744820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210745d80 0x55e210744820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 -- 172.21.15.2:0/1864379729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e210739c20 con 0x55e210739df0 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94e659c640 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210751c60 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa85015a7a2786c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.730+0000 7f94ccff9640 1 -- 172.21.15.2:0/1864379729 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc043070 con 0x55e210739df0 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ccff9640 1 -- 172.21.15.2:0/1864379729 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc0043c0 con 0x55e210739df0 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ccff9640 1 -- 172.21.15.2:0/1864379729 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc035040 con 0x55e210739df0 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1864379729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 msgr2=0x55e210751c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210751c60 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc03f070 comp rx=0 tx=0).stop 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1864379729 shutdown_connections 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210745d80 0x55e210744820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210739df0 0x55e210751c60 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/1864379729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e2107419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1864379729 >> 172.21.15.2:0/1864379729 conn(0x55e210737300 msgr2=0x55e210744110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1864379729 shutdown_connections 2024-09-10T23:30:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.731+0000 7f94ef4cc740 1 -- 172.21.15.2:0/1864379729 wait complete. 2024-09-10T23:30:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 -- start start 2024-09-10T23:30:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 Processor -- start 2024-09-10T23:30:13.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e21074deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e21074e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210748c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b19e0 con 0x55e210745d80 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b1310 con 0x55e210739df0 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81ae550 con 0x55e2107394d0 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94ef4cc740 10 client.0 _ll_register_callbacks cb 0x7f94e00a8270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210748c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210748c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60114/0 (socket says 172.21.15.2:60114) 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 -- 172.21.15.2:0/2961178815 learned_addr learned my addr 172.21.15.2:0/2961178815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e21074deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e659c640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e21074e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 -- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 msgr2=0x55e21074deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e21074deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 -- 172.21.15.2:0/2961178815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 msgr2=0x55e21074e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e21074e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e759e640 1 -- 172.21.15.2:0/2961178815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e210749390 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.732+0000 7f94e659c640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e21074e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94e759e640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210748c80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f94e00930b0 tx=0x7f94e00aabf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba822d6c86e2735d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94caff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94caff5640 1 -- 172.21.15.2:0/2961178815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e00c5020 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94caff5640 1 -- 172.21.15.2:0/2961178815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f94e00ace00 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94dc0043c0 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94caff5640 1 -- 172.21.15.2:0/2961178815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94e00b5060 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 10 client.17478 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e2107c3200 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94caff5640 1 -- 172.21.15.2:0/2961178815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc0043c0 con 0x55e210745d80 2024-09-10T23:30:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94caff5640 1 -- 172.21.15.2:0/2961178815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94e00a7560 con 0x55e210745d80 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 10 client.17478 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 10 client.17478 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 20 client.17478 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107c3720 0x55e2107c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 4 client.17478 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.733+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2106ad8a0 con 0x55e2107c3720 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107c3720 0x55e2107c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94e6d9d640 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107c3720 0x55e2107c5b10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f329ea08bcfb633 server_cookie=dbb998cd7cdac5c6 in_seq=0 out_seq=0 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94caff5640 10 client.17478 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94caff5640 1 -- 172.21.15.2:0/2961178815 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2106ad8a0 con 0x55e2107c3720 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94caff5640 10 client.17478 handle_command_reply: tid=0 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 client.17478 shutdown 2024-09-10T23:30:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 msgr2=0x55e210748c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210748c80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f94e00930b0 tx=0x7f94e00aabf0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 shutdown_connections 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e2107c3720 0x55e2107c5b10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e210745d80 0x55e210748c80 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e210739df0 0x55e21074e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94caff5640 0 client.17478 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 --2- 172.21.15.2:0/2961178815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e2107394d0 0x55e21074deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.734+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 >> 172.21.15.2:0/2961178815 conn(0x55e210737300 msgr2=0x55e210738920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 shutdown_connections 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ef4cc740 1 -- 172.21.15.2:0/2961178815 wait complete. 2024-09-10T23:30:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ef4cc740 20 client.17478 trim_cache size 0 max 16384 2024-09-10T23:30:13.751 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b52e0 msgr2=0x7f94d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b52e0 0x7f94d00b77a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f94dc031440 tx=0x7f94dc009560 comp rx=0 tx=0).stop 2024-09-10T23:30:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 msgr2=0x7f94e8102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 0x7f94e8102490 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f94e000b9e0 tx=0x7f94e000bea0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 shutdown_connections 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f94d00b52e0 0x7f94d00b77a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e810d140 0x7f94e8102490 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e8104590 0x7f94e8101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 --2- 172.21.15.2:0/313317287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e8103b90 0x7f94e8101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.735+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 >> 172.21.15.2:0/313317287 conn(0x7f94e80fd700 msgr2=0x7f94e80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.736+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 shutdown_connections 2024-09-10T23:30:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:13.736+0000 7f94ed0f7640 1 -- 172.21.15.2:0/313317287 wait complete. 2024-09-10T23:30:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:13 smithi177 ceph-mon[35760]: pgmap v528: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:30:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:13 smithi002 ceph-mon[31150]: pgmap v528: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:30:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:13 smithi154 ceph-mon[35136]: pgmap v528: 97 pgs: 97 active+clean; 4.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 -- 172.21.15.2:0/4012768912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81044c0 msgr2=0x7f7fe810ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 --2- 172.21.15.2:0/4012768912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81044c0 0x7f7fe810ae40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009cd0 tx=0x7f7fe002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 -- 172.21.15.2:0/4012768912 shutdown_connections 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 --2- 172.21.15.2:0/4012768912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81044c0 0x7f7fe810ae40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 --2- 172.21.15.2:0/4012768912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 0x7f7fe8103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 --2- 172.21.15.2:0/4012768912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe81029b0 0x7f7fe8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 -- 172.21.15.2:0/4012768912 >> 172.21.15.2:0/4012768912 conn(0x7f7fe80fe270 msgr2=0x7f7fe8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 -- 172.21.15.2:0/4012768912 shutdown_connections 2024-09-10T23:30:14.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 -- 172.21.15.2:0/4012768912 wait complete. 2024-09-10T23:30:14.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 Processor -- start 2024-09-10T23:30:14.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.502+0000 7f7fee408640 1 -- start start 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fee408640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 0x7f7fe8198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fee408640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 0x7f7fe8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fee408640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe81044c0 0x7f7fe8199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fee408640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe810e600 con 0x7f7fe81029b0 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fee408640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe810e480 con 0x7f7fe81044c0 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fee408640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe810e780 con 0x7f7fe8103b00 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 0x7f7fe8198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 0x7f7fe8198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60126/0 (socket says 172.21.15.2:60126) 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 -- 172.21.15.2:0/1049275606 learned_addr learned my addr 172.21.15.2:0/1049275606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe81044c0 0x7f7fe8199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 0x7f7fe8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 -- 172.21.15.2:0/1049275606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 msgr2=0x7f7fe8199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 0x7f7fe8199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 -- 172.21.15.2:0/1049275606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe81044c0 msgr2=0x7f7fe8199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe81044c0 0x7f7fe8199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 -- 172.21.15.2:0/1049275606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe819a840 con 0x7f7fe81029b0 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 0x7f7fe8199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.503+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 0x7f7fe8198d00 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800d950 tx=0x7f7fd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.504+0000 7f7fe57fa640 1 -- 172.21.15.2:0/1049275606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8017070 con 0x7f7fe81029b0 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.504+0000 7f7fe57fa640 1 -- 172.21.15.2:0/1049275606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd8009c30 con 0x7f7fe81029b0 2024-09-10T23:30:14.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.504+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe819ab30 con 0x7f7fe81029b0 2024-09-10T23:30:14.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.504+0000 7f7fe57fa640 1 -- 172.21.15.2:0/1049275606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800f620 con 0x7f7fe81029b0 2024-09-10T23:30:14.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.504+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81a1200 con 0x7f7fe81029b0 2024-09-10T23:30:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 Processor -- start 2024-09-10T23:30:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 -- start start 2024-09-10T23:30:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7fe57fa640 1 -- 172.21.15.2:0/1049275606 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7fd8010460 con 0x7f7fe81029b0 2024-09-10T23:30:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 0x55ceccc5fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc60190 0x55ceccc62580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccc65090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ceccbcf6f0 con 0x55ceccc5d860 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ceccbbeb20 con 0x55ceccc60190 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ceccbc2930 con 0x55ceccc62bd0 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7fec9a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 0x55ceccc5fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7fec9a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 0x55ceccc5fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60132/0 (socket says 172.21.15.2:60132) 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.506+0000 7f7fec9a5640 1 -- 172.21.15.2:0/1513168684 learned_addr learned my addr 172.21.15.2:0/1513168684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc60190 0x55ceccc62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccc65090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fec9a5640 1 -- 172.21.15.2:0/1513168684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 msgr2=0x55ceccc65090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccc65090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fec9a5640 1 -- 172.21.15.2:0/1513168684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc60190 msgr2=0x55ceccc62580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc60190 0x55ceccc62580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fec9a5640 1 -- 172.21.15.2:0/1513168684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceccb84530 con 0x55ceccc5d860 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc60190 0x55ceccc62580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 0x55ceccc5fc50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7fe002ae00 tx=0x7f7fe0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f49b412e2a805b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fce7fc640 1 -- 172.21.15.2:0/1513168684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0031950 con 0x55ceccc5d860 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fe57fa640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7fd00b5360 0x7f7fd00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fce7fc640 1 -- 172.21.15.2:0/1513168684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe0036040 con 0x55ceccc5d860 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fce7fc640 1 -- 172.21.15.2:0/1513168684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0004620 con 0x55ceccc5d860 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7fd00b5360 0x7f7fd00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.507+0000 7f7fe57fa640 1 -- 172.21.15.2:0/1049275606 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7fd80e5890 con 0x7f7fe81029b0 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 -- 172.21.15.2:0/1513168684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 msgr2=0x55ceccc5fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7fe7fff640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7fd00b5360 0x7f7fd00b7820 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80058c0 tx=0x7f7fd8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 0x55ceccc5fc50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7fe002ae00 tx=0x7f7fe0009a20 comp rx=0 tx=0).stop 2024-09-10T23:30:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 -- 172.21.15.2:0/1513168684 shutdown_connections 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccc65090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc60190 0x55ceccc62580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/1513168684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc5d860 0x55ceccc5fc50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 -- 172.21.15.2:0/1513168684 >> 172.21.15.2:0/1513168684 conn(0x55ceccc589b0 msgr2=0x55ceccc59740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 -- 172.21.15.2:0/1513168684 shutdown_connections 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 -- 172.21.15.2:0/1513168684 wait complete. 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.508+0000 7f7ff11dd740 1 -- start start 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 Processor -- start 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc66e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc60190 0x55ceccc67500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 0x55ceccc680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ceccaf6ab0 con 0x55ceccc62bd0 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ceccb64730 con 0x55ceccc5d860 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ceccc65b50 con 0x55ceccc60190 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7ff11dd740 10 client.0 _ll_register_callbacks cb 0x55ceccbb86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 0x55ceccc680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 0x55ceccc680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60148/0 (socket says 172.21.15.2:60148) 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 -- 172.21.15.2:0/3645559398 learned_addr learned my addr 172.21.15.2:0/3645559398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc66e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc60190 0x55ceccc67500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 -- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc60190 msgr2=0x55ceccc67500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc60190 0x55ceccc67500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 -- 172.21.15.2:0/3645559398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 msgr2=0x55ceccc66e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.509+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc66e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fec9a5640 1 -- 172.21.15.2:0/3645559398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cecc920790 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 0x55ceccc680d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0031e10 tx=0x7f7fe003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7be84337abc513c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fc77fe640 1 -- 172.21.15.2:0/3645559398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00045c0 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fc77fe640 1 -- 172.21.15.2:0/3645559398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7fe0003970 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fe0036040 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fc77fe640 1 -- 172.21.15.2:0/3645559398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fe0003b70 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7ff11dd740 10 client.17490 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cecc999620 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fc77fe640 1 -- 172.21.15.2:0/3645559398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe0036040 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.510+0000 7f7fc77fe640 1 -- 172.21.15.2:0/3645559398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7fe0030070 con 0x55ceccc62bd0 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7ff11dd740 10 client.17490 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7ff11dd740 10 client.17490 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7ff11dd740 20 client.17490 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccc72300 0x55ceccc746f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7ff11dd740 4 client.17490 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ceccbd1640 con 0x55ceccc72300 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccc72300 0x55ceccc746f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccc72300 0x55ceccc746f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ebc4b207d1ad61 server_cookie=4b3be5d0e5ebb52f in_seq=0 out_seq=0 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.511+0000 7f7fc77fe640 10 client.17490 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7fc77fe640 1 -- 172.21.15.2:0/3645559398 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ceccbd1640 con 0x55ceccc72300 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7fc77fe640 10 client.17490 handle_command_reply: tid=0 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 client.17490 shutdown 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 msgr2=0x55ceccc680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 0x55ceccc680d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0031e10 tx=0x7f7fe003d040 comp rx=0 tx=0).stop 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 shutdown_connections 2024-09-10T23:30:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccc72300 0x55ceccc746f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc62bd0 0x55ceccc680d0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc60190 0x55ceccc67500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7fc77fe640 0 client.17490 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3645559398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc66e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.512+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 >> 172.21.15.2:0/3645559398 conn(0x55ceccc589b0 msgr2=0x55ceccc57bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.513+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 shutdown_connections 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.513+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3645559398 wait complete. 2024-09-10T23:30:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.513+0000 7f7ff11dd740 20 client.17490 trim_cache size 0 max 16384 2024-09-10T23:30:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 Processor -- start 2024-09-10T23:30:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 -- start start 2024-09-10T23:30:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc5d860 0x55ceccc680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55ceccc5ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc62bd0 0x55ceccc5d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81a9e10 con 0x55ceccc60190 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81ab950 con 0x55ceccc62bd0 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81aa4e0 con 0x55ceccc5d860 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7fe77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55ceccc5ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7fe77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55ceccc5ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60162/0 (socket says 172.21.15.2:60162) 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.527+0000 7f7fe77fe640 1 -- 172.21.15.2:0/3043491598 learned_addr learned my addr 172.21.15.2:0/3043491598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc5d860 0x55ceccc680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fe77fe640 1 -- 172.21.15.2:0/3043491598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc5d860 msgr2=0x55ceccc680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc5d860 0x55ceccc680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fe77fe640 1 -- 172.21.15.2:0/3043491598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc62bd0 msgr2=0x55ceccc5d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc62bd0 0x55ceccc5d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fe77fe640 1 -- 172.21.15.2:0/3043491598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceccc66c30 con 0x55ceccc60190 2024-09-10T23:30:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc5d860 0x55ceccc680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55ceccc5ccc0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x55ceccc74e70 tx=0x7f7fdc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5eab9fdb3098537 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fcdffb640 1 -- 172.21.15.2:0/3043491598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0142d0 con 0x55ceccc60190 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fcdffb640 1 -- 172.21.15.2:0/3043491598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc01f030 con 0x55ceccc60190 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.528+0000 7f7fcdffb640 1 -- 172.21.15.2:0/3043491598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc012450 con 0x55ceccc60190 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3043491598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 msgr2=0x55ceccc5ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55ceccc5ccc0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x55ceccc74e70 tx=0x7f7fdc009580 comp rx=0 tx=0).stop 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3043491598 shutdown_connections 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc62bd0 0x55ceccc5d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55ceccc5ccc0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/3043491598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc5d860 0x55ceccc680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3043491598 >> 172.21.15.2:0/3043491598 conn(0x55ceccc589b0 msgr2=0x55ceccc53af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3043491598 shutdown_connections 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- 172.21.15.2:0/3043491598 wait complete. 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- start start 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 Processor -- start 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc7a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55cecccdf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccce1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81ab280 con 0x55ceccc60190 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81aabb0 con 0x55ceccc5d860 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81a7df0 con 0x55ceccc62bd0 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7ff11dd740 10 client.0 _ll_register_callbacks cb 0x7f7fe002afa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.529+0000 7f7fe77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55cecccdf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55cecccdf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60172/0 (socket says 172.21.15.2:60172) 2024-09-10T23:30:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 -- 172.21.15.2:0/2133430310 learned_addr learned my addr 172.21.15.2:0/2133430310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc7a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccce1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 -- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 msgr2=0x55ceccce1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccce1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 -- 172.21.15.2:0/2133430310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 msgr2=0x55ceccc7a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc7a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 -- 172.21.15.2:0/2133430310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceccce1fa0 con 0x55ceccc60190 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fe77fe640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55cecccdf100 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc003fb0 tx=0x7f7fdc0140d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda81c29d9057877 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fc77fe640 1 -- 172.21.15.2:0/2133430310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0035f0 con 0x55ceccc60190 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fc77fe640 1 -- 172.21.15.2:0/2133430310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7fdc003790 con 0x55ceccc60190 2024-09-10T23:30:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fdc01f030 con 0x55ceccc60190 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fc77fe640 1 -- 172.21.15.2:0/2133430310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fdc003fe0 con 0x55ceccc60190 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7ff11dd740 10 client.17496 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ceccce32e0 con 0x55ceccc60190 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.530+0000 7f7fc77fe640 1 -- 172.21.15.2:0/2133430310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc01f030 con 0x55ceccc60190 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7fc77fe640 1 -- 172.21.15.2:0/2133430310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7fdc00f040 con 0x55ceccc60190 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7ff11dd740 10 client.17496 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7ff11dd740 10 client.17496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7ff11dd740 20 client.17496 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccce3c70 0x55ceccce6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7ff11dd740 4 client.17496 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ceccbcd0f0 con 0x55ceccce3c70 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccce3c70 0x55ceccce6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7fec9a5640 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccce3c70 0x55ceccce6090 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5183ec7b1226a6c4 server_cookie=772c9504c32664ef in_seq=0 out_seq=0 2024-09-10T23:30:14.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.531+0000 7f7fc77fe640 10 client.17496 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7fc77fe640 1 -- 172.21.15.2:0/2133430310 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ceccbcd0f0 con 0x55ceccce3c70 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7fc77fe640 10 client.17496 handle_command_reply: tid=0 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 client.17496 shutdown 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 msgr2=0x55cecccdf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55cecccdf100 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc003fb0 tx=0x7f7fdc0140d0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 shutdown_connections 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ceccce3c70 0x55ceccce6090 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ceccc62bd0 0x55ceccce1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceccc60190 0x55cecccdf100 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7fc77fe640 0 client.17496 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 --2- 172.21.15.2:0/2133430310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ceccc5d860 0x55ceccc7a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 >> 172.21.15.2:0/2133430310 conn(0x55ceccc589b0 msgr2=0x55ceccc62fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 shutdown_connections 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 1 -- 172.21.15.2:0/2133430310 wait complete. 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.547+0000 7f7ff11dd740 20 client.17496 trim_cache size 0 max 16384 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:30:14.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:30:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7fd00b5360 msgr2=0x7f7fd00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7fd00b5360 0x7f7fd00b7820 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80058c0 tx=0x7f7fd8000bc0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 msgr2=0x7f7fe8198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 0x7f7fe8198d00 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800d950 tx=0x7f7fd800de10 comp rx=0 tx=0).stop 2024-09-10T23:30:14.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 shutdown_connections 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7fd00b5360 0x7f7fd00b7820 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe81044c0 0x7f7fe8199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe8103b00 0x7f7fe8199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 --2- 172.21.15.2:0/1049275606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe81029b0 0x7f7fe8198d00 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 >> 172.21.15.2:0/1049275606 conn(0x7f7fe80fe270 msgr2=0x7f7fe8106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 shutdown_connections 2024-09-10T23:30:14.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:14.548+0000 7f7fee408640 1 -- 172.21.15.2:0/1049275606 wait complete. 2024-09-10T23:30:14.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:15.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 -- 172.21.15.2:0/1849634469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 msgr2=0x7fcaa41135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/1849634469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa41135e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fca98009900 tx=0x7fca9802a410 comp rx=0 tx=0).stop 2024-09-10T23:30:15.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 -- 172.21.15.2:0/1849634469 shutdown_connections 2024-09-10T23:30:15.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/1849634469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4113b20 0x7fcaa4115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/1849634469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa41135e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/1849634469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa4075540 0x7fcaa4075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.299+0000 7fcaabc0a640 1 -- 172.21.15.2:0/1849634469 >> 172.21.15.2:0/1849634469 conn(0x7fcaa40fe830 msgr2=0x7fcaa4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 -- 172.21.15.2:0/1849634469 shutdown_connections 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 -- 172.21.15.2:0/1849634469 wait complete. 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 Processor -- start 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 -- start start 2024-09-10T23:30:15.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4075540 0x7fcaa419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa4113b20 0x7fcaa41a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41193f0 con 0x7fcaa4075e60 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4119270 con 0x7fcaa4075540 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaabc0a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4119570 con 0x7fcaa4113b20 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.300+0000 7fcaa91a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa419fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60178/0 (socket says 172.21.15.2:60178) 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2868460438 learned_addr learned my addr 172.21.15.2:0/2868460438 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa4113b20 0x7fcaa41a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4075540 0x7fcaa419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2868460438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa4113b20 msgr2=0x7fcaa41a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa4113b20 0x7fcaa41a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2868460438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4075540 msgr2=0x7fcaa419f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4075540 0x7fcaa419f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2868460438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa41a5990 con 0x7fcaa4075e60 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4075540 0x7fcaa419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa419fe20 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fca98005ab0 tx=0x7fca98003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fca96ffd640 1 -- 172.21.15.2:0/2868460438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9803f070 con 0x7fcaa4075e60 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fca96ffd640 1 -- 172.21.15.2:0/2868460438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca98031d60 con 0x7fcaa4075e60 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa41a5c20 con 0x7fcaa4075e60 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fca96ffd640 1 -- 172.21.15.2:0/2868460438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98035030 con 0x7fcaa4075e60 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.301+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41ac340 con 0x7fcaa4075e60 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.304+0000 7fcaadfdf740 1 Processor -- start 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.304+0000 7fca96ffd640 1 -- 172.21.15.2:0/2868460438 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fca9803b580 con 0x7fcaa4075e60 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.304+0000 7fcaadfdf740 1 -- start start 2024-09-10T23:30:15.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.304+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dc4d0 0x55c4c48dc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48eb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4c4852ea0 con 0x55c4c48e8d80 2024-09-10T23:30:15.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c4c48422d0 con 0x55c4c48dcdf0 2024-09-10T23:30:15.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c4c48460e0 con 0x55c4c48dc4d0 2024-09-10T23:30:15.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60180/0 (socket says 172.21.15.2:60180) 2024-09-10T23:30:15.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2007662475 learned_addr learned my addr 172.21.15.2:0/2007662475 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:15.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dc4d0 0x55c4c48dc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2007662475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dc4d0 msgr2=0x55c4c48dc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dc4d0 0x55c4c48dc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2007662475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 msgr2=0x55c4c48e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 -- 172.21.15.2:0/2007662475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c45a0650 con 0x55c4c48e8d80 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dc4d0 0x55c4c48dc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:15.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fca96ffd640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca900b52e0 0x7fca900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48eb170 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fca9810cc20 tx=0x7fca9810cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d82a1376043670f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.305+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca900b52e0 0x7fca900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fca8ffff640 1 -- 172.21.15.2:0/2007662475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca980c95d0 con 0x55c4c48e8d80 2024-09-10T23:30:15.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fca96ffd640 1 -- 172.21.15.2:0/2868460438 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fca98106810 con 0x7fcaa4075e60 2024-09-10T23:30:15.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fca8ffff640 1 -- 172.21.15.2:0/2007662475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca980cca90 con 0x55c4c48e8d80 2024-09-10T23:30:15.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fca8ffff640 1 -- 172.21.15.2:0/2007662475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98043e20 con 0x55c4c48e8d80 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 -- 172.21.15.2:0/2007662475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 msgr2=0x55c4c48eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca900b52e0 0x7fca900b77a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcaa406c510 tx=0x7fca9c00a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48eb170 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fca9810cc20 tx=0x7fca9810cd10 comp rx=0 tx=0).stop 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 -- 172.21.15.2:0/2007662475 shutdown_connections 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48eb170 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/2007662475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dc4d0 0x55c4c48dc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.306+0000 7fcaadfdf740 1 -- 172.21.15.2:0/2007662475 >> 172.21.15.2:0/2007662475 conn(0x55c4c48da300 msgr2=0x55c4c48db4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 -- 172.21.15.2:0/2007662475 shutdown_connections 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 -- 172.21.15.2:0/2007662475 wait complete. 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 -- start start 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 Processor -- start 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48e8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48e6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4c46a3700 con 0x55c4c48e8d80 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c4c47dd160 con 0x55c4c48dc4d0 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c4c48eb7c0 con 0x55c4c48dcdf0 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaadfdf740 10 client.0 _ll_register_callbacks cb 0x55c4c47f69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.307+0000 7fcaaa1a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60192/0 (socket says 172.21.15.2:60192) 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 -- 172.21.15.2:0/1010003848 learned_addr learned my addr 172.21.15.2:0/1010003848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 -- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dcdf0 msgr2=0x55c4c48e5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 -- 172.21.15.2:0/1010003848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 msgr2=0x55c4c48e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48e8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 -- 172.21.15.2:0/1010003848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c480ac90 con 0x55c4c48e8d80 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48e6110 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00a9b0 tx=0x7fca9c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119277af8795bae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fca8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fca8d7fa640 1 -- 172.21.15.2:0/1010003848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c004b20 con 0x55c4c48e8d80 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fca8d7fa640 1 -- 172.21.15.2:0/1010003848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fca9c016030 con 0x55c4c48e8d80 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.308+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca980cca90 con 0x55c4c48e8d80 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fca8d7fa640 1 -- 172.21.15.2:0/1010003848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca9c004cc0 con 0x55c4c48e8d80 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 10 client.17508 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c4c48f7140 con 0x55c4c48e8d80 2024-09-10T23:30:15.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fca8d7fa640 1 -- 172.21.15.2:0/1010003848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca980cca90 con 0x55c4c48e8d80 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fca8d7fa640 1 -- 172.21.15.2:0/1010003848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca9c0051b0 con 0x55c4c48e8d80 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 10 client.17508 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 10 client.17508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 20 client.17508 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c48f86a0 0x55c4c48fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 4 client.17508 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4c4854df0 con 0x55c4c48f86a0 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.309+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c48f86a0 0x55c4c48fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.310+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c48f86a0 0x55c4c48fab00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd34e9ad04e28666 server_cookie=640af6c587741474 in_seq=0 out_seq=0 2024-09-10T23:30:15.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.310+0000 7fca8d7fa640 10 client.17508 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:15.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.310+0000 7fca8d7fa640 1 -- 172.21.15.2:0/1010003848 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4c4854df0 con 0x55c4c48f86a0 2024-09-10T23:30:15.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.310+0000 7fca8d7fa640 10 client.17508 handle_command_reply: tid=0 2024-09-10T23:30:15.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.310+0000 7fcaadfdf740 1 client.17508 shutdown 2024-09-10T23:30:15.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 msgr2=0x55c4c48e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48e6110 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00a9b0 tx=0x7fca9c004ab0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 shutdown_connections 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c48f86a0 0x55c4c48fab00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48e8d80 0x55c4c48e6110 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fca8d7fa640 0 client.17508 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1010003848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 >> 172.21.15.2:0/1010003848 conn(0x55c4c48da300 msgr2=0x55c4c48dfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 shutdown_connections 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1010003848 wait complete. 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.311+0000 7fcaadfdf740 20 client.17508 trim_cache size 0 max 16384 2024-09-10T23:30:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 Processor -- start 2024-09-10T23:30:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 -- start start 2024-09-10T23:30:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c48e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b4a20 con 0x55c4c48dcdf0 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b6560 con 0x55c4c48dc4d0 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b50f0 con 0x55c4c48e8d80 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaa91a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaa91a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60206/0 (socket says 172.21.15.2:60206) 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.324+0000 7fcaa91a5640 1 -- 172.21.15.2:0/1020167964 learned_addr learned my addr 172.21.15.2:0/1020167964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c48e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa91a5640 1 -- 172.21.15.2:0/1020167964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 msgr2=0x55c4c48e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c48e2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa91a5640 1 -- 172.21.15.2:0/1020167964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 msgr2=0x55c4c48d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa91a5640 1 -- 172.21.15.2:0/1020167964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c48db9e0 con 0x55c4c48dcdf0 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e7820 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fca9810ce40 tx=0x7fca98031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee3ad5dcf8a9be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fca8f7fe640 1 -- 172.21.15.2:0/1020167964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98049070 con 0x55c4c48dcdf0 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fca8f7fe640 1 -- 172.21.15.2:0/1020167964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9803be50 con 0x55c4c48dcdf0 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.325+0000 7fca8f7fe640 1 -- 172.21.15.2:0/1020167964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98042360 con 0x55c4c48dcdf0 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1020167964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 msgr2=0x55c4c48e7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e7820 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fca9810ce40 tx=0x7fca98031f10 comp rx=0 tx=0).stop 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1020167964 shutdown_connections 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c48e2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dcdf0 0x55c4c48e7820 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/1020167964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dc4d0 0x55c4c48d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1020167964 >> 172.21.15.2:0/1020167964 conn(0x55c4c48da300 msgr2=0x55c4c48e7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1020167964 shutdown_connections 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 -- 172.21.15.2:0/1020167964 wait complete. 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 -- start start 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.326+0000 7fcaadfdf740 1 Processor -- start 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 0x55c4c48ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c49645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b5e90 con 0x55c4c48dc4d0 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b57c0 con 0x55c4c48dcdf0 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b2a00 con 0x55c4c48e8d80 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaadfdf740 10 client.0 _ll_register_callbacks cb 0x7fca9c00adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 0x55c4c48ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 0x55c4c48ed0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60216/0 (socket says 172.21.15.2:60216) 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 -- 172.21.15.2:0/662287973 learned_addr learned my addr 172.21.15.2:0/662287973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c49645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 -- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 msgr2=0x55c4c49645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c49645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 -- 172.21.15.2:0/662287973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 msgr2=0x55c4c48ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 -- 172.21.15.2:0/662287973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c4964b40 con 0x55c4c48dc4d0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaaa1a7640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c49645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fcaa99a6640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 0x55c4c48ed0d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x55c4c48fb340 tx=0x7fcaa0012a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f392bd7e81b525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fca8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.327+0000 7fca8d7fa640 1 -- 172.21.15.2:0/662287973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa001e7e0 con 0x55c4c48dc4d0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fca8d7fa640 1 -- 172.21.15.2:0/662287973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcaa001e980 con 0x55c4c48dc4d0 2024-09-10T23:30:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca9803be50 con 0x55c4c48dc4d0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fca8d7fa640 1 -- 172.21.15.2:0/662287973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcaa001eb80 con 0x55c4c48dc4d0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 10 client.17514 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c4c4965ea0 con 0x55c4c48dc4d0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fca8d7fa640 1 -- 172.21.15.2:0/662287973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9803be50 con 0x55c4c48dc4d0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fca8d7fa640 1 -- 172.21.15.2:0/662287973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcaa000f040 con 0x55c4c48dc4d0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 10 client.17514 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 10 client.17514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 20 client.17514 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c4966650 0x55c4c4968a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 4 client.17514 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4c48508a0 con 0x55c4c4966650 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.328+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c4966650 0x55c4c4968a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaa91a5640 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c4966650 0x55c4c4968a70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6f00af30efda7145 server_cookie=1fa95762ceab4dbf in_seq=0 out_seq=0 2024-09-10T23:30:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fca8d7fa640 10 client.17514 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fca8d7fa640 1 -- 172.21.15.2:0/662287973 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4c48508a0 con 0x55c4c4966650 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fca8d7fa640 10 client.17514 handle_command_reply: tid=0 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 client.17514 shutdown 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 msgr2=0x55c4c48ed0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 0x55c4c48ed0d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x55c4c48fb340 tx=0x7fcaa0012a40 comp rx=0 tx=0).stop 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 shutdown_connections 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c4c4966650 0x55c4c4968a70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4c48e8d80 0x55c4c49645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c48dcdf0 0x55c4c48ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 --2- 172.21.15.2:0/662287973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4c48dc4d0 0x55c4c48ed0d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fca8d7fa640 0 client.17514 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 >> 172.21.15.2:0/662287973 conn(0x55c4c48da300 msgr2=0x55c4c48e7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 shutdown_connections 2024-09-10T23:30:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 1 -- 172.21.15.2:0/662287973 wait complete. 2024-09-10T23:30:15.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.329+0000 7fcaadfdf740 20 client.17514 trim_cache size 0 max 16384 2024-09-10T23:30:15.355 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca900b52e0 msgr2=0x7fca900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca900b52e0 0x7fca900b77a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcaa406c510 tx=0x7fca9c00a4d0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 msgr2=0x7fcaa419fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa419fe20 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fca98005ab0 tx=0x7fca98003cd0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 shutdown_connections 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fca900b52e0 0x7fca900b77a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa4113b20 0x7fcaa41a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa4075e60 0x7fcaa419fe20 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 --2- 172.21.15.2:0/2868460438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa4075540 0x7fcaa419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 >> 172.21.15.2:0/2868460438 conn(0x7fcaa40fe830 msgr2=0x7fcaa40ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 shutdown_connections 2024-09-10T23:30:15.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:15.330+0000 7fcaabc0a640 1 -- 172.21.15.2:0/2868460438 wait complete. 2024-09-10T23:30:16.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:30:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:15 smithi177 ceph-mon[35760]: pgmap v529: 97 pgs: 97 active+clean; 4.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:16.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:15 smithi002 ceph-mon[31150]: pgmap v529: 97 pgs: 97 active+clean; 4.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:15 smithi154 ceph-mon[35136]: pgmap v529: 97 pgs: 97 active+clean; 4.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:16.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 -- 172.21.15.2:0/897485983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 msgr2=0x7f4e24108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/897485983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24108c10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009900 tx=0x7f4e1802a410 comp rx=0 tx=0).stop 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 -- 172.21.15.2:0/897485983 shutdown_connections 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/897485983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24109150 0x7f4e2410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/897485983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24108c10 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/897485983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e24102dc0 0x7f4e241031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 -- 172.21.15.2:0/897485983 >> 172.21.15.2:0/897485983 conn(0x7f4e240fe830 msgr2=0x7f4e24100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.850+0000 7f4e2c15c640 1 -- 172.21.15.2:0/897485983 shutdown_connections 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 -- 172.21.15.2:0/897485983 wait complete. 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 Processor -- start 2024-09-10T23:30:16.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 -- start start 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24102dc0 0x7f4e241992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e24109150 0x7f4e2419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24112dd0 con 0x7f4e241087d0 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24112c50 con 0x7f4e24102dc0 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e2c15c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24112f50 con 0x7f4e24109150 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e296f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.851+0000 7f4e296f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60248/0 (socket says 172.21.15.2:60248) 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 -- 172.21.15.2:0/1801804215 learned_addr learned my addr 172.21.15.2:0/1801804215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e24109150 0x7f4e2419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24102dc0 0x7f4e241992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 -- 172.21.15.2:0/1801804215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e24109150 msgr2=0x7f4e2419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e24109150 0x7f4e2419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 -- 172.21.15.2:0/1801804215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24102dc0 msgr2=0x7f4e241992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24102dc0 0x7f4e241992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 -- 172.21.15.2:0/1801804215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2419f390 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e296f7640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24199820 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4e18005940 tx=0x7f4e180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e16ffd640 1 -- 172.21.15.2:0/1801804215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1803f030 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e16ffd640 1 -- 172.21.15.2:0/1801804215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e18003cb0 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2419f620 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e16ffd640 1 -- 172.21.15.2:0/1801804215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18035070 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.852+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e241a5d40 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 Processor -- start 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e16ffd640 1 -- 172.21.15.2:0/1801804215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f4e1803bbf0 con 0x7f4e241087d0 2024-09-10T23:30:16.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 -- start start 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73e844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73e94870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd73dfaea0 con 0x55fd73e84a10 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd73dea2d0 con 0x55fd73e840f0 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.855+0000 7f4e2e531740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd73dee0e0 con 0x55fd73e94db0 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73e94870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73e94870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60260/0 (socket says 172.21.15.2:60260) 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 -- 172.21.15.2:0/1098557828 learned_addr learned my addr 172.21.15.2:0/1098557828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e296f7640 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73e844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 -- 172.21.15.2:0/1098557828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 msgr2=0x55fd73e971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 -- 172.21.15.2:0/1098557828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 msgr2=0x55fd73e844d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73e844d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 -- 172.21.15.2:0/1098557828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd73b48650 con 0x55fd73e84a10 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e16ffd640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e100b52e0 0x7f4e100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73e94870 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000bce0 tx=0x7f4e2000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f170de668e8c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e100b52e0 0x7f4e100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e16ffd640 1 -- 172.21.15.2:0/1801804215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4e18106740 con 0x7f4e241087d0 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e0ffff640 1 -- 172.21.15.2:0/1098557828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e20015070 con 0x55fd73e84a10 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.856+0000 7f4e0ffff640 1 -- 172.21.15.2:0/1098557828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e2001a910 con 0x55fd73e84a10 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e0ffff640 1 -- 172.21.15.2:0/1098557828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e200118e0 con 0x55fd73e84a10 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 -- 172.21.15.2:0/1098557828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 msgr2=0x55fd73e94870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e100b52e0 0x7f4e100b77a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00aec0 tx=0x7f4e1c00a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73e94870 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000bce0 tx=0x7f4e2000f730 comp rx=0 tx=0).stop 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 -- 172.21.15.2:0/1098557828 shutdown_connections 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73e94870 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 --2- 172.21.15.2:0/1098557828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73e844d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 -- 172.21.15.2:0/1098557828 >> 172.21.15.2:0/1098557828 conn(0x55fd73e81f20 msgr2=0x55fd73e830c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 -- 172.21.15.2:0/1098557828 shutdown_connections 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.857+0000 7f4e2e531740 1 -- 172.21.15.2:0/1098557828 wait complete. 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 -- start start 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 Processor -- start 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e840f0 0x55fd73e94740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e91b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 0x55fd73e92260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd73c4b700 con 0x55fd73e94db0 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd73d85160 con 0x55fd73e84a10 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd73e97a60 con 0x55fd73e840f0 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2e531740 10 client.0 _ll_register_callbacks cb 0x55fd73d9e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2a6f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 0x55fd73e92260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2a6f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 0x55fd73e92260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60266/0 (socket says 172.21.15.2:60266) 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e2a6f9640 1 -- 172.21.15.2:0/3655729358 learned_addr learned my addr 172.21.15.2:0/3655729358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e840f0 0x55fd73e94740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.858+0000 7f4e296f7640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e91b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2a6f9640 1 -- 172.21.15.2:0/3655729358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e840f0 msgr2=0x55fd73e94740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e840f0 0x55fd73e94740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2a6f9640 1 -- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 msgr2=0x55fd73e91b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e91b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2a6f9640 1 -- 172.21.15.2:0/3655729358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd73db2c90 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 0x55fd73e92260 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00fe00 tx=0x7f4e1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57aca563b08b5b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/3655729358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00eb30 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/3655729358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4e1c00ecd0 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e2001a910 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/3655729358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e1c026480 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2e531740 10 client.17526 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.859+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd73ea34e0 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/3655729358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e2001a910 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/3655729358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4e1c01c550 con 0x55fd73e94db0 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e2e531740 10 client.17526 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e2e531740 10 client.17526 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:30:16.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e2e531740 20 client.17526 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:16.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e2e531740 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73ea49a0 0x55fd73ea6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e2e531740 4 client.17526 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:16.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd73dfcdf0 con 0x55fd73ea49a0 2024-09-10T23:30:16.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73ea49a0 0x55fd73ea6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73ea49a0 0x55fd73ea6db0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc21f33a414b132c server_cookie=7813a99145763bf9 in_seq=0 out_seq=0 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.860+0000 7f4e0d7fa640 10 client.17526 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/3655729358 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd73dfcdf0 con 0x55fd73ea49a0 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e0d7fa640 10 client.17526 handle_command_reply: tid=0 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 client.17526 shutdown 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 msgr2=0x55fd73e92260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 0x55fd73e92260 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00fe00 tx=0x7f4e1c004a40 comp rx=0 tx=0).stop 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 shutdown_connections 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73ea49a0 0x55fd73ea6db0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e94db0 0x55fd73e92260 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e91b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e0d7fa640 0 client.17526 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 --2- 172.21.15.2:0/3655729358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e840f0 0x55fd73e94740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.861+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 >> 172.21.15.2:0/3655729358 conn(0x55fd73e81f20 msgr2=0x55fd73e87ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.862+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 shutdown_connections 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.862+0000 7f4e2e531740 1 -- 172.21.15.2:0/3655729358 wait complete. 2024-09-10T23:30:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.862+0000 7f4e2e531740 20 client.17526 trim_cache size 0 max 16384 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 Processor -- start 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 -- start start 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 0x55fd73ea0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e96c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e97180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241ac1a0 con 0x55fd73e840f0 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241adce0 con 0x55fd73e84a10 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2e531740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241ac870 con 0x55fd73e94db0 2024-09-10T23:30:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 0x55fd73ea0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 0x55fd73ea0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60270/0 (socket says 172.21.15.2:60270) 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 -- 172.21.15.2:0/2930433417 learned_addr learned my addr 172.21.15.2:0/2930433417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e97180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 -- 172.21.15.2:0/2930433417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 msgr2=0x55fd73e97180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e97180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e296f7640 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e96c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 -- 172.21.15.2:0/2930433417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 msgr2=0x55fd73e96c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e96c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.875+0000 7f4e29ef8640 1 -- 172.21.15.2:0/2930433417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd73e91fc0 con 0x55fd73e840f0 2024-09-10T23:30:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 0x55fd73ea0c90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000bce0 tx=0x7f4e20011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5f77bd01e0b137 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e0f7fe640 1 -- 172.21.15.2:0/2930433417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e20015040 con 0x55fd73e840f0 2024-09-10T23:30:16.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e0f7fe640 1 -- 172.21.15.2:0/2930433417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e20005030 con 0x55fd73e840f0 2024-09-10T23:30:16.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e0f7fe640 1 -- 172.21.15.2:0/2930433417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e200048e0 con 0x55fd73e840f0 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 -- 172.21.15.2:0/2930433417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 msgr2=0x55fd73ea0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 0x55fd73ea0c90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000bce0 tx=0x7f4e20011580 comp rx=0 tx=0).stop 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 -- 172.21.15.2:0/2930433417 shutdown_connections 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73e97180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e84a10 0x55fd73e96c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 --2- 172.21.15.2:0/2930433417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e840f0 0x55fd73ea0c90 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.876+0000 7f4e2e531740 1 -- 172.21.15.2:0/2930433417 >> 172.21.15.2:0/2930433417 conn(0x55fd73e81f20 msgr2=0x55fd73e83050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 -- 172.21.15.2:0/2930433417 shutdown_connections 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 -- 172.21.15.2:0/2930433417 wait complete. 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 -- start start 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 Processor -- start 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73eac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73eacb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73ead050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241ad610 con 0x55fd73e84a10 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241acf40 con 0x55fd73e840f0 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.877+0000 7f4e2e531740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241aa180 con 0x55fd73e94db0 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e2e531740 10 client.0 _ll_register_callbacks cb 0x7f4e1c00fab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73eacb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73eacb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60286/0 (socket says 172.21.15.2:60286) 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e29ef8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73eac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 -- 172.21.15.2:0/4105384470 learned_addr learned my addr 172.21.15.2:0/4105384470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e2a6f9640 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73ead050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 -- 172.21.15.2:0/4105384470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 msgr2=0x55fd73ead050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73ead050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 -- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 msgr2=0x55fd73eac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73eac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 -- 172.21.15.2:0/4105384470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd73e9c4e0 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e296f7640 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73eacb10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4e1810c2f0 tx=0x7f4e18009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b39f64c67dcd9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/4105384470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18049070 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/4105384470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4e180cd370 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e20005030 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.878+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/4105384470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e180ccce0 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 10 client.17532 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd73f11c20 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/4105384470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e20005030 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/4105384470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4e180d1070 con 0x55fd73e84a10 2024-09-10T23:30:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 10 client.17532 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 10 client.17532 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 20 client.17532 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73f12340 0x55fd73f14730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 4 client.17532 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd73df88a0 con 0x55fd73f12340 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.879+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73f12340 0x55fd73f14730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e29ef8640 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73f12340 0x55fd73f14730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=823efd64e1e1fdb1 server_cookie=52213be33f42151b in_seq=0 out_seq=0 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e0d7fa640 10 client.17532 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e0d7fa640 1 -- 172.21.15.2:0/4105384470 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd73df88a0 con 0x55fd73f12340 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e0d7fa640 10 client.17532 handle_command_reply: tid=0 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 client.17532 shutdown 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 msgr2=0x55fd73eacb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73eacb10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4e1810c2f0 tx=0x7f4e18009620 comp rx=0 tx=0).stop 2024-09-10T23:30:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 shutdown_connections 2024-09-10T23:30:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd73e94db0 0x55fd73ead050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55fd73f12340 0x55fd73f14730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd73e84a10 0x55fd73eacb10 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 --2- 172.21.15.2:0/4105384470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd73e840f0 0x55fd73eac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 >> 172.21.15.2:0/4105384470 conn(0x55fd73e81f20 msgr2=0x55fd73e96c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e0d7fa640 0 client.17532 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 shutdown_connections 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 1 -- 172.21.15.2:0/4105384470 wait complete. 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.880+0000 7f4e2e531740 20 client.17532 trim_cache size 0 max 16384 2024-09-10T23:30:16.886 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e100b52e0 msgr2=0x7f4e100b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e100b52e0 0x7f4e100b77a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00aec0 tx=0x7f4e1c00a4d0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 msgr2=0x7f4e24199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24199820 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4e18005940 tx=0x7f4e180042f0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 shutdown_connections 2024-09-10T23:30:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f4e100b52e0 0x7f4e100b77a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e24109150 0x7f4e2419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e241087d0 0x7f4e24199820 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 --2- 172.21.15.2:0/1801804215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24102dc0 0x7f4e241992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 >> 172.21.15.2:0/1801804215 conn(0x7f4e240fe830 msgr2=0x7f4e24100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 shutdown_connections 2024-09-10T23:30:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:16.881+0000 7f4e2c15c640 1 -- 172.21.15.2:0/1801804215 wait complete. 2024-09-10T23:30:17.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:30:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:17.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:17 smithi002 ceph-mon[31150]: pgmap v530: 97 pgs: 97 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:30:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:17 smithi177 ceph-mon[35760]: pgmap v530: 97 pgs: 97 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:30:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:17 smithi154 ceph-mon[35136]: pgmap v530: 97 pgs: 97 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:30:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2682344370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 msgr2=0x7f7b7410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2682344370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b7410f950 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009ca0 tx=0x7f7b6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2682344370 shutdown_connections 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2682344370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b7410f950 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2682344370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 0x7f7b74108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2682344370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b74102dc0 0x7f7b741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2682344370 >> 172.21.15.2:0/2682344370 conn(0x7f7b740fe830 msgr2=0x7f7b74100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2682344370 shutdown_connections 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.519+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2682344370 wait complete. 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 Processor -- start 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 -- start start 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b74102dc0 0x7f7b7419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 0x7f7b7419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b741a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74112e10 con 0x7f7b74109150 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74112c90 con 0x7f7b74102dc0 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7bd2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74112f90 con 0x7f7b741087d0 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7a2cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b741a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7a2cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b741a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60306/0 (socket says 172.21.15.2:60306) 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b7a2cb640 1 -- 172.21.15.2:0/2906423501 learned_addr learned my addr 172.21.15.2:0/2906423501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b79aca640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b74102dc0 0x7f7b7419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.520+0000 7f7b792c9640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 0x7f7b7419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7a2cb640 1 -- 172.21.15.2:0/2906423501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 msgr2=0x7f7b7419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7a2cb640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 0x7f7b7419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7a2cb640 1 -- 172.21.15.2:0/2906423501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b74102dc0 msgr2=0x7f7b7419b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7a2cb640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b74102dc0 0x7f7b7419b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7a2cb640 1 -- 172.21.15.2:0/2906423501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b741a1530 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b792c9640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 0x7f7b7419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7a2cb640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b741a0d60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c005cc0 tx=0x7f7b6c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b6affd640 1 -- 172.21.15.2:0/2906423501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c003bf0 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b6affd640 1 -- 172.21.15.2:0/2906423501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b6c003d90 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b6affd640 1 -- 172.21.15.2:0/2906423501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c02fbc0 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b741a17c0 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.521+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b741a7ee0 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.523+0000 7f7b7e103740 1 Processor -- start 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b6affd640 1 -- 172.21.15.2:0/2906423501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7b6c004610 con 0x7f7b74109150 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 -- start start 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab3064d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab312460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab314d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7ab27cea0 con 0x55d7ab3129a0 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d7ab26c2d0 con 0x55d7ab306a10 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b7e103740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d7ab2700e0 con 0x55d7ab3060f0 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b792c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab314d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b792c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab314d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60312/0 (socket says 172.21.15.2:60312) 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b792c9640 1 -- 172.21.15.2:0/3935262745 learned_addr learned my addr 172.21.15.2:0/3935262745 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b79aca640 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab312460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.524+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab3064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b6affd640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7b600b5360 0x7f7b600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b792c9640 1 -- 172.21.15.2:0/3935262745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 msgr2=0x55d7ab3064d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab3064d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b792c9640 1 -- 172.21.15.2:0/3935262745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 msgr2=0x55d7ab312460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab312460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b792c9640 1 -- 172.21.15.2:0/3935262745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7aafca650 con 0x55d7ab3129a0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b7a2cb640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7b600b5360 0x7f7b600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab314d90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7b64012820 tx=0x7f7b6400d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60ae9573493084f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b6affd640 1 -- 172.21.15.2:0/2906423501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7b6c107100 con 0x7f7b74109150 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b5ffff640 1 -- 172.21.15.2:0/3935262745 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64012e60 con 0x55d7ab3129a0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b5ffff640 1 -- 172.21.15.2:0/3935262745 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b640103d0 con 0x55d7ab3129a0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.525+0000 7f7b5ffff640 1 -- 172.21.15.2:0/3935262745 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400f620 con 0x55d7ab3129a0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 -- 172.21.15.2:0/3935262745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 msgr2=0x55d7ab314d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab314d90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7b64012820 tx=0x7f7b6400d3c0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7a2cb640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7b600b5360 0x7f7b600b7820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0cab40 tx=0x7f7b6c09aeb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 -- 172.21.15.2:0/3935262745 shutdown_connections 2024-09-10T23:30:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab314d90 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab312460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3935262745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab3064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 -- 172.21.15.2:0/3935262745 >> 172.21.15.2:0/3935262745 conn(0x55d7ab303f20 msgr2=0x55d7ab3050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 -- 172.21.15.2:0/3935262745 shutdown_connections 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 -- 172.21.15.2:0/3935262745 wait complete. 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 -- start start 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.526+0000 7f7b7e103740 1 Processor -- start 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab312310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab30f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab30fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7ab0cd700 con 0x55d7ab3129a0 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d7ab207160 con 0x55d7ab306a10 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d7ab315620 con 0x55d7ab3060f0 2024-09-10T23:30:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b7e103740 10 client.0 _ll_register_callbacks cb 0x55d7ab2209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab30fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab30fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60326/0 (socket says 172.21.15.2:60326) 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 -- 172.21.15.2:0/51015730 learned_addr learned my addr 172.21.15.2:0/51015730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b79aca640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab30f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab312310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 -- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 msgr2=0x55d7ab312310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab312310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 -- 172.21.15.2:0/51015730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 msgr2=0x55d7ab30f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab30f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.527+0000 7f7b792c9640 1 -- 172.21.15.2:0/51015730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ab234c90 con 0x55d7ab3129a0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b792c9640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab30fde0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7b64010e00 tx=0x7f7b64014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1ceeade282659d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/51015730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64012e60 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/51015730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7b64010580 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b640103d0 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/51015730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7b64010ea0 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 10 client.17544 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7ab321000 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/51015730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b640103d0 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/51015730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7b640050b0 con 0x55d7ab3129a0 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 10 client.17544 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 10 client.17544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 20 client.17544 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab322350 0x55d7ab324740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 4 client.17544 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.528+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7ab27edf0 con 0x55d7ab322350 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.529+0000 7f7b79aca640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab322350 0x55d7ab324740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.529+0000 7f7b5d7fa640 10 client.17544 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.529+0000 7f7b79aca640 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab322350 0x55d7ab324740 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d72f7a317f608b0 server_cookie=eb544fc5ab34e31d in_seq=0 out_seq=0 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/51015730 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7ab27edf0 con 0x55d7ab322350 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b5d7fa640 10 client.17544 handle_command_reply: tid=0 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 client.17544 shutdown 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 msgr2=0x55d7ab30fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab30fde0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7b64010e00 tx=0x7f7b64014040 comp rx=0 tx=0).stop 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 shutdown_connections 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab322350 0x55d7ab324740 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3129a0 0x55d7ab30fde0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab306a10 0x55d7ab30f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b5d7fa640 0 client.17544 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 --2- 172.21.15.2:0/51015730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab312310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 >> 172.21.15.2:0/51015730 conn(0x55d7ab303f20 msgr2=0x55d7ab309a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 shutdown_connections 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 1 -- 172.21.15.2:0/51015730 wait complete. 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.530+0000 7f7b7e103740 20 client.17544 trim_cache size 0 max 16384 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 Processor -- start 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 -- start start 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 0x55d7ab2fee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab306a10 0x55d7ab303760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab3114a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7b741b0570 con 0x55d7ab3060f0 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b741b20b0 con 0x55d7ab3129a0 2024-09-10T23:30:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b7e103740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b741b0c40 con 0x55d7ab306a10 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 0x55d7ab2fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 0x55d7ab2fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60342/0 (socket says 172.21.15.2:60342) 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 -- 172.21.15.2:0/747452099 learned_addr learned my addr 172.21.15.2:0/747452099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b79aca640 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab306a10 0x55d7ab303760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 -- 172.21.15.2:0/747452099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab306a10 msgr2=0x55d7ab303760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab306a10 0x55d7ab303760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 -- 172.21.15.2:0/747452099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 msgr2=0x55d7ab3114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab3114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.544+0000 7f7b792c9640 1 -- 172.21.15.2:0/747452099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ab3049a0 con 0x55d7ab3060f0 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b792c9640 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 0x55d7ab2fee70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7b640058c0 tx=0x7f7b6400d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5a4cd57d6cca1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b5f7fe640 1 -- 172.21.15.2:0/747452099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64012e60 con 0x55d7ab3060f0 2024-09-10T23:30:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b5f7fe640 1 -- 172.21.15.2:0/747452099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b6403b070 con 0x55d7ab3060f0 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b5f7fe640 1 -- 172.21.15.2:0/747452099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400aac0 con 0x55d7ab3060f0 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 -- 172.21.15.2:0/747452099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 msgr2=0x55d7ab2fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 0x55d7ab2fee70 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7b640058c0 tx=0x7f7b6400d8e0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 -- 172.21.15.2:0/747452099 shutdown_connections 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab3114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab306a10 0x55d7ab303760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 --2- 172.21.15.2:0/747452099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab3060f0 0x55d7ab2fee70 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.545+0000 7f7b7e103740 1 -- 172.21.15.2:0/747452099 >> 172.21.15.2:0/747452099 conn(0x55d7ab303f20 msgr2=0x55d7ab310d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 -- 172.21.15.2:0/747452099 shutdown_connections 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 -- 172.21.15.2:0/747452099 wait complete. 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 -- start start 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 Processor -- start 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab329dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 0x55d7ab32a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab32a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7b741b19e0 con 0x55d7ab306a10 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b741b1310 con 0x55d7ab3129a0 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b741ae550 con 0x55d7ab3060f0 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b7e103740 10 client.0 _ll_register_callbacks cb 0x7f7b7000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b79aca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 0x55d7ab32a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b79aca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 0x55d7ab32a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60354/0 (socket says 172.21.15.2:60354) 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.546+0000 7f7b79aca640 1 -- 172.21.15.2:0/3246510735 learned_addr learned my addr 172.21.15.2:0/3246510735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab329dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab32a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b79aca640 1 -- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 msgr2=0x55d7ab329dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b79aca640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab329dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b79aca640 1 -- 172.21.15.2:0/3246510735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 msgr2=0x55d7ab32a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b79aca640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab32a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b79aca640 1 -- 172.21.15.2:0/3246510735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ab31a0d0 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b79aca640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 0x55d7ab32a310 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000bdd0 tx=0x7f7b700039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c57df6528b9efc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/3246510735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70028060 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/3246510735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7b70011650 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b6403b070 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/3246510735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7b70011850 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b7e103740 10 client.17550 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.547+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7ab38f480 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/3246510735 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b6403b070 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/3246510735 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7b7001d990 con 0x55d7ab306a10 2024-09-10T23:30:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b7e103740 10 client.17550 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b7e103740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b7e103740 20 client.17550 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab38fb80 0x55d7ab391fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b7e103740 4 client.17550 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7ab27a8a0 con 0x55d7ab38fb80 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.548+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab38fb80 0x55d7ab391fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b5d7fa640 10 client.17550 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b792c9640 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab38fb80 0x55d7ab391fa0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=822847243c0e4d75 server_cookie=fc01f3375809892d in_seq=0 out_seq=0 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b5d7fa640 1 -- 172.21.15.2:0/3246510735 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7ab27a8a0 con 0x55d7ab38fb80 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b5d7fa640 10 client.17550 handle_command_reply: tid=0 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 client.17550 shutdown 2024-09-10T23:30:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 msgr2=0x55d7ab32a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 0x55d7ab32a310 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000bdd0 tx=0x7f7b700039c0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 shutdown_connections 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d7ab38fb80 0x55d7ab391fa0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7ab3129a0 0x55d7ab32a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ab306a10 0x55d7ab32a310 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b5d7fa640 0 client.17550 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 --2- 172.21.15.2:0/3246510735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7ab3060f0 0x55d7ab329dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 >> 172.21.15.2:0/3246510735 conn(0x55d7ab303f20 msgr2=0x55d7ab3115b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 shutdown_connections 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 1 -- 172.21.15.2:0/3246510735 wait complete. 2024-09-10T23:30:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.549+0000 7f7b7e103740 20 client.17550 trim_cache size 0 max 16384 2024-09-10T23:30:18.566 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7b600b5360 msgr2=0x7f7b600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7b600b5360 0x7f7b600b7820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0cab40 tx=0x7f7b6c09aeb0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 msgr2=0x7f7b741a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b741a0d60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c005cc0 tx=0x7f7b6c02f380 comp rx=0 tx=0).stop 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 shutdown_connections 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7b600b5360 0x7f7b600b7820 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74109150 0x7f7b741a0d60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b741087d0 0x7f7b7419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 --2- 172.21.15.2:0/2906423501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b74102dc0 0x7f7b7419b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 >> 172.21.15.2:0/2906423501 conn(0x7f7b740fe830 msgr2=0x7f7b74104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 shutdown_connections 2024-09-10T23:30:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:18.550+0000 7f7b7bd2e640 1 -- 172.21.15.2:0/2906423501 wait complete. 2024-09-10T23:30:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:19 smithi177 ceph-mon[35760]: pgmap v531: 97 pgs: 97 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:20.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:19 smithi002 ceph-mon[31150]: pgmap v531: 97 pgs: 97 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:19 smithi154 ceph-mon[35136]: pgmap v531: 97 pgs: 97 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:20.363 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:30:20.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:30:20.637 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 -- 172.21.15.2:0/963646161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904103ca0 msgr2=0x7f2904104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 --2- 172.21.15.2:0/963646161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904103ca0 0x7f2904104080 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009900 tx=0x7f28f402a410 comp rx=0 tx=0).stop 2024-09-10T23:30:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 -- 172.21.15.2:0/963646161 shutdown_connections 2024-09-10T23:30:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 --2- 172.21.15.2:0/963646161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f290410d100 0x7f290410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 --2- 172.21.15.2:0/963646161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29041045c0 0x7f290410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 --2- 172.21.15.2:0/963646161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904103ca0 0x7f2904104080 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 -- 172.21.15.2:0/963646161 >> 172.21.15.2:0/963646161 conn(0x7f29040fd700 msgr2=0x7f29040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 -- 172.21.15.2:0/963646161 shutdown_connections 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 -- 172.21.15.2:0/963646161 wait complete. 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 Processor -- start 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.133+0000 7f29099ad640 1 -- start start 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29099ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2904103ca0 0x7f2904199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29099ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29041045c0 0x7f29041997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29099ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 0x7f290419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29099ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2904112dc0 con 0x7f290410d100 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29099ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2904112c40 con 0x7f29041045c0 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29099ad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2904112f40 con 0x7f2904103ca0 2024-09-10T23:30:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 0x7f290419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 0x7f290419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59624/0 (socket says 172.21.15.2:59624) 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 -- 172.21.15.2:0/2547742929 learned_addr learned my addr 172.21.15.2:0/2547742929 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29027fc640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29041045c0 0x7f29041997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f2902ffd640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2904103ca0 0x7f2904199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 -- 172.21.15.2:0/2547742929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2904103ca0 msgr2=0x7f2904199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2904103ca0 0x7f2904199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 -- 172.21.15.2:0/2547742929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29041045c0 msgr2=0x7f29041997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29041045c0 0x7f29041997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 -- 172.21.15.2:0/2547742929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290419f340 con 0x7f290410d100 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29037fe640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 0x7f290419eb70 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d750 tx=0x7f28fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.134+0000 7f29089ab640 1 -- 172.21.15.2:0/2547742929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc017070 con 0x7f290410d100 2024-09-10T23:30:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.135+0000 7f29089ab640 1 -- 172.21.15.2:0/2547742929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc0054d0 con 0x7f290410d100 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.135+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290419f630 con 0x7f290410d100 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.135+0000 7f29089ab640 1 -- 172.21.15.2:0/2547742929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc004c60 con 0x7f290410d100 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.135+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29041a5ec0 con 0x7f290410d100 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.137+0000 7f290bd82740 1 Processor -- start 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.137+0000 7f29089ab640 1 -- 172.21.15.2:0/2547742929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f28fc004e00 con 0x7f290410d100 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.137+0000 7f290bd82740 1 -- start start 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f290bd82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f290bd82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f290bd82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd8b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f290bd82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643bd81ce60 con 0x5643bd8a5ee0 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f290bd82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5643bd80c290 con 0x5643bd8b2790 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f290bd82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5643bd8100a0 con 0x5643bd8a6800 2024-09-10T23:30:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59640/0 (socket says 172.21.15.2:59640) 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 -- 172.21.15.2:0/1455141834 learned_addr learned my addr 172.21.15.2:0/1455141834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f2902ffd640 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 -- 172.21.15.2:0/1455141834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 msgr2=0x5643bd8b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 -- 172.21.15.2:0/1455141834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 msgr2=0x5643bd8b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd8b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 -- 172.21.15.2:0/1455141834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643bd56a930 con 0x5643bd8a5ee0 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.138+0000 7f29027fc640 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a62c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f28f80123f0 tx=0x7f28f80128b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4fe1578d679d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f29089ab640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f28ec0b5360 0x7f28ec0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f28e9ffb640 1 -- 172.21.15.2:0/1455141834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8004d20 con 0x5643bd8a5ee0 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f28e9ffb640 1 -- 172.21.15.2:0/1455141834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28f8013970 con 0x5643bd8a5ee0 2024-09-10T23:30:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f28e9ffb640 1 -- 172.21.15.2:0/1455141834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8005410 con 0x5643bd8a5ee0 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f2902ffd640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f28ec0b5360 0x7f28ec0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f29089ab640 1 -- 172.21.15.2:0/2547742929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f28fc0e5540 con 0x7f290410d100 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f2902ffd640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f28ec0b5360 0x7f28ec0b7820 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000c00 tx=0x7f28f4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f290bd82740 1 -- 172.21.15.2:0/1455141834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 msgr2=0x5643bd8a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.139+0000 7f290bd82740 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a62c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f28f80123f0 tx=0x7f28f80128b0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 -- 172.21.15.2:0/1455141834 shutdown_connections 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd8b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 --2- 172.21.15.2:0/1455141834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a62c0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 -- 172.21.15.2:0/1455141834 >> 172.21.15.2:0/1455141834 conn(0x5643bd8a3d10 msgr2=0x5643bd8a4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 -- 172.21.15.2:0/1455141834 shutdown_connections 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 -- 172.21.15.2:0/1455141834 wait complete. 2024-09-10T23:30:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 -- start start 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.140+0000 7f290bd82740 1 Processor -- start 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8af790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a6800 0x5643bd8afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8b2790 0x5643bd8b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643bd66d890 con 0x5643bd8a5ee0 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5643bd7a6d40 con 0x5643bd8a6800 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5643bd8b5440 con 0x5643bd8b2790 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 10 client.0 _ll_register_callbacks cb 0x5643bd80ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8af790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59646/0 (socket says 172.21.15.2:59646) 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 -- 172.21.15.2:0/3785988627 learned_addr learned my addr 172.21.15.2:0/3785988627 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f29037fe640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8b2790 0x5643bd8b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f29027fc640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a6800 0x5643bd8afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 -- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8b2790 msgr2=0x5643bd8b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8b2790 0x5643bd8b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 -- 172.21.15.2:0/3785988627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a6800 msgr2=0x5643bd8afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a6800 0x5643bd8afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 -- 172.21.15.2:0/3785988627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643bd8be870 con 0x5643bd8a5ee0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f29037fe640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8b2790 0x5643bd8b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f29027fc640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a6800 0x5643bd8afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f2902ffd640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8af790 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009900 tx=0x7f28f4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51392d3f3cafecc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f28e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f28e2ffd640 1 -- 172.21.15.2:0/3785988627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f404d070 con 0x5643bd8a5ee0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f28e2ffd640 1 -- 172.21.15.2:0/3785988627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f28f4004cd0 con 0x5643bd8a5ee0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.141+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f8013970 con 0x5643bd8a5ee0 2024-09-10T23:30:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f28e2ffd640 1 -- 172.21.15.2:0/3785988627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f28f4059050 con 0x5643bd8a5ee0 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 10 client.17562 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643bd8c1200 con 0x5643bd8a5ee0 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f28e2ffd640 1 -- 172.21.15.2:0/3785988627 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28f8013970 con 0x5643bd8a5ee0 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f28e2ffd640 1 -- 172.21.15.2:0/3785988627 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f28f40325b0 con 0x5643bd8a5ee0 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 10 client.17562 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 10 client.17562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 20 client.17562 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd8c2660 0x5643bd8c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 4 client.17562 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643bd81edb0 con 0x5643bd8c2660 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.142+0000 7f29027fc640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd8c2660 0x5643bd8c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.143+0000 7f29027fc640 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd8c2660 0x5643bd8c4b00 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7020c71baf5e5bb5 server_cookie=e6ce0b36274f9e7e in_seq=0 out_seq=0 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.143+0000 7f28e2ffd640 10 client.17562 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.143+0000 7f28e2ffd640 1 -- 172.21.15.2:0/3785988627 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643bd81edb0 con 0x5643bd8c2660 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f28e2ffd640 10 client.17562 handle_command_reply: tid=0 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 client.17562 shutdown 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 msgr2=0x5643bd8af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8af790 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009900 tx=0x7f28f4009260 comp rx=0 tx=0).stop 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 shutdown_connections 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd8c2660 0x5643bd8c4b00 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8b2790 0x5643bd8b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a6800 0x5643bd8afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f28e2ffd640 0 client.17562 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 --2- 172.21.15.2:0/3785988627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8af790 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 >> 172.21.15.2:0/3785988627 conn(0x5643bd8a3d10 msgr2=0x5643bd8a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 shutdown_connections 2024-09-10T23:30:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 1 -- 172.21.15.2:0/3785988627 wait complete. 2024-09-10T23:30:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.144+0000 7f290bd82740 20 client.17562 trim_cache size 0 max 16384 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 Processor -- start 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 -- start start 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 0x5643bd8ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ae410 con 0x5643bd8b2790 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29041aff50 con 0x5643bd8a5ee0 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f290bd82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f29041aeae0 con 0x5643bd8a6800 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f29037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 0x5643bd8ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f29037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 0x5643bd8ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59654/0 (socket says 172.21.15.2:59654) 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f29037fe640 1 -- 172.21.15.2:0/3811811938 learned_addr learned my addr 172.21.15.2:0/3811811938 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.162+0000 7f29027fc640 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f2902ffd640 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29037fe640 1 -- 172.21.15.2:0/3811811938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 msgr2=0x5643bd8a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29037fe640 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29037fe640 1 -- 172.21.15.2:0/3811811938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a5ee0 msgr2=0x5643bd8a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29037fe640 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29037fe640 1 -- 172.21.15.2:0/3811811938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643bd8a3b40 con 0x5643bd8b2790 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29027fc640 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f29037fe640 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 0x5643bd8ac9a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009610 tx=0x7f28fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657140bb46de175a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f28e97fa640 1 -- 172.21.15.2:0/3811811938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc020040 con 0x5643bd8b2790 2024-09-10T23:30:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f28e97fa640 1 -- 172.21.15.2:0/3811811938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc0ac410 con 0x5643bd8b2790 2024-09-10T23:30:21.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.163+0000 7f28e97fa640 1 -- 172.21.15.2:0/3811811938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc005120 con 0x5643bd8b2790 2024-09-10T23:30:21.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 -- 172.21.15.2:0/3811811938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 msgr2=0x5643bd8ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 0x5643bd8ac9a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009610 tx=0x7f28fc000bc0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 -- 172.21.15.2:0/3811811938 shutdown_connections 2024-09-10T23:30:21.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8b2790 0x5643bd8ac9a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 --2- 172.21.15.2:0/3811811938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8a5ee0 0x5643bd8a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 -- 172.21.15.2:0/3811811938 >> 172.21.15.2:0/3811811938 conn(0x5643bd8a3d10 msgr2=0x5643bd8a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 -- 172.21.15.2:0/3811811938 shutdown_connections 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 -- 172.21.15.2:0/3811811938 wait complete. 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 -- start start 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.164+0000 7f290bd82740 1 Processor -- start 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd92b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29041af880 con 0x5643bd8a5ee0 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29041af1b0 con 0x5643bd8b2790 2024-09-10T23:30:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ac3f0 con 0x5643bd8a6800 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f290bd82740 10 client.0 _ll_register_callbacks cb 0x7f28f4004450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59668/0 (socket says 172.21.15.2:59668) 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f29027fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 -- 172.21.15.2:0/55259244 learned_addr learned my addr 172.21.15.2:0/55259244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f29037fe640 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd92b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 -- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 msgr2=0x5643bd8b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 -- 172.21.15.2:0/55259244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 msgr2=0x5643bd92b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd92b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 -- 172.21.15.2:0/55259244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643bd92bcd0 con 0x5643bd8a5ee0 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f2902ffd640 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8b7f30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f28f402a930 tx=0x7f28f40043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7086fd919ac87c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.165+0000 7f28e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f28e2ffd640 1 -- 172.21.15.2:0/55259244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4061070 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f28e2ffd640 1 -- 172.21.15.2:0/55259244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f28f40326b0 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28fc0ac410 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f28e2ffd640 1 -- 172.21.15.2:0/55259244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f28f406d050 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 10 client.17568 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643bd92d010 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f28e2ffd640 1 -- 172.21.15.2:0/55259244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc0ac410 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f28e2ffd640 1 -- 172.21.15.2:0/55259244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f28f4003c90 con 0x5643bd8a5ee0 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 10 client.17568 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 20 client.17568 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd935ba0 0x5643bd937f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 4 client.17568 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:30:21.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.166+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5643bd81a860 con 0x5643bd935ba0 2024-09-10T23:30:21.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.167+0000 7f29027fc640 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd935ba0 0x5643bd937f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.167+0000 7f28e2ffd640 10 client.17568 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:21.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.167+0000 7f29027fc640 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd935ba0 0x5643bd937f90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6c4828943cf96f server_cookie=da21ba16cffcffe3 in_seq=0 out_seq=0 2024-09-10T23:30:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.168+0000 7f28e2ffd640 1 -- 172.21.15.2:0/55259244 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5643bd81a860 con 0x5643bd935ba0 2024-09-10T23:30:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f28e2ffd640 10 client.17568 handle_command_reply: tid=0 2024-09-10T23:30:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 client.17568 shutdown 2024-09-10T23:30:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 msgr2=0x5643bd8b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8b7f30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f28f402a930 tx=0x7f28f40043a0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 shutdown_connections 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5643bd935ba0 0x5643bd937f90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643bd8b2790 0x5643bd92b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5643bd8a6800 0x5643bd8b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 --2- 172.21.15.2:0/55259244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643bd8a5ee0 0x5643bd8b7f30 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 >> 172.21.15.2:0/55259244 conn(0x5643bd8a3d10 msgr2=0x5643bd8a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f28e2ffd640 0 client.17568 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 shutdown_connections 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 1 -- 172.21.15.2:0/55259244 wait complete. 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.169+0000 7f290bd82740 20 client.17568 trim_cache size 0 max 16384 2024-09-10T23:30:21.175 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:30:21.176 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:30:21.176 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "32e5e900-25de-4eae-a23d-81ec44329fc7", 2024-09-10T23:30:21.176 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:30:21.176 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:30:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f28ec0b5360 msgr2=0x7f28ec0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f28ec0b5360 0x7f28ec0b7820 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000c00 tx=0x7f28f4005b50 comp rx=0 tx=0).stop 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 msgr2=0x7f290419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 0x7f290419eb70 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d750 tx=0x7f28fc00dc10 comp rx=0 tx=0).stop 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 shutdown_connections 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f28ec0b5360 0x7f28ec0b7820 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f290410d100 0x7f290419eb70 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29041045c0 0x7f29041997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 --2- 172.21.15.2:0/2547742929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2904103ca0 0x7f2904199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 >> 172.21.15.2:0/2547742929 conn(0x7f29040fd700 msgr2=0x7f290410f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 shutdown_connections 2024-09-10T23:30:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:21.170+0000 7f29099ad640 1 -- 172.21.15.2:0/2547742929 wait complete. 2024-09-10T23:30:22.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:21 smithi002 ceph-mon[31150]: pgmap v532: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:22.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:30:22.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:22.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:30:22.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:22.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:30:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:21 smithi177 ceph-mon[35760]: pgmap v532: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:30:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:30:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:21 smithi154 ceph-mon[35136]: pgmap v532: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:30:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:30:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:30:22.297 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 -- 172.21.15.2:0/2815971712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120108020 msgr2=0x7f012010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 --2- 172.21.15.2:0/2815971712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120108020 0x7f012010e820 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f0118009ca0 tx=0x7f011802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 -- 172.21.15.2:0/2815971712 shutdown_connections 2024-09-10T23:30:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 --2- 172.21.15.2:0/2815971712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120108020 0x7f012010e820 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 --2- 172.21.15.2:0/2815971712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01201076a0 0x7f0120107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 --2- 172.21.15.2:0/2815971712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120101c90 0x7f0120102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 -- 172.21.15.2:0/2815971712 >> 172.21.15.2:0/2815971712 conn(0x7f01200fd700 msgr2=0x7f01200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 -- 172.21.15.2:0/2815971712 shutdown_connections 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 -- 172.21.15.2:0/2815971712 wait complete. 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 Processor -- start 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.773+0000 7f012752f640 1 -- start start 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 0x7f01200fde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01201076a0 0x7f01200fe360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120108020 0x7f01200fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0120111ca0 con 0x7f0120101c90 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0120111b20 con 0x7f01201076a0 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0120111e20 con 0x7f0120108020 2024-09-10T23:30:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 0x7f01200fde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 0x7f01200fde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59694/0 (socket says 172.21.15.2:59694) 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 -- 172.21.15.2:0/2489759918 learned_addr learned my addr 172.21.15.2:0/2489759918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f0124aca640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01201076a0 0x7f01200fe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f0125acc640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120108020 0x7f01200fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 -- 172.21.15.2:0/2489759918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120108020 msgr2=0x7f01200fe8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120108020 0x7f01200fe8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 -- 172.21.15.2:0/2489759918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01201076a0 msgr2=0x7f01200fe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01201076a0 0x7f01200fe360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 -- 172.21.15.2:0/2489759918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01201a75e0 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f0125acc640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120108020 0x7f01200fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01252cb640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 0x7f01200fde20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c920 tx=0x7f011c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01167fc640 1 -- 172.21.15.2:0/2489759918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c007c70 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01167fc640 1 -- 172.21.15.2:0/2489759918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f011c007e10 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01201a78d0 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.774+0000 7f01167fc640 1 -- 172.21.15.2:0/2489759918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c018820 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.775+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01201a7e60 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 Processor -- start 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f01167fc640 1 -- 172.21.15.2:0/2489759918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f011c00f450 con 0x7f0120101c90 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 -- start start 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94980a0 0x55a6e9498480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 0x55a6e94a4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94a4950 0x55a6e94a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a6e940ee50 con 0x55a6e94989c0 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a6e93fe280 con 0x55a6e94980a0 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f0129904740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a6e9402090 con 0x55a6e94a4950 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.777+0000 7f01252cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 0x55a6e94a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 0x55a6e94a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59706/0 (socket says 172.21.15.2:59706) 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 -- 172.21.15.2:0/1763714174 learned_addr learned my addr 172.21.15.2:0/1763714174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f0125acc640 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94980a0 0x55a6e9498480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f0124aca640 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94a4950 0x55a6e94a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 -- 172.21.15.2:0/1763714174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94a4950 msgr2=0x55a6e94a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94a4950 0x55a6e94a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 -- 172.21.15.2:0/1763714174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94980a0 msgr2=0x55a6e9498480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94980a0 0x55a6e9498480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 -- 172.21.15.2:0/1763714174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6e915c650 con 0x55a6e94989c0 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01252cb640 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 0x55a6e94a4410 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f011c0e9ed0 tx=0x7f011c0ee430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9042152a83f13d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f010b7fe640 1 -- 172.21.15.2:0/1763714174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c0eee60 con 0x55a6e94989c0 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f01167fc640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f010c0b5360 0x7f010c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f010b7fe640 1 -- 172.21.15.2:0/1763714174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f011c0ac010 con 0x55a6e94989c0 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f010b7fe640 1 -- 172.21.15.2:0/1763714174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c0abc70 con 0x55a6e94989c0 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.778+0000 7f0125acc640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f010c0b5360 0x7f010c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f01167fc640 1 -- 172.21.15.2:0/2489759918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f011c0e5d30 con 0x7f0120101c90 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 -- 172.21.15.2:0/1763714174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 msgr2=0x55a6e94a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0125acc640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f010c0b5360 0x7f010c0b7820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0118004af0 tx=0x7f0118005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 0x55a6e94a4410 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f011c0e9ed0 tx=0x7f011c0ee430 comp rx=0 tx=0).stop 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 -- 172.21.15.2:0/1763714174 shutdown_connections 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94a4950 0x55a6e94a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94989c0 0x55a6e94a4410 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 --2- 172.21.15.2:0/1763714174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94980a0 0x55a6e9498480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 -- 172.21.15.2:0/1763714174 >> 172.21.15.2:0/1763714174 conn(0x55a6e9495ed0 msgr2=0x55a6e9497070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 -- 172.21.15.2:0/1763714174 shutdown_connections 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 -- 172.21.15.2:0/1763714174 wait complete. 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.779+0000 7f0129904740 1 -- start start 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 Processor -- start 2024-09-10T23:30:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 0x55a6e94a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94989c0 0x55a6e94a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94a4950 0x55a6e94a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a6e925f700 con 0x55a6e94980a0 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a6e9399110 con 0x55a6e94a4950 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a6e94a75d0 con 0x55a6e94989c0 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0129904740 10 client.0 _ll_register_callbacks cb 0x55a6e93b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 0x55a6e94a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 0x55a6e94a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59720/0 (socket says 172.21.15.2:59720) 2024-09-10T23:30:22.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 -- 172.21.15.2:0/2992643784 learned_addr learned my addr 172.21.15.2:0/2992643784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:22.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0125acc640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94a4950 0x55a6e94a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0124aca640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94989c0 0x55a6e94a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 -- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94989c0 msgr2=0x55a6e94a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94989c0 0x55a6e94a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 -- 172.21.15.2:0/2992643784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94a4950 msgr2=0x55a6e94a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94a4950 0x55a6e94a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f01252cb640 1 -- 172.21.15.2:0/2992643784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6e93c6c40 con 0x55a6e94980a0 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0125acc640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94a4950 0x55a6e94a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.780+0000 7f0124aca640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94989c0 0x55a6e94a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f01252cb640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 0x55a6e94a41b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ac200 tx=0x7f011c00fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6053e63a4711e5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0108ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:22.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0108ff9640 1 -- 172.21.15.2:0/2992643784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c0c48a0 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0108ff9640 1 -- 172.21.15.2:0/2992643784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f011c00f770 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f011c0ac010 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0108ff9640 1 -- 172.21.15.2:0/2992643784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f011c0c3f70 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 10 client.17580 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6e94b2eb0 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0108ff9640 1 -- 172.21.15.2:0/2992643784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f011c0ac010 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0108ff9640 1 -- 172.21.15.2:0/2992643784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f011c0f5070 con 0x55a6e94980a0 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 10 client.17580 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 20 client.17580 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:22.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e94b4200 0x55a6e94b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 4 client.17580 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.781+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6e9410da0 con 0x55a6e94b4200 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.782+0000 7f0124aca640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e94b4200 0x55a6e94b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.782+0000 7f0108ff9640 10 client.17580 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.782+0000 7f0124aca640 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e94b4200 0x55a6e94b65f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b195b900f2f5c0a3 server_cookie=fe77e011e653d25c in_seq=0 out_seq=0 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0108ff9640 1 -- 172.21.15.2:0/2992643784 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a6e9410da0 con 0x55a6e94b4200 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0108ff9640 10 client.17580 handle_command_reply: tid=0 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 client.17580 shutdown 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 msgr2=0x55a6e94a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 0x55a6e94a41b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ac200 tx=0x7f011c00fd60 comp rx=0 tx=0).stop 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 shutdown_connections 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e94b4200 0x55a6e94b65f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94a4950 0x55a6e94a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94989c0 0x55a6e94a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 --2- 172.21.15.2:0/2992643784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94980a0 0x55a6e94a41b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0108ff9640 0 client.17580 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 >> 172.21.15.2:0/2992643784 conn(0x55a6e9495ed0 msgr2=0x55a6e949ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 shutdown_connections 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 1 -- 172.21.15.2:0/2992643784 wait complete. 2024-09-10T23:30:22.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.783+0000 7f0129904740 20 client.17580 trim_cache size 0 max 16384 2024-09-10T23:30:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 Processor -- start 2024-09-10T23:30:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 -- start start 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e9496f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e949b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e949bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01201b0530 con 0x55a6e94a4950 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01201b2070 con 0x55a6e94989c0 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.801+0000 7f0129904740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01201b0c00 con 0x55a6e94980a0 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e949bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e949bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59724/0 (socket says 172.21.15.2:59724) 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 -- 172.21.15.2:0/98373896 learned_addr learned my addr 172.21.15.2:0/98373896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f01252cb640 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e9496f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0124aca640 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e949b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 -- 172.21.15.2:0/98373896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 msgr2=0x55a6e9496f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e9496f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 -- 172.21.15.2:0/98373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 msgr2=0x55a6e949b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e949b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 -- 172.21.15.2:0/98373896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6e94987f0 con 0x55a6e94a4950 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f0125acc640 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e949bde0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f0118032ed0 tx=0x7f0118040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b5713f576849cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f010affd640 1 -- 172.21.15.2:0/98373896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180318e0 con 0x55a6e94a4950 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f010affd640 1 -- 172.21.15.2:0/98373896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0118036050 con 0x55a6e94a4950 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.802+0000 7f010affd640 1 -- 172.21.15.2:0/98373896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118004310 con 0x55a6e94a4950 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 -- 172.21.15.2:0/98373896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 msgr2=0x55a6e949bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e949bde0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f0118032ed0 tx=0x7f0118040000 comp rx=0 tx=0).stop 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 -- 172.21.15.2:0/98373896 shutdown_connections 2024-09-10T23:30:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e949bde0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e949b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 --2- 172.21.15.2:0/98373896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e9496f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 -- 172.21.15.2:0/98373896 >> 172.21.15.2:0/98373896 conn(0x55a6e9495ed0 msgr2=0x55a6e949b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 -- 172.21.15.2:0/98373896 shutdown_connections 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 -- 172.21.15.2:0/98373896 wait complete. 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 -- start start 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.803+0000 7f0129904740 1 Processor -- start 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e94b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e94b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e94b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01201b19a0 con 0x55a6e94a4950 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01201b12d0 con 0x55a6e94989c0 2024-09-10T23:30:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01201ae510 con 0x55a6e94980a0 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0129904740 10 client.0 _ll_register_callbacks cb 0x7f0118009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e94b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f01252cb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e94b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0124aca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e94b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e94b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59740/0 (socket says 172.21.15.2:59740) 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 -- 172.21.15.2:0/1307363608 learned_addr learned my addr 172.21.15.2:0/1307363608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 -- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 msgr2=0x55a6e94b9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e94b9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 -- 172.21.15.2:0/1307363608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 msgr2=0x55a6e94b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e94b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.804+0000 7f0125acc640 1 -- 172.21.15.2:0/1307363608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6e94b7420 con 0x55a6e94a4950 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0125acc640 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e94b6c20 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f0118005e30 tx=0x7f0118003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e228bfe8b9ff2cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0108ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0108ff9640 1 -- 172.21.15.2:0/1307363608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118060060 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0108ff9640 1 -- 172.21.15.2:0/1307363608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0118004190 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0118036050 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0108ff9640 1 -- 172.21.15.2:0/1307363608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01180318e0 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 10 client.17586 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6e9521eb0 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0108ff9640 1 -- 172.21.15.2:0/1307363608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0118036050 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0108ff9640 1 -- 172.21.15.2:0/1307363608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0118030ae0 con 0x55a6e94a4950 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 10 client.17586 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 10 client.17586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 20 client.17586 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e95225d0 0x55a6e95249f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 4 client.17586 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.805+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a6e940c850 con 0x55a6e95225d0 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.806+0000 7f01252cb640 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e95225d0 0x55a6e95249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.806+0000 7f01252cb640 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e95225d0 0x55a6e95249f0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e249f20fc041a13b server_cookie=bf404cfbaffe0636 in_seq=0 out_seq=0 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.806+0000 7f0108ff9640 10 client.17586 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.806+0000 7f0108ff9640 1 -- 172.21.15.2:0/1307363608 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55a6e940c850 con 0x55a6e95225d0 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0108ff9640 10 client.17586 handle_command_reply: tid=0 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 client.17586 shutdown 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 msgr2=0x55a6e94b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e94b6c20 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f0118005e30 tx=0x7f0118003fb0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 shutdown_connections 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55a6e95225d0 0x55a6e95249f0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6e94a4950 0x55a6e94b6c20 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a6e94989c0 0x55a6e94b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 --2- 172.21.15.2:0/1307363608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a6e94980a0 0x55a6e94b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 >> 172.21.15.2:0/1307363608 conn(0x55a6e9495ed0 msgr2=0x55a6e949b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0108ff9640 0 client.17586 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 shutdown_connections 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 1 -- 172.21.15.2:0/1307363608 wait complete. 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.807+0000 7f0129904740 20 client.17586 trim_cache size 0 max 16384 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:30:22.816 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "32e5e900-25de-4eae-a23d-81ec44329fc7", 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.818 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:30:22.818 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:30:22.818 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.818 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.818 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:30:22.819 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.820 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.821 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.822 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.823 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.824 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:22.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:22.826 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:30:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f010c0b5360 msgr2=0x7f010c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f010c0b5360 0x7f010c0b7820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0118004af0 tx=0x7f0118005da0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 msgr2=0x7f01200fde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 0x7f01200fde20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c920 tx=0x7f011c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 shutdown_connections 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f010c0b5360 0x7f010c0b7820 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0120108020 0x7f01200fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01201076a0 0x7f01200fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 --2- 172.21.15.2:0/2489759918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0120101c90 0x7f01200fde20 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 >> 172.21.15.2:0/2489759918 conn(0x7f01200fd700 msgr2=0x7f012006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 shutdown_connections 2024-09-10T23:30:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:22.808+0000 7f012752f640 1 -- 172.21.15.2:0/2489759918 wait complete. 2024-09-10T23:30:23.614 INFO:tasks.cephfs.filesystem:scrub status for tag:32e5e900-25de-4eae-a23d-81ec44329fc7 - {'path': '/', 'tag': '32e5e900-25de-4eae-a23d-81ec44329fc7', 'options': 'recursive,force'} 2024-09-10T23:30:24.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:23 smithi177 ceph-mon[35760]: pgmap v533: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:30:24.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:23 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:30:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:23 smithi002 ceph-mon[31150]: pgmap v533: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:30:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:23 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:30:24.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:23 smithi154 ceph-mon[35136]: pgmap v533: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:30:24.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:23 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:30:26.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:25 smithi177 ceph-mon[35760]: pgmap v534: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:25 smithi002 ceph-mon[31150]: pgmap v534: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:25 smithi154 ceph-mon[35136]: pgmap v534: 97 pgs: 97 active+clean; 4.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 -- 172.21.15.2:0/3715756762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5688102a00 msgr2=0x7f5688102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 --2- 172.21.15.2:0/3715756762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5688102a00 0x7f5688102e80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5670009930 tx=0x7f567002a420 comp rx=0 tx=0).stop 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 -- 172.21.15.2:0/3715756762 shutdown_connections 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 --2- 172.21.15.2:0/3715756762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56881033c0 0x7f5688109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 --2- 172.21.15.2:0/3715756762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5688102a00 0x7f5688102e80 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 --2- 172.21.15.2:0/3715756762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56881018b0 0x7f5688101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.649+0000 7f568dced640 1 -- 172.21.15.2:0/3715756762 >> 172.21.15.2:0/3715756762 conn(0x7f56880fd150 msgr2=0x7f56880ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.650+0000 7f568dced640 1 -- 172.21.15.2:0/3715756762 shutdown_connections 2024-09-10T23:30:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.650+0000 7f568dced640 1 -- 172.21.15.2:0/3715756762 wait complete. 2024-09-10T23:30:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.650+0000 7f568dced640 1 Processor -- start 2024-09-10T23:30:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.650+0000 7f568dced640 1 -- start start 2024-09-10T23:30:27.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f568dced640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56881018b0 0x7f5688198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f568dced640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5688102a00 0x7f5688199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f568dced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 0x7f568819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f568dced640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f568810d500 con 0x7f56881033c0 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f568dced640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f568810d380 con 0x7f56881018b0 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f568dced640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f568810d680 con 0x7f5688102a00 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 0x7f568819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 0x7f568819a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59754/0 (socket says 172.21.15.2:59754) 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 -- 172.21.15.2:0/4283840333 learned_addr learned my addr 172.21.15.2:0/4283840333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f567effd640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5688102a00 0x7f5688199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f56877fe640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56881018b0 0x7f5688198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 -- 172.21.15.2:0/4283840333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5688102a00 msgr2=0x7f5688199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5688102a00 0x7f5688199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 -- 172.21.15.2:0/4283840333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56881018b0 msgr2=0x7f5688198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56881018b0 0x7f5688198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 -- 172.21.15.2:0/4283840333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568819a940 con 0x7f56881033c0 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f5687fff640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 0x7f568819a080 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f568000eaa0 tx=0x7f568000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.651+0000 7f56857fa640 1 -- 172.21.15.2:0/4283840333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568000cdb0 con 0x7f56881033c0 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.652+0000 7f56857fa640 1 -- 172.21.15.2:0/4283840333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5680005020 con 0x7f56881033c0 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.652+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568819ac30 con 0x7f56881033c0 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.652+0000 7f56857fa640 1 -- 172.21.15.2:0/4283840333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56800116d0 con 0x7f56881033c0 2024-09-10T23:30:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.652+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56881a1300 con 0x7f56881033c0 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.654+0000 7f5690ab9740 1 Processor -- start 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.654+0000 7f56857fa640 1 -- 172.21.15.2:0/4283840333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f568000f040 con 0x7f56881033c0 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 -- start start 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9109ff860 0x55c910a01c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a04580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 0x55c910a07090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9109716f0 con 0x55c910a04bd0 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c910960b20 con 0x55c910a02190 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f5690ab9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c910964930 con 0x55c9109ff860 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 0x55c910a07090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 0x55c910a07090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59758/0 (socket says 172.21.15.2:59758) 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 -- 172.21.15.2:0/3655924686 learned_addr learned my addr 172.21.15.2:0/3655924686 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9109ff860 0x55c910a01c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f56877fe640 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a04580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 -- 172.21.15.2:0/3655924686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9109ff860 msgr2=0x55c910a01c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9109ff860 0x55c910a01c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 -- 172.21.15.2:0/3655924686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 msgr2=0x55c910a04580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a04580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.655+0000 7f567effd640 1 -- 172.21.15.2:0/3655924686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c910926530 con 0x55c910a04bd0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f56857fa640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f56740b52e0 0x7f56740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f567effd640 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 0x55c910a07090 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f5670000c00 tx=0x7f56700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a8501c6da8864a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f56877fe640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f56740b52e0 0x7f56740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f567dffb640 1 -- 172.21.15.2:0/3655924686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670035070 con 0x55c910a04bd0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f567dffb640 1 -- 172.21.15.2:0/3655924686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670005030 con 0x55c910a04bd0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f56857fa640 1 -- 172.21.15.2:0/4283840333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f56800e59c0 con 0x7f56881033c0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.656+0000 7f567dffb640 1 -- 172.21.15.2:0/3655924686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56700049e0 con 0x55c910a04bd0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 -- 172.21.15.2:0/3655924686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 msgr2=0x55c910a07090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f56877fe640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f56740b52e0 0x7f56740b77a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5678004610 tx=0x7f567800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 0x55c910a07090 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f5670000c00 tx=0x7f56700046c0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 -- 172.21.15.2:0/3655924686 shutdown_connections 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c910a04bd0 0x55c910a07090 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a04580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 --2- 172.21.15.2:0/3655924686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9109ff860 0x55c910a01c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 -- 172.21.15.2:0/3655924686 >> 172.21.15.2:0/3655924686 conn(0x55c9109fa9b0 msgr2=0x55c9109fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 -- 172.21.15.2:0/3655924686 shutdown_connections 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 -- 172.21.15.2:0/3655924686 wait complete. 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 -- start start 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.657+0000 7f5690ab9740 1 Processor -- start 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a0e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c910898ab0 con 0x55c9109ff860 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c910906730 con 0x55c910a02190 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c910a0bed0 con 0x55c910a04bd0 2024-09-10T23:30:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5690ab9740 10 client.0 _ll_register_callbacks cb 0x55c91095a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59774/0 (socket says 172.21.15.2:59774) 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 -- 172.21.15.2:0/2188263753 learned_addr learned my addr 172.21.15.2:0/2188263753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5687fff640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a0e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f567effd640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 -- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 msgr2=0x55c910a0e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a0e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 -- 172.21.15.2:0/2188263753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 msgr2=0x55c910a0d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 -- 172.21.15.2:0/2188263753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9106c2790 con 0x55c9109ff860 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5687fff640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a0e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f56877fe640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0d2c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f56780058a0 tx=0x7f5678004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73f5a26a375718e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.658+0000 7f5666ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5666ffd640 1 -- 172.21.15.2:0/2188263753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567802c060 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5666ffd640 1 -- 172.21.15.2:0/2188263753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5678017030 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5670005030 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5666ffd640 1 -- 172.21.15.2:0/2188263753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5678027410 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 10 client.17598 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c91073b620 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5666ffd640 1 -- 172.21.15.2:0/2188263753 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670005030 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5666ffd640 1 -- 172.21.15.2:0/2188263753 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56780115d0 con 0x55c9109ff860 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 10 client.17598 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 10 client.17598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 20 client.17598 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a18bb0 0x55c910a1b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 4 client.17598 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.659+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c910973640 con 0x55c910a18bb0 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.660+0000 7f567effd640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a18bb0 0x55c910a1b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.660+0000 7f567effd640 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a18bb0 0x55c910a1b030 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de7bdffc33706931 server_cookie=6cbfeeeea6c0d43c in_seq=0 out_seq=0 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.660+0000 7f5666ffd640 10 client.17598 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5666ffd640 1 -- 172.21.15.2:0/2188263753 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c910973640 con 0x55c910a18bb0 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5666ffd640 10 client.17598 handle_command_reply: tid=0 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 client.17598 shutdown 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 msgr2=0x55c910a0d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0d2c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f56780058a0 tx=0x7f5678004730 comp rx=0 tx=0).stop 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 shutdown_connections 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a18bb0 0x55c910a1b030 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a0e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5666ffd640 0 client.17598 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2188263753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0d2c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 >> 172.21.15.2:0/2188263753 conn(0x55c9109fa9b0 msgr2=0x55c9109f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 shutdown_connections 2024-09-10T23:30:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 1 -- 172.21.15.2:0/2188263753 wait complete. 2024-09-10T23:30:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.661+0000 7f5690ab9740 20 client.17598 trim_cache size 0 max 16384 2024-09-10T23:30:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 Processor -- start 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 -- start start 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a05020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56881a7da0 con 0x55c9109ff860 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56881a98e0 con 0x55c910a02190 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f5690ab9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56881a8470 con 0x55c910a04bd0 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.676+0000 7f56877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59778/0 (socket says 172.21.15.2:59778) 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 -- 172.21.15.2:0/1753836399 learned_addr learned my addr 172.21.15.2:0/1753836399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f5687fff640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a05020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 -- 172.21.15.2:0/1753836399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 msgr2=0x55c910a05020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f567effd640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a05020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 -- 172.21.15.2:0/1753836399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 msgr2=0x55c910a0c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 -- 172.21.15.2:0/1753836399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c910a17520 con 0x55c9109ff860 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f5687fff640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a05020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f567effd640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f56877fe640 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0c2f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f56780059f0 tx=0x7f567800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e82bc6118316e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f567d7fa640 1 -- 172.21.15.2:0/1753836399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678037070 con 0x55c9109ff860 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f567d7fa640 1 -- 172.21.15.2:0/1753836399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5678011e60 con 0x55c9109ff860 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.677+0000 7f567d7fa640 1 -- 172.21.15.2:0/1753836399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678033450 con 0x55c9109ff860 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 -- 172.21.15.2:0/1753836399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 msgr2=0x55c910a0c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0c2f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f56780059f0 tx=0x7f567800be50 comp rx=0 tx=0).stop 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 -- 172.21.15.2:0/1753836399 shutdown_connections 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a04bd0 0x55c910a05020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a02190 0x55c910a0c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 --2- 172.21.15.2:0/1753836399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a0c2f0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 -- 172.21.15.2:0/1753836399 >> 172.21.15.2:0/1753836399 conn(0x55c9109fa9b0 msgr2=0x55c9109fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 -- 172.21.15.2:0/1753836399 shutdown_connections 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 -- 172.21.15.2:0/1753836399 wait complete. 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 -- start start 2024-09-10T23:30:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.678+0000 7f5690ab9740 1 Processor -- start 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a02190 0x55c910a15040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a04bd0 0x55c910a137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56881a9210 con 0x55c9109ff860 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56881a8b40 con 0x55c910a04bd0 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56881a5d80 con 0x55c910a02190 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 10 client.0 _ll_register_callbacks cb 0x7f5678004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a149a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59782/0 (socket says 172.21.15.2:59782) 2024-09-10T23:30:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 -- 172.21.15.2:0/2312745165 learned_addr learned my addr 172.21.15.2:0/2312745165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f567effd640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a02190 0x55c910a15040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5687fff640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a04bd0 0x55c910a137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 -- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a02190 msgr2=0x55c910a15040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a02190 0x55c910a15040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 -- 172.21.15.2:0/2312745165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a04bd0 msgr2=0x55c910a137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a04bd0 0x55c910a137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 -- 172.21.15.2:0/2312745165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c910a13ff0 con 0x55c9109ff860 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5687fff640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a04bd0 0x55c910a137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f56877fe640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a149a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5678005b90 tx=0x7f5678003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a31b7d14370160d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5666ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5666ffd640 1 -- 172.21.15.2:0/2312745165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567803f070 con 0x55c9109ff860 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5666ffd640 1 -- 172.21.15.2:0/2312745165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f56780277b0 con 0x55c9109ff860 2024-09-10T23:30:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.679+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5678011e60 con 0x55c9109ff860 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5666ffd640 1 -- 172.21.15.2:0/2312745165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f567804b050 con 0x55c9109ff860 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 10 client.17604 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c910a12ff0 con 0x55c9109ff860 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5666ffd640 1 -- 172.21.15.2:0/2312745165 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5678011e60 con 0x55c9109ff860 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5666ffd640 1 -- 172.21.15.2:0/2312745165 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56780046d0 con 0x55c9109ff860 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 10 client.17604 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 10 client.17604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 20 client.17604 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a85fe0 0x55c910a88400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 4 client.17604 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c91096f0f0 con 0x55c910a85fe0 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.680+0000 7f567effd640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a85fe0 0x55c910a88400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.681+0000 7f567effd640 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a85fe0 0x55c910a88400 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9329247797901389 server_cookie=6756d1b1cc68240d in_seq=0 out_seq=0 2024-09-10T23:30:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.681+0000 7f5666ffd640 10 client.17604 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5666ffd640 1 -- 172.21.15.2:0/2312745165 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c91096f0f0 con 0x55c910a85fe0 2024-09-10T23:30:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5666ffd640 10 client.17604 handle_command_reply: tid=0 2024-09-10T23:30:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 client.17604 shutdown 2024-09-10T23:30:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 msgr2=0x55c910a149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a149a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5678005b90 tx=0x7f5678003ce0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 shutdown_connections 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55c910a85fe0 0x55c910a88400 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c910a04bd0 0x55c910a137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c910a02190 0x55c910a15040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 --2- 172.21.15.2:0/2312745165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9109ff860 0x55c910a149a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5666ffd640 0 client.17604 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.695+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 >> 172.21.15.2:0/2312745165 conn(0x55c9109fa9b0 msgr2=0x55c9109fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 shutdown_connections 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f5690ab9740 1 -- 172.21.15.2:0/2312745165 wait complete. 2024-09-10T23:30:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f5690ab9740 20 client.17604 trim_cache size 0 max 16384 2024-09-10T23:30:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:30:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:30:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:30:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:30:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f56740b52e0 msgr2=0x7f56740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f56740b52e0 0x7f56740b77a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5678004610 tx=0x7f567800b390 comp rx=0 tx=0).stop 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 msgr2=0x7f568819a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 0x7f568819a080 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f568000eaa0 tx=0x7f568000ef60 comp rx=0 tx=0).stop 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 shutdown_connections 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f56740b52e0 0x7f56740b77a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56881033c0 0x7f568819a080 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5688102a00 0x7f5688199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 --2- 172.21.15.2:0/4283840333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56881018b0 0x7f5688198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 >> 172.21.15.2:0/4283840333 conn(0x7f56880fd150 msgr2=0x7f56880fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 shutdown_connections 2024-09-10T23:30:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:27.696+0000 7f568dced640 1 -- 172.21.15.2:0/4283840333 wait complete. 2024-09-10T23:30:28.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:27 smithi177 ceph-mon[35760]: pgmap v535: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-09-10T23:30:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:27 smithi002 ceph-mon[31150]: pgmap v535: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-09-10T23:30:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:27 smithi154 ceph-mon[35136]: pgmap v535: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-09-10T23:30:29.864 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:251/600: open fd = 3 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:252/600: open fd = 3 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.866 INFO:tasks.workunit.client.0.smithi002.stdout:253/600: open fd = 3 2024-09-10T23:30:29.866 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.866 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.866 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.866 INFO:tasks.workunit.client.0.smithi002.stdout:254/600: open fd = 3 2024-09-10T23:30:29.866 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.867 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.867 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.867 INFO:tasks.workunit.client.0.smithi002.stdout:255/600: open fd = 3 2024-09-10T23:30:29.867 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.867 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.867 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.868 INFO:tasks.workunit.client.0.smithi002.stdout:256/600: open fd = 3 2024-09-10T23:30:29.868 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.868 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.868 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.868 INFO:tasks.workunit.client.0.smithi002.stdout:257/600: open fd = 3 2024-09-10T23:30:29.869 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.869 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.869 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.869 INFO:tasks.workunit.client.0.smithi002.stdout:258/600: open fd = 3 2024-09-10T23:30:29.869 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.869 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:259/600: open fd = 3 2024-09-10T23:30:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:260/600: open fd = 3 2024-09-10T23:30:29.871 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.871 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.871 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.871 INFO:tasks.workunit.client.0.smithi002.stdout:261/600: open fd = 3 2024-09-10T23:30:29.871 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.871 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.872 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.872 INFO:tasks.workunit.client.0.smithi002.stdout:262/600: open fd = 3 2024-09-10T23:30:29.872 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.872 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.872 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.872 INFO:tasks.workunit.client.0.smithi002.stdout:263/600: open fd = 3 2024-09-10T23:30:29.873 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.873 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.873 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.873 INFO:tasks.workunit.client.0.smithi002.stdout:264/600: open fd = 3 2024-09-10T23:30:29.873 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.873 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.874 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.874 INFO:tasks.workunit.client.0.smithi002.stdout:265/600: open fd = 3 2024-09-10T23:30:29.874 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.874 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.874 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:266/600: open fd = 3 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:267/600: open fd = 3 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:268/600: open fd = 3 2024-09-10T23:30:29.875 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:269/600: open fd = 3 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:270/600: open fd = 3 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.876 INFO:tasks.workunit.client.0.smithi002.stdout:271/600: open fd = 3 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:272/600: open fd = 3 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:273/600: open fd = 3 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.877 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:274/600: open fd = 3 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:275/600: open fd = 3 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:276/600: open fd = 3 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.878 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:277/600: open fd = 3 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:278/600: open fd = 3 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:279/600: open fd = 3 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:280/600: open fd = 3 2024-09-10T23:30:29.879 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:281/600: open fd = 3 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:282/600: open fd = 3 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.880 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:283/600: open fd = 3 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:284/600: open fd = 3 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:285/600: open fd = 3 2024-09-10T23:30:29.881 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:286/600: open fd = 3 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:287/600: open fd = 3 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:288/600: open fd = 3 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.882 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:289/600: open fd = 3 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:290/600: open fd = 3 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:291/600: open fd = 3 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.883 INFO:tasks.workunit.client.0.smithi002.stdout:292/600: open fd = 3 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:293/600: open fd = 3 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:294/600: open fd = 3 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.884 INFO:tasks.workunit.client.0.smithi002.stdout:295/600: open fd = 3 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:296/600: open fd = 3 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:297/600: open fd = 3 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:298/600: open fd = 3 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.885 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:299/600: open fd = 3 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:300/600: open fd = 3 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:301/600: open fd = 3 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.886 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:302/600: open fd = 3 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:303/600: open fd = 3 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:304/600: open fd = 3 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.887 INFO:tasks.workunit.client.0.smithi002.stdout:305/600: open fd = 3 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:306/600: open fd = 3 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:307/600: open fd = 3 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:308/600: open fd = 3 2024-09-10T23:30:29.888 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:309/600: open fd = 3 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:310/600: open fd = 3 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:311/600: open fd = 3 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:30:29.890 INFO:tasks.workunit.client.0.smithi002.stdout:312/600: open fd = 3 2024-09-10T23:30:29.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:29.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:30:30.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:29 smithi177 ceph-mon[35760]: pgmap v536: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-10T23:30:30.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:29 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:29 smithi002 ceph-mon[31150]: pgmap v536: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-10T23:30:30.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:29 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:29 smithi154 ceph-mon[35136]: pgmap v536: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-10T23:30:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:29 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:31.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:30 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:31.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:30 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:31.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:30 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:30:31.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:30 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:31.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:30 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:31.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:30 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:30:31.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:30 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:31.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:30 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:31.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:30 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:30:32.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:31 smithi177 ceph-mon[35760]: pgmap v537: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-10T23:30:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:31 smithi002 ceph-mon[31150]: pgmap v537: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-10T23:30:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:31 smithi154 ceph-mon[35136]: pgmap v537: 97 pgs: 97 active+clean; 4.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-10T23:30:34.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:33 smithi177 ceph-mon[35760]: pgmap v538: 97 pgs: 97 active+clean; 715 KiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T23:30:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:33 smithi002 ceph-mon[31150]: pgmap v538: 97 pgs: 97 active+clean; 715 KiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T23:30:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:33 smithi154 ceph-mon[35136]: pgmap v538: 97 pgs: 97 active+clean; 715 KiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T23:30:36.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:35 smithi177 ceph-mon[35760]: pgmap v539: 97 pgs: 97 active+clean; 715 KiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 20 op/s 2024-09-10T23:30:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:35 smithi002 ceph-mon[31150]: pgmap v539: 97 pgs: 97 active+clean; 715 KiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 20 op/s 2024-09-10T23:30:36.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:35 smithi154 ceph-mon[35136]: pgmap v539: 97 pgs: 97 active+clean; 715 KiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 20 op/s 2024-09-10T23:30:38.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:37 smithi177 ceph-mon[35760]: pgmap v540: 97 pgs: 97 active+clean; 715 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 19 op/s 2024-09-10T23:30:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:37 smithi002 ceph-mon[31150]: pgmap v540: 97 pgs: 97 active+clean; 715 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 19 op/s 2024-09-10T23:30:38.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:37 smithi154 ceph-mon[35136]: pgmap v540: 97 pgs: 97 active+clean; 715 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 19 op/s 2024-09-10T23:30:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:39 smithi177 ceph-mon[35760]: pgmap v541: 97 pgs: 97 active+clean; 782 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:30:40.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:39 smithi002 ceph-mon[31150]: pgmap v541: 97 pgs: 97 active+clean; 782 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:30:40.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:39 smithi154 ceph-mon[35136]: pgmap v541: 97 pgs: 97 active+clean; 782 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:30:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 -- 172.21.15.2:0/410836361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec81044a0 msgr2=0x7faec810ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 --2- 172.21.15.2:0/410836361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec81044a0 0x7faec810ae20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7faec0009cd0 tx=0x7faec002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 -- 172.21.15.2:0/410836361 shutdown_connections 2024-09-10T23:30:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 --2- 172.21.15.2:0/410836361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec81044a0 0x7faec810ae20 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 --2- 172.21.15.2:0/410836361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec8103ae0 0x7faec8103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 --2- 172.21.15.2:0/410836361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faec8102990 0x7faec8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 -- 172.21.15.2:0/410836361 >> 172.21.15.2:0/410836361 conn(0x7faec80fe250 msgr2=0x7faec8100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 -- 172.21.15.2:0/410836361 shutdown_connections 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 -- 172.21.15.2:0/410836361 wait complete. 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 Processor -- start 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.799+0000 7faed02e2640 1 -- start start 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faed02e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec8102990 0x7faec8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faed02e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 0x7faec8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faed02e2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faec81044a0 0x7faec8199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faed02e2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faec810e5e0 con 0x7faec8103ae0 2024-09-10T23:30:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faed02e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faec810e460 con 0x7faec8102990 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faed02e2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faec810e760 con 0x7faec81044a0 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 0x7faec8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 0x7faec8199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49438/0 (socket says 172.21.15.2:49438) 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 -- 172.21.15.2:0/4041210398 learned_addr learned my addr 172.21.15.2:0/4041210398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faece07e640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec8102990 0x7faec8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faece87f640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faec81044a0 0x7faec8199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 -- 172.21.15.2:0/4041210398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faec81044a0 msgr2=0x7faec8199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faec81044a0 0x7faec8199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 -- 172.21.15.2:0/4041210398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec8102990 msgr2=0x7faec8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec8102990 0x7faec8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 -- 172.21.15.2:0/4041210398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec819a880 con 0x7faec8103ae0 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.800+0000 7faecd87d640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 0x7faec8199390 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7faeb800d950 tx=0x7faeb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.801+0000 7faebf7fe640 1 -- 172.21.15.2:0/4041210398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8017070 con 0x7faec8103ae0 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.801+0000 7faebf7fe640 1 -- 172.21.15.2:0/4041210398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faeb8009c30 con 0x7faec8103ae0 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.801+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec819ab70 con 0x7faec8103ae0 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.801+0000 7faebf7fe640 1 -- 172.21.15.2:0/4041210398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb800f620 con 0x7faec8103ae0 2024-09-10T23:30:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.801+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec81a1240 con 0x7faec8103ae0 2024-09-10T23:30:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 Processor -- start 2024-09-10T23:30:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 -- start start 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 0x5639ef41ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef420090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639ef38a6f0 con 0x5639ef418860 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5639ef379b20 con 0x5639ef41b190 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faed30b3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5639ef37d930 con 0x5639ef41dbd0 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faebf7fe640 1 -- 172.21.15.2:0/4041210398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faeb8010460 con 0x7faec8103ae0 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faece87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 0x5639ef41ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faece87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 0x5639ef41ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49446/0 (socket says 172.21.15.2:49446) 2024-09-10T23:30:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.804+0000 7faece87f640 1 -- 172.21.15.2:0/3810809047 learned_addr learned my addr 172.21.15.2:0/3810809047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece07e640 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faecd87d640 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef420090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece87f640 1 -- 172.21.15.2:0/3810809047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 msgr2=0x5639ef420090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece87f640 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef420090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece87f640 1 -- 172.21.15.2:0/3810809047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 msgr2=0x5639ef41d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece87f640 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece87f640 1 -- 172.21.15.2:0/3810809047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ef33f530 con 0x5639ef418860 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece07e640 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faece87f640 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 0x5639ef41ac50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7faec002ae00 tx=0x7faec0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893bb188b71c8344 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faebcbfe640 1 -- 172.21.15.2:0/3810809047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0031570 con 0x5639ef418860 2024-09-10T23:30:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faebcbfe640 1 -- 172.21.15.2:0/3810809047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec0036040 con 0x5639ef418860 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faebcbfe640 1 -- 172.21.15.2:0/3810809047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0004410 con 0x5639ef418860 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.805+0000 7faebf7fe640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faeb40b5360 0x7faeb40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faece07e640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faeb40b5360 0x7faeb40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faebf7fe640 1 -- 172.21.15.2:0/4041210398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faeb80e56a0 con 0x7faec8103ae0 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faece07e640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faeb40b5360 0x7faeb40b7820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faec4005d00 tx=0x7faec400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 -- 172.21.15.2:0/3810809047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 msgr2=0x5639ef41ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 0x5639ef41ac50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7faec002ae00 tx=0x7faec0009a20 comp rx=0 tx=0).stop 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 -- 172.21.15.2:0/3810809047 shutdown_connections 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef420090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810809047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef418860 0x5639ef41ac50 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 -- 172.21.15.2:0/3810809047 >> 172.21.15.2:0/3810809047 conn(0x5639ef4139b0 msgr2=0x5639ef414740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 -- 172.21.15.2:0/3810809047 shutdown_connections 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.806+0000 7faed30b3740 1 -- 172.21.15.2:0/3810809047 wait complete. 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 -- start start 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 Processor -- start 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef418860 0x5639ef421e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef4224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef423080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639ef2b1ab0 con 0x5639ef41b190 2024-09-10T23:30:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5639ef31f730 con 0x5639ef418860 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5639ef420af0 con 0x5639ef41dbd0 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faed30b3740 10 client.0 _ll_register_callbacks cb 0x5639ef3736b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef4224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef4224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49448/0 (socket says 172.21.15.2:49448) 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 -- 172.21.15.2:0/1010442555 learned_addr learned my addr 172.21.15.2:0/1010442555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faece87f640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef423080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faece07e640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef418860 0x5639ef421e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 -- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 msgr2=0x5639ef423080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef423080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 -- 172.21.15.2:0/1010442555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef418860 msgr2=0x5639ef421e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef418860 0x5639ef421e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faecd87d640 1 -- 172.21.15.2:0/1010442555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ef0db790 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.807+0000 7faece07e640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef418860 0x5639ef421e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faecd87d640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef4224b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb80a7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97e02f319f3054b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faeb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1010442555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8020070 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1010442555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faeb80ab180 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec0036040 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1010442555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faeb80ab690 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 10 client.17616 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639ef154620 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1010442555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec0036040 con 0x5639ef41b190 2024-09-10T23:30:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1010442555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faeb8010780 con 0x5639ef41b190 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 10 client.17616 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 10 client.17616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 20 client.17616 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef42d7a0 0x5639ef42fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 4 client.17616 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.808+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639ef38c640 con 0x5639ef42d7a0 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.809+0000 7faece07e640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef42d7a0 0x5639ef42fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.809+0000 7faece07e640 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef42d7a0 0x5639ef42fb90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c281f374b928552e server_cookie=633e1883f6805033 in_seq=0 out_seq=0 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.809+0000 7faeb1ffb640 10 client.17616 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1010442555 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639ef38c640 con 0x5639ef42d7a0 2024-09-10T23:30:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faeb1ffb640 10 client.17616 handle_command_reply: tid=0 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 client.17616 shutdown 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 msgr2=0x5639ef4224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef4224b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb80a7e30 comp rx=0 tx=0).stop 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 shutdown_connections 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef42d7a0 0x5639ef42fb90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef41dbd0 0x5639ef423080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef4224b0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 --2- 172.21.15.2:0/1010442555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef418860 0x5639ef421e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faeb1ffb640 0 client.17616 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 >> 172.21.15.2:0/1010442555 conn(0x5639ef4139b0 msgr2=0x5639ef412bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.810+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 shutdown_connections 2024-09-10T23:30:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.811+0000 7faed30b3740 1 -- 172.21.15.2:0/1010442555 wait complete. 2024-09-10T23:30:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.811+0000 7faed30b3740 20 client.17616 trim_cache size 0 max 16384 2024-09-10T23:30:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.825+0000 7faed30b3740 1 Processor -- start 2024-09-10T23:30:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 -- start start 2024-09-10T23:30:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef423950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 0x5639ef41e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faec81a9e20 con 0x5639ef41dbd0 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faec81ab960 con 0x5639ef41b190 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faed30b3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faec81aa4f0 con 0x5639ef418860 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 0x5639ef41e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 0x5639ef41e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49464/0 (socket says 172.21.15.2:49464) 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 -- 172.21.15.2:0/3810268135 learned_addr learned my addr 172.21.15.2:0/3810268135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece07e640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef423950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faecd87d640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 -- 172.21.15.2:0/3810268135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 msgr2=0x5639ef423950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef423950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 -- 172.21.15.2:0/3810268135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 msgr2=0x5639ef41dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 -- 172.21.15.2:0/3810268135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ef41afc0 con 0x5639ef41dbd0 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece07e640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef423950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faecd87d640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.826+0000 7faece87f640 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 0x5639ef41e4f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7faec0004af0 tx=0x7faec002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f859ef31cf6ff49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faeb3fff640 1 -- 172.21.15.2:0/3810268135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0052020 con 0x5639ef41dbd0 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faeb3fff640 1 -- 172.21.15.2:0/3810268135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec0036040 con 0x5639ef41dbd0 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faeb3fff640 1 -- 172.21.15.2:0/3810268135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0004460 con 0x5639ef41dbd0 2024-09-10T23:30:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 -- 172.21.15.2:0/3810268135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 msgr2=0x5639ef41e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 0x5639ef41e4f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7faec0004af0 tx=0x7faec002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 -- 172.21.15.2:0/3810268135 shutdown_connections 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41dbd0 0x5639ef41e4f0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41b190 0x5639ef41dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 --2- 172.21.15.2:0/3810268135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef423950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 -- 172.21.15.2:0/3810268135 >> 172.21.15.2:0/3810268135 conn(0x5639ef4139b0 msgr2=0x5639ef414670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 -- 172.21.15.2:0/3810268135 shutdown_connections 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 -- 172.21.15.2:0/3810268135 wait complete. 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.827+0000 7faed30b3740 1 -- start start 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 Processor -- start 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef429750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef428450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41dbd0 0x5639ef428990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faec81ab290 con 0x5639ef41b190 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faec81aabc0 con 0x5639ef41dbd0 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faec81a7e00 con 0x5639ef418860 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faed30b3740 10 client.0 _ll_register_callbacks cb 0x7faeb800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef428450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef428450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49466/0 (socket says 172.21.15.2:49466) 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 -- 172.21.15.2:0/1040423235 learned_addr learned my addr 172.21.15.2:0/1040423235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faece07e640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef429750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faece87f640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41dbd0 0x5639ef428990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 -- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 msgr2=0x5639ef429750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef429750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 -- 172.21.15.2:0/1040423235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41dbd0 msgr2=0x5639ef428990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41dbd0 0x5639ef428990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 -- 172.21.15.2:0/1040423235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ef41d8f0 con 0x5639ef41b190 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faecd87d640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef428450 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faeb80abc20 tx=0x7faeb80b0a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6ddc1ded67bbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.828+0000 7faeb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1040423235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8057e60 con 0x5639ef41b190 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1040423235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faeb80930f0 con 0x5639ef41b190 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec0036040 con 0x5639ef41b190 2024-09-10T23:30:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1040423235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faeb8020040 con 0x5639ef41b190 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 10 client.17622 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639ef427d80 con 0x5639ef41b190 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1040423235 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec0036040 con 0x5639ef41b190 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1040423235 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faeb80a7870 con 0x5639ef41b190 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 10 client.17622 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 10 client.17622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 20 client.17622 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef49aa60 0x5639ef49ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 4 client.17622 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5639ef3880f0 con 0x5639ef49aa60 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.829+0000 7faece07e640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef49aa60 0x5639ef49ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.830+0000 7faeb1ffb640 10 client.17622 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:40.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.830+0000 7faece07e640 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef49aa60 0x5639ef49ce80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84b85b50b43a343 server_cookie=e9aea2da69d4a47f in_seq=0 out_seq=0 2024-09-10T23:30:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faeb1ffb640 1 -- 172.21.15.2:0/1040423235 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5639ef3880f0 con 0x5639ef49aa60 2024-09-10T23:30:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faeb1ffb640 10 client.17622 handle_command_reply: tid=0 2024-09-10T23:30:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 client.17622 shutdown 2024-09-10T23:30:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 msgr2=0x5639ef428450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef428450 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faeb80abc20 tx=0x7faeb80b0a90 comp rx=0 tx=0).stop 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 shutdown_connections 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5639ef49aa60 0x5639ef49ce80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639ef41dbd0 0x5639ef428990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faeb1ffb640 0 client.17622 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639ef41b190 0x5639ef428450 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 --2- 172.21.15.2:0/1040423235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5639ef418860 0x5639ef429750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 >> 172.21.15.2:0/1040423235 conn(0x5639ef4139b0 msgr2=0x5639ef41dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 shutdown_connections 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 1 -- 172.21.15.2:0/1040423235 wait complete. 2024-09-10T23:30:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.844+0000 7faed30b3740 20 client.17622 trim_cache size 0 max 16384 2024-09-10T23:30:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:30:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:30:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:30:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:30:40.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faeb40b5360 msgr2=0x7faeb40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faeb40b5360 0x7faeb40b7820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faec4005d00 tx=0x7faec400b410 comp rx=0 tx=0).stop 2024-09-10T23:30:40.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 msgr2=0x7faec8199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:40.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 0x7faec8199390 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7faeb800d950 tx=0x7faeb800de10 comp rx=0 tx=0).stop 2024-09-10T23:30:40.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 shutdown_connections 2024-09-10T23:30:40.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faeb40b5360 0x7faeb40b7820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faec81044a0 0x7faec8199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec8103ae0 0x7faec8199390 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 --2- 172.21.15.2:0/4041210398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec8102990 0x7faec8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 >> 172.21.15.2:0/4041210398 conn(0x7faec80fe250 msgr2=0x7faec8106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 shutdown_connections 2024-09-10T23:30:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:40.845+0000 7faed02e2640 1 -- 172.21.15.2:0/4041210398 wait complete. 2024-09-10T23:30:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:41 smithi177 ceph-mon[35760]: pgmap v542: 97 pgs: 97 active+clean; 782 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:30:42.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:41 smithi002 ceph-mon[31150]: pgmap v542: 97 pgs: 97 active+clean; 782 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:30:42.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:41 smithi154 ceph-mon[35136]: pgmap v542: 97 pgs: 97 active+clean; 782 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:30:44.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:43 smithi002 ceph-mon[31150]: pgmap v543: 97 pgs: 97 active+clean; 841 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:30:44.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:43 smithi154 ceph-mon[35136]: pgmap v543: 97 pgs: 97 active+clean; 841 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:30:44.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:43 smithi177 ceph-mon[35760]: pgmap v543: 97 pgs: 97 active+clean; 841 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:30:46.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:45 smithi002 ceph-mon[31150]: pgmap v544: 97 pgs: 97 active+clean; 841 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:46.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:45 smithi154 ceph-mon[35136]: pgmap v544: 97 pgs: 97 active+clean; 841 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:46.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:45 smithi177 ceph-mon[35760]: pgmap v544: 97 pgs: 97 active+clean; 841 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:47 smithi002 ceph-mon[31150]: pgmap v545: 97 pgs: 97 active+clean; 841 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:48.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:47 smithi154 ceph-mon[35136]: pgmap v545: 97 pgs: 97 active+clean; 841 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:48.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:47 smithi177 ceph-mon[35760]: pgmap v545: 97 pgs: 97 active+clean; 841 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:50.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:49 smithi002 ceph-mon[31150]: pgmap v546: 97 pgs: 97 active+clean; 899 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:30:50.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:49 smithi154 ceph-mon[35136]: pgmap v546: 97 pgs: 97 active+clean; 899 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:30:50.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:49 smithi177 ceph-mon[35760]: pgmap v546: 97 pgs: 97 active+clean; 899 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:30:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:51 smithi002 ceph-mon[31150]: pgmap v547: 97 pgs: 97 active+clean; 899 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:51 smithi154 ceph-mon[35136]: pgmap v547: 97 pgs: 97 active+clean; 899 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:52.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:51 smithi177 ceph-mon[35760]: pgmap v547: 97 pgs: 97 active+clean; 899 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:30:53.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:30:53.914 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 -- 172.21.15.2:0/1330805809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81029b0 msgr2=0x7f1be8102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 --2- 172.21.15.2:0/1330805809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81029b0 0x7f1be8102e30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009930 tx=0x7f1bd002a420 comp rx=0 tx=0).stop 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 -- 172.21.15.2:0/1330805809 shutdown_connections 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 --2- 172.21.15.2:0/1330805809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1be8103370 0x7f1be8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 --2- 172.21.15.2:0/1330805809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81029b0 0x7f1be8102e30 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 --2- 172.21.15.2:0/1330805809 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8101860 0x7f1be8101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 -- 172.21.15.2:0/1330805809 >> 172.21.15.2:0/1330805809 conn(0x7f1be80fd140 msgr2=0x7f1be80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 -- 172.21.15.2:0/1330805809 shutdown_connections 2024-09-10T23:30:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 -- 172.21.15.2:0/1330805809 wait complete. 2024-09-10T23:30:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.951+0000 7f1bed152640 1 Processor -- start 2024-09-10T23:30:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 -- start start 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8101860 0x7f1be806b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1be81029b0 0x7f1be819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 0x7f1be81a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1be810d4d0 con 0x7f1be8103370 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1be810d350 con 0x7f1be81029b0 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1bed152640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1be810d650 con 0x7f1be8101860 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 0x7f1be81a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 0x7f1be81a0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58114/0 (socket says 172.21.15.2:58114) 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 -- 172.21.15.2:0/1143349565 learned_addr learned my addr 172.21.15.2:0/1143349565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8101860 0x7f1be806b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be659c640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1be81029b0 0x7f1be819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 -- 172.21.15.2:0/1143349565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8101860 msgr2=0x7f1be806b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8101860 0x7f1be806b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 -- 172.21.15.2:0/1143349565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1be81029b0 msgr2=0x7f1be819daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1be81029b0 0x7f1be819daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 -- 172.21.15.2:0/1143349565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be81a0950 con 0x7f1be8103370 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.952+0000 7f1be759e640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 0x7f1be81a0090 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800eaa0 tx=0x7f1bd800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.953+0000 7f1bdffff640 1 -- 172.21.15.2:0/1143349565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800cdb0 con 0x7f1be8103370 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.953+0000 7f1bdffff640 1 -- 172.21.15.2:0/1143349565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd8005020 con 0x7f1be8103370 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.953+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be81a0c40 con 0x7f1be8103370 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.953+0000 7f1bdffff640 1 -- 172.21.15.2:0/1143349565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80116d0 con 0x7f1be8103370 2024-09-10T23:30:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.953+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be81a1140 con 0x7f1be8103370 2024-09-10T23:30:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.955+0000 7f1befff6740 1 Processor -- start 2024-09-10T23:30:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.955+0000 7f1bdffff640 1 -- 172.21.15.2:0/1143349565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1bd800f040 con 0x7f1be8103370 2024-09-10T23:30:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.955+0000 7f1befff6740 1 -- start start 2024-09-10T23:30:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1befff6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bbec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1befff6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbf190 0x55edd8bc1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1befff6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1befff6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55edd8b2e6f0 con 0x55edd8bbc860 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1befff6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edd8b1db20 con 0x55edd8bbf190 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1befff6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55edd8b21930 con 0x55edd8bc1bd0 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bbec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bbec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58120/0 (socket says 172.21.15.2:58120) 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 -- 172.21.15.2:0/2284033939 learned_addr learned my addr 172.21.15.2:0/2284033939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 -- 172.21.15.2:0/2284033939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 msgr2=0x55edd8bc4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbf190 0x55edd8bc1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 -- 172.21.15.2:0/2284033939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbf190 msgr2=0x55edd8bc1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbf190 0x55edd8bc1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 -- 172.21.15.2:0/2284033939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd8ae3530 con 0x55edd8bbc860 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.956+0000 7f1be659c640 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bbec50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1bd002a940 tx=0x7f1bd0031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80c760bd405b192 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1bdd7fa640 1 -- 172.21.15.2:0/2284033939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0035070 con 0x55edd8bbc860 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1bdd7fa640 1 -- 172.21.15.2:0/2284033939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0041030 con 0x55edd8bbc860 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1bdd7fa640 1 -- 172.21.15.2:0/2284033939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0003af0 con 0x55edd8bbc860 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1bdffff640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1bd40b52e0 0x7f1bd40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1bd40b52e0 0x7f1bd40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1bdffff640 1 -- 172.21.15.2:0/1143349565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1bd80e5a00 con 0x7f1be8103370 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1befff6740 1 -- 172.21.15.2:0/2284033939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 msgr2=0x55edd8bbec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1bd40b52e0 0x7f1bd40b77a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1be0005fd0 tx=0x7f1be000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.957+0000 7f1befff6740 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bbec50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1bd002a940 tx=0x7f1bd0031bc0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- 172.21.15.2:0/2284033939 shutdown_connections 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbf190 0x55edd8bc1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 --2- 172.21.15.2:0/2284033939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bbec50 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- 172.21.15.2:0/2284033939 >> 172.21.15.2:0/2284033939 conn(0x55edd8bb79b0 msgr2=0x55edd8bb8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- 172.21.15.2:0/2284033939 shutdown_connections 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- 172.21.15.2:0/2284033939 wait complete. 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- start start 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 Processor -- start 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbc860 0x55edd8bc5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 0x55edd8bc6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55edd8a55ab0 con 0x55edd8bbf190 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edd8ac3730 con 0x55edd8bbc860 2024-09-10T23:30:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55edd8bc4b50 con 0x55edd8bc1bd0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1befff6740 10 client.0 _ll_register_callbacks cb 0x55edd8b176b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1be659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 0x55edd8bc6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1be659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 0x55edd8bc6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58126/0 (socket says 172.21.15.2:58126) 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1be659c640 1 -- 172.21.15.2:0/3922234255 learned_addr learned my addr 172.21.15.2:0/3922234255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.958+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbc860 0x55edd8bc5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be759e640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be659c640 1 -- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 msgr2=0x55edd8bc7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be659c640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be659c640 1 -- 172.21.15.2:0/3922234255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbc860 msgr2=0x55edd8bc5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be659c640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbc860 0x55edd8bc5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be659c640 1 -- 172.21.15.2:0/3922234255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd887f790 con 0x55edd8bbf190 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1be659c640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 0x55edd8bc6560 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004650 tx=0x7f1bd0031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fb02f10d13fb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1bce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1bce7fc640 1 -- 172.21.15.2:0/3922234255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0035030 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1bce7fc640 1 -- 172.21.15.2:0/3922234255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1bd0003830 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd0041030 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1bce7fc640 1 -- 172.21.15.2:0/3922234255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1bd0003a30 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1befff6740 10 client.17634 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edd88f8620 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1bce7fc640 1 -- 172.21.15.2:0/3922234255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0041030 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1bce7fc640 1 -- 172.21.15.2:0/3922234255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1bd003bbe0 con 0x55edd8bbf190 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1befff6740 10 client.17634 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.959+0000 7f1befff6740 10 client.17634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1befff6740 20 client.17634 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1befff6740 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8bd1360 0x55edd8bd3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1befff6740 4 client.17634 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edd8b30640 con 0x55edd8bd1360 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8bd1360 0x55edd8bd3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8bd1360 0x55edd8bd3750 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76faeb6fcb0420aa server_cookie=4928dd428f0a4e5d in_seq=0 out_seq=0 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.960+0000 7f1bce7fc640 10 client.17634 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1bce7fc640 1 -- 172.21.15.2:0/3922234255 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edd8b30640 con 0x55edd8bd1360 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1bce7fc640 10 client.17634 handle_command_reply: tid=0 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 client.17634 shutdown 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 msgr2=0x55edd8bc6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 0x55edd8bc6560 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004650 tx=0x7f1bd0031840 comp rx=0 tx=0).stop 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 shutdown_connections 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8bd1360 0x55edd8bd3750 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1bce7fc640 0 client.17634 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbf190 0x55edd8bc6560 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 --2- 172.21.15.2:0/3922234255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bbc860 0x55edd8bc5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 >> 172.21.15.2:0/3922234255 conn(0x55edd8bb79b0 msgr2=0x55edd8bb6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 shutdown_connections 2024-09-10T23:30:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 1 -- 172.21.15.2:0/3922234255 wait complete. 2024-09-10T23:30:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.961+0000 7f1befff6740 20 client.17634 trim_cache size 0 max 16384 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 Processor -- start 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 -- start start 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bc65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bc4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81a9d40 con 0x55edd8bbc860 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81ab880 con 0x55edd8bc1bd0 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1befff6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81aa410 con 0x55edd8bbf190 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1be6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bc65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1be6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bc65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58128/0 (socket says 172.21.15.2:58128) 2024-09-10T23:30:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1373511833 learned_addr learned my addr 172.21.15.2:0/1373511833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1be659c640 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bc4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.976+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1373511833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 msgr2=0x55edd8bc4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bc4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1373511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 msgr2=0x55edd8bc5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be759e640 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1373511833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd8bc18f0 con 0x55edd8bbc860 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be659c640 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bc4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bc65d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1be0003fc0 tx=0x7f1be0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543b5152b3c5e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1bdcff9640 1 -- 172.21.15.2:0/1373511833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0031440 con 0x55edd8bbc860 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1bdcff9640 1 -- 172.21.15.2:0/1373511833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be00208e0 con 0x55edd8bbc860 2024-09-10T23:30:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1bdcff9640 1 -- 172.21.15.2:0/1373511833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be001f9e0 con 0x55edd8bbc860 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1befff6740 1 -- 172.21.15.2:0/1373511833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 msgr2=0x55edd8bc65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.977+0000 7f1befff6740 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bc65d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1be0003fc0 tx=0x7f1be0014000 comp rx=0 tx=0).stop 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- 172.21.15.2:0/1373511833 shutdown_connections 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bc5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bc4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 --2- 172.21.15.2:0/1373511833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bc65d0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- 172.21.15.2:0/1373511833 >> 172.21.15.2:0/1373511833 conn(0x55edd8bb79b0 msgr2=0x55edd8bc5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- 172.21.15.2:0/1373511833 shutdown_connections 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- 172.21.15.2:0/1373511833 wait complete. 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- start start 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 Processor -- start 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bcd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bcc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81ab1b0 con 0x55edd8bbc860 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81aaae0 con 0x55edd8bc1bd0 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81a7d20 con 0x55edd8bbf190 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1befff6740 10 client.0 _ll_register_callbacks cb 0x7f1bd0031b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1be6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bcd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1be6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bcd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58142/0 (socket says 172.21.15.2:58142) 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1671978886 learned_addr learned my addr 172.21.15.2:0/1671978886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1be659c640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bcc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.978+0000 7f1be759e640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 msgr2=0x55edd8bcc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bcc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1671978886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 msgr2=0x55edd8bccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be6d9d640 1 -- 172.21.15.2:0/1671978886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd8bcd2f0 con 0x55edd8bbc860 2024-09-10T23:30:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be759e640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1be6d9d640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bcd920 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f1be00057a0 tx=0x7f1be0012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1359d60a107f5264 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.979+0000 7f1bce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1bce7fc640 1 -- 172.21.15.2:0/1671978886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0020640 con 0x55edd8bbc860 2024-09-10T23:30:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1bce7fc640 1 -- 172.21.15.2:0/1671978886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1be0020a90 con 0x55edd8bbc860 2024-09-10T23:30:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be00208e0 con 0x55edd8bbc860 2024-09-10T23:30:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1bce7fc640 1 -- 172.21.15.2:0/1671978886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1be0020c90 con 0x55edd8bbc860 2024-09-10T23:30:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1befff6740 10 client.17640 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edd8c425c0 con 0x55edd8bbc860 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1bce7fc640 1 -- 172.21.15.2:0/1671978886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be00208e0 con 0x55edd8bbc860 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.982+0000 7f1bce7fc640 1 -- 172.21.15.2:0/1671978886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1be002f020 con 0x55edd8bbc860 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1befff6740 10 client.17640 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1befff6740 10 client.17640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1befff6740 20 client.17640 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1befff6740 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8c42ee0 0x55edd8c45300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1befff6740 4 client.17640 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edd8b2c0f0 con 0x55edd8c42ee0 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1be659c640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8c42ee0 0x55edd8c45300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1be659c640 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8c42ee0 0x55edd8c45300 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea434e6728972134 server_cookie=cb8cb634d7ed2b9a in_seq=0 out_seq=0 2024-09-10T23:30:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.983+0000 7f1bce7fc640 10 client.17640 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1bce7fc640 1 -- 172.21.15.2:0/1671978886 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edd8b2c0f0 con 0x55edd8c42ee0 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1bce7fc640 10 client.17640 handle_command_reply: tid=0 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 client.17640 shutdown 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 msgr2=0x55edd8bcd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bcd920 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f1be00057a0 tx=0x7f1be0012de0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 shutdown_connections 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55edd8c42ee0 0x55edd8c45300 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd8bc1bd0 0x55edd8bccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1bce7fc640 0 client.17640 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edd8bbf190 0x55edd8bcc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 --2- 172.21.15.2:0/1671978886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55edd8bbc860 0x55edd8bcd920 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 >> 172.21.15.2:0/1671978886 conn(0x55edd8bb79b0 msgr2=0x55edd8bb6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 shutdown_connections 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 1 -- 172.21.15.2:0/1671978886 wait complete. 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.998+0000 7f1befff6740 20 client.17640 trim_cache size 0 max 16384 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:30:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:30:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1bd40b52e0 msgr2=0x7f1bd40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1bd40b52e0 0x7f1bd40b77a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1be0005fd0 tx=0x7f1be000b390 comp rx=0 tx=0).stop 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 msgr2=0x7f1be81a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 0x7f1be81a0090 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800eaa0 tx=0x7f1bd800ef60 comp rx=0 tx=0).stop 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 shutdown_connections 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1bd40b52e0 0x7f1bd40b77a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8103370 0x7f1be81a0090 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1be81029b0 0x7f1be819daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 --2- 172.21.15.2:0/1143349565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8101860 0x7f1be806b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 >> 172.21.15.2:0/1143349565 conn(0x7f1be80fd140 msgr2=0x7f1be8103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 shutdown_connections 2024-09-10T23:30:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:30:53.999+0000 7f1bed152640 1 -- 172.21.15.2:0/1143349565 wait complete. 2024-09-10T23:30:54.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:53 smithi002 ceph-mon[31150]: pgmap v548: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-10T23:30:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:53 smithi154 ceph-mon[35136]: pgmap v548: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-10T23:30:54.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:53 smithi177 ceph-mon[35760]: pgmap v548: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-10T23:30:54.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 -- 172.21.15.2:0/1981815497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 msgr2=0x7fd40c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 --2- 172.21.15.2:0/1981815497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c10f5a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd404009ca0 tx=0x7fd40402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 -- 172.21.15.2:0/1981815497 shutdown_connections 2024-09-10T23:30:54.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 --2- 172.21.15.2:0/1981815497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c10f5a0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 --2- 172.21.15.2:0/1981815497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd40c104600 0x7fd40c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 --2- 172.21.15.2:0/1981815497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd40c103ce0 0x7fd40c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 -- 172.21.15.2:0/1981815497 >> 172.21.15.2:0/1981815497 conn(0x7fd40c0fd720 msgr2=0x7fd40c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 -- 172.21.15.2:0/1981815497 shutdown_connections 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.576+0000 7fd411add640 1 -- 172.21.15.2:0/1981815497 wait complete. 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 Processor -- start 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 -- start start 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd40c103ce0 0x7fd40c101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd40c104600 0x7fd40c101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c112db0 con 0x7fd40c10d140 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c112c30 con 0x7fd40c104600 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.577+0000 7fd411add640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c112f30 con 0x7fd40c103ce0 2024-09-10T23:30:54.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58156/0 (socket says 172.21.15.2:58156) 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 -- 172.21.15.2:0/2033227430 learned_addr learned my addr 172.21.15.2:0/2033227430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40affd640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd40c104600 0x7fd40c101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd40c103ce0 0x7fd40c101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 -- 172.21.15.2:0/2033227430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd40c103ce0 msgr2=0x7fd40c101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd40c103ce0 0x7fd40c101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 -- 172.21.15.2:0/2033227430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd40c104600 msgr2=0x7fd40c101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd40c104600 0x7fd40c101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 -- 172.21.15.2:0/2033227430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c1a7700 con 0x7fd40c10d140 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd40bfff640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c102410 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd404005cc0 tx=0x7fd40402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd408ff9640 1 -- 172.21.15.2:0/2033227430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404003bf0 con 0x7fd40c10d140 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c1a7990 con 0x7fd40c10d140 2024-09-10T23:30:54.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd408ff9640 1 -- 172.21.15.2:0/2033227430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd404003d90 con 0x7fd40c10d140 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.578+0000 7fd408ff9640 1 -- 172.21.15.2:0/2033227430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40402fbc0 con 0x7fd40c10d140 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.579+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c1a7ed0 con 0x7fd40c10d140 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd408ff9640 1 -- 172.21.15.2:0/2033227430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd404004610 con 0x7fd40c10d140 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 Processor -- start 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 -- start start 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6fe4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ef6f5ae50 con 0x555ef6fe4480 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555ef6f4a280 con 0x555ef6ff0d30 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd413eb2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555ef6f4e090 con 0x555ef6fe4da0 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd40affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6fe4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.581+0000 7fd40affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6fe4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58158/0 (socket says 172.21.15.2:58158) 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 -- 172.21.15.2:0/3064866539 learned_addr learned my addr 172.21.15.2:0/3064866539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 -- 172.21.15.2:0/3064866539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 msgr2=0x555ef6ff07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 -- 172.21.15.2:0/3064866539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 msgr2=0x555ef6ff3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 -- 172.21.15.2:0/3064866539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ef6ca8650 con 0x555ef6fe4480 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd408ff9640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3f40b52e0 0x7fd3f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3f40b52e0 0x7fd3f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd40affd640 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6fe4860 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd40000afc0 tx=0x7fd40000a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618a60e38196188f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd408ff9640 1 -- 172.21.15.2:0/2033227430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd404107010 con 0x7fd40c10d140 2024-09-10T23:30:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.582+0000 7fd3f1ffb640 1 -- 172.21.15.2:0/3064866539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400019030 con 0x555ef6fe4480 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd3f1ffb640 1 -- 172.21.15.2:0/3064866539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4000054d0 con 0x555ef6fe4480 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3f40b52e0 0x7fd3f40b77a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x555ef6fe3190 tx=0x7fd3fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd3f1ffb640 1 -- 172.21.15.2:0/3064866539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40000f890 con 0x555ef6fe4480 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 -- 172.21.15.2:0/3064866539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 msgr2=0x555ef6fe4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6fe4860 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd40000afc0 tx=0x7fd40000a690 comp rx=0 tx=0).stop 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 -- 172.21.15.2:0/3064866539 shutdown_connections 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 --2- 172.21.15.2:0/3064866539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6fe4860 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 -- 172.21.15.2:0/3064866539 >> 172.21.15.2:0/3064866539 conn(0x555ef6fe22b0 msgr2=0x555ef6fe3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 -- 172.21.15.2:0/3064866539 shutdown_connections 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.583+0000 7fd413eb2740 1 -- 172.21.15.2:0/3064866539 wait complete. 2024-09-10T23:30:54.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 -- start start 2024-09-10T23:30:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 Processor -- start 2024-09-10T23:30:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ff0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6fe4da0 0x555ef6fedab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6ff0d30 0x555ef6fee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ef6dab700 con 0x555ef6fe4480 2024-09-10T23:30:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555ef6ee5110 con 0x555ef6fe4da0 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555ef6ff39b0 con 0x555ef6ff0d30 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd413eb2740 10 client.0 _ll_register_callbacks cb 0x555ef6efe990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd40b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ff0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd40b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ff0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58164/0 (socket says 172.21.15.2:58164) 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.584+0000 7fd40b7fe640 1 -- 172.21.15.2:0/2474415354 learned_addr learned my addr 172.21.15.2:0/2474415354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40affd640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6fe4da0 0x555ef6fedab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40bfff640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6ff0d30 0x555ef6fee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40b7fe640 1 -- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6ff0d30 msgr2=0x555ef6fee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6ff0d30 0x555ef6fee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40b7fe640 1 -- 172.21.15.2:0/2474415354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6fe4da0 msgr2=0x555ef6fedab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6fe4da0 0x555ef6fedab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40b7fe640 1 -- 172.21.15.2:0/2474415354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ef6f12c40 con 0x555ef6fe4480 2024-09-10T23:30:54.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ff0660 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004130 tx=0x7fd3fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602b1080d5e63188 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd3eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2474415354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc02c060 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2474415354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd3fc017030 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4000054d0 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2474415354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3fc027410 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd413eb2740 10 client.17652 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.585+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555ef6fff380 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2474415354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4000054d0 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2474415354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3fc01c480 con 0x555ef6fe4480 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd413eb2740 10 client.17652 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd413eb2740 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd413eb2740 20 client.17652 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7002c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd413eb2740 4 client.17652 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.586+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ef6f5cda0 con 0x555ef7000840 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.587+0000 7fd40affd640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7002c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.587+0000 7fd40affd640 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7002c90 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5f0e1681afe55f server_cookie=71f90ddde4185953 in_seq=0 out_seq=0 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.587+0000 7fd3eaffd640 10 client.17652 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2474415354 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ef6f5cda0 con 0x555ef7000840 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd3eaffd640 10 client.17652 handle_command_reply: tid=0 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 client.17652 shutdown 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 msgr2=0x555ef6ff0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ff0660 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004130 tx=0x7fd3fc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 shutdown_connections 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7002c90 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd3eaffd640 0 client.17652 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6ff0d30 0x555ef6fee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6fe4da0 0x555ef6fedab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2474415354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ff0660 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.588+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 >> 172.21.15.2:0/2474415354 conn(0x555ef6fe22b0 msgr2=0x555ef6fe7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.589+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 shutdown_connections 2024-09-10T23:30:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.589+0000 7fd413eb2740 1 -- 172.21.15.2:0/2474415354 wait complete. 2024-09-10T23:30:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.589+0000 7fd413eb2740 20 client.17652 trim_cache size 0 max 16384 2024-09-10T23:30:54.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.607+0000 7fd413eb2740 1 Processor -- start 2024-09-10T23:30:54.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.607+0000 7fd413eb2740 1 -- start start 2024-09-10T23:30:54.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ffcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd413eb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1b05b0 con 0x555ef6fe4480 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd413eb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1b20f0 con 0x555ef6ff0d30 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd413eb2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1b0c80 con 0x555ef6fe4da0 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:48276/0 (socket says 172.21.15.2:48276) 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ffcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 -- 172.21.15.2:0/579552728 learned_addr learned my addr 172.21.15.2:0/579552728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 -- 172.21.15.2:0/579552728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 msgr2=0x555ef6ff2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 -- 172.21.15.2:0/579552728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 msgr2=0x555ef6ffcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ffcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40bfff640 1 -- 172.21.15.2:0/579552728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ef6ff09d0 con 0x555ef6ff0d30 2024-09-10T23:30:54.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.608+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ffcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:54.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.609+0000 7fd40bfff640 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff2660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4040caa50 tx=0x7fd404003f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cca318e49cf62e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:54.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.609+0000 7fd3f17fa640 1 -- 172.21.15.2:0/579552728 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040cdee0 con 0x555ef6ff0d30 2024-09-10T23:30:54.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.609+0000 7fd3f17fa640 1 -- 172.21.15.2:0/579552728 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd404036040 con 0x555ef6ff0d30 2024-09-10T23:30:54.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.609+0000 7fd3f17fa640 1 -- 172.21.15.2:0/579552728 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040d68e0 con 0x555ef6ff0d30 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.609+0000 7fd413eb2740 1 -- 172.21.15.2:0/579552728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 msgr2=0x555ef6ff2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.609+0000 7fd413eb2740 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff2660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4040caa50 tx=0x7fd404003f40 comp rx=0 tx=0).stop 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- 172.21.15.2:0/579552728 shutdown_connections 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff2660 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4da0 0x555ef6ff2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 --2- 172.21.15.2:0/579552728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4480 0x555ef6ffcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- 172.21.15.2:0/579552728 >> 172.21.15.2:0/579552728 conn(0x555ef6fe22b0 msgr2=0x555ef6fec330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- 172.21.15.2:0/579552728 shutdown_connections 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- 172.21.15.2:0/579552728 wait complete. 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- start start 2024-09-10T23:30:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 Processor -- start 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4480 0x555ef6ff9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 0x555ef6ff6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1b1a20 con 0x555ef6fe4da0 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1b1350 con 0x555ef6ff0d30 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.610+0000 7fd413eb2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1ae590 con 0x555ef6fe4480 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd413eb2740 10 client.0 _ll_register_callbacks cb 0x7fd3fc004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 0x555ef6ff6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 0x555ef6ff6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58186/0 (socket says 172.21.15.2:58186) 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 -- 172.21.15.2:0/2653900069 learned_addr learned my addr 172.21.15.2:0/2653900069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4480 0x555ef6ff9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 -- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4480 msgr2=0x555ef6ff9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4480 0x555ef6ff9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 -- 172.21.15.2:0/2653900069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 msgr2=0x555ef6ff7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 -- 172.21.15.2:0/2653900069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ef6ff7ae0 con 0x555ef6fe4da0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4480 0x555ef6ff9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40bfff640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd40affd640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 0x555ef6ff6e10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c00 tx=0x7fd400013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8c553f4430945 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd3eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.611+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2653900069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400035020 con 0x555ef6fe4da0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd404036040 con 0x555ef6fe4da0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2653900069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd400004880 con 0x555ef6fe4da0 2024-09-10T23:30:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2653900069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd400019040 con 0x555ef6fe4da0 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 10 client.17658 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555ef706e740 con 0x555ef6fe4da0 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2653900069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd404036040 con 0x555ef6fe4da0 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2653900069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd400004cf0 con 0x555ef6fe4da0 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 10 client.17658 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 20 client.17658 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 4 client.17658 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.612+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555ef6f58850 con 0x555ef7000840 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.613+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.613+0000 7fd40b7fe640 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7070bc0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19d5065879d37b3b server_cookie=e3096fa7f4e0f995 in_seq=0 out_seq=0 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.613+0000 7fd3eaffd640 10 client.17658 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.613+0000 7fd3eaffd640 1 -- 172.21.15.2:0/2653900069 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x555ef6f58850 con 0x555ef7000840 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.613+0000 7fd3eaffd640 10 client.17658 handle_command_reply: tid=0 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.613+0000 7fd413eb2740 1 client.17658 shutdown 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 msgr2=0x555ef6ff6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 0x555ef6ff6e10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c00 tx=0x7fd400013460 comp rx=0 tx=0).stop 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 shutdown_connections 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555ef7000840 0x555ef7070bc0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ef6ff0d30 0x555ef6ff7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ef6fe4da0 0x555ef6ff6e10 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 --2- 172.21.15.2:0/2653900069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555ef6fe4480 0x555ef6ff9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 >> 172.21.15.2:0/2653900069 conn(0x555ef6fe22b0 msgr2=0x555ef6fef0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd3eaffd640 0 client.17658 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 shutdown_connections 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 1 -- 172.21.15.2:0/2653900069 wait complete. 2024-09-10T23:30:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.614+0000 7fd413eb2740 20 client.17658 trim_cache size 0 max 16384 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:30:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:30:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:30:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:30:54.628 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3f40b52e0 msgr2=0x7fd3f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3f40b52e0 0x7fd3f40b77a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x555ef6fe3190 tx=0x7fd3fc00b390 comp rx=0 tx=0).stop 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 msgr2=0x7fd40c102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c102410 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd404005cc0 tx=0x7fd40402f380 comp rx=0 tx=0).stop 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 shutdown_connections 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd3f40b52e0 0x7fd3f40b77a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c10d140 0x7fd40c102410 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd40c104600 0x7fd40c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 --2- 172.21.15.2:0/2033227430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd40c103ce0 0x7fd40c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 >> 172.21.15.2:0/2033227430 conn(0x7fd40c0fd720 msgr2=0x7fd40c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 shutdown_connections 2024-09-10T23:30:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:54.615+0000 7fd411add640 1 -- 172.21.15.2:0/2033227430 wait complete. 2024-09-10T23:30:55.461 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:30:55.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:30:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:56.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:55 smithi002 ceph-mon[31150]: pgmap v549: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:55 smithi154 ceph-mon[35136]: pgmap v549: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:56.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/1617361973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8102dc0 msgr2=0x7ff2e81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/1617361973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8102dc0 0x7ff2e81031a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009900 tx=0x7ff2e402a410 comp rx=0 tx=0).stop 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/1617361973 shutdown_connections 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/1617361973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e8109150 0x7ff2e810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/1617361973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2e81087d0 0x7ff2e8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/1617361973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8102dc0 0x7ff2e81031a0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/1617361973 >> 172.21.15.2:0/1617361973 conn(0x7ff2e80fe830 msgr2=0x7ff2e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/1617361973 shutdown_connections 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.379+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/1617361973 wait complete. 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 Processor -- start 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 -- start start 2024-09-10T23:30:56.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e8102dc0 0x7ff2e8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2e81087d0 0x7ff2e81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 0x7ff2e819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8112e10 con 0x7ff2e8109150 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8112c90 con 0x7ff2e8102dc0 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2ef4f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8112f90 con 0x7ff2e81087d0 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2eda94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 0x7ff2e819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.380+0000 7ff2eda94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 0x7ff2e819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58196/0 (socket says 172.21.15.2:58196) 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 -- 172.21.15.2:0/2488088332 learned_addr learned my addr 172.21.15.2:0/2488088332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eca92640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2e81087d0 0x7ff2e81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2ed293640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e8102dc0 0x7ff2e8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 -- 172.21.15.2:0/2488088332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2e81087d0 msgr2=0x7ff2e81997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2e81087d0 0x7ff2e81997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 -- 172.21.15.2:0/2488088332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e8102dc0 msgr2=0x7ff2e8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e8102dc0 0x7ff2e8199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 -- 172.21.15.2:0/2488088332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e819f330 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2eda94640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 0x7ff2e819eb60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000cce0 tx=0x7ff2e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000f450 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2e000faa0 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e819f620 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0018b70 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.381+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e81a5ce0 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.382+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e81031a0 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.384+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff2e000f5f0 con 0x7ff2e8109150 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.384+0000 7ff2de7fc640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff2d40b5360 0x7ff2d40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.385+0000 7ff2ed293640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff2d40b5360 0x7ff2d40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.385+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff2e00e62a0 con 0x7ff2e8109150 2024-09-10T23:30:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.385+0000 7ff2ed293640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff2d40b5360 0x7ff2d40b7820 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4031440 tx=0x7ff2e4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.387+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff2e0014030 con 0x7ff2e8109150 2024-09-10T23:30:56.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:55 smithi177 ceph-mon[35760]: pgmap v549: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:30:56.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.612+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2e81a6100 con 0x7ff2e8109150 2024-09-10T23:30:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.612+0000 7ff2de7fc640 1 -- 172.21.15.2:0/2488088332 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7ff2e00ad280 con 0x7ff2e8109150 2024-09-10T23:30:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:30:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:30:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff2d40b5360 msgr2=0x7ff2d40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff2d40b5360 0x7ff2d40b7820 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4031440 tx=0x7ff2e4005b50 comp rx=0 tx=0).stop 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 msgr2=0x7ff2e819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 0x7ff2e819eb60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000cce0 tx=0x7ff2e000a620 comp rx=0 tx=0).stop 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 shutdown_connections 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff2d40b5360 0x7ff2d40b7820 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2e8109150 0x7ff2e819eb60 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2e81087d0 0x7ff2e81997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 --2- 172.21.15.2:0/2488088332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e8102dc0 0x7ff2e8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:56.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 >> 172.21.15.2:0/2488088332 conn(0x7ff2e80fe830 msgr2=0x7ff2e81000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:56.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 shutdown_connections 2024-09-10T23:30:56.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:56.615+0000 7ff2ef4f7640 1 -- 172.21.15.2:0/2488088332 wait complete. 2024-09-10T23:30:57.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2488088332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:30:57.291 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2488088332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:30:57.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:30:57.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2488088332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:30:57.584 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:58.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 -- 172.21.15.2:0/3940624725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec109150 msgr2=0x7f96ec10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 --2- 172.21.15.2:0/3940624725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec109150 0x7f96ec10f950 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009ca0 tx=0x7f96e402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 -- 172.21.15.2:0/3940624725 shutdown_connections 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 --2- 172.21.15.2:0/3940624725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec109150 0x7f96ec10f950 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 --2- 172.21.15.2:0/3940624725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ec1087d0 0x7f96ec108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 --2- 172.21.15.2:0/3940624725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec102dc0 0x7f96ec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 -- 172.21.15.2:0/3940624725 >> 172.21.15.2:0/3940624725 conn(0x7f96ec0fe830 msgr2=0x7f96ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 -- 172.21.15.2:0/3940624725 shutdown_connections 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 -- 172.21.15.2:0/3940624725 wait complete. 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 Processor -- start 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.094+0000 7f96f26d4640 1 -- start start 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f26d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 0x7f96ec1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f26d4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ec1087d0 0x7f96ec199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f26d4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec109150 0x7f96ec19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f26d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec112e50 con 0x7f96ec102dc0 2024-09-10T23:30:58.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f26d4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec112cd0 con 0x7f96ec109150 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f26d4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec112fd0 con 0x7f96ec1087d0 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 0x7f96ec1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 0x7f96ec1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58202/0 (socket says 172.21.15.2:58202) 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 -- 172.21.15.2:0/1193784947 learned_addr learned my addr 172.21.15.2:0/1193784947 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96e3fff640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ec1087d0 0x7f96ec199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f0c71640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec109150 0x7f96ec19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 -- 172.21.15.2:0/1193784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ec1087d0 msgr2=0x7f96ec199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ec1087d0 0x7f96ec199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 -- 172.21.15.2:0/1193784947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec109150 msgr2=0x7f96ec19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec109150 0x7f96ec19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 -- 172.21.15.2:0/1193784947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec19f470 con 0x7f96ec102dc0 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96f0c71640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec109150 0x7f96ec19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:58.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96ebfff640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 0x7f96ec1993c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00b4a0 tx=0x7f96dc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.095+0000 7f96e9ffb640 1 -- 172.21.15.2:0/1193784947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc015020 con 0x7f96ec102dc0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.096+0000 7f96e9ffb640 1 -- 172.21.15.2:0/1193784947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96dc011ce0 con 0x7f96ec102dc0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.096+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec19f760 con 0x7f96ec102dc0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.096+0000 7f96e9ffb640 1 -- 172.21.15.2:0/1193784947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc010dc0 con 0x7f96ec102dc0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.096+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec1a5ea0 con 0x7f96ec102dc0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.098+0000 7f96e9ffb640 1 -- 172.21.15.2:0/1193784947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f96dc011830 con 0x7f96ec102dc0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.098+0000 7f96f4aa9740 1 Processor -- start 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.098+0000 7f96f4aa9740 1 -- start start 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.098+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c828b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.098+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c92c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.098+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51c95580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c51bf8ea0 con 0x560c51c824d0 2024-09-10T23:30:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c51be82d0 con 0x560c51c93190 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560c51bec0e0 con 0x560c51c82df0 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c828b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c828b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58218/0 (socket says 172.21.15.2:58218) 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 -- 172.21.15.2:0/633584175 learned_addr learned my addr 172.21.15.2:0/633584175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96ebfff640 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c92c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96e3fff640 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51c95580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 -- 172.21.15.2:0/633584175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 msgr2=0x560c51c92c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c92c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 -- 172.21.15.2:0/633584175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 msgr2=0x560c51c95580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51c95580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 -- 172.21.15.2:0/633584175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c51946650 con 0x560c51c824d0 2024-09-10T23:30:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96ebfff640 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c92c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96f0c71640 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c828b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009a20 tx=0x7f96e4031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5b2d640496a0da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96e9ffb640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f96d80b52e0 0x7f96d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96ebfff640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f96d80b52e0 0x7f96d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.099+0000 7f96e27fc640 1 -- 172.21.15.2:0/633584175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4031710 con 0x560c51c824d0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96e27fc640 1 -- 172.21.15.2:0/633584175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e4040070 con 0x560c51c824d0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96e9ffb640 1 -- 172.21.15.2:0/1193784947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f96dc0e56a0 con 0x7f96ec102dc0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96e27fc640 1 -- 172.21.15.2:0/633584175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4004830 con 0x560c51c824d0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 -- 172.21.15.2:0/633584175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 msgr2=0x560c51c828b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96ebfff640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f96d80b52e0 0x7f96d80b77a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00b470 tx=0x7f96dc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c828b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009a20 tx=0x7f96e4031af0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 -- 172.21.15.2:0/633584175 shutdown_connections 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51c95580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c92c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/633584175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c828b0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 -- 172.21.15.2:0/633584175 >> 172.21.15.2:0/633584175 conn(0x560c51c80300 msgr2=0x560c51c814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 -- 172.21.15.2:0/633584175 shutdown_connections 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.100+0000 7f96f4aa9740 1 -- 172.21.15.2:0/633584175 wait complete. 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 -- start start 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 Processor -- start 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c92a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c82df0 0x560c51c8feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c93190 0x560c51c90490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c51a49700 con 0x560c51c824d0 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c51b83160 con 0x560c51c82df0 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560c51c95de0 con 0x560c51c93190 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f4aa9740 10 client.0 _ll_register_callbacks cb 0x560c51b9c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f0c71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c92a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f0c71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c92a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58232/0 (socket says 172.21.15.2:58232) 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f0c71640 1 -- 172.21.15.2:0/2383867504 learned_addr learned my addr 172.21.15.2:0/2383867504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96e3fff640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c82df0 0x560c51c8feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.101+0000 7f96f0c71640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c93190 0x560c51c90490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f0c71640 1 -- 172.21.15.2:0/2383867504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c93190 msgr2=0x560c51c90490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f0c71640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c93190 0x560c51c90490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f0c71640 1 -- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c82df0 msgr2=0x560c51c8feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f0c71640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c82df0 0x560c51c8feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f0c71640 1 -- 172.21.15.2:0/2383867504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c51bb0c90 con 0x560c51c824d0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f0c71640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c92a60 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009bf0 tx=0x7f96e40044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd386a15d09b5fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96cb7fe640 1 -- 172.21.15.2:0/2383867504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4050020 con 0x560c51c824d0 2024-09-10T23:30:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96cb7fe640 1 -- 172.21.15.2:0/2383867504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f96e402f870 con 0x560c51c824d0 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96e4040070 con 0x560c51c824d0 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96cb7fe640 1 -- 172.21.15.2:0/2383867504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f96e402fa70 con 0x560c51c824d0 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f4aa9740 10 client.17676 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c51ca1720 con 0x560c51c824d0 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.102+0000 7f96cb7fe640 1 -- 172.21.15.2:0/2383867504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e4040070 con 0x560c51c824d0 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96cb7fe640 1 -- 172.21.15.2:0/2383867504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f96e40305c0 con 0x560c51c824d0 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96f4aa9740 10 client.17676 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96f4aa9740 10 client.17676 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96f4aa9740 20 client.17676 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51ca2a70 0x560c51ca4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96f4aa9740 4 client.17676 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c51bfadf0 con 0x560c51ca2a70 2024-09-10T23:30:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96e3fff640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51ca2a70 0x560c51ca4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96e3fff640 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51ca2a70 0x560c51ca4e60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed89bdc0a5ee20ef server_cookie=92700842a89ecc79 in_seq=0 out_seq=0 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.103+0000 7f96cb7fe640 10 client.17676 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96cb7fe640 1 -- 172.21.15.2:0/2383867504 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c51bfadf0 con 0x560c51ca2a70 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96cb7fe640 10 client.17676 handle_command_reply: tid=0 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96f4aa9740 1 client.17676 shutdown 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 msgr2=0x560c51c92a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c92a60 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009bf0 tx=0x7f96e40044d0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 shutdown_connections 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51ca2a70 0x560c51ca4e60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.104+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c93190 0x560c51c90490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96cb7fe640 0 client.17676 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c82df0 0x560c51c8feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/2383867504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c824d0 0x560c51c92a60 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 >> 172.21.15.2:0/2383867504 conn(0x560c51c80300 msgr2=0x560c51c85ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 shutdown_connections 2024-09-10T23:30:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96f4aa9740 1 -- 172.21.15.2:0/2383867504 wait complete. 2024-09-10T23:30:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.105+0000 7f96f4aa9740 20 client.17676 trim_cache size 0 max 16384 2024-09-10T23:30:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.118+0000 7f96f4aa9740 1 Processor -- start 2024-09-10T23:30:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.118+0000 7f96f4aa9740 1 -- start start 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.118+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c824d0 0x560c51c9f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.118+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.118+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 0x560c51ca7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ac2c0 con 0x560c51c93190 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ade00 con 0x560c51c824d0 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ac990 con 0x560c51c82df0 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 0x560c51ca7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 0x560c51ca7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58246/0 (socket says 172.21.15.2:58246) 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 -- 172.21.15.2:0/779377209 learned_addr learned my addr 172.21.15.2:0/779377209 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96e3fff640 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c824d0 0x560c51c9f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 -- 172.21.15.2:0/779377209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 msgr2=0x560c51c816f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c816f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 -- 172.21.15.2:0/779377209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c824d0 msgr2=0x560c51c9f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c824d0 0x560c51c9f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 -- 172.21.15.2:0/779377209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c51c7bbb0 con 0x560c51c93190 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96f0c71640 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 0x560c51ca7e80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f96e4005d50 tx=0x7f96e4004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2125ec22fcccd06b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96e1ffb640 1 -- 172.21.15.2:0/779377209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4050070 con 0x560c51c93190 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96e1ffb640 1 -- 172.21.15.2:0/779377209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e4040040 con 0x560c51c93190 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.119+0000 7f96e1ffb640 1 -- 172.21.15.2:0/779377209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e402fc10 con 0x560c51c93190 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 -- 172.21.15.2:0/779377209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 msgr2=0x560c51ca7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 0x560c51ca7e80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f96e4005d50 tx=0x7f96e4004540 comp rx=0 tx=0).stop 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 -- 172.21.15.2:0/779377209 shutdown_connections 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c93190 0x560c51ca7e80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c82df0 0x560c51c816f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/779377209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c824d0 0x560c51c9f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 -- 172.21.15.2:0/779377209 >> 172.21.15.2:0/779377209 conn(0x560c51c80300 msgr2=0x560c51c80fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 -- 172.21.15.2:0/779377209 shutdown_connections 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 -- 172.21.15.2:0/779377209 wait complete. 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.120+0000 7f96f4aa9740 1 -- start start 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 Processor -- start 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c824d0 0x560c51ca65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 0x560c51ca6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51d0e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ad730 con 0x560c51c82df0 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ad060 con 0x560c51c93190 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1aa2a0 con 0x560c51c824d0 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f4aa9740 10 client.0 _ll_register_callbacks cb 0x7f96d40093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 0x560c51ca6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 0x560c51ca6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58252/0 (socket says 172.21.15.2:58252) 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 -- 172.21.15.2:0/778044984 learned_addr learned my addr 172.21.15.2:0/778044984 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f0c71640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c824d0 0x560c51ca65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96f0c71640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51d0e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 -- 172.21.15.2:0/778044984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c824d0 msgr2=0x560c51ca65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c824d0 0x560c51ca65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 -- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 msgr2=0x560c51d0e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51d0e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.121+0000 7f96e3fff640 1 -- 172.21.15.2:0/778044984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c51d0ec20 con 0x560c51c82df0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96e3fff640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 0x560c51ca6b10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009bb0 tx=0x7f96d4009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7d8e69b22bc67e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96cb7fe640 1 -- 172.21.15.2:0/778044984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4015c80 con 0x560c51c82df0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96cb7fe640 1 -- 172.21.15.2:0/778044984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f96d4027420 con 0x560c51c82df0 2024-09-10T23:30:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96e4040040 con 0x560c51c82df0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96cb7fe640 1 -- 172.21.15.2:0/778044984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f96d4015e20 con 0x560c51c82df0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96f4aa9740 10 client.17682 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c51d0ff20 con 0x560c51c82df0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96cb7fe640 1 -- 172.21.15.2:0/778044984 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e4040040 con 0x560c51c82df0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96cb7fe640 1 -- 172.21.15.2:0/778044984 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f96d4026810 con 0x560c51c82df0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96f4aa9740 10 client.17682 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.122+0000 7f96f4aa9740 10 client.17682 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f4aa9740 20 client.17682 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51d10720 0x560c51d12b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f4aa9740 4 client.17682 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c51bf68a0 con 0x560c51d10720 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f0c71640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51d10720 0x560c51d12b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f0c71640 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51d10720 0x560c51d12b40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=df97920c319012f4 server_cookie=bf36337082004158 in_seq=0 out_seq=0 2024-09-10T23:30:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96cb7fe640 10 client.17682 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96cb7fe640 1 -- 172.21.15.2:0/778044984 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c51bf68a0 con 0x560c51d10720 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96cb7fe640 10 client.17682 handle_command_reply: tid=0 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.123+0000 7f96f4aa9740 1 client.17682 shutdown 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 msgr2=0x560c51ca6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 0x560c51ca6b10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009bb0 tx=0x7f96d4009660 comp rx=0 tx=0).stop 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 shutdown_connections 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x560c51d10720 0x560c51d12b40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c51c93190 0x560c51d0e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c51c82df0 0x560c51ca6b10 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 --2- 172.21.15.2:0/778044984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c51c824d0 0x560c51ca65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 >> 172.21.15.2:0/778044984 conn(0x560c51c80300 msgr2=0x560c51c914e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96cb7fe640 0 client.17682 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:30:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 shutdown_connections 2024-09-10T23:30:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 1 -- 172.21.15.2:0/778044984 wait complete. 2024-09-10T23:30:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f4aa9740 20 client.17682 trim_cache size 0 max 16384 2024-09-10T23:30:58.133 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f96d80b52e0 msgr2=0x7f96d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f26d4640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f96d80b52e0 0x7f96d80b77a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00b470 tx=0x7f96dc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 msgr2=0x7f96ec1993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f26d4640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 0x7f96ec1993c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00b4a0 tx=0x7f96dc00b8a0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.124+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 shutdown_connections 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f96d80b52e0 0x7f96d80b77a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96ec109150 0x7f96ec19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ec1087d0 0x7f96ec199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 --2- 172.21.15.2:0/1193784947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96ec102dc0 0x7f96ec1993c0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 >> 172.21.15.2:0/1193784947 conn(0x7f96ec0fe830 msgr2=0x7f96ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 shutdown_connections 2024-09-10T23:30:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:58.125+0000 7f96f26d4640 1 -- 172.21.15.2:0/1193784947 wait complete. 2024-09-10T23:30:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:57 smithi154 ceph-mon[35136]: pgmap v550: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:30:58.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:57 smithi177 ceph-mon[35760]: pgmap v550: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:30:58.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:57 smithi002 ceph-mon[31150]: pgmap v550: 97 pgs: 97 active+clean; 965 KiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:30:58.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:30:59.120 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.623+0000 7f409467d640 1 -- 172.21.15.2:0/3228316635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c109150 msgr2=0x7f408c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.623+0000 7f409467d640 1 --2- 172.21.15.2:0/3228316635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c109150 0x7f408c10f950 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4084009ca0 tx=0x7f408402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 -- 172.21.15.2:0/3228316635 shutdown_connections 2024-09-10T23:30:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 --2- 172.21.15.2:0/3228316635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c109150 0x7f408c10f950 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 --2- 172.21.15.2:0/3228316635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c1087d0 0x7f408c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 --2- 172.21.15.2:0/3228316635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f408c102dc0 0x7f408c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 -- 172.21.15.2:0/3228316635 >> 172.21.15.2:0/3228316635 conn(0x7f408c0fe830 msgr2=0x7f408c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 -- 172.21.15.2:0/3228316635 shutdown_connections 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 -- 172.21.15.2:0/3228316635 wait complete. 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 Processor -- start 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 -- start start 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.624+0000 7f409467d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f408c102dc0 0x7f408c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 0x7f408c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c109150 0x7f408c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f408c112dd0 con 0x7f408c1087d0 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f408c112c50 con 0x7f408c102dc0 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f408c112f50 con 0x7f408c109150 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 0x7f408c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 0x7f408c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58280/0 (socket says 172.21.15.2:58280) 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 -- 172.21.15.2:0/2393025196 learned_addr learned my addr 172.21.15.2:0/2393025196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4092419640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f408c102dc0 0x7f408c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4092c1a640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c109150 0x7f408c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 -- 172.21.15.2:0/2393025196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c109150 msgr2=0x7f408c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c109150 0x7f408c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 -- 172.21.15.2:0/2393025196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f408c102dc0 msgr2=0x7f408c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f408c102dc0 0x7f408c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 -- 172.21.15.2:0/2393025196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c1a7660 con 0x7f408c1087d0 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4092c1a640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c109150 0x7f408c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f4091c18640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 0x7f408c0759e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f407c00c890 tx=0x7f407c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f40837fe640 1 -- 172.21.15.2:0/2393025196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c004220 con 0x7f408c1087d0 2024-09-10T23:30:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f40837fe640 1 -- 172.21.15.2:0/2393025196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f407c0043c0 con 0x7f408c1087d0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c1a7950 con 0x7f408c1087d0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f40837fe640 1 -- 172.21.15.2:0/2393025196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c004a00 con 0x7f408c1087d0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.625+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c1a7e90 con 0x7f408c1087d0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 Processor -- start 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f40837fe640 1 -- 172.21.15.2:0/2393025196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f407c0079b0 con 0x7f408c1087d0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 -- start start 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 0x55e9bf4918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf49d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e9bf407ea0 con 0x55e9bf4914d0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e9bf3f72d0 con 0x55e9bf491df0 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.628+0000 7f4096a52740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9bf3fb0e0 con 0x55e9bf49dd80 2024-09-10T23:30:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 0x55e9bf4918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 0x55e9bf4918b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58288/0 (socket says 172.21.15.2:58288) 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 -- 172.21.15.2:0/3859953801 learned_addr learned my addr 172.21.15.2:0/3859953801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4091c18640 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092419640 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf49d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 -- 172.21.15.2:0/3859953801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 msgr2=0x55e9bf4a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 -- 172.21.15.2:0/3859953801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 msgr2=0x55e9bf49d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf49d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 -- 172.21.15.2:0/3859953801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9bf155650 con 0x55e9bf4914d0 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4091c18640 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092c1a640 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 0x55e9bf4918b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4084035000 tx=0x7f40840099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e216faa52091d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f40837fe640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40780b52e0 0x7f40780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4092419640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40780b52e0 0x7f40780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f4080ff9640 1 -- 172.21.15.2:0/3859953801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084031450 con 0x55e9bf4914d0 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.629+0000 7f40837fe640 1 -- 172.21.15.2:0/2393025196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f407c0e5880 con 0x7f408c1087d0 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4080ff9640 1 -- 172.21.15.2:0/3859953801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4084036040 con 0x55e9bf4914d0 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4080ff9640 1 -- 172.21.15.2:0/3859953801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084004460 con 0x55e9bf4914d0 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 -- 172.21.15.2:0/3859953801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 msgr2=0x55e9bf4918b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4092419640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40780b52e0 0x7f40780b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55e9bf4901e0 tx=0x7f408800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 0x55e9bf4918b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4084035000 tx=0x7f40840099c0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 -- 172.21.15.2:0/3859953801 shutdown_connections 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf49d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 --2- 172.21.15.2:0/3859953801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf4914d0 0x55e9bf4918b0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 -- 172.21.15.2:0/3859953801 >> 172.21.15.2:0/3859953801 conn(0x55e9bf48f300 msgr2=0x55e9bf4904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.630+0000 7f4096a52740 1 -- 172.21.15.2:0/3859953801 shutdown_connections 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 -- 172.21.15.2:0/3859953801 wait complete. 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 -- start start 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 Processor -- start 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf4914d0 0x55e9bf49d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf49b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e9bf258700 con 0x55e9bf491df0 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e9bf392160 con 0x55e9bf4914d0 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9bf4a09a0 con 0x55e9bf49dd80 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4096a52740 10 client.0 _ll_register_callbacks cb 0x55e9bf3ab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4091c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4091c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58304/0 (socket says 172.21.15.2:58304) 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4091c18640 1 -- 172.21.15.2:0/3659666769 learned_addr learned my addr 172.21.15.2:0/3659666769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4092419640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf4914d0 0x55e9bf49d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.631+0000 7f4092c1a640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf49b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4091c18640 1 -- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 msgr2=0x55e9bf49b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4091c18640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf49b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4091c18640 1 -- 172.21.15.2:0/3659666769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf4914d0 msgr2=0x55e9bf49d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4091c18640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf4914d0 0x55e9bf49d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4091c18640 1 -- 172.21.15.2:0/3659666769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9bf3bfc90 con 0x55e9bf491df0 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4091c18640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49ab20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f407c0a9260 tx=0x7f407c0eb310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99eab38d97e7511 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4075ffb640 1 -- 172.21.15.2:0/3659666769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c01d040 con 0x55e9bf491df0 2024-09-10T23:30:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4075ffb640 1 -- 172.21.15.2:0/3659666769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f407c0e3440 con 0x55e9bf491df0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4084036040 con 0x55e9bf491df0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4075ffb640 1 -- 172.21.15.2:0/3659666769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f407c0ab940 con 0x55e9bf491df0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4096a52740 10 client.17694 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9bf4ac360 con 0x55e9bf491df0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4075ffb640 1 -- 172.21.15.2:0/3659666769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4084036040 con 0x55e9bf491df0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.632+0000 7f4075ffb640 1 -- 172.21.15.2:0/3659666769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f407c0ab250 con 0x55e9bf491df0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4096a52740 10 client.17694 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4096a52740 10 client.17694 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4096a52740 20 client.17694 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4096a52740 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf4ad810 0x55e9bf4afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4096a52740 4 client.17694 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9bf409df0 con 0x55e9bf4ad810 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4092419640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf4ad810 0x55e9bf4afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4075ffb640 10 client.17694 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.633+0000 7f4092419640 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf4ad810 0x55e9bf4afc20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ca90889b83b26fb8 server_cookie=c77ff715a670c9d7 in_seq=0 out_seq=0 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4075ffb640 1 -- 172.21.15.2:0/3659666769 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9bf409df0 con 0x55e9bf4ad810 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4075ffb640 10 client.17694 handle_command_reply: tid=0 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 client.17694 shutdown 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 msgr2=0x55e9bf49ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49ab20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f407c0a9260 tx=0x7f407c0eb310 comp rx=0 tx=0).stop 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 shutdown_connections 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf4ad810 0x55e9bf4afc20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf49dd80 0x55e9bf49b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49ab20 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4075ffb640 0 client.17694 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 --2- 172.21.15.2:0/3659666769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf4914d0 0x55e9bf49d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 >> 172.21.15.2:0/3659666769 conn(0x55e9bf48f300 msgr2=0x55e9bf494e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 shutdown_connections 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 1 -- 172.21.15.2:0/3659666769 wait complete. 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.634+0000 7f4096a52740 20 client.17694 trim_cache size 0 max 16384 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.647+0000 7f4096a52740 1 Processor -- start 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.647+0000 7f4096a52740 1 -- start start 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4096a52740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4096a52740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4096a52740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf49dd80 0x55e9bf49f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4096a52740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1b05a0 con 0x55e9bf491df0 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4096a52740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1b20e0 con 0x55e9bf49dd80 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4096a52740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1b0c70 con 0x55e9bf4914d0 2024-09-10T23:30:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58320/0 (socket says 172.21.15.2:58320) 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 -- 172.21.15.2:0/2349948308 learned_addr learned my addr 172.21.15.2:0/2349948308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4092419640 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 -- 172.21.15.2:0/2349948308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 msgr2=0x55e9bf4a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 -- 172.21.15.2:0/2349948308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf49dd80 msgr2=0x55e9bf49f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf49dd80 0x55e9bf49f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 -- 172.21.15.2:0/2349948308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9bf499020 con 0x55e9bf491df0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4091c18640 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49f170 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f407c005fd0 tx=0x7f407c0045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e906cae8d5cf61de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4077fff640 1 -- 172.21.15.2:0/2349948308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c01d070 con 0x55e9bf491df0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4077fff640 1 -- 172.21.15.2:0/2349948308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f407c0ac6f0 con 0x55e9bf491df0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.648+0000 7f4077fff640 1 -- 172.21.15.2:0/2349948308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0ab760 con 0x55e9bf491df0 2024-09-10T23:30:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 -- 172.21.15.2:0/2349948308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 msgr2=0x55e9bf49f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49f170 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f407c005fd0 tx=0x7f407c0045b0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 -- 172.21.15.2:0/2349948308 shutdown_connections 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf49dd80 0x55e9bf49f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf491df0 0x55e9bf49f170 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 --2- 172.21.15.2:0/2349948308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 -- 172.21.15.2:0/2349948308 >> 172.21.15.2:0/2349948308 conn(0x55e9bf48f300 msgr2=0x55e9bf49c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 -- 172.21.15.2:0/2349948308 shutdown_connections 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 -- 172.21.15.2:0/2349948308 wait complete. 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.649+0000 7f4096a52740 1 -- start start 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 Processor -- start 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf4a6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1b1a10 con 0x55e9bf49dd80 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1b1340 con 0x55e9bf491df0 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1ae580 con 0x55e9bf4914d0 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4096a52740 10 client.0 _ll_register_callbacks cb 0x7f407c0058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58326/0 (socket says 172.21.15.2:58326) 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 -- 172.21.15.2:0/206920010 learned_addr learned my addr 172.21.15.2:0/206920010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092419640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 -- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 msgr2=0x55e9bf4a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4091c18640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf4a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 -- 172.21.15.2:0/206920010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 msgr2=0x55e9bf4a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf4a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 -- 172.21.15.2:0/206920010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9bf4a1490 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4092c1a640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0c60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4084006010 tx=0x7f40840095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f748f699d14be64e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.650+0000 7f4075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4075ffb640 1 -- 172.21.15.2:0/206920010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408404a040 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f407c0ac6f0 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4075ffb640 1 -- 172.21.15.2:0/206920010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4084003970 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4075ffb640 1 -- 172.21.15.2:0/206920010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4084003b70 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 10 client.17700 fetch_fsmap learned FSMap version 28 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9bf51b200 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4075ffb640 1 -- 172.21.15.2:0/206920010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f407c0ac6f0 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4075ffb640 1 -- 172.21.15.2:0/206920010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f408404d070 con 0x55e9bf49dd80 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 10 client.17700 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:30:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 10 client.17700 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 20 client.17700 populate_metadata read hostname 'smithi002' 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf51b550 0x55e9bf51d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 4 client.17700 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.651+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9bf4058a0 con 0x55e9bf51b550 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4092419640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf51b550 0x55e9bf51d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4092419640 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf51b550 0x55e9bf51d940 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8360e1440d493bf6 server_cookie=802e032098e8d7eb in_seq=0 out_seq=0 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4075ffb640 10 client.17700 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4075ffb640 1 -- 172.21.15.2:0/206920010 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9bf4058a0 con 0x55e9bf51b550 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4075ffb640 10 client.17700 handle_command_reply: tid=0 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 client.17700 shutdown 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 msgr2=0x55e9bf4a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0c60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4084006010 tx=0x7f40840095d0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 shutdown_connections 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55e9bf51b550 0x55e9bf51d940 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e9bf49dd80 0x55e9bf4a0c60 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e9bf491df0 0x55e9bf4a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 --2- 172.21.15.2:0/206920010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e9bf4914d0 0x55e9bf4a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 >> 172.21.15.2:0/206920010 conn(0x55e9bf48f300 msgr2=0x55e9bf48dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.652+0000 7f4075ffb640 0 client.17700 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:30:59.673 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 shutdown_connections 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f4096a52740 1 -- 172.21.15.2:0/206920010 wait complete. 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f4096a52740 20 client.17700 trim_cache size 0 max 16384 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40780b52e0 msgr2=0x7f40780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40780b52e0 0x7f40780b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55e9bf4901e0 tx=0x7f408800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 msgr2=0x7f408c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 0x7f408c0759e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f407c00c890 tx=0x7f407c00cc90 comp rx=0 tx=0).stop 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 shutdown_connections 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f40780b52e0 0x7f40780b77a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f408c109150 0x7f408c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f408c1087d0 0x7f408c0759e0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 --2- 172.21.15.2:0/2393025196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f408c102dc0 0x7f408c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 >> 172.21.15.2:0/2393025196 conn(0x7f408c0fe830 msgr2=0x7f408c0ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 shutdown_connections 2024-09-10T23:30:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:30:59.653+0000 7f409467d640 1 -- 172.21.15.2:0/2393025196 wait complete. 2024-09-10T23:31:00.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:30:59 smithi002 ceph-mon[31150]: pgmap v551: 97 pgs: 97 active+clean; 1.0 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:30:59 smithi154 ceph-mon[35136]: pgmap v551: 97 pgs: 97 active+clean; 1.0 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:00.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:31:00.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:30:59 smithi177 ceph-mon[35760]: pgmap v551: 97 pgs: 97 active+clean; 1.0 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:00.630 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:01.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 -- 172.21.15.2:0/2979761146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 msgr2=0x7fde281031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 --2- 172.21.15.2:0/2979761146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde281031a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fde18009900 tx=0x7fde1802a410 comp rx=0 tx=0).stop 2024-09-10T23:31:01.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 -- 172.21.15.2:0/2979761146 shutdown_connections 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 --2- 172.21.15.2:0/2979761146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde28109150 0x7fde2810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 --2- 172.21.15.2:0/2979761146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde281087d0 0x7fde28108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 --2- 172.21.15.2:0/2979761146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde281031a0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 -- 172.21.15.2:0/2979761146 >> 172.21.15.2:0/2979761146 conn(0x7fde280fe830 msgr2=0x7fde28100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 -- 172.21.15.2:0/2979761146 shutdown_connections 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.124+0000 7fde2d190640 1 -- 172.21.15.2:0/2979761146 wait complete. 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.125+0000 7fde2d190640 1 Processor -- start 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.125+0000 7fde2d190640 1 -- start start 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2d190640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde2819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2d190640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde281087d0 0x7fde2819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2d190640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde28109150 0x7fde281a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2d190640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde28112e60 con 0x7fde28102dc0 2024-09-10T23:31:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2d190640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde28112ce0 con 0x7fde281087d0 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2d190640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fde28112fe0 con 0x7fde28109150 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde2819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde2819b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52034/0 (socket says 172.21.15.2:52034) 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 -- 172.21.15.2:0/973865834 learned_addr learned my addr 172.21.15.2:0/973865834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2759e640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde28109150 0x7fde281a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde2659c640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde281087d0 0x7fde2819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 -- 172.21.15.2:0/973865834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde28109150 msgr2=0x7fde281a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde28109150 0x7fde281a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 -- 172.21.15.2:0/973865834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde281087d0 msgr2=0x7fde2819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde281087d0 0x7fde2819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 -- 172.21.15.2:0/973865834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde281a1560 con 0x7fde28102dc0 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde26d9d640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde2819b4b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fde18005ab0 tx=0x7fde18003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:01.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.126+0000 7fde1ffff640 1 -- 172.21.15.2:0/973865834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1803f070 con 0x7fde28102dc0 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.127+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde281a17f0 con 0x7fde28102dc0 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.127+0000 7fde1ffff640 1 -- 172.21.15.2:0/973865834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde18031d60 con 0x7fde28102dc0 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.127+0000 7fde1ffff640 1 -- 172.21.15.2:0/973865834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18035030 con 0x7fde28102dc0 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.127+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde281a7f10 con 0x7fde28102dc0 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 Processor -- start 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 -- start start 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde1ffff640 1 -- 172.21.15.2:0/973865834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fde1803b580 con 0x7fde28102dc0 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d6df0 0x5640240e2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 0x5640240e5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56402404cea0 con 0x5640240e2d80 2024-09-10T23:31:01.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56402403c2d0 con 0x5640240d64d0 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.129+0000 7fde2f565740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5640240400e0 con 0x5640240d6df0 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 0x5640240e5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 0x5640240e5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52046/0 (socket says 172.21.15.2:52046) 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2659c640 1 -- 172.21.15.2:0/3732022322 learned_addr learned my addr 172.21.15.2:0/3732022322 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde26d9d640 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d6df0 0x5640240e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 -- 172.21.15.2:0/3732022322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d6df0 msgr2=0x5640240e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d6df0 0x5640240e2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 -- 172.21.15.2:0/3732022322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 msgr2=0x5640240e5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 0x5640240e5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 -- 172.21.15.2:0/3732022322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564023d9a650 con 0x5640240d64d0 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2659c640 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 0x5640240e5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:01.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde26d9d640 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d6df0 0x5640240e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde2759e640 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d68b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde20009f30 tx=0x7fde20010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f414dd753b71eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde1ffff640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fde140b52e0 0x7fde140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde26d9d640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fde140b52e0 0x7fde140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.130+0000 7fde1d7fa640 1 -- 172.21.15.2:0/3732022322 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20016070 con 0x5640240d64d0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde1d7fa640 1 -- 172.21.15.2:0/3732022322 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde20004d20 con 0x5640240d64d0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde1d7fa640 1 -- 172.21.15.2:0/3732022322 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20012770 con 0x5640240d64d0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde1ffff640 1 -- 172.21.15.2:0/973865834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fde181067b0 con 0x7fde28102dc0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 -- 172.21.15.2:0/3732022322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 msgr2=0x5640240d68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde26d9d640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fde140b52e0 0x7fde140b77a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fde18104630 tx=0x7fde18031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d68b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde20009f30 tx=0x7fde20010800 comp rx=0 tx=0).stop 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 -- 172.21.15.2:0/3732022322 shutdown_connections 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240e2d80 0x5640240e5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d6df0 0x5640240e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 --2- 172.21.15.2:0/3732022322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d68b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.131+0000 7fde2f565740 1 -- 172.21.15.2:0/3732022322 >> 172.21.15.2:0/3732022322 conn(0x5640240d4300 msgr2=0x5640240d54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 -- 172.21.15.2:0/3732022322 shutdown_connections 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 -- 172.21.15.2:0/3732022322 wait complete. 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 -- start start 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 Processor -- start 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240e2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240dfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564023e9d700 con 0x5640240d6df0 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564023fd7160 con 0x5640240d64d0 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5640240e5a00 con 0x5640240e2d80 2024-09-10T23:31:01.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2f565740 10 client.0 _ll_register_callbacks cb 0x564023ff09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240dfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240dfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52058/0 (socket says 172.21.15.2:52058) 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.132+0000 7fde2659c640 1 -- 172.21.15.2:0/4266195692 learned_addr learned my addr 172.21.15.2:0/4266195692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2759e640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240e2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2759e640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2659c640 1 -- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 msgr2=0x5640240e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2659c640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2659c640 1 -- 172.21.15.2:0/4266195692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 msgr2=0x5640240e2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2659c640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240e2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2659c640 1 -- 172.21.15.2:0/4266195692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564024004c90 con 0x5640240d6df0 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2759e640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240e2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2659c640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240dfa60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fde1000bf10 tx=0x7fde10012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3610cf30bae2b1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde0e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde0e7fc640 1 -- 172.21.15.2:0/4266195692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10010960 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde0e7fc640 1 -- 172.21.15.2:0/4266195692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fde10010b00 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde20004d20 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde0e7fc640 1 -- 172.21.15.2:0/4266195692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde10010d00 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2f565740 10 client.17712 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640240f1360 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.133+0000 7fde0e7fc640 1 -- 172.21.15.2:0/4266195692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde20004d20 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde0e7fc640 1 -- 172.21.15.2:0/4266195692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fde10019070 con 0x5640240d6df0 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2f565740 10 client.17712 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2f565740 10 client.17712 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2f565740 20 client.17712 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2f565740 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5640240f2860 0x5640240f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2f565740 4 client.17712 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56402404edf0 con 0x5640240f2860 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.134+0000 7fde2759e640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5640240f2860 0x5640240f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2759e640 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5640240f2860 0x5640240f4c50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8106542008e30124 server_cookie=1a6043aae2746d23 in_seq=0 out_seq=0 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde0e7fc640 10 client.17712 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde0e7fc640 1 -- 172.21.15.2:0/4266195692 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56402404edf0 con 0x5640240f2860 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde0e7fc640 10 client.17712 handle_command_reply: tid=0 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 client.17712 shutdown 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 msgr2=0x5640240dfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240dfa60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fde1000bf10 tx=0x7fde10012820 comp rx=0 tx=0).stop 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 shutdown_connections 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x5640240f2860 0x5640240f4c50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240dfa60 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 --2- 172.21.15.2:0/4266195692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240e2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 >> 172.21.15.2:0/4266195692 conn(0x5640240d4300 msgr2=0x5640240d9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.135+0000 7fde0e7fc640 0 client.17712 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.136+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 shutdown_connections 2024-09-10T23:31:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.136+0000 7fde2f565740 1 -- 172.21.15.2:0/4266195692 wait complete. 2024-09-10T23:31:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.136+0000 7fde2f565740 20 client.17712 trim_cache size 0 max 16384 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 Processor -- start 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 -- start start 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde281b05a0 con 0x5640240d6df0 2024-09-10T23:31:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde281b20e0 con 0x5640240d64d0 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2f565740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fde281b0c70 con 0x5640240e2d80 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52060/0 (socket says 172.21.15.2:52060) 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 -- 172.21.15.2:0/764246830 learned_addr learned my addr 172.21.15.2:0/764246830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2759e640 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 -- 172.21.15.2:0/764246830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 msgr2=0x5640240dcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240dcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 -- 172.21.15.2:0/764246830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 msgr2=0x5640240d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.149+0000 7fde2659c640 1 -- 172.21.15.2:0/764246830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640240e0370 con 0x5640240d6df0 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.150+0000 7fde2759e640 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240dcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.150+0000 7fde2659c640 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e17a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fde10001eb0 tx=0x7fde100057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c950594a4ef4b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.150+0000 7fde1cff9640 1 -- 172.21.15.2:0/764246830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10012d20 con 0x5640240d6df0 2024-09-10T23:31:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.150+0000 7fde1cff9640 1 -- 172.21.15.2:0/764246830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde10021030 con 0x5640240d6df0 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.150+0000 7fde1cff9640 1 -- 172.21.15.2:0/764246830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100042c0 con 0x5640240d6df0 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- 172.21.15.2:0/764246830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 msgr2=0x5640240e17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e17a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fde10001eb0 tx=0x7fde100057d0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- 172.21.15.2:0/764246830 shutdown_connections 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240e2d80 0x5640240dcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e17a0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- 172.21.15.2:0/764246830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240d64d0 0x5640240d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- 172.21.15.2:0/764246830 >> 172.21.15.2:0/764246830 conn(0x5640240d4300 msgr2=0x5640240e1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- 172.21.15.2:0/764246830 shutdown_connections 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- 172.21.15.2:0/764246830 wait complete. 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- start start 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 Processor -- start 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d64d0 0x5640240e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240e2d80 0x5640240e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde281b1a10 con 0x5640240d6df0 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde281b1340 con 0x5640240e2d80 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fde281ae580 con 0x5640240d64d0 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.151+0000 7fde2f565740 10 client.0 _ll_register_callbacks cb 0x7fde1000b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52064/0 (socket says 172.21.15.2:52064) 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 -- 172.21.15.2:0/2412707138 learned_addr learned my addr 172.21.15.2:0/2412707138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2759e640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d64d0 0x5640240e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2759e640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240e2d80 0x5640240e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 -- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d64d0 msgr2=0x5640240e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d64d0 0x5640240e6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 -- 172.21.15.2:0/2412707138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240e2d80 msgr2=0x5640240e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240e2d80 0x5640240e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 -- 172.21.15.2:0/2412707138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402415e8c0 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2659c640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e7260 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fde10005b90 tx=0x7fde1000b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a83449ed7d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde0e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde0e7fc640 1 -- 172.21.15.2:0/2412707138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10039060 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde0e7fc640 1 -- 172.21.15.2:0/2412707138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fde10010760 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.152+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde10021030 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde0e7fc640 1 -- 172.21.15.2:0/2412707138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde10004260 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 10 client.17718 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56402415fb10 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde0e7fc640 1 -- 172.21.15.2:0/2412707138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde10021030 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde0e7fc640 1 -- 172.21.15.2:0/2412707138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fde10019050 con 0x5640240d6df0 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 10 client.17718 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 10 client.17718 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:31:01.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 20 client.17718 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x564024160170 0x564024162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 4 client.17718 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56402404a8a0 con 0x564024160170 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.153+0000 7fde2759e640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x564024160170 0x564024162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde0e7fc640 10 client.17718 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2759e640 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x564024160170 0x564024162560 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10726bf9ce5476ca server_cookie=cc9722587a46996e in_seq=0 out_seq=0 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde0e7fc640 1 -- 172.21.15.2:0/2412707138 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56402404a8a0 con 0x564024160170 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde0e7fc640 10 client.17718 handle_command_reply: tid=0 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 client.17718 shutdown 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 msgr2=0x5640240e7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e7260 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fde10005b90 tx=0x7fde1000b520 comp rx=0 tx=0).stop 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 shutdown_connections 2024-09-10T23:31:01.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x564024160170 0x564024162560 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640240e2d80 0x5640240e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640240d6df0 0x5640240e7260 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 --2- 172.21.15.2:0/2412707138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640240d64d0 0x5640240e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 >> 172.21.15.2:0/2412707138 conn(0x5640240d4300 msgr2=0x5640240e18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde0e7fc640 0 client.17718 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 shutdown_connections 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.154+0000 7fde2f565740 1 -- 172.21.15.2:0/2412707138 wait complete. 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2f565740 20 client.17718 trim_cache size 0 max 16384 2024-09-10T23:31:01.163 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fde140b52e0 msgr2=0x7fde140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fde140b52e0 0x7fde140b77a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fde18104630 tx=0x7fde18031400 comp rx=0 tx=0).stop 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 msgr2=0x7fde2819b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde2819b4b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fde18005ab0 tx=0x7fde18003cd0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 shutdown_connections 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fde140b52e0 0x7fde140b77a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde28109150 0x7fde281a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde281087d0 0x7fde2819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 --2- 172.21.15.2:0/973865834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28102dc0 0x7fde2819b4b0 secure :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fde18005ab0 tx=0x7fde18003cd0 comp rx=0 tx=0).stop 2024-09-10T23:31:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 >> 172.21.15.2:0/973865834 conn(0x7fde280fe830 msgr2=0x7fde280ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 shutdown_connections 2024-09-10T23:31:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:01.155+0000 7fde2d190640 1 -- 172.21.15.2:0/973865834 wait complete. 2024-09-10T23:31:01.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:31:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:02.220 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:01 smithi002 ceph-mon[31150]: pgmap v552: 97 pgs: 97 active+clean; 1.0 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:01 smithi154 ceph-mon[35136]: pgmap v552: 97 pgs: 97 active+clean; 1.0 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:02.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:01 smithi177 ceph-mon[35760]: pgmap v552: 97 pgs: 97 active+clean; 1.0 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:02.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 -- 172.21.15.2:0/1659020867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c1087d0 msgr2=0x7f915c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 --2- 172.21.15.2:0/1659020867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c1087d0 0x7f915c108c10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f914c009900 tx=0x7f914c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 -- 172.21.15.2:0/1659020867 shutdown_connections 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 --2- 172.21.15.2:0/1659020867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f915c109150 0x7f915c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 --2- 172.21.15.2:0/1659020867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c1087d0 0x7f915c108c10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 --2- 172.21.15.2:0/1659020867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f915c102dc0 0x7f915c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 -- 172.21.15.2:0/1659020867 >> 172.21.15.2:0/1659020867 conn(0x7f915c0fe830 msgr2=0x7f915c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 -- 172.21.15.2:0/1659020867 shutdown_connections 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.560+0000 7f9163335640 1 -- 172.21.15.2:0/1659020867 wait complete. 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 Processor -- start 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 -- start start 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 0x7f915c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f915c1087d0 0x7f915c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f915c109150 0x7f915c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f915c112dd0 con 0x7f915c102dc0 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f915c112c50 con 0x7f915c1087d0 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.561+0000 7f9163335640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f915c112f50 con 0x7f915c109150 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 0x7f915c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 0x7f915c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52088/0 (socket says 172.21.15.2:52088) 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 -- 172.21.15.2:0/4256770103 learned_addr learned my addr 172.21.15.2:0/4256770103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91618d2640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f915c109150 0x7f915c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91608d0640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f915c1087d0 0x7f915c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 -- 172.21.15.2:0/4256770103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f915c109150 msgr2=0x7f915c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f915c109150 0x7f915c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 -- 172.21.15.2:0/4256770103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f915c1087d0 msgr2=0x7f915c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f915c1087d0 0x7f915c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 -- 172.21.15.2:0/4256770103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c19f390 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91610d1640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 0x7f915c1992e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f915800d950 tx=0x7f915800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91527fc640 1 -- 172.21.15.2:0/4256770103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158017070 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91527fc640 1 -- 172.21.15.2:0/4256770103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9158009c30 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915c19f680 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f91527fc640 1 -- 172.21.15.2:0/4256770103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800f620 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.562+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915c1a5f10 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 Processor -- start 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 -- start start 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91527fc640 1 -- 172.21.15.2:0/4256770103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9158010460 con 0x7f915c102dc0 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5eb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 0x55878d5edd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878d555ea0 con 0x55878d5df0f0 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55878d5452d0 con 0x55878d5eb9a0 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f916570a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55878d5490e0 con 0x55878d5dfa10 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52090/0 (socket says 172.21.15.2:52090) 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 -- 172.21.15.2:0/2549510647 learned_addr learned my addr 172.21.15.2:0/2549510647 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91610d1640 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5eb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 -- 172.21.15.2:0/2549510647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 msgr2=0x55878d5eb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5eb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 -- 172.21.15.2:0/2549510647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 msgr2=0x55878d5edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 0x55878d5edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91618d2640 1 -- 172.21.15.2:0/2549510647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878d2a3650 con 0x55878d5df0f0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.566+0000 7f91610d1640 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5eb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91618d2640 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5df4d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9154009fd0 tx=0x7f91540118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b9b24ca5ed10a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91477fe640 1 -- 172.21.15.2:0/2549510647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154004d20 con 0x55878d5df0f0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91477fe640 1 -- 172.21.15.2:0/2549510647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9154004050 con 0x55878d5df0f0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91477fe640 1 -- 172.21.15.2:0/2549510647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154005260 con 0x55878d5df0f0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91527fc640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91480b5360 0x7f91480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91610d1640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91480b5360 0x7f91480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.567+0000 7f91527fc640 1 -- 172.21.15.2:0/4256770103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f91580e5730 con 0x7f915c102dc0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 -- 172.21.15.2:0/2549510647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 msgr2=0x55878d5df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f91610d1640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91480b5360 0x7f91480b7820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f91580e35b0 tx=0x7f9158010cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5df4d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9154009fd0 tx=0x7f91540118d0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 -- 172.21.15.2:0/2549510647 shutdown_connections 2024-09-10T23:31:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 0x55878d5edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5eb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 --2- 172.21.15.2:0/2549510647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5df4d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 -- 172.21.15.2:0/2549510647 >> 172.21.15.2:0/2549510647 conn(0x55878d5dcf20 msgr2=0x55878d5de0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 -- 172.21.15.2:0/2549510647 shutdown_connections 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 -- 172.21.15.2:0/2549510647 wait complete. 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 -- start start 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.568+0000 7f916570a740 1 Processor -- start 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5eb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5dfa10 0x55878d5e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5eb9a0 0x55878d5e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878d3a6700 con 0x55878d5df0f0 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55878d4e0160 con 0x55878d5dfa10 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55878d5ee620 con 0x55878d5eb9a0 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 10 client.0 _ll_register_callbacks cb 0x55878d4f99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5eb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52094/0 (socket says 172.21.15.2:52094) 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 -- 172.21.15.2:0/713975380 learned_addr learned my addr 172.21.15.2:0/713975380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5eb9a0 0x55878d5e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91608d0640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5dfa10 0x55878d5e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 -- 172.21.15.2:0/713975380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5eb9a0 msgr2=0x55878d5e8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5eb9a0 0x55878d5e8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 -- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5dfa10 msgr2=0x55878d5e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5dfa10 0x55878d5e86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 -- 172.21.15.2:0/713975380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878d50dc90 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f91618d2640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5eb280 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9154005c40 tx=0x7f9154003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b3db438d344a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f9144ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f9144ff9640 1 -- 172.21.15.2:0/713975380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154004e50 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f9144ff9640 1 -- 172.21.15.2:0/713975380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9154005040 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.569+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9154004050 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f9144ff9640 1 -- 172.21.15.2:0/713975380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9154005240 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 10 client.17730 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55878d5f9f70 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f9144ff9640 1 -- 172.21.15.2:0/713975380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9154004050 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f9144ff9640 1 -- 172.21.15.2:0/713975380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f915400f990 con 0x55878d5df0f0 2024-09-10T23:31:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 10 client.17730 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 10 client.17730 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 20 client.17730 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d5fb370 0x55878d5fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 4 client.17730 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55878d557df0 con 0x55878d5fb370 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.570+0000 7f91608d0640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d5fb370 0x55878d5fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.571+0000 7f91608d0640 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d5fb370 0x55878d5fd760 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a518803742bca38 server_cookie=51873edec645a3b0 in_seq=0 out_seq=0 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.571+0000 7f9144ff9640 10 client.17730 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.571+0000 7f9144ff9640 1 -- 172.21.15.2:0/713975380 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55878d557df0 con 0x55878d5fb370 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.571+0000 7f9144ff9640 10 client.17730 handle_command_reply: tid=0 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.571+0000 7f916570a740 1 client.17730 shutdown 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 msgr2=0x55878d5eb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5eb280 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9154005c40 tx=0x7f9154003f90 comp rx=0 tx=0).stop 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 shutdown_connections 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5eb9a0 0x55878d5e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5dfa10 0x55878d5e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d5fb370 0x55878d5fd760 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 --2- 172.21.15.2:0/713975380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5df0f0 0x55878d5eb280 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f9144ff9640 0 client.17730 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 >> 172.21.15.2:0/713975380 conn(0x55878d5dcf20 msgr2=0x55878d5e2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 shutdown_connections 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 1 -- 172.21.15.2:0/713975380 wait complete. 2024-09-10T23:31:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.572+0000 7f916570a740 20 client.17730 trim_cache size 0 max 16384 2024-09-10T23:31:02.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.585+0000 7f916570a740 1 Processor -- start 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.585+0000 7f916570a740 1 -- start start 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f916570a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5df0f0 0x55878d5f7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f916570a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 0x55878d5ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f916570a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 0x55878d5ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f916570a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1ae380 con 0x55878d5dfa10 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f916570a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1afec0 con 0x55878d5eb9a0 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f916570a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1aea50 con 0x55878d5df0f0 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 0x55878d5ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 0x55878d5ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52104/0 (socket says 172.21.15.2:52104) 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 -- 172.21.15.2:0/977601908 learned_addr learned my addr 172.21.15.2:0/977601908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 -- 172.21.15.2:0/977601908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5df0f0 msgr2=0x55878d5f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91618d2640 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5df0f0 0x55878d5f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5df0f0 0x55878d5f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 -- 172.21.15.2:0/977601908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 msgr2=0x55878d5ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 0x55878d5ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 -- 172.21.15.2:0/977601908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878d5e9070 con 0x55878d5dfa10 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91618d2640 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5df0f0 0x55878d5f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f91608d0640 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 0x55878d5ecd90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f914c0096c0 tx=0x7f914c0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e53269130e0d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f9146ffd640 1 -- 172.21.15.2:0/977601908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c047020 con 0x55878d5dfa10 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f9146ffd640 1 -- 172.21.15.2:0/977601908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f914c031950 con 0x55878d5dfa10 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.586+0000 7f9146ffd640 1 -- 172.21.15.2:0/977601908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c035040 con 0x55878d5dfa10 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 -- 172.21.15.2:0/977601908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 msgr2=0x55878d5ecd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 0x55878d5ecd90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f914c0096c0 tx=0x7f914c0092d0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 -- 172.21.15.2:0/977601908 shutdown_connections 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5eb9a0 0x55878d5ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5dfa10 0x55878d5ecd90 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 --2- 172.21.15.2:0/977601908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5df0f0 0x55878d5f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 -- 172.21.15.2:0/977601908 >> 172.21.15.2:0/977601908 conn(0x55878d5dcf20 msgr2=0x55878d5ea520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 -- 172.21.15.2:0/977601908 shutdown_connections 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 -- 172.21.15.2:0/977601908 wait complete. 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 -- start start 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.587+0000 7f916570a740 1 Processor -- start 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5df0f0 0x55878d5f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5f1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 0x55878d5f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1af7f0 con 0x55878d5eb9a0 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1af120 con 0x55878d5df0f0 2024-09-10T23:31:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1ac360 con 0x55878d5dfa10 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f916570a740 10 client.0 _ll_register_callbacks cb 0x7f9154009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 0x55878d5f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 0x55878d5f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52108/0 (socket says 172.21.15.2:52108) 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 -- 172.21.15.2:0/3019369028 learned_addr learned my addr 172.21.15.2:0/3019369028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91608d0640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5df0f0 0x55878d5f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 -- 172.21.15.2:0/3019369028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 msgr2=0x55878d5f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 -- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5df0f0 msgr2=0x55878d5f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5df0f0 0x55878d5f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.588+0000 7f91618d2640 1 -- 172.21.15.2:0/3019369028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878d5f2440 con 0x55878d5eb9a0 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f91618d2640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 0x55878d5f1e50 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f915400a010 tx=0x7f9154009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e42510f4ed2e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f9144ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f9144ff9640 1 -- 172.21.15.2:0/3019369028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154004e60 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f9144ff9640 1 -- 172.21.15.2:0/3019369028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f91540045a0 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f914c031950 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f9144ff9640 1 -- 172.21.15.2:0/3019369028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91540047a0 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 10 client.17736 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55878d66d290 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f9144ff9640 1 -- 172.21.15.2:0/3019369028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f914c031950 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f9144ff9640 1 -- 172.21.15.2:0/3019369028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f91540055a0 con 0x55878d5eb9a0 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 10 client.17736 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 10 client.17736 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 20 client.17736 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d66d970 0x55878d66fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 4 client.17736 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.589+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55878d5538a0 con 0x55878d66d970 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f91608d0640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d66d970 0x55878d66fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f91608d0640 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d66d970 0x55878d66fd90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a1c548a6b75a8bf server_cookie=4a54e5536de5577b in_seq=0 out_seq=0 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f9144ff9640 10 client.17736 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f9144ff9640 1 -- 172.21.15.2:0/3019369028 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55878d5538a0 con 0x55878d66d970 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f9144ff9640 10 client.17736 handle_command_reply: tid=0 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 client.17736 shutdown 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 msgr2=0x55878d5f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 0x55878d5f1e50 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f915400a010 tx=0x7f9154009500 comp rx=0 tx=0).stop 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 shutdown_connections 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55878d66d970 0x55878d66fd90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878d5eb9a0 0x55878d5f1e50 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55878d5dfa10 0x55878d5f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 --2- 172.21.15.2:0/3019369028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55878d5df0f0 0x55878d5f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 >> 172.21.15.2:0/3019369028 conn(0x55878d5dcf20 msgr2=0x55878d5e9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.590+0000 7f9144ff9640 0 client.17736 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 shutdown_connections 2024-09-10T23:31:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f916570a740 1 -- 172.21.15.2:0/3019369028 wait complete. 2024-09-10T23:31:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f916570a740 20 client.17736 trim_cache size 0 max 16384 2024-09-10T23:31:02.606 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91480b5360 msgr2=0x7f91480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91480b5360 0x7f91480b7820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f91580e35b0 tx=0x7f9158010cb0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 msgr2=0x7f915c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 0x7f915c1992e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f915800d950 tx=0x7f915800de10 comp rx=0 tx=0).stop 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 shutdown_connections 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f91480b5360 0x7f91480b7820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f915c109150 0x7f915c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f915c1087d0 0x7f915c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 --2- 172.21.15.2:0/4256770103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f915c102dc0 0x7f915c1992e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 >> 172.21.15.2:0/4256770103 conn(0x7f915c0fe830 msgr2=0x7f915c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 shutdown_connections 2024-09-10T23:31:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:02.591+0000 7f9163335640 1 -- 172.21.15.2:0/4256770103 wait complete. 2024-09-10T23:31:03.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:31:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 -- 172.21.15.2:0/2167244081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c108060 msgr2=0x7f413c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 --2- 172.21.15.2:0/2167244081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c108060 0x7f413c10e860 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f413402a410 comp rx=0 tx=0).stop 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 -- 172.21.15.2:0/2167244081 shutdown_connections 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 --2- 172.21.15.2:0/2167244081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c108060 0x7f413c10e860 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 --2- 172.21.15.2:0/2167244081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c1076e0 0x7f413c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 --2- 172.21.15.2:0/2167244081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413c101cd0 0x7f413c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 -- 172.21.15.2:0/2167244081 >> 172.21.15.2:0/2167244081 conn(0x7f413c0fd700 msgr2=0x7f413c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 -- 172.21.15.2:0/2167244081 shutdown_connections 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 -- 172.21.15.2:0/2167244081 wait complete. 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.019+0000 7f4142b64640 1 Processor -- start 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 -- start start 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c101cd0 0x7f413c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 0x7f413c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413c108060 0x7f413c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f413c111d60 con 0x7f413c1076e0 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f413c111be0 con 0x7f413c101cd0 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4142b64640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f413c111ee0 con 0x7f413c108060 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 0x7f413c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 0x7f413c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52128/0 (socket says 172.21.15.2:52128) 2024-09-10T23:31:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 -- 172.21.15.2:0/3790746422 learned_addr learned my addr 172.21.15.2:0/3790746422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4140900640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c101cd0 0x7f413c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4141101640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413c108060 0x7f413c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 -- 172.21.15.2:0/3790746422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413c108060 msgr2=0x7f413c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413c108060 0x7f413c198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 -- 172.21.15.2:0/3790746422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c101cd0 msgr2=0x7f413c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c101cd0 0x7f413c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 -- 172.21.15.2:0/3790746422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c1a7780 con 0x7f413c1076e0 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f4140900640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c101cd0 0x7f413c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.020+0000 7f413bfff640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 0x7f413c1984e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f412c00ba50 tx=0x7f412c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.021+0000 7f4139ffb640 1 -- 172.21.15.2:0/3790746422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c019070 con 0x7f413c1076e0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.021+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c1a7a70 con 0x7f413c1076e0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.021+0000 7f4139ffb640 1 -- 172.21.15.2:0/3790746422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c00cbe0 con 0x7f413c1076e0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.021+0000 7f4139ffb640 1 -- 172.21.15.2:0/3790746422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0075d0 con 0x7f413c1076e0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.021+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c1a7fb0 con 0x7f413c1076e0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.023+0000 7f4139ffb640 1 -- 172.21.15.2:0/3790746422 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f412c007830 con 0x7f413c1076e0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 Processor -- start 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 -- start start 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f9214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f92fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56224f897ea0 con 0x56224f92d9a0 2024-09-10T23:31:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56224f8872d0 con 0x56224f9210f0 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4144f39740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56224f88b0e0 con 0x56224f921a10 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f92fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f92fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52136/0 (socket says 172.21.15.2:52136) 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 -- 172.21.15.2:0/879400961 learned_addr learned my addr 172.21.15.2:0/879400961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4140900640 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4141101640 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f9214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f4139ffb640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41280b52e0 0x7f41280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 -- 172.21.15.2:0/879400961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 msgr2=0x56224f92d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 -- 172.21.15.2:0/879400961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 msgr2=0x56224f9214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f9214d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.024+0000 7f413bfff640 1 -- 172.21.15.2:0/879400961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224f5e5650 con 0x56224f92d9a0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f4141101640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41280b52e0 0x7f41280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f4139ffb640 1 -- 172.21.15.2:0/3790746422 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f412c0e5450 con 0x7f413c1076e0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f413bfff640 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f92fd90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f412c0d4230 tx=0x7f412c0a78f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d2284b175f57f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f4132ffd640 1 -- 172.21.15.2:0/879400961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0ab570 con 0x56224f92d9a0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f4132ffd640 1 -- 172.21.15.2:0/879400961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c0ab730 con 0x56224f92d9a0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f4132ffd640 1 -- 172.21.15.2:0/879400961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0d1810 con 0x56224f92d9a0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.025+0000 7f4141101640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41280b52e0 0x7f41280b77a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4134005940 tx=0x7f4134009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 -- 172.21.15.2:0/879400961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 msgr2=0x56224f92fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f92fd90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f412c0d4230 tx=0x7f412c0a78f0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 -- 172.21.15.2:0/879400961 shutdown_connections 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f92fd90 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 --2- 172.21.15.2:0/879400961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f9214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 -- 172.21.15.2:0/879400961 >> 172.21.15.2:0/879400961 conn(0x56224f91ef20 msgr2=0x56224f9200c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 -- 172.21.15.2:0/879400961 shutdown_connections 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 -- 172.21.15.2:0/879400961 wait complete. 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 -- start start 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.026+0000 7f4144f39740 1 Processor -- start 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f9210f0 0x56224f92d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 0x56224f92a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56224f6e8700 con 0x56224f921a10 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56224f822160 con 0x56224f92d9a0 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56224f930620 con 0x56224f9210f0 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 10 client.0 _ll_register_callbacks cb 0x56224f83b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 0x56224f92a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 0x56224f92a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52150/0 (socket says 172.21.15.2:52150) 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 -- 172.21.15.2:0/1544945979 learned_addr learned my addr 172.21.15.2:0/1544945979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4140900640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f9210f0 0x56224f92d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4141101640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 -- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f9210f0 msgr2=0x56224f92d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f9210f0 0x56224f92d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 -- 172.21.15.2:0/1544945979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 msgr2=0x56224f92ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 -- 172.21.15.2:0/1544945979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224f84fc90 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4141101640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f413bfff640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 0x56224f92a6a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f412c0a81f0 tx=0x7f412c0e8af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803f322168edafa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f411bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f411bfff640 1 -- 172.21.15.2:0/1544945979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0b3cc0 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f411bfff640 1 -- 172.21.15.2:0/1544945979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f412c0e50e0 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.027+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c0ab730 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f411bfff640 1 -- 172.21.15.2:0/1544945979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f412c0b4b10 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 10 client.17748 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56224f93bf70 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f411bfff640 1 -- 172.21.15.2:0/1544945979 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c0ab730 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f411bfff640 1 -- 172.21.15.2:0/1544945979 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f412c0abe80 con 0x56224f921a10 2024-09-10T23:31:04.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 10 client.17748 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 10 client.17748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 20 client.17748 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f93d2c0 0x56224f93f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 4 client.17748 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56224f899df0 con 0x56224f93d2c0 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.028+0000 7f4140900640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f93d2c0 0x56224f93f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.029+0000 7f4140900640 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f93d2c0 0x56224f93f6b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=898e39d18ab543b3 server_cookie=da9b99e150bc5069 in_seq=0 out_seq=0 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.029+0000 7f411bfff640 10 client.17748 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.029+0000 7f411bfff640 1 -- 172.21.15.2:0/1544945979 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56224f899df0 con 0x56224f93d2c0 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.029+0000 7f411bfff640 10 client.17748 handle_command_reply: tid=0 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.029+0000 7f4144f39740 1 client.17748 shutdown 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 msgr2=0x56224f92a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 0x56224f92a6a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f412c0a81f0 tx=0x7f412c0e8af0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 shutdown_connections 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f93d2c0 0x56224f93f6b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f921a10 0x56224f92a6a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f411bfff640 0 client.17748 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 --2- 172.21.15.2:0/1544945979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f9210f0 0x56224f92d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 >> 172.21.15.2:0/1544945979 conn(0x56224f91ef20 msgr2=0x56224f924a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 shutdown_connections 2024-09-10T23:31:04.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 1 -- 172.21.15.2:0/1544945979 wait complete. 2024-09-10T23:31:04.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.030+0000 7f4144f39740 20 client.17748 trim_cache size 0 max 16384 2024-09-10T23:31:04.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.043+0000 7f4144f39740 1 Processor -- start 2024-09-10T23:31:04.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.043+0000 7f4144f39740 1 -- start start 2024-09-10T23:31:04.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4144f39740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 0x56224f92c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4144f39740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4144f39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4144f39740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1b0520 con 0x56224f9210f0 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4144f39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1b2060 con 0x56224f92d9a0 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4144f39740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1b0bf0 con 0x56224f921a10 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 0x56224f92c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 0x56224f92c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52164/0 (socket says 172.21.15.2:52164) 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 -- 172.21.15.2:0/3559972836 learned_addr learned my addr 172.21.15.2:0/3559972836 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:04.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f413bfff640 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 -- 172.21.15.2:0/3559972836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 msgr2=0x56224f92ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 -- 172.21.15.2:0/3559972836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 msgr2=0x56224f92f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 -- 172.21.15.2:0/3559972836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224f91a7e0 con 0x56224f9210f0 2024-09-10T23:31:04.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f4140900640 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 0x56224f92c3e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x56224f930770 tx=0x7f4124008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a210905d52ac054f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f41327fc640 1 -- 172.21.15.2:0/3559972836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41240169e0 con 0x56224f9210f0 2024-09-10T23:31:04.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f41327fc640 1 -- 172.21.15.2:0/3559972836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124020030 con 0x56224f9210f0 2024-09-10T23:31:04.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.044+0000 7f41327fc640 1 -- 172.21.15.2:0/3559972836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124024cb0 con 0x56224f9210f0 2024-09-10T23:31:04.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 -- 172.21.15.2:0/3559972836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 msgr2=0x56224f92c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 0x56224f92c3e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x56224f930770 tx=0x7f4124008040 comp rx=0 tx=0).stop 2024-09-10T23:31:04.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 -- 172.21.15.2:0/3559972836 shutdown_connections 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f92d9a0 0x56224f92f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f92ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 --2- 172.21.15.2:0/3559972836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f9210f0 0x56224f92c3e0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 -- 172.21.15.2:0/3559972836 >> 172.21.15.2:0/3559972836 conn(0x56224f91ef20 msgr2=0x56224f92bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 -- 172.21.15.2:0/3559972836 shutdown_connections 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 -- 172.21.15.2:0/3559972836 wait complete. 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.045+0000 7f4144f39740 1 -- start start 2024-09-10T23:31:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 Processor -- start 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f93ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f93f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f9a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1b1990 con 0x56224f92d9a0 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1b12c0 con 0x56224f9210f0 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1ae500 con 0x56224f921a10 2024-09-10T23:31:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4144f39740 10 client.0 _ll_register_callbacks cb 0x7f41240071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4141101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f9a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4141101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f9a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52176/0 (socket says 172.21.15.2:52176) 2024-09-10T23:31:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4141101640 1 -- 172.21.15.2:0/3043556316 learned_addr learned my addr 172.21.15.2:0/3043556316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f413bfff640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f93f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.046+0000 7f4140900640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f93ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4141101640 1 -- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 msgr2=0x56224f93f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4141101640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f93f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4141101640 1 -- 172.21.15.2:0/3043556316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 msgr2=0x56224f93ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4141101640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f93ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4141101640 1 -- 172.21.15.2:0/3043556316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224f9a9510 con 0x56224f92d9a0 2024-09-10T23:31:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4140900640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f93ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f413bfff640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f93f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4141101640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f9a8e20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f41340052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766e9ca4d623ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f411bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f411bfff640 1 -- 172.21.15.2:0/3043556316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413404d020 con 0x56224f92d9a0 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f411bfff640 1 -- 172.21.15.2:0/3043556316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4134004250 con 0x56224f92d9a0 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4124020030 con 0x56224f92d9a0 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f411bfff640 1 -- 172.21.15.2:0/3043556316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4134035040 con 0x56224f92d9a0 2024-09-10T23:31:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4144f39740 10 client.17754 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56224f9aa7f0 con 0x56224f92d9a0 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.047+0000 7f411bfff640 1 -- 172.21.15.2:0/3043556316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124020030 con 0x56224f92d9a0 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f411bfff640 1 -- 172.21.15.2:0/3043556316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f41340035f0 con 0x56224f92d9a0 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4144f39740 10 client.17754 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4144f39740 10 client.17754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4144f39740 20 client.17754 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4144f39740 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f9aaf90 0x56224f9ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4144f39740 4 client.17754 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56224f8958a0 con 0x56224f9aaf90 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4140900640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f9aaf90 0x56224f9ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f4140900640 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f9aaf90 0x56224f9ad3b0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d78903a96dcc38 server_cookie=619dff46914e8a41 in_seq=0 out_seq=0 2024-09-10T23:31:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.048+0000 7f411bfff640 10 client.17754 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f411bfff640 1 -- 172.21.15.2:0/3043556316 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56224f8958a0 con 0x56224f9aaf90 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f411bfff640 10 client.17754 handle_command_reply: tid=0 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 client.17754 shutdown 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 msgr2=0x56224f9a8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f9a8e20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f41340052c0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 shutdown_connections 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56224f9aaf90 0x56224f9ad3b0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56224f92d9a0 0x56224f9a8e20 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56224f921a10 0x56224f93f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 --2- 172.21.15.2:0/3043556316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56224f9210f0 0x56224f93ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 >> 172.21.15.2:0/3043556316 conn(0x56224f91ef20 msgr2=0x56224f92c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f411bfff640 0 client.17754 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 shutdown_connections 2024-09-10T23:31:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 1 -- 172.21.15.2:0/3043556316 wait complete. 2024-09-10T23:31:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.049+0000 7f4144f39740 20 client.17754 trim_cache size 0 max 16384 2024-09-10T23:31:04.073 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41280b52e0 msgr2=0x7f41280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41280b52e0 0x7f41280b77a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4134005940 tx=0x7f4134009260 comp rx=0 tx=0).stop 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 msgr2=0x7f413c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 0x7f413c1984e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f412c00ba50 tx=0x7f412c00bf10 comp rx=0 tx=0).stop 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 shutdown_connections 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f41280b52e0 0x7f41280b77a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413c108060 0x7f413c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f413c1076e0 0x7f413c1984e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 --2- 172.21.15.2:0/3790746422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413c101cd0 0x7f413c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 >> 172.21.15.2:0/3790746422 conn(0x7f413c0fd700 msgr2=0x7f413c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 shutdown_connections 2024-09-10T23:31:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:04.050+0000 7f4142b64640 1 -- 172.21.15.2:0/3790746422 wait complete. 2024-09-10T23:31:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:03 smithi002 ceph-mon[31150]: pgmap v553: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:31:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:03 smithi154 ceph-mon[35136]: pgmap v553: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:31:04.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:03 smithi177 ceph-mon[35760]: pgmap v553: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:31:05.842 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:31:05.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:31:06.119 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:06.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:06 smithi002 ceph-mon[31150]: pgmap v554: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:31:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:06 smithi154 ceph-mon[35136]: pgmap v554: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:31:06.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:06 smithi177 ceph-mon[35760]: pgmap v554: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 -- 172.21.15.2:0/1816861856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 msgr2=0x7fb384102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 --2- 172.21.15.2:0/1816861856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384102090 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fb374009900 tx=0x7fb37402a410 comp rx=0 tx=0).stop 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 -- 172.21.15.2:0/1816861856 shutdown_connections 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 --2- 172.21.15.2:0/1816861856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb384108040 0x7fb38410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 --2- 172.21.15.2:0/1816861856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3841076c0 0x7fb384107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 --2- 172.21.15.2:0/1816861856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384102090 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 -- 172.21.15.2:0/1816861856 >> 172.21.15.2:0/1816861856 conn(0x7fb3840fd700 msgr2=0x7fb3840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 -- 172.21.15.2:0/1816861856 shutdown_connections 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.659+0000 7fb388a2b640 1 -- 172.21.15.2:0/1816861856 wait complete. 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 Processor -- start 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 -- start start 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384103570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3841076c0 0x7fb384103ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb384108040 0x7fb384103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb384111d00 con 0x7fb384101cb0 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb384111b80 con 0x7fb384108040 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb388a2b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb384111e80 con 0x7fb3841076c0 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384103570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384103570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52190/0 (socket says 172.21.15.2:52190) 2024-09-10T23:31:06.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 -- 172.21.15.2:0/2517466622 learned_addr learned my addr 172.21.15.2:0/2517466622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb384108040 0x7fb384103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb37bfff640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3841076c0 0x7fb384103ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 -- 172.21.15.2:0/2517466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3841076c0 msgr2=0x7fb384103ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3841076c0 0x7fb384103ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 -- 172.21.15.2:0/2517466622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb384108040 msgr2=0x7fb384103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb384108040 0x7fb384103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.660+0000 7fb38259c640 1 -- 172.21.15.2:0/2517466622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3841a7670 con 0x7fb384101cb0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.661+0000 7fb38259c640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384103570 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb374005940 tx=0x7fb374004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.661+0000 7fb37b7fe640 1 -- 172.21.15.2:0/2517466622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37403f030 con 0x7fb384101cb0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.661+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3841a7900 con 0x7fb384101cb0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.661+0000 7fb37b7fe640 1 -- 172.21.15.2:0/2517466622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb374003aa0 con 0x7fb384101cb0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.661+0000 7fb37b7fe640 1 -- 172.21.15.2:0/2517466622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374035070 con 0x7fb384101cb0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.661+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3841a7de0 con 0x7fb384101cb0 2024-09-10T23:31:06.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.664+0000 7fb38ae00740 1 Processor -- start 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.664+0000 7fb38ae00740 1 -- start start 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.664+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.664+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fca800 0x5618a1fd6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.664+0000 7fb37b7fe640 1 -- 172.21.15.2:0/2517466622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb37403bcc0 con 0x7fb384101cb0 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb38ae00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5618a1f40e60 con 0x5618a1fd6790 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb38ae00740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5618a1f30290 con 0x5618a1fca800 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb38ae00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5618a1f340a0 con 0x5618a1fc9ee0 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52194/0 (socket says 172.21.15.2:52194) 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 -- 172.21.15.2:0/2515111302 learned_addr learned my addr 172.21.15.2:0/2515111302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb38259c640 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fca800 0x5618a1fd6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 -- 172.21.15.2:0/2515111302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 msgr2=0x5618a1fca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 -- 172.21.15.2:0/2515111302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fca800 msgr2=0x5618a1fd6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fca800 0x5618a1fd6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 -- 172.21.15.2:0/2515111302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618a1c8e930 con 0x5618a1fd6790 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.665+0000 7fb37bfff640 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd8b80 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009cc0 tx=0x7fb36c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58379edaf65f5d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.666+0000 7fb37b7fe640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3700b52e0 0x7fb3700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.666+0000 7fb378ff9640 1 -- 172.21.15.2:0/2515111302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c01e070 con 0x5618a1fd6790 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.666+0000 7fb378ff9640 1 -- 172.21.15.2:0/2515111302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c019ae0 con 0x5618a1fd6790 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.666+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3700b52e0 0x7fb3700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.666+0000 7fb378ff9640 1 -- 172.21.15.2:0/2515111302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00ea40 con 0x5618a1fd6790 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.666+0000 7fb37b7fe640 1 -- 172.21.15.2:0/2517466622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb374106510 con 0x7fb384101cb0 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 -- 172.21.15.2:0/2515111302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 msgr2=0x5618a1fd8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3700b52e0 0x7fb3700b77a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb384105630 tx=0x7fb37c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd8b80 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009cc0 tx=0x7fb36c011810 comp rx=0 tx=0).stop 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 -- 172.21.15.2:0/2515111302 shutdown_connections 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd8b80 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fca800 0x5618a1fd6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2515111302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 -- 172.21.15.2:0/2515111302 >> 172.21.15.2:0/2515111302 conn(0x5618a1fc7d10 msgr2=0x5618a1fc8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 -- 172.21.15.2:0/2515111302 shutdown_connections 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 -- 172.21.15.2:0/2515111302 wait complete. 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 -- start start 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.667+0000 7fb38ae00740 1 Processor -- start 2024-09-10T23:31:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fd3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5618a1d91890 con 0x5618a1fd6790 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5618a1ecad40 con 0x5618a1fc9ee0 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5618a1fd9440 con 0x5618a1fca800 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38ae00740 10 client.0 _ll_register_callbacks cb 0x5618a1f2ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52196/0 (socket says 172.21.15.2:52196) 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 -- 172.21.15.2:0/2513517062 learned_addr learned my addr 172.21.15.2:0/2513517062 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb37bfff640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fd3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb38259c640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 -- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 msgr2=0x5618a1fd3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fd3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 -- 172.21.15.2:0/2513517062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fc9ee0 msgr2=0x5618a1fd3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 -- 172.21.15.2:0/2513517062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618a1fe2850 con 0x5618a1fd6790 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb37bfff640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fd3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb382d9d640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd4180 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb37c014fd0 tx=0x7fb37c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb5e6aa5fa0ae36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.668+0000 7fb369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb369ffb640 1 -- 172.21.15.2:0/2513517062 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c01ecb0 con 0x5618a1fd6790 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb369ffb640 1 -- 172.21.15.2:0/2513517062 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb37c02a480 con 0x5618a1fd6790 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb36c019ae0 con 0x5618a1fd6790 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb369ffb640 1 -- 172.21.15.2:0/2513517062 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb37c01ee50 con 0x5618a1fd6790 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 10 client.17766 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618a1fe5260 con 0x5618a1fd6790 2024-09-10T23:31:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb369ffb640 1 -- 172.21.15.2:0/2513517062 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c019ae0 con 0x5618a1fd6790 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb369ffb640 1 -- 172.21.15.2:0/2513517062 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb37c00f040 con 0x5618a1fd6790 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 10 client.17766 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 10 client.17766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 20 client.17766 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a1fe6770 0x5618a1fe8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 4 client.17766 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.669+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618a1f42db0 con 0x5618a1fe6770 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.670+0000 7fb38259c640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a1fe6770 0x5618a1fe8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.670+0000 7fb38259c640 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a1fe6770 0x5618a1fe8bb0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9074fda39f9e5b7b server_cookie=b8b3ac1a550419cf in_seq=0 out_seq=0 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.670+0000 7fb369ffb640 10 client.17766 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb369ffb640 1 -- 172.21.15.2:0/2513517062 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618a1f42db0 con 0x5618a1fe6770 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb369ffb640 10 client.17766 handle_command_reply: tid=0 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 client.17766 shutdown 2024-09-10T23:31:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 msgr2=0x5618a1fd4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd4180 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb37c014fd0 tx=0x7fb37c004a40 comp rx=0 tx=0).stop 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 shutdown_connections 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a1fe6770 0x5618a1fe8bb0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fd6790 0x5618a1fd4180 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fd3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 --2- 172.21.15.2:0/2513517062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 >> 172.21.15.2:0/2513517062 conn(0x5618a1fc7d10 msgr2=0x5618a1fc6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb369ffb640 0 client.17766 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 shutdown_connections 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 1 -- 172.21.15.2:0/2513517062 wait complete. 2024-09-10T23:31:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.671+0000 7fb38ae00740 20 client.17766 trim_cache size 0 max 16384 2024-09-10T23:31:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.689+0000 7fb38ae00740 1 Processor -- start 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.689+0000 7fb38ae00740 1 -- start start 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 0x5618a1fd3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fd4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38ae00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3841b0530 con 0x5618a1fca800 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38ae00740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3841b2070 con 0x5618a1fd6790 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38ae00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3841b0c00 con 0x5618a1fc9ee0 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 0x5618a1fd3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 0x5618a1fd3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52198/0 (socket says 172.21.15.2:52198) 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb38259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:54746/0 (socket says 172.21.15.2:54746) 2024-09-10T23:31:06.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 -- 172.21.15.2:0/1925753385 learned_addr learned my addr 172.21.15.2:0/1925753385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:06.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb382d9d640 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fd4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 -- 172.21.15.2:0/1925753385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 msgr2=0x5618a1fd5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 -- 172.21.15.2:0/1925753385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 msgr2=0x5618a1fd4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fd4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb37bfff640 1 -- 172.21.15.2:0/1925753385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618a1fd2660 con 0x5618a1fca800 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.690+0000 7fb382d9d640 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fd4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.691+0000 7fb37bfff640 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 0x5618a1fd3c00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb36c01afd0 tx=0x7fb36c00e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526d1fbbaac979d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.691+0000 7fb36bfff640 1 -- 172.21.15.2:0/1925753385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c029030 con 0x5618a1fca800 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.691+0000 7fb36bfff640 1 -- 172.21.15.2:0/1925753385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c01f040 con 0x5618a1fca800 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.691+0000 7fb36bfff640 1 -- 172.21.15.2:0/1925753385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c01e040 con 0x5618a1fca800 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- 172.21.15.2:0/1925753385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 msgr2=0x5618a1fd3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 0x5618a1fd3c00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb36c01afd0 tx=0x7fb36c00e5a0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- 172.21.15.2:0/1925753385 shutdown_connections 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fd4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fca800 0x5618a1fd3c00 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1925753385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fc9ee0 0x5618a1fd5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- 172.21.15.2:0/1925753385 >> 172.21.15.2:0/1925753385 conn(0x5618a1fc7d10 msgr2=0x5618a1fd4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- 172.21.15.2:0/1925753385 shutdown_connections 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- 172.21.15.2:0/1925753385 wait complete. 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- start start 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 Processor -- start 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 0x5618a1fde760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fdeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fdb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3841b19a0 con 0x5618a1fc9ee0 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3841b12d0 con 0x5618a1fd6790 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3841ae510 con 0x5618a1fca800 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.692+0000 7fb38ae00740 10 client.0 _ll_register_callbacks cb 0x7fb37c009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 0x5618a1fde760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 0x5618a1fde760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52214/0 (socket says 172.21.15.2:52214) 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 -- 172.21.15.2:0/1399866450 learned_addr learned my addr 172.21.15.2:0/1399866450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb382d9d640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fdb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb37bfff640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fdeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 -- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 msgr2=0x5618a1fdeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fdeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 -- 172.21.15.2:0/1399866450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 msgr2=0x5618a1fdb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fdb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 -- 172.21.15.2:0/1399866450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618a1fdbc70 con 0x5618a1fc9ee0 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb382d9d640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fdb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38259c640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 0x5618a1fde760 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb3740c9360 tx=0x7fb3740c94a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad6198fb0f92557 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb369ffb640 1 -- 172.21.15.2:0/1399866450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374049040 con 0x5618a1fc9ee0 2024-09-10T23:31:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb369ffb640 1 -- 172.21.15.2:0/1399866450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb3740b40c0 con 0x5618a1fc9ee0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb36c01f040 con 0x5618a1fc9ee0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb369ffb640 1 -- 172.21.15.2:0/1399866450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb3740cc6e0 con 0x5618a1fc9ee0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38ae00740 10 client.17772 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.693+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618a2053e70 con 0x5618a1fc9ee0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb369ffb640 1 -- 172.21.15.2:0/1399866450 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c01f040 con 0x5618a1fc9ee0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb369ffb640 1 -- 172.21.15.2:0/1399866450 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb3740ccff0 con 0x5618a1fc9ee0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb38ae00740 10 client.17772 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb38ae00740 10 client.17772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb38ae00740 20 client.17772 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a20545e0 0x5618a20569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb38ae00740 4 client.17772 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618a1f3e860 con 0x5618a20545e0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.694+0000 7fb37bfff640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a20545e0 0x5618a20569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.695+0000 7fb37bfff640 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a20545e0 0x5618a20569d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24a11827062a1e3 server_cookie=e984e5fb021dad39 in_seq=0 out_seq=0 2024-09-10T23:31:06.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.695+0000 7fb369ffb640 10 client.17772 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.696+0000 7fb369ffb640 1 -- 172.21.15.2:0/1399866450 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618a1f3e860 con 0x5618a20545e0 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.696+0000 7fb369ffb640 10 client.17772 handle_command_reply: tid=0 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.696+0000 7fb38ae00740 1 client.17772 shutdown 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 msgr2=0x5618a1fde760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 0x5618a1fde760 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb3740c9360 tx=0x7fb3740c94a0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 shutdown_connections 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5618a20545e0 0x5618a20569d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618a1fd6790 0x5618a1fdb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5618a1fca800 0x5618a1fdeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 --2- 172.21.15.2:0/1399866450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5618a1fc9ee0 0x5618a1fde760 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 >> 172.21.15.2:0/1399866450 conn(0x5618a1fc7d10 msgr2=0x5618a1fd5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb369ffb640 0 client.17772 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 shutdown_connections 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 1 -- 172.21.15.2:0/1399866450 wait complete. 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb38ae00740 20 client.17772 trim_cache size 0 max 16384 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "321f56bb-834f-4ce6-8722-b0a77258430e", 2024-09-10T23:31:06.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:31:06.704 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:31:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3700b52e0 msgr2=0x7fb3700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.697+0000 7fb388a2b640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3700b52e0 0x7fb3700b77a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb384105630 tx=0x7fb37c009600 comp rx=0 tx=0).stop 2024-09-10T23:31:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 msgr2=0x7fb384103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384103570 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb374005940 tx=0x7fb374004270 comp rx=0 tx=0).stop 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 shutdown_connections 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3700b52e0 0x7fb3700b77a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb384108040 0x7fb384103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3841076c0 0x7fb384103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 --2- 172.21.15.2:0/2517466622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb384101cb0 0x7fb384103570 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 >> 172.21.15.2:0/2517466622 conn(0x7fb3840fd700 msgr2=0x7fb3840ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 shutdown_connections 2024-09-10T23:31:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:06.698+0000 7fb388a2b640 1 -- 172.21.15.2:0/2517466622 wait complete. 2024-09-10T23:31:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/430836810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 msgr2=0x7fcbd0109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/430836810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0109cf0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009cd0 tx=0x7fcbc802a8e0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/430836810 shutdown_connections 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/430836810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0109cf0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/430836810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbd01029b0 0x7fcbd0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/430836810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbd0101860 0x7fcbd0101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/430836810 >> 172.21.15.2:0/430836810 conn(0x7fcbd00fd140 msgr2=0x7fcbd00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/430836810 shutdown_connections 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.088+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/430836810 wait complete. 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 Processor -- start 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 -- start start 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbd0101860 0x7fcbd0198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbd01029b0 0x7fcbd0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd010d4d0 con 0x7fcbd0103370 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd010d350 con 0x7fcbd0101860 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd7ddb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd010d650 con 0x7fcbd01029b0 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd6378640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd6378640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52230/0 (socket says 172.21.15.2:52230) 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd6378640 1 -- 172.21.15.2:0/3956885123 learned_addr learned my addr 172.21.15.2:0/3956885123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd5376640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbd01029b0 0x7fcbd0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd6378640 1 -- 172.21.15.2:0/3956885123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbd01029b0 msgr2=0x7fcbd0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd6378640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbd01029b0 0x7fcbd0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbd0101860 0x7fcbd0198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.089+0000 7fcbd6378640 1 -- 172.21.15.2:0/3956885123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbd0101860 msgr2=0x7fcbd0198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbd6378640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbd0101860 0x7fcbd0198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbd6378640 1 -- 172.21.15.2:0/3956885123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd019a870 con 0x7fcbd0103370 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbd6378640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0199fb0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8033040 tx=0x7fcbc8003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbc6ffd640 1 -- 172.21.15.2:0/3956885123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8004240 con 0x7fcbd0103370 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbc6ffd640 1 -- 172.21.15.2:0/3956885123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc80305a0 con 0x7fcbd0103370 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd019ab00 con 0x7fcbd0103370 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbc6ffd640 1 -- 172.21.15.2:0/3956885123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80466e0 con 0x7fcbd0103370 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.090+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01a1230 con 0x7fcbd0103370 2024-09-10T23:31:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.092+0000 7fcbc6ffd640 1 -- 172.21.15.2:0/3956885123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcbc804e070 con 0x7fcbd0103370 2024-09-10T23:31:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbc6ffd640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcbbc0b52e0 0x7fcbbc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 Processor -- start 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcbbc0b52e0 0x7fcbbc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbc6ffd640 1 -- 172.21.15.2:0/3956885123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcbc802e030 con 0x7fcbd0103370 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 -- start start 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f4860 0x55b6b60f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f7190 0x55b6b60f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6b60666f0 con 0x55b6b60f9bd0 2024-09-10T23:31:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6b6055b20 con 0x55b6b60f7190 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbdac82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6b6059930 con 0x55b6b60f4860 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbd6378640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbd6378640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52242/0 (socket says 172.21.15.2:52242) 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbd6378640 1 -- 172.21.15.2:0/3126037462 learned_addr learned my addr 172.21.15.2:0/3126037462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.094+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcbbc0b52e0 0x7fcbbc0b77a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009aa0 tx=0x7fcbcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f4860 0x55b6b60f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd5376640 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f7190 0x55b6b60f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd6378640 1 -- 172.21.15.2:0/3126037462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f4860 msgr2=0x55b6b60f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd6378640 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f4860 0x55b6b60f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd6378640 1 -- 172.21.15.2:0/3126037462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f7190 msgr2=0x55b6b60f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd6378640 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f7190 0x55b6b60f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd6378640 1 -- 172.21.15.2:0/3126037462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b601b530 con 0x55b6b60f9bd0 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd5376640 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f7190 0x55b6b60f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbd6378640 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fc090 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80c9c90 tx=0x7fcbc80cd5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35918484f2e117b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbbbfff640 1 -- 172.21.15.2:0/3126037462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80cddc0 con 0x55b6b60f9bd0 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbbbfff640 1 -- 172.21.15.2:0/3126037462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc8036020 con 0x55b6b60f9bd0 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.095+0000 7fcbbbfff640 1 -- 172.21.15.2:0/3126037462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80c9930 con 0x55b6b60f9bd0 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 -- 172.21.15.2:0/3126037462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 msgr2=0x55b6b60fc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fc090 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80c9c90 tx=0x7fcbc80cd5c0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 -- 172.21.15.2:0/3126037462 shutdown_connections 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fc090 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f7190 0x55b6b60f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 --2- 172.21.15.2:0/3126037462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f4860 0x55b6b60f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 -- 172.21.15.2:0/3126037462 >> 172.21.15.2:0/3126037462 conn(0x55b6b60ef9b0 msgr2=0x55b6b60f0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 -- 172.21.15.2:0/3126037462 shutdown_connections 2024-09-10T23:31:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 -- 172.21.15.2:0/3126037462 wait complete. 2024-09-10T23:31:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.096+0000 7fcbdac82740 1 -- start start 2024-09-10T23:31:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 Processor -- start 2024-09-10T23:31:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6b5f8dab0 con 0x55b6b60f7190 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6b5ffb730 con 0x55b6b60f4860 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6b60fc970 con 0x55b6b60f9bd0 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbdac82740 10 client.0 _ll_register_callbacks cb 0x55b6b604f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbd5376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbd5376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52254/0 (socket says 172.21.15.2:52254) 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbd5376640 1 -- 172.21.15.2:0/1171709962 learned_addr learned my addr 172.21.15.2:0/1171709962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbd6378640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.097+0000 7fcbd5376640 1 -- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 msgr2=0x55b6b60fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd5376640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd5376640 1 -- 172.21.15.2:0/1171709962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 msgr2=0x55b6b60fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd5376640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd5376640 1 -- 172.21.15.2:0/1171709962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b5db7790 con 0x55b6b60f7190 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd6378640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbd5376640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe290 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00106a0 tx=0x7fcbc0010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b45b3e76d37d1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbb97fa640 1 -- 172.21.15.2:0/1171709962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0010ea0 con 0x55b6b60f7190 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbb97fa640 1 -- 172.21.15.2:0/1171709962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcbc0004230 con 0x55b6b60f7190 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbc8036020 con 0x55b6b60f7190 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbb97fa640 1 -- 172.21.15.2:0/1171709962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcbc0004430 con 0x55b6b60f7190 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbdac82740 10 client.17784 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6b5e30620 con 0x55b6b60f7190 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.098+0000 7fcbb97fa640 1 -- 172.21.15.2:0/1171709962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc8036020 con 0x55b6b60f7190 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbb97fa640 1 -- 172.21.15.2:0/1171709962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcbc000f040 con 0x55b6b60f7190 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbdac82740 10 client.17784 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbdac82740 10 client.17784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbdac82740 20 client.17784 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b6109450 0x55b6b610b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbdac82740 4 client.17784 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6b6068640 con 0x55b6b6109450 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b6109450 0x55b6b610b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbb97fa640 10 client.17784 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.099+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b6109450 0x55b6b610b860 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bfbf167635d12f5 server_cookie=86fd9041461f4bcc in_seq=0 out_seq=0 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbb97fa640 1 -- 172.21.15.2:0/1171709962 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6b6068640 con 0x55b6b6109450 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbb97fa640 10 client.17784 handle_command_reply: tid=0 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 client.17784 shutdown 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 msgr2=0x55b6b60fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe290 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00106a0 tx=0x7fcbc0010b60 comp rx=0 tx=0).stop 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 shutdown_connections 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b6109450 0x55b6b610b860 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe290 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbb97fa640 0 client.17784 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1171709962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.100+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 >> 172.21.15.2:0/1171709962 conn(0x55b6b60ef9b0 msgr2=0x55b6b60eebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.101+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 shutdown_connections 2024-09-10T23:31:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.101+0000 7fcbdac82740 1 -- 172.21.15.2:0/1171709962 wait complete. 2024-09-10T23:31:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.101+0000 7fcbdac82740 20 client.17784 trim_cache size 0 max 16384 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 Processor -- start 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 -- start start 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01a9e10 con 0x55b6b60f7190 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01ab950 con 0x55b6b60f4860 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbdac82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01aa4e0 con 0x55b6b60f9bd0 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbd5376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbd5376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52264/0 (socket says 172.21.15.2:52264) 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbd5376640 1 -- 172.21.15.2:0/1814472288 learned_addr learned my addr 172.21.15.2:0/1814472288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbd6378640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.130+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbd5376640 1 -- 172.21.15.2:0/1814472288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 msgr2=0x55b6b60fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbd5376640 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbd5376640 1 -- 172.21.15.2:0/1814472288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 msgr2=0x55b6b60fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbd5376640 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbd5376640 1 -- 172.21.15.2:0/1814472288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b60f0c10 con 0x55b6b60f7190 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbd5376640 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe130 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006010 tx=0x7fcbc000b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ab623d22d368b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbbb7fe640 1 -- 172.21.15.2:0/1814472288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0012450 con 0x55b6b60f7190 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbbb7fe640 1 -- 172.21.15.2:0/1814472288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc0020030 con 0x55b6b60f7190 2024-09-10T23:31:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.131+0000 7fcbbb7fe640 1 -- 172.21.15.2:0/1814472288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000e8d0 con 0x55b6b60f7190 2024-09-10T23:31:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 -- 172.21.15.2:0/1814472288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 msgr2=0x55b6b60fe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe130 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006010 tx=0x7fcbc000b340 comp rx=0 tx=0).stop 2024-09-10T23:31:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 -- 172.21.15.2:0/1814472288 shutdown_connections 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b60fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b60fe130 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 --2- 172.21.15.2:0/1814472288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b60fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 -- 172.21.15.2:0/1814472288 >> 172.21.15.2:0/1814472288 conn(0x55b6b60ef9b0 msgr2=0x55b6b60fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 -- 172.21.15.2:0/1814472288 shutdown_connections 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 -- 172.21.15.2:0/1814472288 wait complete. 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.132+0000 7fcbdac82740 1 -- start start 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 Processor -- start 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b6105350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b6104050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b6104590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01ab280 con 0x55b6b60f7190 2024-09-10T23:31:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01aabb0 con 0x55b6b60f4860 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01a7df0 con 0x55b6b60f9bd0 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbdac82740 10 client.0 _ll_register_callbacks cb 0x7fcbc000b3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b6104050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b6104050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52274/0 (socket says 172.21.15.2:52274) 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 -- 172.21.15.2:0/975213752 learned_addr learned my addr 172.21.15.2:0/975213752 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b6105350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd6378640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b6104590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 -- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 msgr2=0x55b6b6104590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b6104590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 -- 172.21.15.2:0/975213752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 msgr2=0x55b6b6105350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b6105350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.133+0000 7fcbd5376640 1 -- 172.21.15.2:0/975213752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b6104ad0 con 0x55b6b60f7190 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbd5376640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b6104050 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00106a0 tx=0x7fcbc0003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec677e1d4b771002 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbb97fa640 1 -- 172.21.15.2:0/975213752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc003a060 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbb97fa640 1 -- 172.21.15.2:0/975213752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcbc0010070 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbc0020030 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbb97fa640 1 -- 172.21.15.2:0/975213752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcbc000e8d0 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 10 client.17790 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6b6103950 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbb97fa640 1 -- 172.21.15.2:0/975213752 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc0020030 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbb97fa640 1 -- 172.21.15.2:0/975213752 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcbc00129f0 con 0x55b6b60f7190 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 10 client.17790 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 10 client.17790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 20 client.17790 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b61769c0 0x55b6b6178de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 4 client.17790 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.134+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b6b60640f0 con 0x55b6b61769c0 2024-09-10T23:31:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.135+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b61769c0 0x55b6b6178de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.135+0000 7fcbb97fa640 10 client.17790 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.135+0000 7fcbd5b77640 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b61769c0 0x55b6b6178de0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b849fe6f22b244e server_cookie=25ebdd85a88a0349 in_seq=0 out_seq=0 2024-09-10T23:31:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbb97fa640 1 -- 172.21.15.2:0/975213752 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b6b60640f0 con 0x55b6b61769c0 2024-09-10T23:31:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbb97fa640 10 client.17790 handle_command_reply: tid=0 2024-09-10T23:31:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 client.17790 shutdown 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 msgr2=0x55b6b6104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b6104050 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00106a0 tx=0x7fcbc0003ae0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 shutdown_connections 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6b61769c0 0x55b6b6178de0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6b60f9bd0 0x55b6b6104590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbb97fa640 0 client.17790 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6b60f7190 0x55b6b6104050 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 --2- 172.21.15.2:0/975213752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6b60f4860 0x55b6b6105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 >> 172.21.15.2:0/975213752 conn(0x55b6b60ef9b0 msgr2=0x55b6b60ee3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 shutdown_connections 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 1 -- 172.21.15.2:0/975213752 wait complete. 2024-09-10T23:31:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.148+0000 7fcbdac82740 20 client.17790 trim_cache size 0 max 16384 2024-09-10T23:31:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:31:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:31:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:31:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcbbc0b52e0 msgr2=0x7fcbbc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcbbc0b52e0 0x7fcbbc0b77a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009aa0 tx=0x7fcbcc005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 msgr2=0x7fcbd0199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0199fb0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8033040 tx=0x7fcbc8003b80 comp rx=0 tx=0).stop 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 shutdown_connections 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcbbc0b52e0 0x7fcbbc0b77a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd0103370 0x7fcbd0199fb0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbd01029b0 0x7fcbd0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 --2- 172.21.15.2:0/3956885123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbd0101860 0x7fcbd0198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 >> 172.21.15.2:0/3956885123 conn(0x7fcbd00fd140 msgr2=0x7fcbd00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 shutdown_connections 2024-09-10T23:31:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:07.149+0000 7fcbd7ddb640 1 -- 172.21.15.2:0/3956885123 wait complete. 2024-09-10T23:31:07.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:31:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:08.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 -- 172.21.15.2:0/630882579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 msgr2=0x7f829410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 --2- 172.21.15.2:0/630882579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829410e860 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f828c009ca0 tx=0x7f828c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 -- 172.21.15.2:0/630882579 shutdown_connections 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 --2- 172.21.15.2:0/630882579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829410e860 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 --2- 172.21.15.2:0/630882579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82941076e0 0x7f8294107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 --2- 172.21.15.2:0/630882579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8294101cd0 0x7f82941020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 -- 172.21.15.2:0/630882579 >> 172.21.15.2:0/630882579 conn(0x7f82940fd720 msgr2=0x7f82940ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 -- 172.21.15.2:0/630882579 shutdown_connections 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.210+0000 7f829a51c640 1 -- 172.21.15.2:0/630882579 wait complete. 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 Processor -- start 2024-09-10T23:31:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 -- start start 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8294101cd0 0x7f8294198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82941076e0 0x7f8294198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8294111d20 con 0x7f8294108060 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8294111ba0 con 0x7f8294101cd0 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f829a51c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8294111ea0 con 0x7f82941076e0 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f8298ab9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f8298ab9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829419d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52300/0 (socket says 172.21.15.2:52300) 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.211+0000 7f8298ab9640 1 -- 172.21.15.2:0/3327868040 learned_addr learned my addr 172.21.15.2:0/3327868040 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f82937fe640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82941076e0 0x7f8294198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8293fff640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8294101cd0 0x7f8294198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8298ab9640 1 -- 172.21.15.2:0/3327868040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82941076e0 msgr2=0x7f8294198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8298ab9640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82941076e0 0x7f8294198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8298ab9640 1 -- 172.21.15.2:0/3327868040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8294101cd0 msgr2=0x7f8294198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8298ab9640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8294101cd0 0x7f8294198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8298ab9640 1 -- 172.21.15.2:0/3327868040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829419e1c0 con 0x7f8294108060 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f8298ab9640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829419d9f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f828c005cc0 tx=0x7f828c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f82917fa640 1 -- 172.21.15.2:0/3327868040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c003bf0 con 0x7f8294108060 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829419e450 con 0x7f8294108060 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f82917fa640 1 -- 172.21.15.2:0/3327868040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f828c003d90 con 0x7f8294108060 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f82917fa640 1 -- 172.21.15.2:0/3327868040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c02fb20 con 0x7f8294108060 2024-09-10T23:31:08.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.212+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941a4b70 con 0x7f8294108060 2024-09-10T23:31:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 Processor -- start 2024-09-10T23:31:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f82917fa640 1 -- 172.21.15.2:0/3327868040 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f828c004580 con 0x7f8294108060 2024-09-10T23:31:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 -- start start 2024-09-10T23:31:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdb6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdb6da0 0x5574afdc27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 0x5574afdc5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5574afd2ce50 con 0x5574afdc2d30 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5574afd1c280 con 0x5574afdb6da0 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.215+0000 7f829c8f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5574afd20090 con 0x5574afdb6480 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 0x5574afdc5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 0x5574afdc5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52314/0 (socket says 172.21.15.2:52314) 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 -- 172.21.15.2:0/1530568493 learned_addr learned my addr 172.21.15.2:0/1530568493 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdb6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f8293fff640 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdb6da0 0x5574afdc27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 -- 172.21.15.2:0/1530568493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 msgr2=0x5574afdb6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdb6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 -- 172.21.15.2:0/1530568493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdb6da0 msgr2=0x5574afdc27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdb6da0 0x5574afdc27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 -- 172.21.15.2:0/1530568493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574afa7a650 con 0x5574afdc2d30 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82917fa640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b52e0 0x7f827c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82937fe640 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 0x5574afdc5120 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f82880117e0 tx=0x7f828800a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354edf1fc4fa993b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f8293fff640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b52e0 0x7f827c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f82917fa640 1 -- 172.21.15.2:0/3327868040 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f828c106f90 con 0x7f8294108060 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f827a7fc640 1 -- 172.21.15.2:0/1530568493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288011e20 con 0x5574afdc2d30 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f827a7fc640 1 -- 172.21.15.2:0/1530568493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f828800fe80 con 0x5574afdc2d30 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.216+0000 7f827a7fc640 1 -- 172.21.15.2:0/1530568493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288004a00 con 0x5574afdc2d30 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 -- 172.21.15.2:0/1530568493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 msgr2=0x5574afdc5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f8293fff640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b52e0 0x7f827c0b77a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8284005fd0 tx=0x7f828400b650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 0x5574afdc5120 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f82880117e0 tx=0x7f828800a760 comp rx=0 tx=0).stop 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 -- 172.21.15.2:0/1530568493 shutdown_connections 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdc2d30 0x5574afdc5120 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdb6da0 0x5574afdc27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1530568493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdb6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 -- 172.21.15.2:0/1530568493 >> 172.21.15.2:0/1530568493 conn(0x5574afdb42b0 msgr2=0x5574afdb5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 -- 172.21.15.2:0/1530568493 shutdown_connections 2024-09-10T23:31:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.217+0000 7f829c8f1740 1 -- 172.21.15.2:0/1530568493 wait complete. 2024-09-10T23:31:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 -- start start 2024-09-10T23:31:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 Processor -- start 2024-09-10T23:31:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdc1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 0x5574afdc2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdc72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5574afb7d700 con 0x5574afdb6da0 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5574afcb7110 con 0x5574afdc2d30 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5574afdc59b0 con 0x5574afdb6480 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f829c8f1740 10 client.0 _ll_register_callbacks cb 0x5574afcd0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f82937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 0x5574afdc2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f82937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 0x5574afdc2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52316/0 (socket says 172.21.15.2:52316) 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.218+0000 7f82937fe640 1 -- 172.21.15.2:0/2063198420 learned_addr learned my addr 172.21.15.2:0/2063198420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f8293fff640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdc1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f8298ab9640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdc72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82937fe640 1 -- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 msgr2=0x5574afdc1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82937fe640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdc1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82937fe640 1 -- 172.21.15.2:0/2063198420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 msgr2=0x5574afdc72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82937fe640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdc72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82937fe640 1 -- 172.21.15.2:0/2063198420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574afce4c40 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f8298ab9640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdc72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f8293fff640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdc1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82937fe640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 0x5574afdc2480 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f828800a310 tx=0x7f828800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32128765f4a50c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82737fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82737fe640 1 -- 172.21.15.2:0/2063198420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288004ad0 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82737fe640 1 -- 172.21.15.2:0/2063198420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8288004c70 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5574afd2eda0 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f82737fe640 1 -- 172.21.15.2:0/2063198420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8288004e70 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f829c8f1740 10 client.17802 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.219+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574afdd35b0 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f82737fe640 1 -- 172.21.15.2:0/2063198420 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5574afd2eda0 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f82737fe640 1 -- 172.21.15.2:0/2063198420 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f828801ece0 con 0x5574afdb6da0 2024-09-10T23:31:08.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f829c8f1740 10 client.17802 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f829c8f1740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f829c8f1740 20 client.17802 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f829c8f1740 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afdd4900 0x5574afdd6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f829c8f1740 4 client.17802 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574afd2a850 con 0x5574afdd4900 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f8293fff640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afdd4900 0x5574afdd6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f8293fff640 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afdd4900 0x5574afdd6cf0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f84959f9ce42c115 server_cookie=d2142c1e8c6bc44b in_seq=0 out_seq=0 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.220+0000 7f82737fe640 10 client.17802 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f82737fe640 1 -- 172.21.15.2:0/2063198420 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5574afd2a850 con 0x5574afdd4900 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f82737fe640 10 client.17802 handle_command_reply: tid=0 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 client.17802 shutdown 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 msgr2=0x5574afdc2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 0x5574afdc2480 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f828800a310 tx=0x7f828800fc00 comp rx=0 tx=0).stop 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 shutdown_connections 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afdd4900 0x5574afdd6cf0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdc72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6da0 0x5574afdc2480 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 --2- 172.21.15.2:0/2063198420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6480 0x5574afdc1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.221+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 >> 172.21.15.2:0/2063198420 conn(0x5574afdb42b0 msgr2=0x5574afdb9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.222+0000 7f82737fe640 0 client.17802 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.222+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 shutdown_connections 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.222+0000 7f829c8f1740 1 -- 172.21.15.2:0/2063198420 wait complete. 2024-09-10T23:31:08.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.222+0000 7f829c8f1740 20 client.17802 trim_cache size 0 max 16384 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 Processor -- start 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 -- start start 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afdb3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdc72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdbe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82941ac080 con 0x5574afdb6480 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82941adbc0 con 0x5574afdc2d30 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f829c8f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82941ac750 con 0x5574afdb6da0 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f8293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afdb3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f8293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afdb3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52322/0 (socket says 172.21.15.2:52322) 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.239+0000 7f8293fff640 1 -- 172.21.15.2:0/1207537913 learned_addr learned my addr 172.21.15.2:0/1207537913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:08.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f82937fe640 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdc72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8298ab9640 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdbe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8293fff640 1 -- 172.21.15.2:0/1207537913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 msgr2=0x5574afdc72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8293fff640 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdc72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8293fff640 1 -- 172.21.15.2:0/1207537913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 msgr2=0x5574afdbe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8293fff640 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdbe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8293fff640 1 -- 172.21.15.2:0/1207537913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574afdbea50 con 0x5574afdb6480 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8293fff640 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afdb3bc0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f828400b580 tx=0x7f8284014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44c3a181fc5d911 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8279ffb640 1 -- 172.21.15.2:0/1207537913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284005220 con 0x5574afdb6480 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8279ffb640 1 -- 172.21.15.2:0/1207537913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8284004c50 con 0x5574afdb6480 2024-09-10T23:31:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.240+0000 7f8279ffb640 1 -- 172.21.15.2:0/1207537913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284020b10 con 0x5574afdb6480 2024-09-10T23:31:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 -- 172.21.15.2:0/1207537913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 msgr2=0x5574afdb3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afdb3bc0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f828400b580 tx=0x7f8284014000 comp rx=0 tx=0).stop 2024-09-10T23:31:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 -- 172.21.15.2:0/1207537913 shutdown_connections 2024-09-10T23:31:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdbe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdc72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 --2- 172.21.15.2:0/1207537913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afdb3bc0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 -- 172.21.15.2:0/1207537913 >> 172.21.15.2:0/1207537913 conn(0x5574afdb42b0 msgr2=0x5574afdb5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 -- 172.21.15.2:0/1207537913 shutdown_connections 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 -- 172.21.15.2:0/1207537913 wait complete. 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 -- start start 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.241+0000 7f829c8f1740 1 Processor -- start 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afddccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdd0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdd0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82941ad4f0 con 0x5574afdb6480 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82941ace20 con 0x5574afdc2d30 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82941aa080 con 0x5574afdb6da0 2024-09-10T23:31:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f829c8f1740 10 client.0 _ll_register_callbacks cb 0x7f828800ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afddccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afddccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52338/0 (socket says 172.21.15.2:52338) 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 -- 172.21.15.2:0/4278246590 learned_addr learned my addr 172.21.15.2:0/4278246590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f82937fe640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdd0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8298ab9640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdd0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 -- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 msgr2=0x5574afdd0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdd0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 -- 172.21.15.2:0/4278246590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 msgr2=0x5574afdd0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdd0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 -- 172.21.15.2:0/4278246590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574afdc3f10 con 0x5574afdb6480 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8298ab9640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdd0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f8293fff640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afddccf0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f828400bd70 tx=0x7f828400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f624280fa6f75198 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f82737fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.242+0000 7f82737fe640 1 -- 172.21.15.2:0/4278246590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840048d0 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f82737fe640 1 -- 172.21.15.2:0/4278246590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8284020890 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8284004c50 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f82737fe640 1 -- 172.21.15.2:0/4278246590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8284004a70 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 10 client.17808 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574afe41860 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f82737fe640 1 -- 172.21.15.2:0/4278246590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8284004c50 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f82737fe640 1 -- 172.21.15.2:0/4278246590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f828402f030 con 0x5574afdb6480 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 10 client.17808 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 10 client.17808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 20 client.17808 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afe41f00 0x5574afe44320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 4 client.17808 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5574afd27c80 con 0x5574afe41f00 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.243+0000 7f82937fe640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afe41f00 0x5574afe44320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f82937fe640 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afe41f00 0x5574afe44320 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f4445b039663ab7 server_cookie=5cde59b6a02ff9c2 in_seq=0 out_seq=0 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f82737fe640 10 client.17808 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f82737fe640 1 -- 172.21.15.2:0/4278246590 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x5574afd27c80 con 0x5574afe41f00 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f82737fe640 10 client.17808 handle_command_reply: tid=0 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 client.17808 shutdown 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 msgr2=0x5574afddccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afddccf0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f828400bd70 tx=0x7f828400b860 comp rx=0 tx=0).stop 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 shutdown_connections 2024-09-10T23:31:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5574afe41f00 0x5574afe44320 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5574afdc2d30 0x5574afdd0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5574afdb6da0 0x5574afdd0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 --2- 172.21.15.2:0/4278246590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5574afdb6480 0x5574afddccf0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 >> 172.21.15.2:0/4278246590 conn(0x5574afdb42b0 msgr2=0x5574afdb5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.244+0000 7f82737fe640 0 client.17808 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 shutdown_connections 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829c8f1740 1 -- 172.21.15.2:0/4278246590 wait complete. 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829c8f1740 20 client.17808 trim_cache size 0 max 16384 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:31:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:31:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:31:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:31:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.258 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:08.260 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:08.261 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:08.261 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:08.261 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:08.261 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:31:08.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b52e0 msgr2=0x7f827c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b52e0 0x7f827c0b77a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8284005fd0 tx=0x7f828400b650 comp rx=0 tx=0).stop 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 msgr2=0x7f829419d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829419d9f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f828c005cc0 tx=0x7f828c02f380 comp rx=0 tx=0).stop 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 shutdown_connections 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f827c0b52e0 0x7f827c0b77a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294108060 0x7f829419d9f0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82941076e0 0x7f8294198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 --2- 172.21.15.2:0/3327868040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8294101cd0 0x7f8294198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 >> 172.21.15.2:0/3327868040 conn(0x7f82940fd720 msgr2=0x7f8294103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.245+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 shutdown_connections 2024-09-10T23:31:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:08.246+0000 7f829a51c640 1 -- 172.21.15.2:0/3327868040 wait complete. 2024-09-10T23:31:08.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:08 smithi002 ceph-mon[31150]: pgmap v555: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:31:08.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:08 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:31:08.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:08 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:08.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:08 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:31:08.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:08 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:08 smithi154 ceph-mon[35136]: pgmap v555: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:31:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:08 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:31:08.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:08 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:08 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:31:08.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:08 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:08 smithi177 ceph-mon[35760]: pgmap v555: 97 pgs: 97 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:31:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:08 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:31:08.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:08 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:08.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:08 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:31:08.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:08 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:09.131 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:31:09.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:31:09.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:09 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:31:09.396 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:09.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:09 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:31:09.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:09 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:31:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.951+0000 7f312bd96640 1 -- 172.21.15.2:0/123623713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 msgr2=0x7f31241020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.951+0000 7f312bd96640 1 --2- 172.21.15.2:0/123623713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241020b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3120009ca0 tx=0x7f312002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.951+0000 7f312bd96640 1 -- 172.21.15.2:0/123623713 shutdown_connections 2024-09-10T23:31:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.951+0000 7f312bd96640 1 --2- 172.21.15.2:0/123623713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 0x7f312410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.951+0000 7f312bd96640 1 --2- 172.21.15.2:0/123623713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31241076e0 0x7f3124107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.951+0000 7f312bd96640 1 --2- 172.21.15.2:0/123623713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241020b0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- 172.21.15.2:0/123623713 >> 172.21.15.2:0/123623713 conn(0x7f31240fd700 msgr2=0x7f31240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- 172.21.15.2:0/123623713 shutdown_connections 2024-09-10T23:31:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- 172.21.15.2:0/123623713 wait complete. 2024-09-10T23:31:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 Processor -- start 2024-09-10T23:31:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- start start 2024-09-10T23:31:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31241076e0 0x7f31241997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 0x7f312419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3124111d20 con 0x7f3124101cd0 2024-09-10T23:31:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3124111ba0 con 0x7f3124108060 2024-09-10T23:31:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.952+0000 7f312bd96640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3124111ea0 con 0x7f31241076e0 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52360/0 (socket says 172.21.15.2:52360) 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 -- 172.21.15.2:0/339799536 learned_addr learned my addr 172.21.15.2:0/339799536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f312a333640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 0x7f312419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129331640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31241076e0 0x7f31241997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 -- 172.21.15.2:0/339799536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31241076e0 msgr2=0x7f31241997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31241076e0 0x7f31241997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 -- 172.21.15.2:0/339799536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 msgr2=0x7f312419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 0x7f312419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 -- 172.21.15.2:0/339799536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312419f360 con 0x7f3124101cd0 2024-09-10T23:31:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f312a333640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 0x7f312419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f3129b32640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241992b0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f3120006010 tx=0x7f31200319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120003bf0 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3120003d90 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312419f5f0 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312002fc20 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.953+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31241a5d10 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.954+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31241020b0 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.956+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f31200046a0 con 0x7f3124101cd0 2024-09-10T23:31:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.956+0000 7f311affd640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31100b5360 0x7f31100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.957+0000 7f3129331640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31100b5360 0x7f31100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.957+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3120107000 con 0x7f3124101cd0 2024-09-10T23:31:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.957+0000 7f3129331640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31100b5360 0x7f31100b7820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3124106580 tx=0x7f311400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:09.959+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31200cded0 con 0x7f3124101cd0 2024-09-10T23:31:10.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.183+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f312419a3e0 con 0x7f3124101cd0 2024-09-10T23:31:10.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:10 smithi002 ceph-mon[31150]: pgmap v556: 97 pgs: 97 active+clean; 1.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:31:10.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.184+0000 7f311affd640 1 -- 172.21.15.2:0/339799536 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f312419a3e0 con 0x7f3124101cd0 2024-09-10T23:31:10.185 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:31:10.185 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:31:10.185 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:31:10.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31100b5360 msgr2=0x7f31100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31100b5360 0x7f31100b7820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3124106580 tx=0x7f311400b390 comp rx=0 tx=0).stop 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 msgr2=0x7f31241992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241992b0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f3120006010 tx=0x7f31200319f0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 shutdown_connections 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31100b5360 0x7f31100b7820 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3124108060 0x7f312419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31241076e0 0x7f31241997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 --2- 172.21.15.2:0/339799536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3124101cd0 0x7f31241992b0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 >> 172.21.15.2:0/339799536 conn(0x7f31240fd700 msgr2=0x7f312406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 shutdown_connections 2024-09-10T23:31:10.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:10.186+0000 7f312bd96640 1 -- 172.21.15.2:0/339799536 wait complete. 2024-09-10T23:31:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:10 smithi154 ceph-mon[35136]: pgmap v556: 97 pgs: 97 active+clean; 1.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:31:10.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:10 smithi177 ceph-mon[35760]: pgmap v556: 97 pgs: 97 active+clean; 1.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:31:10.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:31:11.205 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/339799536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:31:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/339799536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:31:11.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/339799536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:31:11.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 -- 172.21.15.2:0/714918738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c101cd0 msgr2=0x7f653c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 --2- 172.21.15.2:0/714918738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c101cd0 0x7f653c1020b0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f652c009900 tx=0x7f652c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 -- 172.21.15.2:0/714918738 shutdown_connections 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 --2- 172.21.15.2:0/714918738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c108060 0x7f653c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 --2- 172.21.15.2:0/714918738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f653c1076e0 0x7f653c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 --2- 172.21.15.2:0/714918738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c101cd0 0x7f653c1020b0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 -- 172.21.15.2:0/714918738 >> 172.21.15.2:0/714918738 conn(0x7f653c0fd700 msgr2=0x7f653c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 -- 172.21.15.2:0/714918738 shutdown_connections 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.723+0000 7f65416f6640 1 -- 172.21.15.2:0/714918738 wait complete. 2024-09-10T23:31:11.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 Processor -- start 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 -- start start 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c101cd0 0x7f653c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f653c1076e0 0x7f653c10f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 0x7f653c10fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f653c112e70 con 0x7f653c108060 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f653c112cf0 con 0x7f653c101cd0 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f65416f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f653c112ff0 con 0x7f653c1076e0 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f653b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 0x7f653c10fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f653b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 0x7f653c10fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35928/0 (socket says 172.21.15.2:35928) 2024-09-10T23:31:11.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.724+0000 7f653b7fe640 1 -- 172.21.15.2:0/2272248163 learned_addr learned my addr 172.21.15.2:0/2272248163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653affd640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c101cd0 0x7f653c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653a7fc640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f653c1076e0 0x7f653c10f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653b7fe640 1 -- 172.21.15.2:0/2272248163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f653c1076e0 msgr2=0x7f653c10f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653b7fe640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f653c1076e0 0x7f653c10f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653b7fe640 1 -- 172.21.15.2:0/2272248163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c101cd0 msgr2=0x7f653c10f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653b7fe640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c101cd0 0x7f653c10f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653b7fe640 1 -- 172.21.15.2:0/2272248163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c1a7700 con 0x7f653c108060 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f653b7fe640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 0x7f653c10fdf0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f653400eaa0 tx=0x7f653400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f6523fff640 1 -- 172.21.15.2:0/2272248163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653400cdb0 con 0x7f653c108060 2024-09-10T23:31:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f6523fff640 1 -- 172.21.15.2:0/2272248163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6534005020 con 0x7f653c108060 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c1a79f0 con 0x7f653c108060 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f6523fff640 1 -- 172.21.15.2:0/2272248163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65340116d0 con 0x7f653c108060 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.725+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1a7ee0 con 0x7f653c108060 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6523fff640 1 -- 172.21.15.2:0/2272248163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f653400f040 con 0x7f653c108060 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 Processor -- start 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 -- start start 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fdee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 0x55922fdfa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fdfd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55922fd64ea0 con 0x55922fdeedf0 2024-09-10T23:31:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55922fd542d0 con 0x55922fdfad80 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6543acb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55922fd580e0 con 0x55922fdee4d0 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f653affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 0x55922fdfa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f653affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 0x55922fdfa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35930/0 (socket says 172.21.15.2:35930) 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f653affd640 1 -- 172.21.15.2:0/4158690313 learned_addr learned my addr 172.21.15.2:0/4158690313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f653a7fc640 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fdee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.728+0000 7f6523fff640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f65240b52e0 0x7f65240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653a7fc640 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fdfd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653b7fe640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f65240b52e0 0x7f65240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653affd640 1 -- 172.21.15.2:0/4158690313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 msgr2=0x55922fdee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653affd640 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fdee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653affd640 1 -- 172.21.15.2:0/4158690313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 msgr2=0x55922fdfd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653affd640 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fdfd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653affd640 1 -- 172.21.15.2:0/4158690313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55922fab2650 con 0x55922fdeedf0 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653a7fc640 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fdee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f6523fff640 1 -- 172.21.15.2:0/2272248163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f65340e5a30 con 0x7f653c108060 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653affd640 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 0x55922fdfa840 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f652c000c00 tx=0x7f652c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e44489230e15924 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f653b7fe640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f65240b52e0 0x7f65240b77a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f65340a9470 tx=0x7f65340762d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f65217fa640 1 -- 172.21.15.2:0/4158690313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c035040 con 0x55922fdeedf0 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f65217fa640 1 -- 172.21.15.2:0/4158690313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f652c0054f0 con 0x55922fdeedf0 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.729+0000 7f65217fa640 1 -- 172.21.15.2:0/4158690313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c003850 con 0x55922fdeedf0 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 -- 172.21.15.2:0/4158690313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 msgr2=0x55922fdfa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 0x55922fdfa840 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f652c000c00 tx=0x7f652c004180 comp rx=0 tx=0).stop 2024-09-10T23:31:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 -- 172.21.15.2:0/4158690313 shutdown_connections 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fdfd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdeedf0 0x55922fdfa840 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 --2- 172.21.15.2:0/4158690313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fdee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 -- 172.21.15.2:0/4158690313 >> 172.21.15.2:0/4158690313 conn(0x55922fdec300 msgr2=0x55922fded4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 -- 172.21.15.2:0/4158690313 shutdown_connections 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 -- 172.21.15.2:0/4158690313 wait complete. 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 -- start start 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.730+0000 7f6543acb740 1 Processor -- start 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdee4d0 0x55922fdfa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdf7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55922fbb5700 con 0x55922fdfad80 2024-09-10T23:31:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55922fcef160 con 0x55922fdee4d0 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55922fdfd9a0 con 0x55922fdeedf0 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 10 client.0 _ll_register_callbacks cb 0x55922fd089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35946/0 (socket says 172.21.15.2:35946) 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 -- 172.21.15.2:0/3809729252 learned_addr learned my addr 172.21.15.2:0/3809729252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdee4d0 0x55922fdfa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653affd640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdf7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 -- 172.21.15.2:0/3809729252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 msgr2=0x55922fdf7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdf7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 -- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdee4d0 msgr2=0x55922fdfa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdee4d0 0x55922fdfa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 -- 172.21.15.2:0/3809729252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55922fd1cc90 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f653a7fc640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf8030 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f653000c5e0 tx=0x7f653000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c00c8555ebefdc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f651eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f651eff5640 1 -- 172.21.15.2:0/3809729252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653000fe00 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f651eff5640 1 -- 172.21.15.2:0/3809729252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6530004030 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.731+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f652c0054f0 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f651eff5640 1 -- 172.21.15.2:0/3809729252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6530027050 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 10 client.17826 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55922fe09350 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f651eff5640 1 -- 172.21.15.2:0/3809729252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f652c0054f0 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f651eff5640 1 -- 172.21.15.2:0/3809729252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6530011440 con 0x55922fdfad80 2024-09-10T23:31:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 10 client.17826 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 10 client.17826 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 20 client.17826 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe0a800 0x55922fe0cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 4 client.17826 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.732+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55922fd66df0 con 0x55922fe0a800 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.733+0000 7f653affd640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe0a800 0x55922fe0cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.733+0000 7f653affd640 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe0a800 0x55922fe0cbf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e224a1d81d84ea7 server_cookie=c8466c04eda5265e in_seq=0 out_seq=0 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.733+0000 7f651eff5640 10 client.17826 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f651eff5640 1 -- 172.21.15.2:0/3809729252 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55922fd66df0 con 0x55922fe0a800 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f651eff5640 10 client.17826 handle_command_reply: tid=0 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 client.17826 shutdown 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 msgr2=0x55922fdf8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf8030 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f653000c5e0 tx=0x7f653000c830 comp rx=0 tx=0).stop 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 shutdown_connections 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe0a800 0x55922fe0cbf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf8030 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdf7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f651eff5640 0 client.17826 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 --2- 172.21.15.2:0/3809729252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdee4d0 0x55922fdfa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 >> 172.21.15.2:0/3809729252 conn(0x55922fdec300 msgr2=0x55922fdf1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 shutdown_connections 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 1 -- 172.21.15.2:0/3809729252 wait complete. 2024-09-10T23:31:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.734+0000 7f6543acb740 20 client.17826 trim_cache size 0 max 16384 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.747+0000 7f6543acb740 1 Processor -- start 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.747+0000 7f6543acb740 1 -- start start 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f6543acb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fe06c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f6543acb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdeedf0 0x55922fdf97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f6543acb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f6543acb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b0530 con 0x55922fdfad80 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f6543acb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b2070 con 0x55922fdeedf0 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f6543acb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b0c00 con 0x55922fdee4d0 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35954/0 (socket says 172.21.15.2:35954) 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 -- 172.21.15.2:0/1334971174 learned_addr learned my addr 172.21.15.2:0/1334971174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fe06c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 -- 172.21.15.2:0/1334971174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 msgr2=0x55922fe06c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fe06c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653affd640 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdeedf0 0x55922fdf97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 -- 172.21.15.2:0/1334971174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdeedf0 msgr2=0x55922fdf97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdeedf0 0x55922fdf97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 -- 172.21.15.2:0/1334971174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55922fdf2780 con 0x55922fdfad80 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653affd640 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdeedf0 0x55922fdf97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.748+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf4c80 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f653000cc70 tx=0x7f653000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eafe03f9e98561a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6520ff9640 1 -- 172.21.15.2:0/1334971174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530005b80 con 0x55922fdfad80 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6520ff9640 1 -- 172.21.15.2:0/1334971174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f653000c610 con 0x55922fdfad80 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6520ff9640 1 -- 172.21.15.2:0/1334971174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653002c8c0 con 0x55922fdfad80 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 -- 172.21.15.2:0/1334971174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 msgr2=0x55922fdf4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf4c80 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f653000cc70 tx=0x7f653000cbc0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 -- 172.21.15.2:0/1334971174 shutdown_connections 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdfad80 0x55922fdf4c80 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdeedf0 0x55922fdf97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 --2- 172.21.15.2:0/1334971174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdee4d0 0x55922fe06c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 -- 172.21.15.2:0/1334971174 >> 172.21.15.2:0/1334971174 conn(0x55922fdec300 msgr2=0x55922fdf90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 -- 172.21.15.2:0/1334971174 shutdown_connections 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.749+0000 7f6543acb740 1 -- 172.21.15.2:0/1334971174 wait complete. 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 -- start start 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 Processor -- start 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 0x55922fdff570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fe70720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b19a0 con 0x55922fdee4d0 2024-09-10T23:31:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b12d0 con 0x55922fdfad80 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1ae510 con 0x55922fdeedf0 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f6543acb740 10 client.0 _ll_register_callbacks cb 0x7f653000c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f653a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 0x55922fdff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f653a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 0x55922fdff570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35958/0 (socket says 172.21.15.2:35958) 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f653a7fc640 1 -- 172.21.15.2:0/1588479108 learned_addr learned my addr 172.21.15.2:0/1588479108 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f653affd640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.750+0000 7f653a7fc640 1 -- 172.21.15.2:0/1588479108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 msgr2=0x55922fdffaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdffaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f653a7fc640 1 -- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 msgr2=0x55922fe70720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fe70720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f653a7fc640 1 -- 172.21.15.2:0/1588479108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55922fe70e30 con 0x55922fdee4d0 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f653affd640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f653a7fc640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 0x55922fdff570 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f6530010010 tx=0x7f65300116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99e61351388f37f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f651eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f651eff5640 1 -- 172.21.15.2:0/1588479108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530033070 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f651eff5640 1 -- 172.21.15.2:0/1588479108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f6530011a30 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55922fd628a0 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f651eff5640 1 -- 172.21.15.2:0/1588479108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6530011c30 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 10 client.17832 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55922fe78140 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f651eff5640 1 -- 172.21.15.2:0/1588479108 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55922fd628a0 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f651eff5640 1 -- 172.21.15.2:0/1588479108 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6530037070 con 0x55922fdee4d0 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 10 client.17832 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 10 client.17832 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 20 client.17832 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe78860 0x55922fe7ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 4 client.17832 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.751+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55922fd5fcd0 con 0x55922fe78860 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f653affd640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe78860 0x55922fe7ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f651eff5640 10 client.17832 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f653affd640 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe78860 0x55922fe7ac80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=110d0c121af30658 server_cookie=26c280a23c0cbfe2 in_seq=0 out_seq=0 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f651eff5640 1 -- 172.21.15.2:0/1588479108 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55922fd5fcd0 con 0x55922fe78860 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f651eff5640 10 client.17832 handle_command_reply: tid=0 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f6543acb740 1 client.17832 shutdown 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 msgr2=0x55922fdff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.752+0000 7f6543acb740 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 0x55922fdff570 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f6530010010 tx=0x7f65300116c0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 shutdown_connections 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55922fe78860 0x55922fe7ac80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55922fdfad80 0x55922fe70720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55922fdeedf0 0x55922fdffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 --2- 172.21.15.2:0/1588479108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922fdee4d0 0x55922fdff570 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 >> 172.21.15.2:0/1588479108 conn(0x55922fdec300 msgr2=0x55922fdf98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f651eff5640 0 client.17832 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 shutdown_connections 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 1 -- 172.21.15.2:0/1588479108 wait complete. 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f6543acb740 20 client.17832 trim_cache size 0 max 16384 2024-09-10T23:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f65240b52e0 msgr2=0x7f65240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f65240b52e0 0x7f65240b77a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f65340a9470 tx=0x7f65340762d0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 msgr2=0x7f653c10fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 0x7f653c10fdf0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f653400eaa0 tx=0x7f653400ef60 comp rx=0 tx=0).stop 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 shutdown_connections 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f65240b52e0 0x7f65240b77a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653c108060 0x7f653c10fdf0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f653c1076e0 0x7f653c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 --2- 172.21.15.2:0/2272248163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c101cd0 0x7f653c10f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 >> 172.21.15.2:0/2272248163 conn(0x7f653c0fd700 msgr2=0x7f653c0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 shutdown_connections 2024-09-10T23:31:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:11.753+0000 7f65416f6640 1 -- 172.21.15.2:0/2272248163 wait complete. 2024-09-10T23:31:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:12 smithi154 ceph-mon[35136]: pgmap v557: 97 pgs: 97 active+clean; 1.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:31:12.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:12 smithi177 ceph-mon[35760]: pgmap v557: 97 pgs: 97 active+clean; 1.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:31:12.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:12 smithi002 ceph-mon[31150]: pgmap v557: 97 pgs: 97 active+clean; 1.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:31:12.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:31:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 -- 172.21.15.2:0/767158522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc1087d0 msgr2=0x7f76cc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 --2- 172.21.15.2:0/767158522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc1087d0 0x7f76cc108c10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009ca0 tx=0x7f76c802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 -- 172.21.15.2:0/767158522 shutdown_connections 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 --2- 172.21.15.2:0/767158522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc109150 0x7f76cc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 --2- 172.21.15.2:0/767158522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc1087d0 0x7f76cc108c10 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 --2- 172.21.15.2:0/767158522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 -- 172.21.15.2:0/767158522 >> 172.21.15.2:0/767158522 conn(0x7f76cc0fe830 msgr2=0x7f76cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 -- 172.21.15.2:0/767158522 shutdown_connections 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.351+0000 7f76d37fe640 1 -- 172.21.15.2:0/767158522 wait complete. 2024-09-10T23:31:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 Processor -- start 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 -- start start 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc1087d0 0x7f76cc199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 0x7f76cc19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc112dd0 con 0x7f76cc109150 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc112c50 con 0x7f76cc102dc0 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d37fe640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc112f50 con 0x7f76cc1087d0 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 0x7f76cc19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 0x7f76cc19ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35970/0 (socket says 172.21.15.2:35970) 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.352+0000 7f76d1d9b640 1 -- 172.21.15.2:0/837577875 learned_addr learned my addr 172.21.15.2:0/837577875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d159a640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d0d99640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc1087d0 0x7f76cc199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d1d9b640 1 -- 172.21.15.2:0/837577875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc1087d0 msgr2=0x7f76cc199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc1087d0 0x7f76cc199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d1d9b640 1 -- 172.21.15.2:0/837577875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 msgr2=0x7f76cc199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d1d9b640 1 -- 172.21.15.2:0/837577875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc19f3d0 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d0d99640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc1087d0 0x7f76cc199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 0x7f76cc19ec00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f76c400d750 tx=0x7f76c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76be7fc640 1 -- 172.21.15.2:0/837577875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76be7fc640 1 -- 172.21.15.2:0/837577875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c40054d0 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc19f6c0 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76be7fc640 1 -- 172.21.15.2:0/837577875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4004c60 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.353+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc1a5f50 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76be7fc640 1 -- 172.21.15.2:0/837577875 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f76c4004e00 con 0x7f76cc109150 2024-09-10T23:31:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 Processor -- start 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 -- start start 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee73b0f0 0x562dee73b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73ba10 0x562dee747460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 0x562dee749d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562dee6b1ea0 con 0x562dee7479a0 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562dee6a12d0 con 0x562dee73b0f0 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562dee6a50e0 con 0x562dee73ba10 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 0x562dee749d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 0x562dee749d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35986/0 (socket says 172.21.15.2:35986) 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d0d99640 1 -- 172.21.15.2:0/2958497275 learned_addr learned my addr 172.21.15.2:0/2958497275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.356+0000 7f76d159a640 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73ba10 0x562dee747460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee73b0f0 0x562dee73b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 -- 172.21.15.2:0/2958497275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73ba10 msgr2=0x562dee747460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73ba10 0x562dee747460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 -- 172.21.15.2:0/2958497275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee73b0f0 msgr2=0x562dee73b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee73b0f0 0x562dee73b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 -- 172.21.15.2:0/2958497275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dee3ff650 con 0x562dee7479a0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76be7fc640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f76b80b5360 0x7f76b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 0x562dee749d90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f76c8005e30 tx=0x7f76c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c792d31dd295df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76d159a640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f76b80b5360 0x7f76b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76be7fc640 1 -- 172.21.15.2:0/837577875 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f76c40e5540 con 0x7f76cc109150 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76b77fe640 1 -- 172.21.15.2:0/2958497275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8031d40 con 0x562dee7479a0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76b77fe640 1 -- 172.21.15.2:0/2958497275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c8036050 con 0x562dee7479a0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.357+0000 7f76b77fe640 1 -- 172.21.15.2:0/2958497275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8003e60 con 0x562dee7479a0 2024-09-10T23:31:13.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2958497275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 msgr2=0x562dee749d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d159a640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f76b80b5360 0x7f76b80b7820 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x562dee739e00 tx=0x7f76c000b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 0x562dee749d90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f76c8005e30 tx=0x7f76c8004a40 comp rx=0 tx=0).stop 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2958497275 shutdown_connections 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee7479a0 0x562dee749d90 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73ba10 0x562dee747460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2958497275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee73b0f0 0x562dee73b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2958497275 >> 172.21.15.2:0/2958497275 conn(0x562dee738f20 msgr2=0x562dee73a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2958497275 shutdown_connections 2024-09-10T23:31:13.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2958497275 wait complete. 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 -- start start 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.358+0000 7f76d5bd3740 1 Processor -- start 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee7472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee744700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee744d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562dee502700 con 0x562dee73ba10 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562dee63c160 con 0x562dee7479a0 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562dee74a5c0 con 0x562dee73b0f0 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d5bd3740 10 client.0 _ll_register_callbacks cb 0x562dee6559e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee744700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee744700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35988/0 (socket says 172.21.15.2:35988) 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 -- 172.21.15.2:0/811414421 learned_addr learned my addr 172.21.15.2:0/811414421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:13.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d159a640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee7472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 -- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 msgr2=0x562dee7472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee7472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 -- 172.21.15.2:0/811414421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 msgr2=0x562dee744d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee744d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 -- 172.21.15.2:0/811414421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dee669c90 con 0x562dee73ba10 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d159a640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee7472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76d0d99640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee744700 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f76c8003a20 tx=0x7f76c8005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142556fcee4ef273 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.359+0000 7f76b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76b4ff9640 1 -- 172.21.15.2:0/811414421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8003e40 con 0x562dee73ba10 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76b4ff9640 1 -- 172.21.15.2:0/811414421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f76c8002030 con 0x562dee73ba10 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76c8036050 con 0x562dee73ba10 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76b4ff9640 1 -- 172.21.15.2:0/811414421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76c805b050 con 0x562dee73ba10 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 10 client.17844 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562dee755f50 con 0x562dee73ba10 2024-09-10T23:31:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76b4ff9640 1 -- 172.21.15.2:0/811414421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c8036050 con 0x562dee73ba10 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76b4ff9640 1 -- 172.21.15.2:0/811414421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f76c802f6f0 con 0x562dee73ba10 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 10 client.17844 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 10 client.17844 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 20 client.17844 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7572a0 0x562dee759690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 4 client.17844 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.360+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dee6b3df0 con 0x562dee7572a0 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.361+0000 7f76d159a640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7572a0 0x562dee759690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.361+0000 7f76d159a640 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7572a0 0x562dee759690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4624bf27147184d2 server_cookie=30b34abdd3138a2d in_seq=0 out_seq=0 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.361+0000 7f76b4ff9640 10 client.17844 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76b4ff9640 1 -- 172.21.15.2:0/811414421 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562dee6b3df0 con 0x562dee7572a0 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76b4ff9640 10 client.17844 handle_command_reply: tid=0 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 client.17844 shutdown 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 msgr2=0x562dee744700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee744700 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f76c8003a20 tx=0x7f76c8005d80 comp rx=0 tx=0).stop 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 shutdown_connections 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7572a0 0x562dee759690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee744d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee744700 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/811414421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee7472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 >> 172.21.15.2:0/811414421 conn(0x562dee738f20 msgr2=0x562dee73ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76b4ff9640 0 client.17844 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 shutdown_connections 2024-09-10T23:31:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 1 -- 172.21.15.2:0/811414421 wait complete. 2024-09-10T23:31:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.362+0000 7f76d5bd3740 20 client.17844 trim_cache size 0 max 16384 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.375+0000 7f76d5bd3740 1 Processor -- start 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.375+0000 7f76d5bd3740 1 -- start start 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee738760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee739f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee73a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1ae3e0 con 0x562dee73ba10 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1aff20 con 0x562dee7479a0 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1aeab0 con 0x562dee73b0f0 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee739f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee739f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35990/0 (socket says 172.21.15.2:35990) 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 -- 172.21.15.2:0/3606315479 learned_addr learned my addr 172.21.15.2:0/3606315479 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d159a640 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee738760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee73a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 -- 172.21.15.2:0/3606315479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 msgr2=0x562dee738760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee738760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 -- 172.21.15.2:0/3606315479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 msgr2=0x562dee73a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee73a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 -- 172.21.15.2:0/3606315479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dee7347e0 con 0x562dee73ba10 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee73a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76d0d99640 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee739f70 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f76c8004af0 tx=0x7f76c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948bdbd301ece7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76b6ffd640 1 -- 172.21.15.2:0/3606315479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8003a50 con 0x562dee73ba10 2024-09-10T23:31:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76b6ffd640 1 -- 172.21.15.2:0/3606315479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c8036030 con 0x562dee73ba10 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.376+0000 7f76b6ffd640 1 -- 172.21.15.2:0/3606315479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c80318c0 con 0x562dee73ba10 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 -- 172.21.15.2:0/3606315479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 msgr2=0x562dee739f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee739f70 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f76c8004af0 tx=0x7f76c8004a40 comp rx=0 tx=0).stop 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 -- 172.21.15.2:0/3606315479 shutdown_connections 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee73a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee739f70 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/3606315479 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee738760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 -- 172.21.15.2:0/3606315479 >> 172.21.15.2:0/3606315479 conn(0x562dee738f20 msgr2=0x562dee73f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 -- 172.21.15.2:0/3606315479 shutdown_connections 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.377+0000 7f76d5bd3740 1 -- 172.21.15.2:0/3606315479 wait complete. 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 -- start start 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 Processor -- start 2024-09-10T23:31:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee74f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee74fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee74a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1af850 con 0x562dee73ba10 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1af180 con 0x562dee7479a0 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1ac3c0 con 0x562dee73b0f0 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d5bd3740 10 client.0 _ll_register_callbacks cb 0x7f76c000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee74fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d0d99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee74fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36000/0 (socket says 172.21.15.2:36000) 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.378+0000 7f76d0d99640 1 -- 172.21.15.2:0/2389399299 learned_addr learned my addr 172.21.15.2:0/2389399299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d159a640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee74f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee74a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d0d99640 1 -- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 msgr2=0x562dee74f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee74f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d0d99640 1 -- 172.21.15.2:0/2389399299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 msgr2=0x562dee74a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee74a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d0d99640 1 -- 172.21.15.2:0/2389399299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dee750510 con 0x562dee73ba10 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d1d9b640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee74a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d0d99640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee74fdd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f76c802fb40 tx=0x7f76c802fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2405f51e76281e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76b4ff9640 1 -- 172.21.15.2:0/2389399299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8064020 con 0x562dee73ba10 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76b4ff9640 1 -- 172.21.15.2:0/2389399299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f76c8003c20 con 0x562dee73ba10 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76c8036030 con 0x562dee73ba10 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76b4ff9640 1 -- 172.21.15.2:0/2389399299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76c8003fa0 con 0x562dee73ba10 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d5bd3740 10 client.17850 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.379+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562dee7c8720 con 0x562dee73ba10 2024-09-10T23:31:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76b4ff9640 1 -- 172.21.15.2:0/2389399299 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c8036030 con 0x562dee73ba10 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76b4ff9640 1 -- 172.21.15.2:0/2389399299 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f76c8030860 con 0x562dee73ba10 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d5bd3740 10 client.17850 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d5bd3740 10 client.17850 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d5bd3740 20 client.17850 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7c8d70 0x562dee7cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d5bd3740 4 client.17850 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562dee6af8a0 con 0x562dee7c8d70 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d159a640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7c8d70 0x562dee7cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76d159a640 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7c8d70 0x562dee7cb160 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1dd00d75150764b3 server_cookie=f1880a076e78868e in_seq=0 out_seq=0 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.380+0000 7f76b4ff9640 10 client.17850 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76b4ff9640 1 -- 172.21.15.2:0/2389399299 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562dee6af8a0 con 0x562dee7c8d70 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76b4ff9640 10 client.17850 handle_command_reply: tid=0 2024-09-10T23:31:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 client.17850 shutdown 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 msgr2=0x562dee74fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee74fdd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f76c802fb40 tx=0x7f76c802fdb0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 shutdown_connections 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x562dee7c8d70 0x562dee7cb160 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562dee7479a0 0x562dee74a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562dee73ba10 0x562dee74fdd0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 --2- 172.21.15.2:0/2389399299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562dee73b0f0 0x562dee74f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 >> 172.21.15.2:0/2389399299 conn(0x562dee738f20 msgr2=0x562dee739f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76b4ff9640 0 client.17850 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 shutdown_connections 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 1 -- 172.21.15.2:0/2389399299 wait complete. 2024-09-10T23:31:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.381+0000 7f76d5bd3740 20 client.17850 trim_cache size 0 max 16384 2024-09-10T23:31:13.389 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f76b80b5360 msgr2=0x7f76b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f76b80b5360 0x7f76b80b7820 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x562dee739e00 tx=0x7f76c000b4d0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 msgr2=0x7f76cc19ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 0x7f76cc19ec00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f76c400d750 tx=0x7f76c400dc10 comp rx=0 tx=0).stop 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 shutdown_connections 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f76b80b5360 0x7f76b80b7820 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76cc109150 0x7f76cc19ec00 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76cc1087d0 0x7f76cc199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 --2- 172.21.15.2:0/837577875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 >> 172.21.15.2:0/837577875 conn(0x7f76cc0fe830 msgr2=0x7f76cc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 shutdown_connections 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:13.382+0000 7f76d37fe640 1 -- 172.21.15.2:0/837577875 wait complete. 2024-09-10T23:31:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:14 smithi154 ceph-mon[35136]: pgmap v558: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:31:14.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:14 smithi002 ceph-mon[31150]: pgmap v558: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:31:14.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:31:14.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:14 smithi177 ceph-mon[35760]: pgmap v558: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:31:14.543 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 -- 172.21.15.2:0/3655681331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4102dc0 msgr2=0x7f52d41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 --2- 172.21.15.2:0/3655681331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4102dc0 0x7f52d41031a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009900 tx=0x7f52c402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 -- 172.21.15.2:0/3655681331 shutdown_connections 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 --2- 172.21.15.2:0/3655681331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d4109150 0x7f52d410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 --2- 172.21.15.2:0/3655681331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52d41087d0 0x7f52d4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 --2- 172.21.15.2:0/3655681331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4102dc0 0x7f52d41031a0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 -- 172.21.15.2:0/3655681331 >> 172.21.15.2:0/3655681331 conn(0x7f52d40fe830 msgr2=0x7f52d4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 -- 172.21.15.2:0/3655681331 shutdown_connections 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 -- 172.21.15.2:0/3655681331 wait complete. 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.010+0000 7f52d8940640 1 Processor -- start 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 -- start start 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d4102dc0 0x7f52d40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52d41087d0 0x7f52d40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 0x7f52d4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4112e10 con 0x7f52d4109150 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4112c90 con 0x7f52d4102dc0 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d8940640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4112f90 con 0x7f52d41087d0 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 0x7f52d4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 0x7f52d4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36020/0 (socket says 172.21.15.2:36020) 2024-09-10T23:31:15.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1376460507 learned_addr learned my addr 172.21.15.2:0/1376460507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52d41087d0 0x7f52d40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d259c640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d4102dc0 0x7f52d40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1376460507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52d41087d0 msgr2=0x7f52d40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52d41087d0 0x7f52d40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1376460507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d4102dc0 msgr2=0x7f52d40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d4102dc0 0x7f52d40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1376460507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d41a7600 con 0x7f52d4109150 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.011+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 0x7f52d4075f20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cce0 tx=0x7f52cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.012+0000 7f52cb7fe640 1 -- 172.21.15.2:0/1376460507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f450 con 0x7f52d4109150 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.012+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d41a78f0 con 0x7f52d4109150 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.012+0000 7f52cb7fe640 1 -- 172.21.15.2:0/1376460507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52cc00faa0 con 0x7f52d4109150 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.012+0000 7f52cb7fe640 1 -- 172.21.15.2:0/1376460507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc018a80 con 0x7f52d4109150 2024-09-10T23:31:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.012+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d41a7e30 con 0x7f52d4109150 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.014+0000 7f52cb7fe640 1 -- 172.21.15.2:0/1376460507 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f52cc020030 con 0x7f52d4109150 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.014+0000 7f52dad15740 1 Processor -- start 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 -- start start 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071ce64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cf2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cf4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559071c5cea0 con 0x559071ce6a10 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559071c4c2d0 con 0x559071ce60f0 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52dad15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559071c500e0 con 0x559071cf29a0 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cf2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cf2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36032/0 (socket says 172.21.15.2:36032) 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 -- 172.21.15.2:0/1063222784 learned_addr learned my addr 172.21.15.2:0/1063222784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:15.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071ce64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cf4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 -- 172.21.15.2:0/1063222784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 msgr2=0x559071cf4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cf4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 -- 172.21.15.2:0/1063222784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 msgr2=0x559071ce64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071ce64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52cb7fe640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52c00b52e0 0x7f52c00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.015+0000 7f52d259c640 1 -- 172.21.15.2:0/1063222784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590719aa650 con 0x559071ce6a10 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.016+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52c00b52e0 0x7f52c00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.016+0000 7f52d259c640 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cf2460 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009900 tx=0x7f52c4031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397c3823aea364ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.016+0000 7f52cb7fe640 1 -- 172.21.15.2:0/1376460507 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52cc0e5cf0 con 0x7f52d4109150 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.016+0000 7f52c8ff9640 1 -- 172.21.15.2:0/1063222784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4040070 con 0x559071ce6a10 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.016+0000 7f52c8ff9640 1 -- 172.21.15.2:0/1063222784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52c40316a0 con 0x559071ce6a10 2024-09-10T23:31:15.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.016+0000 7f52c8ff9640 1 -- 172.21.15.2:0/1063222784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4035040 con 0x559071ce6a10 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 -- 172.21.15.2:0/1063222784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 msgr2=0x559071cf2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52c00b52e0 0x7f52c00b77a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f52d4076f90 tx=0x7f52bc013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cf2460 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009900 tx=0x7f52c4031de0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 -- 172.21.15.2:0/1063222784 shutdown_connections 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cf4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cf2460 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 --2- 172.21.15.2:0/1063222784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071ce64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 -- 172.21.15.2:0/1063222784 >> 172.21.15.2:0/1063222784 conn(0x559071ce3f20 msgr2=0x559071ce50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 -- 172.21.15.2:0/1063222784 shutdown_connections 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 -- 172.21.15.2:0/1063222784 wait complete. 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 -- start start 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.017+0000 7f52dad15740 1 Processor -- start 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cf2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cefc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559071aad700 con 0x559071ce6a10 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559071be7160 con 0x559071ce60f0 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559071cf55c0 con 0x559071cf29a0 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52dad15740 10 client.0 _ll_register_callbacks cb 0x559071c009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cef690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36036/0 (socket says 172.21.15.2:36036) 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 -- 172.21.15.2:0/1989888827 learned_addr learned my addr 172.21.15.2:0/1989888827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52d259c640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cf2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cefc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 -- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 msgr2=0x559071cefc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cefc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 -- 172.21.15.2:0/1989888827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 msgr2=0x559071cf2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cf2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 -- 172.21.15.2:0/1989888827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559071c14c90 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cef690 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f52bc01fd70 tx=0x7f52bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fbe83876a9c9ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.018+0000 7f52b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52b9ffb640 1 -- 172.21.15.2:0/1989888827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc01fe60 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52b9ffb640 1 -- 172.21.15.2:0/1989888827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52bc020640 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52c40316a0 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52b9ffb640 1 -- 172.21.15.2:0/1989888827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52bc020840 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 10 client.17862 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559071d00f40 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52b9ffb640 1 -- 172.21.15.2:0/1989888827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52c40316a0 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52b9ffb640 1 -- 172.21.15.2:0/1989888827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52bc02ab00 con 0x559071ce6a10 2024-09-10T23:31:15.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 10 client.17862 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 10 client.17862 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 20 client.17862 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d024a0 0x559071d04940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 4 client.17862 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.021+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559071c5edf0 con 0x559071d024a0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.022+0000 7f52d259c640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d024a0 0x559071d04940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.022+0000 7f52d259c640 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d024a0 0x559071d04940 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da4f9f3d5983f0b3 server_cookie=32a06160b4313e9f in_seq=0 out_seq=0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.022+0000 7f52b9ffb640 10 client.17862 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52b9ffb640 1 -- 172.21.15.2:0/1989888827 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559071c5edf0 con 0x559071d024a0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52b9ffb640 10 client.17862 handle_command_reply: tid=0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 client.17862 shutdown 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 msgr2=0x559071cef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cef690 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f52bc01fd70 tx=0x7f52bc004730 comp rx=0 tx=0).stop 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 shutdown_connections 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d024a0 0x559071d04940 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071cf29a0 0x559071cefc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071ce6a10 0x559071cef690 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52b9ffb640 0 client.17862 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 --2- 172.21.15.2:0/1989888827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cf2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 >> 172.21.15.2:0/1989888827 conn(0x559071ce3f20 msgr2=0x559071ce9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 shutdown_connections 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 1 -- 172.21.15.2:0/1989888827 wait complete. 2024-09-10T23:31:15.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.023+0000 7f52dad15740 20 client.17862 trim_cache size 0 max 16384 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 Processor -- start 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 -- start start 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071ceeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cedf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41b0430 con 0x559071cf29a0 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41b1f70 con 0x559071ce60f0 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52dad15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41b0b00 con 0x559071ce6a10 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cedf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cedf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36048/0 (socket says 172.21.15.2:36048) 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1554777739 learned_addr learned my addr 172.21.15.2:0/1554777739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.037+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071ceeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d259c640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1554777739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 msgr2=0x559071ceeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071ceeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1554777739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 msgr2=0x559071cfe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d2d9d640 1 -- 172.21.15.2:0/1554777739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559071ce6840 con 0x559071cf29a0 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52cbfff640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071ceeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d259c640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cedf10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0a96d0 tx=0x7f52cc0a8ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87da89481997272 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52bbfff640 1 -- 172.21.15.2:0/1554777739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0acb60 con 0x559071cf29a0 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52bbfff640 1 -- 172.21.15.2:0/1554777739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52cc0ac460 con 0x559071cf29a0 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.038+0000 7f52bbfff640 1 -- 172.21.15.2:0/1554777739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0a6dc0 con 0x559071cf29a0 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- 172.21.15.2:0/1554777739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 msgr2=0x559071cedf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cedf10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0a96d0 tx=0x7f52cc0a8ab0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- 172.21.15.2:0/1554777739 shutdown_connections 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cedf10 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071ceeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- 172.21.15.2:0/1554777739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- 172.21.15.2:0/1554777739 >> 172.21.15.2:0/1554777739 conn(0x559071ce3f20 msgr2=0x559071cea970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- 172.21.15.2:0/1554777739 shutdown_connections 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- 172.21.15.2:0/1554777739 wait complete. 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- start start 2024-09-10T23:31:15.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 Processor -- start 2024-09-10T23:31:15.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071cfafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cf5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41b18a0 con 0x559071cf29a0 2024-09-10T23:31:15.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41b11d0 con 0x559071ce60f0 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41ae410 con 0x559071ce6a10 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.039+0000 7f52dad15740 10 client.0 _ll_register_callbacks cb 0x7f52bc00acb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cf5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cf5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36056/0 (socket says 172.21.15.2:36056) 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 -- 172.21.15.2:0/145165634 learned_addr learned my addr 172.21.15.2:0/145165634 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52cbfff640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071cfafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d259c640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 -- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 msgr2=0x559071cfafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071cfafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 -- 172.21.15.2:0/145165634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 msgr2=0x559071cfaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 -- 172.21.15.2:0/145165634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559071cf5f80 con 0x559071cf29a0 2024-09-10T23:31:15.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d259c640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52d2d9d640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cf5840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cf50 tx=0x7f52cc007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3516e55e10bd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52b9ffb640 1 -- 172.21.15.2:0/145165634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f7f0 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52b9ffb640 1 -- 172.21.15.2:0/145165634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f52cc0ab6c0 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.040+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52cc0ac460 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52b9ffb640 1 -- 172.21.15.2:0/145165634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52cc0b59f0 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 10 client.17868 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559071d6fdc0 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52b9ffb640 1 -- 172.21.15.2:0/145165634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52cc0ac460 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52b9ffb640 1 -- 172.21.15.2:0/145165634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52cc0ab130 con 0x559071cf29a0 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 10 client.17868 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 10 client.17868 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 20 client.17868 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d704e0 0x559071d72900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 4 client.17868 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559071c5a8a0 con 0x559071d704e0 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.041+0000 7f52d259c640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d704e0 0x559071d72900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52d259c640 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d704e0 0x559071d72900 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a1510152951a4c02 server_cookie=3e537c55bcc2b617 in_seq=0 out_seq=0 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52b9ffb640 10 client.17868 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52b9ffb640 1 -- 172.21.15.2:0/145165634 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559071c5a8a0 con 0x559071d704e0 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52b9ffb640 10 client.17868 handle_command_reply: tid=0 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 client.17868 shutdown 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 msgr2=0x559071cf5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cf5840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cf50 tx=0x7f52cc007810 comp rx=0 tx=0).stop 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 shutdown_connections 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x559071d704e0 0x559071d72900 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559071cf29a0 0x559071cf5840 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559071ce6a10 0x559071cfafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 --2- 172.21.15.2:0/145165634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559071ce60f0 0x559071cfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 >> 172.21.15.2:0/145165634 conn(0x559071ce3f20 msgr2=0x559071ceded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52b9ffb640 0 client.17868 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:31:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 shutdown_connections 2024-09-10T23:31:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 1 -- 172.21.15.2:0/145165634 wait complete. 2024-09-10T23:31:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.042+0000 7f52dad15740 20 client.17868 trim_cache size 0 max 16384 2024-09-10T23:31:15.049 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52c00b52e0 msgr2=0x7f52c00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52c00b52e0 0x7f52c00b77a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f52d4076f90 tx=0x7f52bc013040 comp rx=0 tx=0).stop 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 msgr2=0x7f52d4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 0x7f52d4075f20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cce0 tx=0x7f52cc00a620 comp rx=0 tx=0).stop 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 shutdown_connections 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f52c00b52e0 0x7f52c00b77a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d4109150 0x7f52d4075f20 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52d41087d0 0x7f52d40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 --2- 172.21.15.2:0/1376460507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d4102dc0 0x7f52d40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 >> 172.21.15.2:0/1376460507 conn(0x7f52d40fe830 msgr2=0x7f52d40fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 shutdown_connections 2024-09-10T23:31:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:15.043+0000 7f52d8940640 1 -- 172.21.15.2:0/1376460507 wait complete. 2024-09-10T23:31:15.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:31:16.108 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:16.229 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:16 smithi002 ceph-mon[31150]: pgmap v559: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:31:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:16 smithi154 ceph-mon[35136]: pgmap v559: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:31:16.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:16 smithi177 ceph-mon[35760]: pgmap v559: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/228755746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 msgr2=0x7fd8a810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/228755746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a810f950 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009ca0 tx=0x7fd8a002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/228755746 shutdown_connections 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/228755746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a810f950 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/228755746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a81087d0 0x7fd8a8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/228755746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a8102dc0 0x7fd8a81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/228755746 >> 172.21.15.2:0/228755746 conn(0x7fd8a80fe830 msgr2=0x7fd8a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/228755746 shutdown_connections 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.595+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/228755746 wait complete. 2024-09-10T23:31:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 Processor -- start 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 -- start start 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a8102dc0 0x7fd8a81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a81087d0 0x7fd8a8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8112e10 con 0x7fd8a8109150 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8112c90 con 0x7fd8a81087d0 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ae8ef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8112f90 con 0x7fd8a8102dc0 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ace8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ace8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36076/0 (socket says 172.21.15.2:36076) 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1345749084 learned_addr learned my addr 172.21.15.2:0/1345749084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.596+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a8102dc0 0x7fd8a81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a81087d0 0x7fd8a8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1345749084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a8102dc0 msgr2=0x7fd8a81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a8102dc0 0x7fd8a81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1345749084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a81087d0 msgr2=0x7fd8a8199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a81087d0 0x7fd8a8199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1345749084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a819f370 con 0x7fd8a8109150 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a8102dc0 0x7fd8a81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a819eba0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0005cc0 tx=0x7fd8a002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8a57fa640 1 -- 172.21.15.2:0/1345749084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0003bf0 con 0x7fd8a8109150 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8a57fa640 1 -- 172.21.15.2:0/1345749084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8a0003d90 con 0x7fd8a8109150 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a819f600 con 0x7fd8a8109150 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8a57fa640 1 -- 172.21.15.2:0/1345749084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a002fbc0 con 0x7fd8a8109150 2024-09-10T23:31:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.597+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81a5da0 con 0x7fd8a8109150 2024-09-10T23:31:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.599+0000 7fd8a57fa640 1 -- 172.21.15.2:0/1345749084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd8a0004610 con 0x7fd8a8109150 2024-09-10T23:31:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 Processor -- start 2024-09-10T23:31:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 -- start start 2024-09-10T23:31:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c3224d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c330d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561f0c298ea0 con 0x561f0c32e9a0 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561f0c2882d0 con 0x561f0c3220f0 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x561f0c28c0e0 con 0x561f0c322a10 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c330d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c330d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36088/0 (socket says 172.21.15.2:36088) 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 -- 172.21.15.2:0/355942203 learned_addr learned my addr 172.21.15.2:0/355942203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c3224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 -- 172.21.15.2:0/355942203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 msgr2=0x561f0c32e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 -- 172.21.15.2:0/355942203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 msgr2=0x561f0c3224d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c3224d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.600+0000 7fd8a77fe640 1 -- 172.21.15.2:0/355942203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0bfe6650 con 0x561f0c32e9a0 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd8a57fa640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8900b5360 0x7fd8900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c330d90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00bfd0 tx=0x7fd89c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9951990e12ead0db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8900b5360 0x7fd8900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd8a57fa640 1 -- 172.21.15.2:0/1345749084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd8a0107140 con 0x7fd8a8109150 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd88e7fc640 1 -- 172.21.15.2:0/355942203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c019030 con 0x561f0c32e9a0 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd88e7fc640 1 -- 172.21.15.2:0/355942203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd89c0118f0 con 0x561f0c32e9a0 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.601+0000 7fd88e7fc640 1 -- 172.21.15.2:0/355942203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c01d7c0 con 0x561f0c32e9a0 2024-09-10T23:31:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/355942203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 msgr2=0x561f0c330d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8900b5360 0x7fd8900b7820 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x561f0c320e00 tx=0x7fd898008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c330d90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00bfd0 tx=0x7fd89c00b6a0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/355942203 shutdown_connections 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c330d90 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/355942203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c3224d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/355942203 >> 172.21.15.2:0/355942203 conn(0x561f0c31ff20 msgr2=0x561f0c3210c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/355942203 shutdown_connections 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/355942203 wait complete. 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 -- start start 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.602+0000 7fd8b0cc4740 1 Processor -- start 2024-09-10T23:31:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c32e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c32be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561f0c0e9700 con 0x561f0c32e9a0 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561f0c223160 con 0x561f0c3220f0 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x561f0c335a30 con 0x561f0c322a10 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8b0cc4740 10 client.0 _ll_register_callbacks cb 0x561f0c23c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c32be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c32be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36094/0 (socket says 172.21.15.2:36094) 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1008059500 learned_addr learned my addr 172.21.15.2:0/1008059500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c32e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1008059500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 msgr2=0x561f0c32b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 msgr2=0x561f0c32e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c32e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 -- 172.21.15.2:0/1008059500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0c250c90 con 0x561f0c32e9a0 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c32be50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00098d0 tx=0x7fd8a00cd0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b496e066e8745934 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.603+0000 7fd8877fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8877fe640 1 -- 172.21.15.2:0/1008059500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00cd8b0 con 0x561f0c32e9a0 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8877fe640 1 -- 172.21.15.2:0/1008059500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd8a00d69b0 con 0x561f0c32e9a0 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd89c0118f0 con 0x561f0c32e9a0 2024-09-10T23:31:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8877fe640 1 -- 172.21.15.2:0/1008059500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8a00d2390 con 0x561f0c32e9a0 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 10 client.17880 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f0c341400 con 0x561f0c32e9a0 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8877fe640 1 -- 172.21.15.2:0/1008059500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd89c0118f0 con 0x561f0c32e9a0 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8877fe640 1 -- 172.21.15.2:0/1008059500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd8a00ccb50 con 0x561f0c32e9a0 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 10 client.17880 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 10 client.17880 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 20 client.17880 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3427f0 0x561f0c344be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 4 client.17880 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f0c29adf0 con 0x561f0c3427f0 2024-09-10T23:31:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.604+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3427f0 0x561f0c344be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.605+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3427f0 0x561f0c344be0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=931e56608cfabbd8 server_cookie=4454ad37951ec53b in_seq=0 out_seq=0 2024-09-10T23:31:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.605+0000 7fd8877fe640 10 client.17880 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8877fe640 1 -- 172.21.15.2:0/1008059500 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f0c29adf0 con 0x561f0c3427f0 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8877fe640 10 client.17880 handle_command_reply: tid=0 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 client.17880 shutdown 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 msgr2=0x561f0c32be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c32be50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00098d0 tx=0x7fd8a00cd0a0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 shutdown_connections 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3427f0 0x561f0c344be0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c32e9a0 0x561f0c32be50 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c32b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1008059500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c3220f0 0x561f0c32e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 >> 172.21.15.2:0/1008059500 conn(0x561f0c31ff20 msgr2=0x561f0c325a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8877fe640 0 client.17880 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 shutdown_connections 2024-09-10T23:31:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1008059500 wait complete. 2024-09-10T23:31:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.606+0000 7fd8b0cc4740 20 client.17880 trim_cache size 0 max 16384 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 Processor -- start 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 -- start start 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c322a10 0x561f0c32d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c32e9a0 0x561f0c32fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81ac0e0 con 0x561f0c3220f0 2024-09-10T23:31:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81adc20 con 0x561f0c322a10 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.619+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81ac7b0 con 0x561f0c32e9a0 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36096/0 (socket says 172.21.15.2:36096) 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1526409028 learned_addr learned my addr 172.21.15.2:0/1526409028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c32e9a0 0x561f0c32fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c322a10 0x561f0c32d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1526409028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c32e9a0 msgr2=0x561f0c32fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c32e9a0 0x561f0c32fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1526409028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c322a10 msgr2=0x561f0c32d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c322a10 0x561f0c32d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1526409028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0c322840 con 0x561f0c3220f0 2024-09-10T23:31:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33ec60 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fd89800b7a0 tx=0x7fd898015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd329e6997baff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd88dffb640 1 -- 172.21.15.2:0/1526409028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89801b040 con 0x561f0c3220f0 2024-09-10T23:31:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd88dffb640 1 -- 172.21.15.2:0/1526409028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd89802e070 con 0x561f0c3220f0 2024-09-10T23:31:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.620+0000 7fd88dffb640 1 -- 172.21.15.2:0/1526409028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898015670 con 0x561f0c3220f0 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1526409028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 msgr2=0x561f0c33ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33ec60 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fd89800b7a0 tx=0x7fd898015000 comp rx=0 tx=0).stop 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1526409028 shutdown_connections 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c32e9a0 0x561f0c32fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c322a10 0x561f0c32d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1526409028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33ec60 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1526409028 >> 172.21.15.2:0/1526409028 conn(0x561f0c31ff20 msgr2=0x561f0c32cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1526409028 shutdown_connections 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1526409028 wait complete. 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.621+0000 7fd8b0cc4740 1 -- start start 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 Processor -- start 2024-09-10T23:31:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c33b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c32e9a0 0x561f0c335c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81ad550 con 0x561f0c3220f0 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81ace80 con 0x561f0c32e9a0 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81aa0c0 con 0x561f0c322a10 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8b0cc4740 10 client.0 _ll_register_callbacks cb 0x7fd8a00095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36100/0 (socket says 172.21.15.2:36100) 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1180714719 learned_addr learned my addr 172.21.15.2:0/1180714719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c33b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c32e9a0 0x561f0c335c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1180714719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 msgr2=0x561f0c33b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c33b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c32e9a0 msgr2=0x561f0c335c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c32e9a0 0x561f0c335c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 -- 172.21.15.2:0/1180714719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0c33b880 con 0x561f0c3220f0 2024-09-10T23:31:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8ace8c640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c32e9a0 0x561f0c335c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8a7fff640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33acd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd89800f5b0 tx=0x7fd89800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22c8e76adca854b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.622+0000 7fd8877fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8877fe640 1 -- 172.21.15.2:0/1180714719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898036030 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8877fe640 1 -- 172.21.15.2:0/1180714719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd898029050 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd89802e070 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8877fe640 1 -- 172.21.15.2:0/1180714719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd89801b070 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 10 client.17886 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f0c3afae0 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8877fe640 1 -- 172.21.15.2:0/1180714719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd89802e070 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8877fe640 1 -- 172.21.15.2:0/1180714719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd8980325d0 con 0x561f0c3220f0 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 10 client.17886 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 10 client.17886 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 20 client.17886 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3b0240 0x561f0c3b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 4 client.17886 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.623+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f0c2968a0 con 0x561f0c3b0240 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3b0240 0x561f0c3b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8a77fe640 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3b0240 0x561f0c3b2660 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b72293c5219f4efc server_cookie=e7e586f6fc6d2867 in_seq=0 out_seq=0 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8877fe640 10 client.17886 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8877fe640 1 -- 172.21.15.2:0/1180714719 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f0c2968a0 con 0x561f0c3b0240 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8877fe640 10 client.17886 handle_command_reply: tid=0 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 client.17886 shutdown 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 msgr2=0x561f0c33acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33acd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd89800f5b0 tx=0x7fd89800f8a0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 shutdown_connections 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561f0c32e9a0 0x561f0c335c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f0c322a10 0x561f0c33b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x561f0c3b0240 0x561f0c3b2660 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 --2- 172.21.15.2:0/1180714719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f0c3220f0 0x561f0c33acd0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 >> 172.21.15.2:0/1180714719 conn(0x561f0c31ff20 msgr2=0x561f0c32d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8877fe640 0 client.17886 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:31:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.624+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 shutdown_connections 2024-09-10T23:31:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8b0cc4740 1 -- 172.21.15.2:0/1180714719 wait complete. 2024-09-10T23:31:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8b0cc4740 20 client.17886 trim_cache size 0 max 16384 2024-09-10T23:31:16.632 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8900b5360 msgr2=0x7fd8900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8900b5360 0x7fd8900b7820 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x561f0c320e00 tx=0x7fd898008040 comp rx=0 tx=0).stop 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 msgr2=0x7fd8a819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a819eba0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0005cc0 tx=0x7fd8a002f380 comp rx=0 tx=0).stop 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 shutdown_connections 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8900b5360 0x7fd8900b7820 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8109150 0x7fd8a819eba0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a81087d0 0x7fd8a8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 --2- 172.21.15.2:0/1345749084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8a8102dc0 0x7fd8a81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 >> 172.21.15.2:0/1345749084 conn(0x7fd8a80fe830 msgr2=0x7fd8a8105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 shutdown_connections 2024-09-10T23:31:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:16.625+0000 7fd8ae8ef640 1 -- 172.21.15.2:0/1345749084 wait complete. 2024-09-10T23:31:17.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:31:17.713 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:18.181 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:18 smithi002 ceph-mon[31150]: pgmap v560: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:18 smithi154 ceph-mon[35136]: pgmap v560: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 -- 172.21.15.2:0/2512226772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 msgr2=0x7f78f81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 --2- 172.21.15.2:0/2512226772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81031a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009900 tx=0x7f78f402a410 comp rx=0 tx=0).stop 2024-09-10T23:31:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 -- 172.21.15.2:0/2512226772 shutdown_connections 2024-09-10T23:31:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 --2- 172.21.15.2:0/2512226772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78f8109150 0x7f78f810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 --2- 172.21.15.2:0/2512226772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78f81087d0 0x7f78f8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 --2- 172.21.15.2:0/2512226772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81031a0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 -- 172.21.15.2:0/2512226772 >> 172.21.15.2:0/2512226772 conn(0x7f78f80fe830 msgr2=0x7f78f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 -- 172.21.15.2:0/2512226772 shutdown_connections 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.267+0000 7f78ff534640 1 -- 172.21.15.2:0/2512226772 wait complete. 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 Processor -- start 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 -- start start 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78f81087d0 0x7f78f81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78f8109150 0x7f78f819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8112dd0 con 0x7f78f8102dc0 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8112c50 con 0x7f78f81087d0 2024-09-10T23:31:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78ff534640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8112f50 con 0x7f78f8109150 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78fd2d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78fd2d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36128/0 (socket says 172.21.15.2:36128) 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78fd2d0640 1 -- 172.21.15.2:0/370204138 learned_addr learned my addr 172.21.15.2:0/370204138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.268+0000 7f78fdad1640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78f8109150 0x7f78f819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fcacf640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78f81087d0 0x7f78f81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fd2d0640 1 -- 172.21.15.2:0/370204138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78f8109150 msgr2=0x7f78f819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78f8109150 0x7f78f819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fd2d0640 1 -- 172.21.15.2:0/370204138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78f81087d0 msgr2=0x7f78f81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78f81087d0 0x7f78f81997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fd2d0640 1 -- 172.21.15.2:0/370204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f819f350 con 0x7f78f8102dc0 2024-09-10T23:31:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81992a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005940 tx=0x7f78f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78ee7fc640 1 -- 172.21.15.2:0/370204138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f403f030 con 0x7f78f8102dc0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78ee7fc640 1 -- 172.21.15.2:0/370204138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4003cb0 con 0x7f78f8102dc0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f819f5e0 con 0x7f78f8102dc0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78ee7fc640 1 -- 172.21.15.2:0/370204138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4035070 con 0x7f78f8102dc0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.269+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f81a5d00 con 0x7f78f8102dc0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 Processor -- start 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78ee7fc640 1 -- 172.21.15.2:0/370204138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f78f403bbf0 con 0x7f78f8102dc0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 -- start start 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e230ea0 con 0x55ea3e2badf0 2024-09-10T23:31:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e2202d0 con 0x55ea3e2ba4d0 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f7901909740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e2240e0 con 0x55ea3e2c6d80 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fd2d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fd2d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36134/0 (socket says 172.21.15.2:36134) 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fd2d0640 1 -- 172.21.15.2:0/623523721 learned_addr learned my addr 172.21.15.2:0/623523721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fcacf640 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fdad1640 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fd2d0640 1 -- 172.21.15.2:0/623523721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 msgr2=0x55ea3e2c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.272+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78fd2d0640 1 -- 172.21.15.2:0/623523721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 msgr2=0x55ea3e2ba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ba8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78fd2d0640 1 -- 172.21.15.2:0/623523721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3df7e650 con 0x55ea3e2badf0 2024-09-10T23:31:18.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78ee7fc640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78e40b52e0 0x7f78e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c6840 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f78f410cc10 tx=0x7f78f410cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84360f4561730c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78fdad1640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78e40b52e0 0x7f78e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78ee7fc640 1 -- 172.21.15.2:0/370204138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78f4106780 con 0x7f78f8102dc0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78e37fe640 1 -- 172.21.15.2:0/623523721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f40c95a0 con 0x55ea3e2badf0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78e37fe640 1 -- 172.21.15.2:0/623523721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f40cca60 con 0x55ea3e2badf0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.273+0000 7f78e37fe640 1 -- 172.21.15.2:0/623523721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4005d50 con 0x55ea3e2badf0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 -- 172.21.15.2:0/623523721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 msgr2=0x55ea3e2c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c6840 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f78f410cc10 tx=0x7f78f410cd00 comp rx=0 tx=0).stop 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f78fdad1640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78e40b52e0 0x7f78e40b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005fd0 tx=0x7f78f0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 -- 172.21.15.2:0/623523721 shutdown_connections 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c6840 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 --2- 172.21.15.2:0/623523721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 -- 172.21.15.2:0/623523721 >> 172.21.15.2:0/623523721 conn(0x55ea3e2b8300 msgr2=0x55ea3e2b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 -- 172.21.15.2:0/623523721 shutdown_connections 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 -- 172.21.15.2:0/623523721 wait complete. 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.274+0000 7f7901909740 1 -- start start 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 Processor -- start 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e081700 con 0x55ea3e2badf0 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e1bb160 con 0x55ea3e2ba4d0 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ea3e2c97c0 con 0x55ea3e2c6d80 2024-09-10T23:31:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f7901909740 10 client.0 _ll_register_callbacks cb 0x55ea3e1d49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36136/0 (socket says 172.21.15.2:36136) 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 -- 172.21.15.2:0/1362127362 learned_addr learned my addr 172.21.15.2:0/1362127362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fdad1640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 -- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 msgr2=0x55ea3e2c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 -- 172.21.15.2:0/1362127362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 msgr2=0x55ea3e2c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fcacf640 1 -- 172.21.15.2:0/1362127362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3e1e8c90 con 0x55ea3e2badf0 2024-09-10T23:31:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.275+0000 7f78fdad1640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78fcacf640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c3a80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009e00 tx=0x7f78e80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9344b446ba52e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78e0ff9640 1 -- 172.21.15.2:0/1362127362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8012860 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78e0ff9640 1 -- 172.21.15.2:0/1362127362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78e8012a00 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f40cca60 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78e0ff9640 1 -- 172.21.15.2:0/1362127362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e8012c00 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f7901909740 10 client.17898 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea3e2d5050 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78e0ff9640 1 -- 172.21.15.2:0/1362127362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f40cca60 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f78e0ff9640 1 -- 172.21.15.2:0/1362127362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78e800f040 con 0x55ea3e2badf0 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f7901909740 10 client.17898 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.276+0000 7f7901909740 10 client.17898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f7901909740 20 client.17898 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f7901909740 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e2d6600 0x55ea3e2d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f7901909740 4 client.17898 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea3e232df0 con 0x55ea3e2d6600 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e2d6600 0x55ea3e2d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e2d6600 0x55ea3e2d8a60 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d16dbb4fb218b6 server_cookie=e62d6061c1737eec in_seq=0 out_seq=0 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.277+0000 7f78e0ff9640 10 client.17898 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f78e0ff9640 1 -- 172.21.15.2:0/1362127362 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea3e232df0 con 0x55ea3e2d6600 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f78e0ff9640 10 client.17898 handle_command_reply: tid=0 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 client.17898 shutdown 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 msgr2=0x55ea3e2c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c3a80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009e00 tx=0x7f78e80117b0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 shutdown_connections 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e2d6600 0x55ea3e2d8a60 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c3a80 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f78e0ff9640 0 client.17898 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 --2- 172.21.15.2:0/1362127362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 >> 172.21.15.2:0/1362127362 conn(0x55ea3e2b8300 msgr2=0x55ea3e2bdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 shutdown_connections 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 1 -- 172.21.15.2:0/1362127362 wait complete. 2024-09-10T23:31:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.278+0000 7f7901909740 20 client.17898 trim_cache size 0 max 16384 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 Processor -- start 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 -- start start 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81ae3a0 con 0x55ea3e2c6d80 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81afee0 con 0x55ea3e2ba4d0 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f7901909740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81aea70 con 0x55ea3e2badf0 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36152/0 (socket says 172.21.15.2:36152) 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 -- 172.21.15.2:0/4129658560 learned_addr learned my addr 172.21.15.2:0/4129658560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fcacf640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 -- 172.21.15.2:0/4129658560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2badf0 msgr2=0x55ea3e2c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 -- 172.21.15.2:0/4129658560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 msgr2=0x55ea3e2b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fdad1640 1 -- 172.21.15.2:0/4129658560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3e2b8d80 con 0x55ea3e2c6d80 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.292+0000 7f78fcacf640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.293+0000 7f78fdad1640 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c8170 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f78f001c610 tx=0x7f78f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bafd5fd7b66a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.293+0000 7f78e2ffd640 1 -- 172.21.15.2:0/4129658560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0010770 con 0x55ea3e2c6d80 2024-09-10T23:31:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.293+0000 7f78e2ffd640 1 -- 172.21.15.2:0/4129658560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f0010dc0 con 0x55ea3e2c6d80 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.293+0000 7f78e2ffd640 1 -- 172.21.15.2:0/4129658560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0026390 con 0x55ea3e2c6d80 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.293+0000 7f7901909740 1 -- 172.21.15.2:0/4129658560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 msgr2=0x55ea3e2c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.293+0000 7f7901909740 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c8170 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f78f001c610 tx=0x7f78f0019000 comp rx=0 tx=0).stop 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- 172.21.15.2:0/4129658560 shutdown_connections 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c8170 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2badf0 0x55ea3e2c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 --2- 172.21.15.2:0/4129658560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- 172.21.15.2:0/4129658560 >> 172.21.15.2:0/4129658560 conn(0x55ea3e2b8300 msgr2=0x55ea3e2c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- 172.21.15.2:0/4129658560 shutdown_connections 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- 172.21.15.2:0/4129658560 wait complete. 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- start start 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 Processor -- start 2024-09-10T23:31:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81af810 con 0x55ea3e2badf0 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81af140 con 0x55ea3e2ba4d0 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.294+0000 7f7901909740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81ac380 con 0x55ea3e2c6d80 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f7901909740 10 client.0 _ll_register_callbacks cb 0x7f78e8009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36164/0 (socket says 172.21.15.2:36164) 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 -- 172.21.15.2:0/3114274619 learned_addr learned my addr 172.21.15.2:0/3114274619 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fdad1640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 -- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 msgr2=0x55ea3e2c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 -- 172.21.15.2:0/3114274619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 msgr2=0x55ea3e2ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 -- 172.21.15.2:0/3114274619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3e2b9d40 con 0x55ea3e2badf0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78fcacf640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2cf2a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2be9f37b6977952 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78e0ff9640 1 -- 172.21.15.2:0/3114274619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8033060 con 0x55ea3e2badf0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f78e0ff9640 1 -- 172.21.15.2:0/3114274619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78e8012860 con 0x55ea3e2badf0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.295+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f0010dc0 con 0x55ea3e2badf0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f78e0ff9640 1 -- 172.21.15.2:0/3114274619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e8029040 con 0x55ea3e2badf0 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 10 client.17904 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea3e3482e0 con 0x55ea3e2badf0 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f78e0ff9640 1 -- 172.21.15.2:0/3114274619 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f0010dc0 con 0x55ea3e2badf0 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f78e0ff9640 1 -- 172.21.15.2:0/3114274619 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78e8019b30 con 0x55ea3e2badf0 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 10 client.17904 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 10 client.17904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 20 client.17904 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e348a90 0x55ea3e34aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 4 client.17904 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea3e22e8a0 con 0x55ea3e348a90 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.296+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e348a90 0x55ea3e34aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f78fd2d0640 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e348a90 0x55ea3e34aeb0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c9b27ca6a37e818 server_cookie=90c93f4bd5929007 in_seq=0 out_seq=0 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f78e0ff9640 10 client.17904 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f78e0ff9640 1 -- 172.21.15.2:0/3114274619 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea3e22e8a0 con 0x55ea3e348a90 2024-09-10T23:31:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f78e0ff9640 10 client.17904 handle_command_reply: tid=0 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 client.17904 shutdown 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 msgr2=0x55ea3e2cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2cf2a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8009980 comp rx=0 tx=0).stop 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 shutdown_connections 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ea3e348a90 0x55ea3e34aeb0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ea3e2c6d80 0x55ea3e2c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea3e2badf0 0x55ea3e2cf2a0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 --2- 172.21.15.2:0/3114274619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea3e2ba4d0 0x55ea3e2ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f78e0ff9640 0 client.17904 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 >> 172.21.15.2:0/3114274619 conn(0x55ea3e2b8300 msgr2=0x55ea3e2c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 shutdown_connections 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 1 -- 172.21.15.2:0/3114274619 wait complete. 2024-09-10T23:31:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.297+0000 7f7901909740 20 client.17904 trim_cache size 0 max 16384 2024-09-10T23:31:18.312 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78e40b52e0 msgr2=0x7f78e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78e40b52e0 0x7f78e40b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005fd0 tx=0x7f78f0009600 comp rx=0 tx=0).stop 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 msgr2=0x7f78f81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81992a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005940 tx=0x7f78f40042f0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 shutdown_connections 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78e40b52e0 0x7f78e40b77a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78f8109150 0x7f78f819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78f81087d0 0x7f78f81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 --2- 172.21.15.2:0/370204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f8102dc0 0x7f78f81992a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 >> 172.21.15.2:0/370204138 conn(0x7f78f80fe830 msgr2=0x7f78f8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 shutdown_connections 2024-09-10T23:31:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:18.298+0000 7f78ff534640 1 -- 172.21.15.2:0/370204138 wait complete. 2024-09-10T23:31:18.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:18 smithi177 ceph-mon[35760]: pgmap v560: 97 pgs: 97 active+clean; 1.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:20.092 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:31:20.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:31:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 -- 172.21.15.2:0/3996195322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 msgr2=0x7f05f410ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 --2- 172.21.15.2:0/3996195322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f410ab30 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009ca0 tx=0x7f05ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 -- 172.21.15.2:0/3996195322 shutdown_connections 2024-09-10T23:31:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 --2- 172.21.15.2:0/3996195322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f410ab30 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 --2- 172.21.15.2:0/3996195322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f4105ac0 0x7f05f4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 --2- 172.21.15.2:0/3996195322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05f406b470 0x7f05f4105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 -- 172.21.15.2:0/3996195322 >> 172.21.15.2:0/3996195322 conn(0x7f05f40fd140 msgr2=0x7f05f40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 -- 172.21.15.2:0/3996195322 shutdown_connections 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 -- 172.21.15.2:0/3996195322 wait complete. 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 Processor -- start 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 -- start start 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f406b470 0x7f05f4198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.245+0000 7f05fac72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05f4105ac0 0x7f05f4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05fac72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f4199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05fac72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410e5a0 con 0x7f05f4108670 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05fac72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410e420 con 0x7f05f406b470 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05fac72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410e720 con 0x7f05f4105ac0 2024-09-10T23:31:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f4199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f4199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36188/0 (socket says 172.21.15.2:36188) 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 -- 172.21.15.2:0/548939873 learned_addr learned my addr 172.21.15.2:0/548939873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f3fff640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05f4105ac0 0x7f05f4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f406b470 0x7f05f4198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 -- 172.21.15.2:0/548939873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05f4105ac0 msgr2=0x7f05f4199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05f4105ac0 0x7f05f4199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 -- 172.21.15.2:0/548939873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f406b470 msgr2=0x7f05f4198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f406b470 0x7f05f4198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 -- 172.21.15.2:0/548939873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f419a830 con 0x7f05f4108670 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f406b470 0x7f05f4198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f920f640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f4199f70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0097b0 tx=0x7f05ec031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f1ffb640 1 -- 172.21.15.2:0/548939873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec003b70 con 0x7f05f4108670 2024-09-10T23:31:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f1ffb640 1 -- 172.21.15.2:0/548939873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ec003d10 con 0x7f05f4108670 2024-09-10T23:31:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f419aac0 con 0x7f05f4108670 2024-09-10T23:31:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.246+0000 7f05f1ffb640 1 -- 172.21.15.2:0/548939873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec02fc10 con 0x7f05f4108670 2024-09-10T23:31:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.247+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f41a11f0 con 0x7f05f4108670 2024-09-10T23:31:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.249+0000 7f05fda3f740 1 Processor -- start 2024-09-10T23:31:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.249+0000 7f05f1ffb640 1 -- 172.21.15.2:0/548939873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f05ec004040 con 0x7f05f4108670 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 -- start start 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 0x556016512c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x556016515580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x556016518090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560164826f0 con 0x556016510860 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556016471b20 con 0x556016515bd0 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05fda3f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556016475930 con 0x556016513190 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 0x556016512c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 0x556016512c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36190/0 (socket says 172.21.15.2:36190) 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 -- 172.21.15.2:0/3470289279 learned_addr learned my addr 172.21.15.2:0/3470289279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x556016515580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x556016518090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 -- 172.21.15.2:0/3470289279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 msgr2=0x556016515580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x556016515580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 -- 172.21.15.2:0/3470289279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 msgr2=0x556016518090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x556016518090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f3fff640 1 -- 172.21.15.2:0/3470289279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556016437530 con 0x556016510860 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.250+0000 7f05f1ffb640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05e40b52e0 0x7f05e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.251+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05e40b52e0 0x7f05e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.251+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 0x556016512c50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f05e0013690 tx=0x7f05e0009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37298435b0a8957e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.251+0000 7f05f1ffb640 1 -- 172.21.15.2:0/548939873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f05ec106fc0 con 0x7f05f4108670 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.251+0000 7f05deffd640 1 -- 172.21.15.2:0/3470289279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e000f5b0 con 0x556016510860 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.251+0000 7f05deffd640 1 -- 172.21.15.2:0/3470289279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05e000fc00 con 0x556016510860 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.251+0000 7f05deffd640 1 -- 172.21.15.2:0/3470289279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0010ac0 con 0x556016510860 2024-09-10T23:31:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 -- 172.21.15.2:0/3470289279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 msgr2=0x556016512c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05e40b52e0 0x7f05e40b77a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009db0 tx=0x7f05e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 0x556016512c50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f05e0013690 tx=0x7f05e0009890 comp rx=0 tx=0).stop 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 -- 172.21.15.2:0/3470289279 shutdown_connections 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x556016518090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x556016515580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3470289279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016510860 0x556016512c50 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 -- 172.21.15.2:0/3470289279 >> 172.21.15.2:0/3470289279 conn(0x55601650b9b0 msgr2=0x55601650c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 -- 172.21.15.2:0/3470289279 shutdown_connections 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 -- 172.21.15.2:0/3470289279 wait complete. 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 -- start start 2024-09-10T23:31:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.252+0000 7f05fda3f740 1 Processor -- start 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016510860 0x556016519ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x55601651a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 0x55601651b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560163a9ab0 con 0x556016515bd0 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556016417730 con 0x556016510860 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556016518bb0 con 0x556016513190 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05fda3f740 10 client.0 _ll_register_callbacks cb 0x55601646b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 0x55601651b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 0x55601651b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36200/0 (socket says 172.21.15.2:36200) 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 -- 172.21.15.2:0/1077926389 learned_addr learned my addr 172.21.15.2:0/1077926389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016510860 0x556016519ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f3fff640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x55601651a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 -- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 msgr2=0x55601651a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x55601651a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 -- 172.21.15.2:0/1077926389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016510860 msgr2=0x556016519ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016510860 0x556016519ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 -- 172.21.15.2:0/1077926389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560161d3790 con 0x556016515bd0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05f920f640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 0x55601651b130 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0caa00 tx=0x7f05ec0cd620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d82654201bd03b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.253+0000 7f05d3fff640 1 -- 172.21.15.2:0/1077926389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0f0040 con 0x556016515bd0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05d3fff640 1 -- 172.21.15.2:0/1077926389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f05ec02fdb0 con 0x556016515bd0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e000fc00 con 0x556016515bd0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05d3fff640 1 -- 172.21.15.2:0/1077926389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05ec0cde90 con 0x556016515bd0 2024-09-10T23:31:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 10 client.17916 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55601624c620 con 0x556016515bd0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05d3fff640 1 -- 172.21.15.2:0/1077926389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05e000fc00 con 0x556016515bd0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05d3fff640 1 -- 172.21.15.2:0/1077926389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f05ec0c9a00 con 0x556016515bd0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 10 client.17916 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 10 client.17916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 20 client.17916 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165257a0 0x556016527c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 4 client.17916 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.254+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556016484640 con 0x5560165257a0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.255+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165257a0 0x556016527c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.255+0000 7f05d3fff640 10 client.17916 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.255+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165257a0 0x556016527c20 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1991f39513d603f3 server_cookie=b05b47172fc613bc in_seq=0 out_seq=0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05d3fff640 1 -- 172.21.15.2:0/1077926389 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556016484640 con 0x5560165257a0 2024-09-10T23:31:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05d3fff640 10 client.17916 handle_command_reply: tid=0 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 client.17916 shutdown 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 msgr2=0x55601651b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 0x55601651b130 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0caa00 tx=0x7f05ec0cd620 comp rx=0 tx=0).stop 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 shutdown_connections 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165257a0 0x556016527c20 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016515bd0 0x55601651b130 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016513190 0x55601651a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05d3fff640 0 client.17916 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1077926389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016510860 0x556016519ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 >> 172.21.15.2:0/1077926389 conn(0x55601650b9b0 msgr2=0x55601650abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 shutdown_connections 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 1 -- 172.21.15.2:0/1077926389 wait complete. 2024-09-10T23:31:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.256+0000 7f05fda3f740 20 client.17916 trim_cache size 0 max 16384 2024-09-10T23:31:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 Processor -- start 2024-09-10T23:31:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 -- start start 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601650fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x556016510230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601650ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41a9e10 con 0x556016513190 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41ab950 con 0x556016515bd0 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05fda3f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41aa4e0 con 0x556016510860 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x556016510230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x556016510230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36216/0 (socket says 172.21.15.2:36216) 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 -- 172.21.15.2:0/3871705916 learned_addr learned my addr 172.21.15.2:0/3871705916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601650fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 -- 172.21.15.2:0/3871705916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 msgr2=0x55601650fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601650fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 -- 172.21.15.2:0/3871705916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 msgr2=0x55601650ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601650ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.271+0000 7f05f3fff640 1 -- 172.21.15.2:0/3871705916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556016512fc0 con 0x556016513190 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.272+0000 7f05f3fff640 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x556016510230 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f05e00058c0 tx=0x7f05e0021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d1a9b570755015 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.272+0000 7f05de7fc640 1 -- 172.21.15.2:0/3871705916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0013190 con 0x556016513190 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.272+0000 7f05de7fc640 1 -- 172.21.15.2:0/3871705916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05e0005580 con 0x556016513190 2024-09-10T23:31:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.272+0000 7f05de7fc640 1 -- 172.21.15.2:0/3871705916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0010e00 con 0x556016513190 2024-09-10T23:31:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.272+0000 7f05fda3f740 1 -- 172.21.15.2:0/3871705916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 msgr2=0x556016510230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.272+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x556016510230 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f05e00058c0 tx=0x7f05e0021040 comp rx=0 tx=0).stop 2024-09-10T23:31:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- 172.21.15.2:0/3871705916 shutdown_connections 2024-09-10T23:31:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601650ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x556016510230 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 --2- 172.21.15.2:0/3871705916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601650fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- 172.21.15.2:0/3871705916 >> 172.21.15.2:0/3871705916 conn(0x55601650b9b0 msgr2=0x55601650c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- 172.21.15.2:0/3871705916 shutdown_connections 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- 172.21.15.2:0/3871705916 wait complete. 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- start start 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 Processor -- start 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601658dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x55601658e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601658eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41ab280 con 0x556016513190 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41aabb0 con 0x556016515bd0 2024-09-10T23:31:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41a7df0 con 0x556016510860 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.273+0000 7f05fda3f740 10 client.0 _ll_register_callbacks cb 0x7f05ec005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x55601658e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x55601658e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36220/0 (socket says 172.21.15.2:36220) 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 -- 172.21.15.2:0/1796971992 learned_addr learned my addr 172.21.15.2:0/1796971992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601658dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f920f640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601658eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 -- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 msgr2=0x55601658dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601658dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 -- 172.21.15.2:0/1796971992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 msgr2=0x55601658eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601658eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 -- 172.21.15.2:0/1796971992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601658f5d0 con 0x556016513190 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05f3fff640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x55601658e240 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f05e0005c20 tx=0x7f05e0009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c97ceb4d2aabb14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05d3fff640 1 -- 172.21.15.2:0/1796971992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0037060 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05d3fff640 1 -- 172.21.15.2:0/1796971992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f05e0011e20 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e0005580 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05d3fff640 1 -- 172.21.15.2:0/1796971992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05e00050d0 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.274+0000 7f05fda3f740 10 client.17922 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556016596970 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05d3fff640 1 -- 172.21.15.2:0/1796971992 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05e0005580 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05d3fff640 1 -- 172.21.15.2:0/1796971992 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f05e0003c10 con 0x556016513190 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 10 client.17922 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 10 client.17922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 20 client.17922 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165970a0 0x5560165994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 4 client.17922 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:31:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560164800f0 con 0x5560165970a0 2024-09-10T23:31:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.275+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165970a0 0x5560165994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.276+0000 7f05d3fff640 10 client.17922 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.276+0000 7f05f8a0e640 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165970a0 0x5560165994c0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad70c78f58badd14 server_cookie=cab3efd72bc1b98f in_seq=0 out_seq=0 2024-09-10T23:31:20.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:20 smithi154 ceph-mon[35136]: pgmap v561: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:31:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05d3fff640 1 -- 172.21.15.2:0/1796971992 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560164800f0 con 0x5560165970a0 2024-09-10T23:31:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05d3fff640 10 client.17922 handle_command_reply: tid=0 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 client.17922 shutdown 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 msgr2=0x55601658e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x55601658e240 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f05e0005c20 tx=0x7f05e0009e70 comp rx=0 tx=0).stop 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 shutdown_connections 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5560165970a0 0x5560165994c0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556016515bd0 0x55601658eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556016513190 0x55601658e240 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05d3fff640 0 client.17922 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 --2- 172.21.15.2:0/1796971992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556016510860 0x55601658dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.289+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 >> 172.21.15.2:0/1796971992 conn(0x55601650b9b0 msgr2=0x55601650c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 shutdown_connections 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fda3f740 1 -- 172.21.15.2:0/1796971992 wait complete. 2024-09-10T23:31:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fda3f740 20 client.17922 trim_cache size 0 max 16384 2024-09-10T23:31:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:31:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:31:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:31:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05e40b52e0 msgr2=0x7f05e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05e40b52e0 0x7f05e40b77a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009db0 tx=0x7f05e8005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 msgr2=0x7f05f4199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f4199f70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0097b0 tx=0x7f05ec031770 comp rx=0 tx=0).stop 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 shutdown_connections 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f05e40b52e0 0x7f05e40b77a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f4108670 0x7f05f4199f70 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05f4105ac0 0x7f05f4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 --2- 172.21.15.2:0/548939873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05f406b470 0x7f05f4198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.290+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 >> 172.21.15.2:0/548939873 conn(0x7f05f40fd140 msgr2=0x7f05f4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.291+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 shutdown_connections 2024-09-10T23:31:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:20.291+0000 7f05fac72640 1 -- 172.21.15.2:0/548939873 wait complete. 2024-09-10T23:31:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:20 smithi177 ceph-mon[35760]: pgmap v561: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:31:20.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:20 smithi002 ceph-mon[31150]: pgmap v561: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 -- 172.21.15.2:0/4034344935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c1076a0 msgr2=0x7f889c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 --2- 172.21.15.2:0/4034344935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c1076a0 0x7f889c107ae0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8890009900 tx=0x7f889002a410 comp rx=0 tx=0).stop 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 -- 172.21.15.2:0/4034344935 shutdown_connections 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 --2- 172.21.15.2:0/4034344935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 0x7f889c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 --2- 172.21.15.2:0/4034344935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c1076a0 0x7f889c107ae0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 --2- 172.21.15.2:0/4034344935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c101c90 0x7f889c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 -- 172.21.15.2:0/4034344935 >> 172.21.15.2:0/4034344935 conn(0x7f889c0fd700 msgr2=0x7f889c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 -- 172.21.15.2:0/4034344935 shutdown_connections 2024-09-10T23:31:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 -- 172.21.15.2:0/4034344935 wait complete. 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.869+0000 7f88a1a72640 1 Processor -- start 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 -- start start 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 0x7f889c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c1076a0 0x7f889c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 0x7f889c1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f889c111ce0 con 0x7f889c101c90 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f889c111b60 con 0x7f889c108020 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f88a1a72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f889c111e60 con 0x7f889c1076a0 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 0x7f889c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 0x7f889c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36240/0 (socket says 172.21.15.2:36240) 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 -- 172.21.15.2:0/2506839549 learned_addr learned my addr 172.21.15.2:0/2506839549 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889bfff640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 0x7f889c1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889affd640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c1076a0 0x7f889c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 -- 172.21.15.2:0/2506839549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c1076a0 msgr2=0x7f889c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c1076a0 0x7f889c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 -- 172.21.15.2:0/2506839549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 msgr2=0x7f889c1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 0x7f889c1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 -- 172.21.15.2:0/2506839549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1a1520 con 0x7f889c101c90 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889affd640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c1076a0 0x7f889c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889bfff640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 0x7f889c1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.870+0000 7f889b7fe640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 0x7f889c19b470 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f888c00d770 tx=0x7f888c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.871+0000 7f8898ff9640 1 -- 172.21.15.2:0/2506839549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c017070 con 0x7f889c101c90 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.871+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1a1810 con 0x7f889c101c90 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.871+0000 7f8898ff9640 1 -- 172.21.15.2:0/2506839549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c0054d0 con 0x7f889c101c90 2024-09-10T23:31:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.871+0000 7f8898ff9640 1 -- 172.21.15.2:0/2506839549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c004c30 con 0x7f889c101c90 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.871+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1a7ed0 con 0x7f889c101c90 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.873+0000 7f8898ff9640 1 -- 172.21.15.2:0/2506839549 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f888c004e10 con 0x7f889c101c90 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.873+0000 7f88a3e47740 1 Processor -- start 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.873+0000 7f88a3e47740 1 -- start start 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a637e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a638a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a638a790 0x5595a638cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f88a3e47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595a62f4e60 con 0x5595a637e800 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f88a3e47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595a62e4290 con 0x5595a637dee0 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f88a3e47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5595a62e80a0 con 0x5595a638a790 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a638a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a638a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36250/0 (socket says 172.21.15.2:36250) 2024-09-10T23:31:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 -- 172.21.15.2:0/2151961085 learned_addr learned my addr 172.21.15.2:0/2151961085 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889bfff640 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a637e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889affd640 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a638a790 0x5595a638cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 -- 172.21.15.2:0/2151961085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a638a790 msgr2=0x5595a638cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a638a790 0x5595a638cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 -- 172.21.15.2:0/2151961085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 msgr2=0x5595a637e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a637e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 -- 172.21.15.2:0/2151961085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595a6042930 con 0x5595a637e800 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f8898ff9640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88840b5360 0x7f88840b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889b7fe640 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a638a250 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f888c0ebc40 tx=0x7f888c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dd7394b02b1bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.874+0000 7f889bfff640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88840b5360 0x7f88840b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f8898ff9640 1 -- 172.21.15.2:0/2506839549 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f888c0e5710 con 0x7f889c101c90 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f8881ffb640 1 -- 172.21.15.2:0/2151961085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0a8530 con 0x5595a637e800 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f8881ffb640 1 -- 172.21.15.2:0/2151961085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c0ab9f0 con 0x5595a637e800 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f8881ffb640 1 -- 172.21.15.2:0/2151961085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0ab650 con 0x5595a637e800 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 -- 172.21.15.2:0/2151961085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 msgr2=0x5595a638a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f889bfff640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88840b5360 0x7f88840b7820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8894005fd0 tx=0x7f8894009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a638a250 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f888c0ebc40 tx=0x7f888c0ed690 comp rx=0 tx=0).stop 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 -- 172.21.15.2:0/2151961085 shutdown_connections 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a638a790 0x5595a638cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a638a250 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 --2- 172.21.15.2:0/2151961085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a637e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 -- 172.21.15.2:0/2151961085 >> 172.21.15.2:0/2151961085 conn(0x5595a637bd10 msgr2=0x5595a637ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 -- 172.21.15.2:0/2151961085 shutdown_connections 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.875+0000 7f88a3e47740 1 -- 172.21.15.2:0/2151961085 wait complete. 2024-09-10T23:31:20.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 -- start start 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 Processor -- start 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637dee0 0x5595a6387760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a6387ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a63881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595a6145890 con 0x5595a637e800 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595a627ed40 con 0x5595a638a790 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5595a638d440 con 0x5595a637dee0 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f88a3e47740 10 client.0 _ll_register_callbacks cb 0x5595a62e2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f889affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a6387ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f889affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a6387ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36264/0 (socket says 172.21.15.2:36264) 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f889affd640 1 -- 172.21.15.2:0/3111631562 learned_addr learned my addr 172.21.15.2:0/3111631562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.876+0000 7f889b7fe640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637dee0 0x5595a6387760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889bfff640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a63881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889affd640 1 -- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637dee0 msgr2=0x5595a6387760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889affd640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637dee0 0x5595a6387760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889affd640 1 -- 172.21.15.2:0/3111631562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 msgr2=0x5595a63881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889affd640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a63881e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889affd640 1 -- 172.21.15.2:0/3111631562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595a6396820 con 0x5595a637e800 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889bfff640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a63881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f889affd640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a6387ca0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8890009230 tx=0x7f88900316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b451c833fba6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f887affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f887affd640 1 -- 172.21.15.2:0/3111631562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889003f070 con 0x5595a637e800 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888c0ab9f0 con 0x5595a637e800 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f887affd640 1 -- 172.21.15.2:0/3111631562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8890004240 con 0x5595a637e800 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f887affd640 1 -- 172.21.15.2:0/3111631562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8890035070 con 0x5595a637e800 2024-09-10T23:31:20.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f88a3e47740 10 client.17934 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595a63991d0 con 0x5595a637e800 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.877+0000 7f887affd640 1 -- 172.21.15.2:0/3111631562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c0ab9f0 con 0x5595a637e800 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f887affd640 1 -- 172.21.15.2:0/3111631562 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8890004b00 con 0x5595a637e800 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f88a3e47740 10 client.17934 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f88a3e47740 10 client.17934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f88a3e47740 20 client.17934 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f88a3e47740 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a639a730 0x5595a639cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f88a3e47740 4 client.17934 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595a62f6db0 con 0x5595a639a730 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f889b7fe640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a639a730 0x5595a639cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f887affd640 10 client.17934 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.878+0000 7f889b7fe640 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a639a730 0x5595a639cb40 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c6018ea60bbe26 server_cookie=f7b3a61407ee0dff in_seq=0 out_seq=0 2024-09-10T23:31:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.879+0000 7f887affd640 1 -- 172.21.15.2:0/3111631562 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595a62f6db0 con 0x5595a639a730 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.879+0000 7f887affd640 10 client.17934 handle_command_reply: tid=0 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.879+0000 7f88a3e47740 1 client.17934 shutdown 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.879+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 msgr2=0x5595a6387ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.879+0000 7f88a3e47740 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a6387ca0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8890009230 tx=0x7f88900316d0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 shutdown_connections 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a639a730 0x5595a639cb40 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a63881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637e800 0x5595a6387ca0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 --2- 172.21.15.2:0/3111631562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637dee0 0x5595a6387760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 >> 172.21.15.2:0/3111631562 conn(0x5595a637bd10 msgr2=0x5595a637af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f887affd640 0 client.17934 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 shutdown_connections 2024-09-10T23:31:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 1 -- 172.21.15.2:0/3111631562 wait complete. 2024-09-10T23:31:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.880+0000 7f88a3e47740 20 client.17934 trim_cache size 0 max 16384 2024-09-10T23:31:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.897+0000 7f88a3e47740 1 Processor -- start 2024-09-10T23:31:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.897+0000 7f88a3e47740 1 -- start start 2024-09-10T23:31:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a63894a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a63a2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 0x5595a63a2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88a3e47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1b0590 con 0x5595a638a790 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88a3e47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1b20d0 con 0x5595a637dee0 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88a3e47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1b0c60 con 0x5595a637e800 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 0x5595a63a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 0x5595a63a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36272/0 (socket says 172.21.15.2:36272) 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 -- 172.21.15.2:0/4010553176 learned_addr learned my addr 172.21.15.2:0/4010553176 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889affd640 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a63a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889b7fe640 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a63894a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 -- 172.21.15.2:0/4010553176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 msgr2=0x5595a63a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a63a2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 -- 172.21.15.2:0/4010553176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 msgr2=0x5595a63894a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a63894a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 -- 172.21.15.2:0/4010553176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595a637cc20 con 0x5595a638a790 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889b7fe640 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a63894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f889bfff640 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 0x5595a63a2950 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8894011790 tx=0x7f8894016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b933ddc313ef15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.898+0000 7f88817fa640 1 -- 172.21.15.2:0/4010553176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894029640 con 0x5595a638a790 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88817fa640 1 -- 172.21.15.2:0/4010553176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889401f8c0 con 0x5595a638a790 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88817fa640 1 -- 172.21.15.2:0/4010553176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940288a0 con 0x5595a638a790 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 -- 172.21.15.2:0/4010553176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 msgr2=0x5595a63a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 0x5595a63a2950 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8894011790 tx=0x7f8894016000 comp rx=0 tx=0).stop 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 -- 172.21.15.2:0/4010553176 shutdown_connections 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a638a790 0x5595a63a2950 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a63a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 --2- 172.21.15.2:0/4010553176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a637dee0 0x5595a63894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 -- 172.21.15.2:0/4010553176 >> 172.21.15.2:0/4010553176 conn(0x5595a637bd10 msgr2=0x5595a6388d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 -- 172.21.15.2:0/4010553176 shutdown_connections 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 -- 172.21.15.2:0/4010553176 wait complete. 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.899+0000 7f88a3e47740 1 -- start start 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 Processor -- start 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 0x5595a638f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a638f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a6400650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1b1a00 con 0x5595a637dee0 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1b1330 con 0x5595a638a790 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1ae570 con 0x5595a637e800 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f88a3e47740 10 client.0 _ll_register_callbacks cb 0x7f8890009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 0x5595a638f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 0x5595a638f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36284/0 (socket says 172.21.15.2:36284) 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 -- 172.21.15.2:0/998532300 learned_addr learned my addr 172.21.15.2:0/998532300 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889bfff640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a6400650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889affd640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a638f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 -- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 msgr2=0x5595a638f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a638f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 -- 172.21.15.2:0/998532300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 msgr2=0x5595a6400650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a6400650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.900+0000 7f889b7fe640 1 -- 172.21.15.2:0/998532300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595a6400d60 con 0x5595a637dee0 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f889affd640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a638f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f889bfff640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a6400650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f889b7fe640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 0x5595a638f120 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f888c0e3590 tx=0x7f888c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76f54e35ea16b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f887affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f887affd640 1 -- 172.21.15.2:0/998532300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c020040 con 0x5595a637dee0 2024-09-10T23:31:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f887affd640 1 -- 172.21.15.2:0/998532300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f888c0971d0 con 0x5595a637dee0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f889401f8c0 con 0x5595a637dee0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f887affd640 1 -- 172.21.15.2:0/998532300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f888c0ab830 con 0x5595a637dee0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 10 client.17940 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595a6408210 con 0x5595a637dee0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f887affd640 1 -- 172.21.15.2:0/998532300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889401f8c0 con 0x5595a637dee0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f887affd640 1 -- 172.21.15.2:0/998532300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f888c0a8150 con 0x5595a637dee0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 10 client.17940 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 10 client.17940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 20 client.17940 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a64084a0 0x5595a640a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 4 client.17940 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.901+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5595a62f2860 con 0x5595a64084a0 2024-09-10T23:31:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.902+0000 7f889affd640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a64084a0 0x5595a640a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.902+0000 7f889affd640 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a64084a0 0x5595a640a890 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef74c6a3f99675c server_cookie=88dcf7baa2a66357 in_seq=0 out_seq=0 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.902+0000 7f887affd640 10 client.17940 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f887affd640 1 -- 172.21.15.2:0/998532300 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5595a62f2860 con 0x5595a64084a0 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f887affd640 10 client.17940 handle_command_reply: tid=0 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 client.17940 shutdown 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 msgr2=0x5595a638f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 0x5595a638f120 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f888c0e3590 tx=0x7f888c009f90 comp rx=0 tx=0).stop 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 shutdown_connections 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5595a64084a0 0x5595a640a890 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595a638a790 0x5595a6400650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595a637e800 0x5595a638f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 --2- 172.21.15.2:0/998532300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a637dee0 0x5595a638f120 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 >> 172.21.15.2:0/998532300 conn(0x5595a637bd10 msgr2=0x5595a63818b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f887affd640 0 client.17940 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 shutdown_connections 2024-09-10T23:31:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 1 -- 172.21.15.2:0/998532300 wait complete. 2024-09-10T23:31:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.904+0000 7f88a3e47740 20 client.17940 trim_cache size 0 max 16384 2024-09-10T23:31:20.916 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:31:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:31:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "583febb8-d786-4e38-9455-bb4c26027f3e", 2024-09-10T23:31:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:31:20.916 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:31:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88840b5360 msgr2=0x7f88840b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88840b5360 0x7f88840b7820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8894005fd0 tx=0x7f8894009800 comp rx=0 tx=0).stop 2024-09-10T23:31:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 msgr2=0x7f889c19b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 0x7f889c19b470 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f888c00d770 tx=0x7f888c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:31:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 shutdown_connections 2024-09-10T23:31:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f88840b5360 0x7f88840b7820 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889c108020 0x7f889c1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f889c1076a0 0x7f889c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 --2- 172.21.15.2:0/2506839549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f889c101c90 0x7f889c19b470 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 >> 172.21.15.2:0/2506839549 conn(0x7f889c0fd700 msgr2=0x7f889c06b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 shutdown_connections 2024-09-10T23:31:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:20.905+0000 7f88a1a72640 1 -- 172.21.15.2:0/2506839549 wait complete. 2024-09-10T23:31:21.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:31:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:22.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:22 smithi002 ceph-mon[31150]: pgmap v562: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:22.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:22 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:31:22.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:22 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:22.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:22 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:31:22.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:22 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:22 smithi177 ceph-mon[35760]: pgmap v562: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:22 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:31:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:22 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:22 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:31:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:22 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:22.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 -- 172.21.15.2:0/768668116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e01087d0 msgr2=0x7f63e0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 --2- 172.21.15.2:0/768668116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e01087d0 0x7f63e0108c10 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009900 tx=0x7f63d002a410 comp rx=0 tx=0).stop 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 -- 172.21.15.2:0/768668116 shutdown_connections 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 --2- 172.21.15.2:0/768668116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63e0109150 0x7f63e010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 --2- 172.21.15.2:0/768668116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e01087d0 0x7f63e0108c10 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 --2- 172.21.15.2:0/768668116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0102dc0 0x7f63e01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 -- 172.21.15.2:0/768668116 >> 172.21.15.2:0/768668116 conn(0x7f63e00fe830 msgr2=0x7f63e0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.504+0000 7f63e8596640 1 -- 172.21.15.2:0/768668116 shutdown_connections 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 -- 172.21.15.2:0/768668116 wait complete. 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 Processor -- start 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 -- start start 2024-09-10T23:31:22.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 0x7f63e00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63e01087d0 0x7f63e00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0109150 0x7f63e0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112e60 con 0x7f63e0102dc0 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112ce0 con 0x7f63e0109150 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e8596640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112fe0 con 0x7f63e01087d0 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.505+0000 7f63e6332640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 0x7f63e00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 0x7f63e00754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41518/0 (socket says 172.21.15.2:41518) 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 -- 172.21.15.2:0/1922375732 learned_addr learned my addr 172.21.15.2:0/1922375732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6b33640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0109150 0x7f63e0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e5b31640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63e01087d0 0x7f63e00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 -- 172.21.15.2:0/1922375732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63e01087d0 msgr2=0x7f63e00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63e01087d0 0x7f63e00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 -- 172.21.15.2:0/1922375732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0109150 msgr2=0x7f63e0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0109150 0x7f63e0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 -- 172.21.15.2:0/1922375732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e01a7650 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6b33640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0109150 0x7f63e0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e6332640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 0x7f63e00754a0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00c890 tx=0x7f63dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63d77fe640 1 -- 172.21.15.2:0/1922375732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc004220 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e01a7940 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63d77fe640 1 -- 172.21.15.2:0/1922375732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63dc0043c0 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63d77fe640 1 -- 172.21.15.2:0/1922375732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc004a00 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.506+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e01a7ea0 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 Processor -- start 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 -- start start 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63d77fe640 1 -- 172.21.15.2:0/1922375732 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f63dc0079b0 con 0x7f63e0102dc0 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b7f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1f9af5e50 con 0x55d1f9b8bd30 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d1f9ae5280 con 0x55d1f9b7f480 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63ea96b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d1f9ae9090 con 0x55d1f9b7fda0 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63e5b31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63e5b31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41532/0 (socket says 172.21.15.2:41532) 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63e5b31640 1 -- 172.21.15.2:0/2735195241 learned_addr learned my addr 172.21.15.2:0/2735195241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.509+0000 7f63e6332640 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e6b33640 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b7f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e5b31640 1 -- 172.21.15.2:0/2735195241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 msgr2=0x55d1f9b8b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e5b31640 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e5b31640 1 -- 172.21.15.2:0/2735195241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 msgr2=0x55d1f9b7f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e5b31640 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b7f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e5b31640 1 -- 172.21.15.2:0/2735195241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f9843650 con 0x55d1f9b8bd30 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63d77fe640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63cc0b52e0 0x7f63cc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e5b31640 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8e120 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f63d0031440 tx=0x7f63d0004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddcf96255814419 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63e6b33640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63cc0b52e0 0x7f63cc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63d77fe640 1 -- 172.21.15.2:0/1922375732 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63dc0e59f0 con 0x7f63e0102dc0 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63d4ff9640 1 -- 172.21.15.2:0/2735195241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d003f070 con 0x55d1f9b8bd30 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63d4ff9640 1 -- 172.21.15.2:0/2735195241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d00047a0 con 0x55d1f9b8bd30 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.510+0000 7f63d4ff9640 1 -- 172.21.15.2:0/2735195241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0035070 con 0x55d1f9b8bd30 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 -- 172.21.15.2:0/2735195241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 msgr2=0x55d1f9b8e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8e120 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f63d0031440 tx=0x7f63d0004390 comp rx=0 tx=0).stop 2024-09-10T23:31:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63e6b33640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63cc0b52e0 0x7f63cc0b77a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f63e0077560 tx=0x7f63d8007740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 -- 172.21.15.2:0/2735195241 shutdown_connections 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8e120 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 --2- 172.21.15.2:0/2735195241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b7f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 -- 172.21.15.2:0/2735195241 >> 172.21.15.2:0/2735195241 conn(0x55d1f9b7d2b0 msgr2=0x55d1f9b7e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 -- 172.21.15.2:0/2735195241 shutdown_connections 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.511+0000 7f63ea96b740 1 -- 172.21.15.2:0/2735195241 wait complete. 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 -- start start 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 Processor -- start 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 0x55d1f9b8b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b88a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b89030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1f9946700 con 0x55d1f9b7f480 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d1f9a80110 con 0x55d1f9b7fda0 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d1f9b8e950 con 0x55d1f9b8bd30 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63ea96b740 10 client.0 _ll_register_callbacks cb 0x55d1f9a99990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 0x55d1f9b8b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 0x55d1f9b8b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41544/0 (socket says 172.21.15.2:41544) 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 -- 172.21.15.2:0/65429560 learned_addr learned my addr 172.21.15.2:0/65429560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e5b31640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b88a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6b33640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b89030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 -- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 msgr2=0x55d1f9b89030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b89030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 -- 172.21.15.2:0/65429560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7fda0 msgr2=0x55d1f9b88a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b88a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.512+0000 7f63e6332640 1 -- 172.21.15.2:0/65429560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f9aadc40 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63e6332640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 0x55d1f9b8b600 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0abec0 tx=0x7f63dc00a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce5b058c3a3988e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63c9ffb640 1 -- 172.21.15.2:0/65429560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc01d040 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63c9ffb640 1 -- 172.21.15.2:0/65429560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63dc0cdba0 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d00047a0 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63c9ffb640 1 -- 172.21.15.2:0/65429560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63dc0abb10 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 10 client.17952 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1f9b9a260 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63c9ffb640 1 -- 172.21.15.2:0/65429560 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d00047a0 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63c9ffb640 1 -- 172.21.15.2:0/65429560 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63dc0a7b10 con 0x55d1f9b7f480 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 10 client.17952 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 20 client.17952 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9b9b670 0x55d1f9b9dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 4 client.17952 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.513+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1f9af7da0 con 0x55d1f9b9b670 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.514+0000 7f63e5b31640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9b9b670 0x55d1f9b9dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.514+0000 7f63e5b31640 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9b9b670 0x55d1f9b9dae0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad8a7cb587dbac2a server_cookie=f9fdc6909ffb6b7b in_seq=0 out_seq=0 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.514+0000 7f63c9ffb640 10 client.17952 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63c9ffb640 1 -- 172.21.15.2:0/65429560 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1f9af7da0 con 0x55d1f9b9b670 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63c9ffb640 10 client.17952 handle_command_reply: tid=0 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 client.17952 shutdown 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 msgr2=0x55d1f9b8b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 0x55d1f9b8b600 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0abec0 tx=0x7f63dc00a5e0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 shutdown_connections 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9b9b670 0x55d1f9b9dae0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b89030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b88a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 --2- 172.21.15.2:0/65429560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7f480 0x55d1f9b8b600 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 >> 172.21.15.2:0/65429560 conn(0x55d1f9b7d2b0 msgr2=0x55d1f9b82e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63c9ffb640 0 client.17952 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 shutdown_connections 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 1 -- 172.21.15.2:0/65429560 wait complete. 2024-09-10T23:31:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.515+0000 7f63ea96b740 20 client.17952 trim_cache size 0 max 16384 2024-09-10T23:31:22.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:22 smithi154 ceph-mon[35136]: pgmap v562: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:22.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:22 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:31:22.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:22 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:22.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:22 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:31:22.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:22 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:31:22.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 Processor -- start 2024-09-10T23:31:22.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 -- start start 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b97b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b7cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b85c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b04b0 con 0x55d1f9b8bd30 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b1ff0 con 0x55d1f9b7f480 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63ea96b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b0b80 con 0x55d1f9b7fda0 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63e6b33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b85c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63e6b33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b85c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41554/0 (socket says 172.21.15.2:41554) 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63e6b33640 1 -- 172.21.15.2:0/19915631 learned_addr learned my addr 172.21.15.2:0/19915631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63e5b31640 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b7cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.533+0000 7f63e6332640 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b97b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63e6b33640 1 -- 172.21.15.2:0/19915631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 msgr2=0x55d1f9b7cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63e6b33640 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b7cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63e6b33640 1 -- 172.21.15.2:0/19915631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 msgr2=0x55d1f9b97b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63e6b33640 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b97b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63e6b33640 1 -- 172.21.15.2:0/19915631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f9b9de50 con 0x55d1f9b8bd30 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63e6b33640 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b85c60 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f63d800f7d0 tx=0x7f63d8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a264e753938d4c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63cbfff640 1 -- 172.21.15.2:0/19915631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d802a070 con 0x55d1f9b8bd30 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63cbfff640 1 -- 172.21.15.2:0/19915631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d801cd30 con 0x55d1f9b8bd30 2024-09-10T23:31:22.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.534+0000 7f63cbfff640 1 -- 172.21.15.2:0/19915631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d801ae30 con 0x55d1f9b8bd30 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 -- 172.21.15.2:0/19915631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 msgr2=0x55d1f9b85c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b85c60 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f63d800f7d0 tx=0x7f63d8014000 comp rx=0 tx=0).stop 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 -- 172.21.15.2:0/19915631 shutdown_connections 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b85c60 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b7cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- 172.21.15.2:0/19915631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b97b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 -- 172.21.15.2:0/19915631 >> 172.21.15.2:0/19915631 conn(0x55d1f9b7d2b0 msgr2=0x55d1f9b83c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 -- 172.21.15.2:0/19915631 shutdown_connections 2024-09-10T23:31:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 -- 172.21.15.2:0/19915631 wait complete. 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 -- start start 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 Processor -- start 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b94450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.535+0000 7f63ea96b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63ea96b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b1920 con 0x55d1f9b7fda0 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63ea96b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b1250 con 0x55d1f9b7f480 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63ea96b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01ae490 con 0x55d1f9b8bd30 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63ea96b740 10 client.0 _ll_register_callbacks cb 0x7f63dc004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41566/0 (socket says 172.21.15.2:41566) 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 -- 172.21.15.2:0/957321 learned_addr learned my addr 172.21.15.2:0/957321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e6332640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b94450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e6b33640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 -- 172.21.15.2:0/957321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 msgr2=0x55d1f9b8ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 -- 172.21.15.2:0/957321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 msgr2=0x55d1f9b94450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b94450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 -- 172.21.15.2:0/957321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f9b907a0 con 0x55d1f9b7fda0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63e5b31640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8f970 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f63d002a450 tx=0x7f63d0005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31bf3d033db42bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63c9ffb640 1 -- 172.21.15.2:0/957321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d003f040 con 0x55d1f9b7fda0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63c9ffb640 1 -- 172.21.15.2:0/957321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63d00316a0 con 0x55d1f9b7fda0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.536+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d801cd30 con 0x55d1f9b7fda0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63c9ffb640 1 -- 172.21.15.2:0/957321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63d005c050 con 0x55d1f9b7fda0 2024-09-10T23:31:22.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 10 client.17958 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1f9c08750 con 0x55d1f9b7fda0 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63c9ffb640 1 -- 172.21.15.2:0/957321 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d801cd30 con 0x55d1f9b7fda0 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63c9ffb640 1 -- 172.21.15.2:0/957321 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63d004e850 con 0x55d1f9b7fda0 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 10 client.17958 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 20 client.17958 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9c08e90 0x55d1f9c0b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 4 client.17958 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1f9af3850 con 0x55d1f9c08e90 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.537+0000 7f63e6332640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9c08e90 0x55d1f9c0b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63c9ffb640 10 client.17958 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63e6332640 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9c08e90 0x55d1f9c0b280 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20daf2640953e1e8 server_cookie=8c0502e709f166f1 in_seq=0 out_seq=0 2024-09-10T23:31:22.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63c9ffb640 1 -- 172.21.15.2:0/957321 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x55d1f9af3850 con 0x55d1f9c08e90 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63c9ffb640 10 client.17958 handle_command_reply: tid=0 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 client.17958 shutdown 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 msgr2=0x55d1f9b8f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8f970 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f63d002a450 tx=0x7f63d0005b50 comp rx=0 tx=0).stop 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 shutdown_connections 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d1f9c08e90 0x55d1f9c0b280 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d1f9b8bd30 0x55d1f9b8ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f9b7fda0 0x55d1f9b8f970 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 --2- 172.21.15.2:0/957321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f9b7f480 0x55d1f9b94450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 >> 172.21.15.2:0/957321 conn(0x55d1f9b7d2b0 msgr2=0x55d1f9b8a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63c9ffb640 0 client.17958 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 shutdown_connections 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 1 -- 172.21.15.2:0/957321 wait complete. 2024-09-10T23:31:22.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.538+0000 7f63ea96b740 20 client.17958 trim_cache size 0 max 16384 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "583febb8-d786-4e38-9455-bb4c26027f3e", 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:31:22.545 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:31:22.546 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.547 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:31:22.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:31:22.553 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:22.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:22.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:22.556 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:22.556 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:22.556 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:31:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63cc0b52e0 msgr2=0x7f63cc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63cc0b52e0 0x7f63cc0b77a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f63e0077560 tx=0x7f63d8007740 comp rx=0 tx=0).stop 2024-09-10T23:31:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 msgr2=0x7f63e00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 0x7f63e00754a0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00c890 tx=0x7f63dc00cd50 comp rx=0 tx=0).stop 2024-09-10T23:31:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 shutdown_connections 2024-09-10T23:31:22.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f63cc0b52e0 0x7f63cc0b77a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0109150 0x7f63e0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63e01087d0 0x7f63e00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 --2- 172.21.15.2:0/1922375732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e0102dc0 0x7f63e00754a0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 >> 172.21.15.2:0/1922375732 conn(0x7f63e00fe830 msgr2=0x7f63e0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 shutdown_connections 2024-09-10T23:31:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:22.539+0000 7f63e8596640 1 -- 172.21.15.2:0/1922375732 wait complete. 2024-09-10T23:31:23.377 INFO:tasks.cephfs.filesystem:scrub status for tag:583febb8-d786-4e38-9455-bb4c26027f3e - {'path': '/', 'tag': '583febb8-d786-4e38-9455-bb4c26027f3e', 'options': 'recursive,force'} 2024-09-10T23:31:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:24 smithi177 ceph-mon[35760]: pgmap v563: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:24 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:31:24.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:24 smithi002 ceph-mon[31150]: pgmap v563: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:24.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:24 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:31:24.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:24 smithi154 ceph-mon[35136]: pgmap v563: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:24.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:24 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:31:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:26 smithi177 ceph-mon[35760]: pgmap v564: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:26.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:26 smithi002 ceph-mon[31150]: pgmap v564: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:26.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:26 smithi154 ceph-mon[35136]: pgmap v564: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:28 smithi177 ceph-mon[35760]: pgmap v565: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:28.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:28 smithi002 ceph-mon[31150]: pgmap v565: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:28.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:28 smithi154 ceph-mon[35136]: pgmap v565: 97 pgs: 97 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:31:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:30 smithi177 ceph-mon[35760]: pgmap v566: 97 pgs: 97 active+clean; 1.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:31:30.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:30 smithi002 ceph-mon[31150]: pgmap v566: 97 pgs: 97 active+clean; 1.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:31:30.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:30 smithi154 ceph-mon[35136]: pgmap v566: 97 pgs: 97 active+clean; 1.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:31:31.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:31.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:31.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:31:31.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:31.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:31.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:31:31.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:31.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:31.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:31.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:31.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:31:32.319 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.319 INFO:tasks.workunit.client.0.smithi002.stdout:313/600: open fd = 3 2024-09-10T23:31:32.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:314/600: open fd = 3 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:315/600: open fd = 3 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:316/600: open fd = 3 2024-09-10T23:31:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:317/600: open fd = 3 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:318/600: open fd = 3 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:319/600: open fd = 3 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.321 INFO:tasks.workunit.client.0.smithi002.stdout:320/600: open fd = 3 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:321/600: open fd = 3 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:322/600: open fd = 3 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:323/600: open fd = 3 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.322 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:324/600: open fd = 3 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:325/600: open fd = 3 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:326/600: open fd = 3 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:327/600: open fd = 3 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:328/600: open fd = 3 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:329/600: open fd = 3 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:330/600: open fd = 3 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:331/600: open fd = 3 2024-09-10T23:31:32.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:332/600: open fd = 3 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:333/600: open fd = 3 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:334/600: open fd = 3 2024-09-10T23:31:32.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:335/600: open fd = 3 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:336/600: open fd = 3 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:337/600: open fd = 3 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:338/600: open fd = 3 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:339/600: open fd = 3 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:340/600: open fd = 3 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:341/600: open fd = 3 2024-09-10T23:31:32.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:342/600: open fd = 3 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:343/600: open fd = 3 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:344/600: open fd = 3 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:345/600: open fd = 3 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:346/600: open fd = 3 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:347/600: open fd = 3 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:348/600: open fd = 3 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:349/600: open fd = 3 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:350/600: open fd = 3 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:351/600: open fd = 3 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:352/600: open fd = 3 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:353/600: open fd = 3 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:354/600: open fd = 3 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:355/600: open fd = 3 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:356/600: open fd = 3 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:357/600: open fd = 3 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:358/600: open fd = 3 2024-09-10T23:31:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:359/600: open fd = 3 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:360/600: open fd = 3 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:361/600: open fd = 3 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:362/600: open fd = 3 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:363/600: open fd = 3 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:364/600: open fd = 3 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:365/600: open fd = 3 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:366/600: open fd = 3 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:367/600: open fd = 3 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:368/600: open fd = 3 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:369/600: open fd = 3 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:370/600: open fd = 3 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:371/600: open fd = 3 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:372/600: open fd = 3 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:373/600: open fd = 3 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:374/600: open fd = 3 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:31:32.337 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:31:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: pgmap v567: 97 pgs: 97 active+clean; 1.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-10T23:31:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-09-10T23:31:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-10T23:31:32.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: Unable to set osd_memory_target on smithi154 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-10T23:31:32.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: Unable to set osd_memory_target on smithi177 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-10T23:31:32.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:32 smithi177 ceph-mon[35760]: Unable to set osd_memory_target on smithi002 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-10T23:31:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: pgmap v567: 97 pgs: 97 active+clean; 1.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-10T23:31:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-09-10T23:31:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-10T23:31:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: Unable to set osd_memory_target on smithi154 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-10T23:31:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: Unable to set osd_memory_target on smithi177 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-10T23:31:32.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:32 smithi002 ceph-mon[31150]: Unable to set osd_memory_target on smithi002 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-10T23:31:32.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: pgmap v567: 97 pgs: 97 active+clean; 1.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:32.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-10T23:31:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-09-10T23:31:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-10T23:31:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: Unable to set osd_memory_target on smithi154 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-10T23:31:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: Unable to set osd_memory_target on smithi177 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-10T23:31:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:32 smithi154 ceph-mon[35136]: Unable to set osd_memory_target on smithi002 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 -- 172.21.15.2:0/3969405659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41033c0 msgr2=0x7faab4109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 --2- 172.21.15.2:0/3969405659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41033c0 0x7faab4109d40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7faaac009cd0 tx=0x7faaac02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 -- 172.21.15.2:0/3969405659 shutdown_connections 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 --2- 172.21.15.2:0/3969405659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41033c0 0x7faab4109d40 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 --2- 172.21.15.2:0/3969405659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faab4102a00 0x7faab4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 --2- 172.21.15.2:0/3969405659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab41018b0 0x7faab4101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 -- 172.21.15.2:0/3969405659 >> 172.21.15.2:0/3969405659 conn(0x7faab40fd150 msgr2=0x7faab40ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 -- 172.21.15.2:0/3969405659 shutdown_connections 2024-09-10T23:31:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.392+0000 7faab8ced640 1 -- 172.21.15.2:0/3969405659 wait complete. 2024-09-10T23:31:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 Processor -- start 2024-09-10T23:31:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 -- start start 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 0x7faab4198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab4102a00 0x7faab4199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faab41033c0 0x7faab419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faab410d520 con 0x7faab41018b0 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faab410d3a0 con 0x7faab4102a00 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab8ced640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faab410d6a0 con 0x7faab41033c0 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 0x7faab4198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 0x7faab4198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51336/0 (socket says 172.21.15.2:51336) 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 -- 172.21.15.2:0/3965630532 learned_addr learned my addr 172.21.15.2:0/3965630532 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab2d9d640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faab41033c0 0x7faab419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab1d9b640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab4102a00 0x7faab4199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 -- 172.21.15.2:0/3965630532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faab41033c0 msgr2=0x7faab419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faab41033c0 0x7faab419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 -- 172.21.15.2:0/3965630532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab4102a00 msgr2=0x7faab4199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab4102a00 0x7faab4199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.393+0000 7faab259c640 1 -- 172.21.15.2:0/3965630532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab419a960 con 0x7faab41018b0 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.394+0000 7faab259c640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 0x7faab4198e20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7faaa400d950 tx=0x7faaa400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.394+0000 7faaa37fe640 1 -- 172.21.15.2:0/3965630532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4017070 con 0x7faab41018b0 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.394+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab419ac50 con 0x7faab41018b0 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.394+0000 7faaa37fe640 1 -- 172.21.15.2:0/3965630532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa4009c30 con 0x7faab41018b0 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.394+0000 7faaa37fe640 1 -- 172.21.15.2:0/3965630532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa400f620 con 0x7faab41018b0 2024-09-10T23:31:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.394+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab41a1320 con 0x7faab41018b0 2024-09-10T23:31:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.397+0000 7faabbac4740 1 Processor -- start 2024-09-10T23:31:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.397+0000 7faabbac4740 1 -- start start 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faabbac4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d0404ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faabbac4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d0404d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faabbac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 0x560d04050090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faabbac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d03fba6f0 con 0x560d0404dbd0 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faabbac4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d03fa9b20 con 0x560d0404b190 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faabbac4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d03fad930 con 0x560d04048860 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 0x560d04050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 0x560d04050090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51350/0 (socket says 172.21.15.2:51350) 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 -- 172.21.15.2:0/1612044987 learned_addr learned my addr 172.21.15.2:0/1612044987 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab2d9d640 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d0404ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faaa37fe640 1 -- 172.21.15.2:0/3965630532 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faaa4010460 con 0x7faab41018b0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 -- 172.21.15.2:0/1612044987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 msgr2=0x560d0404ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d0404ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 -- 172.21.15.2:0/1612044987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 msgr2=0x560d0404d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d0404d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 -- 172.21.15.2:0/1612044987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d03f6f530 con 0x560d0404dbd0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.398+0000 7faab1d9b640 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 0x560d04050090 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009bc0 tx=0x7faaa800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3d5712434a0071 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faaa0ff9640 1 -- 172.21.15.2:0/1612044987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8016070 con 0x560d0404dbd0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faaa0ff9640 1 -- 172.21.15.2:0/1612044987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa8011920 con 0x560d0404dbd0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faaa0ff9640 1 -- 172.21.15.2:0/1612044987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa80107f0 con 0x560d0404dbd0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faaa37fe640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa9c0b52e0 0x7faa9c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faab2d9d640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa9c0b52e0 0x7faa9c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faaa37fe640 1 -- 172.21.15.2:0/3965630532 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faaa40e5910 con 0x7faab41018b0 2024-09-10T23:31:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 -- 172.21.15.2:0/1612044987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 msgr2=0x560d04050090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 0x560d04050090 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009bc0 tx=0x7faaa800e6c0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faab2d9d640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa9c0b52e0 0x7faa9c0b77a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faaac005cc0 tx=0x7faaac031850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 -- 172.21.15.2:0/1612044987 shutdown_connections 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404dbd0 0x560d04050090 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d0404d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 --2- 172.21.15.2:0/1612044987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d0404ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.399+0000 7faabbac4740 1 -- 172.21.15.2:0/1612044987 >> 172.21.15.2:0/1612044987 conn(0x560d040439b0 msgr2=0x560d04044740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 -- 172.21.15.2:0/1612044987 shutdown_connections 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 -- 172.21.15.2:0/1612044987 wait complete. 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 -- start start 2024-09-10T23:31:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 Processor -- start 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04051f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404b190 0x560d040525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d04053170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d03ee1ab0 con 0x560d04048860 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d03f4f730 con 0x560d0404dbd0 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d04050bb0 con 0x560d0404b190 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faabbac4740 10 client.0 _ll_register_callbacks cb 0x560d03fa36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04051f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04051f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51364/0 (socket says 172.21.15.2:51364) 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.400+0000 7faab259c640 1 -- 172.21.15.2:0/679931305 learned_addr learned my addr 172.21.15.2:0/679931305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab2d9d640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d04053170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab1d9b640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404b190 0x560d040525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab259c640 1 -- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404b190 msgr2=0x560d040525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab259c640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404b190 0x560d040525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab259c640 1 -- 172.21.15.2:0/679931305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 msgr2=0x560d04053170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab259c640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d04053170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab259c640 1 -- 172.21.15.2:0/679931305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d03d0b790 con 0x560d04048860 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab1d9b640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404b190 0x560d040525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab2d9d640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d04053170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faab259c640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04051f00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7faaa40abde0 tx=0x7faaa40ab850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338b463f2b354361 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faa99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faa99ffb640 1 -- 172.21.15.2:0/679931305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4020070 con 0x560d04048860 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faa99ffb640 1 -- 172.21.15.2:0/679931305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faaa40ab340 con 0x560d04048860 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaa8011920 con 0x560d04048860 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faa99ffb640 1 -- 172.21.15.2:0/679931305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faaa4009de0 con 0x560d04048860 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faabbac4740 10 client.17970 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.401+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d03d84620 con 0x560d04048860 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faa99ffb640 1 -- 172.21.15.2:0/679931305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa8011920 con 0x560d04048860 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faa99ffb640 1 -- 172.21.15.2:0/679931305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faaa4010780 con 0x560d04048860 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faabbac4740 10 client.17970 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faabbac4740 10 client.17970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faabbac4740 20 client.17970 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faabbac4740 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0405d750 0x560d0405fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faabbac4740 4 client.17970 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d03fbc640 con 0x560d0405d750 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.402+0000 7faab1d9b640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0405d750 0x560d0405fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.403+0000 7faa99ffb640 10 client.17970 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.403+0000 7faab1d9b640 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0405d750 0x560d0405fba0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9aae4037e543d server_cookie=bda3352fd567bf96 in_seq=0 out_seq=0 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.403+0000 7faa99ffb640 1 -- 172.21.15.2:0/679931305 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d03fbc640 con 0x560d0405d750 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.403+0000 7faa99ffb640 10 client.17970 handle_command_reply: tid=0 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.403+0000 7faabbac4740 1 client.17970 shutdown 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 msgr2=0x560d04051f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04051f00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7faaa40abde0 tx=0x7faaa40ab850 comp rx=0 tx=0).stop 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 shutdown_connections 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d0405d750 0x560d0405fba0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d04053170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faa99ffb640 0 client.17970 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404b190 0x560d040525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 --2- 172.21.15.2:0/679931305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04051f00 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 >> 172.21.15.2:0/679931305 conn(0x560d040439b0 msgr2=0x560d04042bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 shutdown_connections 2024-09-10T23:31:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 1 -- 172.21.15.2:0/679931305 wait complete. 2024-09-10T23:31:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.404+0000 7faabbac4740 20 client.17970 trim_cache size 0 max 16384 2024-09-10T23:31:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 Processor -- start 2024-09-10T23:31:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 -- start start 2024-09-10T23:31:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d04044450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 0x560d04044990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d0404dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faab41a9ef0 con 0x560d0404b190 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faab41aba30 con 0x560d0404dbd0 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faabbac4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faab41aa5c0 con 0x560d04048860 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 0x560d04044990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 0x560d04044990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51380/0 (socket says 172.21.15.2:51380) 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 -- 172.21.15.2:0/1064673332 learned_addr learned my addr 172.21.15.2:0/1064673332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab259c640 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d04044450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 -- 172.21.15.2:0/1064673332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 msgr2=0x560d04044450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d04044450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 -- 172.21.15.2:0/1064673332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 msgr2=0x560d0404dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab2d9d640 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d0404dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d0404dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab1d9b640 1 -- 172.21.15.2:0/1064673332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d04060220 con 0x560d0404b190 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.419+0000 7faab2d9d640 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d0404dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faab1d9b640 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 0x560d04044990 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7faaa8005d00 tx=0x7faaa8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8133459d1573c674 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faa9bfff640 1 -- 172.21.15.2:0/1064673332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8016040 con 0x560d0404b190 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faa9bfff640 1 -- 172.21.15.2:0/1064673332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa80035f0 con 0x560d0404b190 2024-09-10T23:31:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faa9bfff640 1 -- 172.21.15.2:0/1064673332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8026690 con 0x560d0404b190 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 -- 172.21.15.2:0/1064673332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 msgr2=0x560d04044990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 0x560d04044990 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7faaa8005d00 tx=0x7faaa8009b30 comp rx=0 tx=0).stop 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 -- 172.21.15.2:0/1064673332 shutdown_connections 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404dbd0 0x560d0404dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d0404b190 0x560d04044990 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 --2- 172.21.15.2:0/1064673332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d04048860 0x560d04044450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 -- 172.21.15.2:0/1064673332 >> 172.21.15.2:0/1064673332 conn(0x560d040439b0 msgr2=0x560d04047d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 -- 172.21.15.2:0/1064673332 shutdown_connections 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.420+0000 7faabbac4740 1 -- 172.21.15.2:0/1064673332 wait complete. 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 -- start start 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 Processor -- start 2024-09-10T23:31:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04059670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d04059d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404dbd0 0x560d04058520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faab41ab360 con 0x560d04048860 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faab41aac90 con 0x560d0404b190 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faab41a7ed0 con 0x560d0404dbd0 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faabbac4740 10 client.0 _ll_register_callbacks cb 0x7faaa40abeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04059670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04059670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51386/0 (socket says 172.21.15.2:51386) 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 -- 172.21.15.2:0/3799075378 learned_addr learned my addr 172.21.15.2:0/3799075378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab1d9b640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d04059d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 -- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404dbd0 msgr2=0x560d04058520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab2d9d640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404dbd0 0x560d04058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404dbd0 0x560d04058520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 -- 172.21.15.2:0/3799075378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 msgr2=0x560d04059d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d04059d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.421+0000 7faab259c640 1 -- 172.21.15.2:0/3799075378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d04058d50 con 0x560d04048860 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faab1d9b640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d04059d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faab2d9d640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404dbd0 0x560d04058520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faab259c640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04059670 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7faaa4010b50 tx=0x7faaa40109b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a9bfe82a4a488 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faa99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faa99ffb640 1 -- 172.21.15.2:0/3799075378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4020070 con 0x560d04048860 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faa99ffb640 1 -- 172.21.15.2:0/3799075378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7faaa40ab550 con 0x560d04048860 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaa80035f0 con 0x560d04048860 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faa99ffb640 1 -- 172.21.15.2:0/3799075378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faaa40b0bc0 con 0x560d04048860 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 10 client.17976 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d04057b50 con 0x560d04048860 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faa99ffb640 1 -- 172.21.15.2:0/3799075378 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa80035f0 con 0x560d04048860 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faa99ffb640 1 -- 172.21.15.2:0/3799075378 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faaa40cdcc0 con 0x560d04048860 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 10 client.17976 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 10 client.17976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 20 client.17976 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d040cada0 0x560d040cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 4 client.17976 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.422+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d03fb80f0 con 0x560d040cada0 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.423+0000 7faab1d9b640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d040cada0 0x560d040cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.423+0000 7faab1d9b640 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d040cada0 0x560d040cd1c0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99350a9e6e0529 server_cookie=7e8d906305d07152 in_seq=0 out_seq=0 2024-09-10T23:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.423+0000 7faa99ffb640 10 client.17976 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faa99ffb640 1 -- 172.21.15.2:0/3799075378 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d03fb80f0 con 0x560d040cada0 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faa99ffb640 10 client.17976 handle_command_reply: tid=0 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faabbac4740 1 client.17976 shutdown 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 msgr2=0x560d04059670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faabbac4740 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04059670 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7faaa4010b50 tx=0x7faaa40109b0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 shutdown_connections 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.436+0000 7faabbac4740 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d040cada0 0x560d040cd1c0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0404dbd0 0x560d04058520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d0404b190 0x560d04059d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faa99ffb640 0 client.17976 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 1 --2- 172.21.15.2:0/3799075378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d04048860 0x560d04059670 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 >> 172.21.15.2:0/3799075378 conn(0x560d040439b0 msgr2=0x560d04047d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 shutdown_connections 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 1 -- 172.21.15.2:0/3799075378 wait complete. 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faabbac4740 20 client.17976 trim_cache size 0 max 16384 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:31:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa9c0b52e0 msgr2=0x7faa9c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa9c0b52e0 0x7faa9c0b77a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faaac005cc0 tx=0x7faaac031850 comp rx=0 tx=0).stop 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 msgr2=0x7faab4198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 0x7faab4198e20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7faaa400d950 tx=0x7faaa400de10 comp rx=0 tx=0).stop 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 shutdown_connections 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7faa9c0b52e0 0x7faa9c0b77a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faab41033c0 0x7faab419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab4102a00 0x7faab4199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 --2- 172.21.15.2:0/3965630532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab41018b0 0x7faab4198e20 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 >> 172.21.15.2:0/3965630532 conn(0x7faab40fd150 msgr2=0x7faab4103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 shutdown_connections 2024-09-10T23:31:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:33.437+0000 7faab8ced640 1 -- 172.21.15.2:0/3965630532 wait complete. 2024-09-10T23:31:34.305 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:34 smithi002 ceph-mon[31150]: pgmap v568: 97 pgs: 97 active+clean; 1.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:31:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:34 smithi177 ceph-mon[35760]: pgmap v568: 97 pgs: 97 active+clean; 1.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:31:34.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:34 smithi154 ceph-mon[35136]: pgmap v568: 97 pgs: 97 active+clean; 1.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:31:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:36 smithi177 ceph-mon[35760]: pgmap v569: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:31:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:36 smithi002 ceph-mon[31150]: pgmap v569: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:31:36.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:36 smithi154 ceph-mon[35136]: pgmap v569: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 18 op/s 2024-09-10T23:31:38.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:38 smithi177 ceph-mon[35760]: pgmap v570: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:31:38.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:38 smithi002 ceph-mon[31150]: pgmap v570: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:31:38.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:38 smithi154 ceph-mon[35136]: pgmap v570: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:31:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:40 smithi177 ceph-mon[35760]: pgmap v571: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:40.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:40 smithi002 ceph-mon[31150]: pgmap v571: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:40.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:40 smithi154 ceph-mon[35136]: pgmap v571: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:42.330 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:42 smithi154 ceph-mon[35136]: pgmap v572: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:42.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:42 smithi177 ceph-mon[35760]: pgmap v572: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:42.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:42 smithi002 ceph-mon[31150]: pgmap v572: 97 pgs: 97 active+clean; 1.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:44.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:44 smithi177 ceph-mon[35760]: pgmap v573: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:44.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:44 smithi002 ceph-mon[31150]: pgmap v573: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:44.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:44 smithi154 ceph-mon[35136]: pgmap v573: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:31:46.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:46 smithi177 ceph-mon[35760]: pgmap v574: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:31:46.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:46 smithi002 ceph-mon[31150]: pgmap v574: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:31:46.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:46 smithi154 ceph-mon[35136]: pgmap v574: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:31:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 -- 172.21.15.2:0/3913195902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb4105af0 msgr2=0x7fddb4107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 --2- 172.21.15.2:0/3913195902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb4105af0 0x7fddb4107f60 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009900 tx=0x7fdda802a410 comp rx=0 tx=0).stop 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 -- 172.21.15.2:0/3913195902 shutdown_connections 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 --2- 172.21.15.2:0/3913195902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb41086a0 0x7fddb410ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 --2- 172.21.15.2:0/3913195902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb4105af0 0x7fddb4107f60 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 --2- 172.21.15.2:0/3913195902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb406bfb0 0x7fddb4105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 -- 172.21.15.2:0/3913195902 >> 172.21.15.2:0/3913195902 conn(0x7fddb40fd170 msgr2=0x7fddb40ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 -- 172.21.15.2:0/3913195902 shutdown_connections 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.538+0000 7fddba55d640 1 -- 172.21.15.2:0/3913195902 wait complete. 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 Processor -- start 2024-09-10T23:31:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 -- start start 2024-09-10T23:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb406bfb0 0x7fddb4198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4105af0 0x7fddb41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 0x7fddb419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddb410e5d0 con 0x7fddb41086a0 2024-09-10T23:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddb410e450 con 0x7fddb406bfb0 2024-09-10T23:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.539+0000 7fddba55d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddb410e750 con 0x7fddb4105af0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 0x7fddb419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 0x7fddb419a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43568/0 (socket says 172.21.15.2:43568) 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 -- 172.21.15.2:0/2214775323 learned_addr learned my addr 172.21.15.2:0/2214775323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb3fff640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb406bfb0 0x7fddb4198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb37fe640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4105af0 0x7fddb41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 -- 172.21.15.2:0/2214775323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4105af0 msgr2=0x7fddb41993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4105af0 0x7fddb41993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 -- 172.21.15.2:0/2214775323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb406bfb0 msgr2=0x7fddb4198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb406bfb0 0x7fddb4198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 -- 172.21.15.2:0/2214775323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb419a8c0 con 0x7fddb41086a0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb8afa640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 0x7fddb419a000 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fddac00eb10 tx=0x7fddac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb17fa640 1 -- 172.21.15.2:0/2214775323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac004b20 con 0x7fddb41086a0 2024-09-10T23:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb17fa640 1 -- 172.21.15.2:0/2214775323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddac004cc0 con 0x7fddb41086a0 2024-09-10T23:31:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb419abb0 con 0x7fddb41086a0 2024-09-10T23:31:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddb17fa640 1 -- 172.21.15.2:0/2214775323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac010670 con 0x7fddb41086a0 2024-09-10T23:31:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.540+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb41a1280 con 0x7fddb41086a0 2024-09-10T23:31:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 Processor -- start 2024-09-10T23:31:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddb17fa640 1 -- 172.21.15.2:0/2214775323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fddac005020 con 0x7fddb41086a0 2024-09-10T23:31:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 -- start start 2024-09-10T23:31:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb9bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcb9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcba1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556efcb0b6f0 con 0x556efcb9c190 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556efcafab20 con 0x556efcb99860 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddbd406740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556efcafe930 con 0x556efcb9ebd0 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcb9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcb9e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43582/0 (socket says 172.21.15.2:43582) 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.543+0000 7fddb3fff640 1 -- 172.21.15.2:0/1872457164 learned_addr learned my addr 172.21.15.2:0/1872457164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcba1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb9bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb3fff640 1 -- 172.21.15.2:0/1872457164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 msgr2=0x556efcba1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb3fff640 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcba1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb3fff640 1 -- 172.21.15.2:0/1872457164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 msgr2=0x556efcb9bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb3fff640 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb9bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb3fff640 1 -- 172.21.15.2:0/1872457164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efcac0530 con 0x556efcb9c190 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb9bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb3fff640 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcb9e580 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdda400bd50 tx=0x7fdda40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78198f11cbcf635 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb17fa640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdd9c0b52e0 0x7fdd9c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb37fe640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdd9c0b52e0 0x7fdd9c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fdd9a7fc640 1 -- 172.21.15.2:0/1872457164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4005220 con 0x556efcb9c190 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fdd9a7fc640 1 -- 172.21.15.2:0/1872457164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdda400be40 con 0x556efcb9c190 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fdd9a7fc640 1 -- 172.21.15.2:0/1872457164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40117c0 con 0x556efcb9c190 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.544+0000 7fddb17fa640 1 -- 172.21.15.2:0/2214775323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fddac0e6200 con 0x7fddb41086a0 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 -- 172.21.15.2:0/1872457164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 msgr2=0x556efcb9e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddb37fe640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdd9c0b52e0 0x7fdd9c0b77a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdda8005c40 tx=0x7fdda80056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcb9e580 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdda400bd50 tx=0x7fdda40107a0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 -- 172.21.15.2:0/1872457164 shutdown_connections 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcba1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcb9e580 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 --2- 172.21.15.2:0/1872457164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb9bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 -- 172.21.15.2:0/1872457164 >> 172.21.15.2:0/1872457164 conn(0x556efcb949b0 msgr2=0x556efcb95740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 -- 172.21.15.2:0/1872457164 shutdown_connections 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 -- 172.21.15.2:0/1872457164 wait complete. 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.545+0000 7fddbd406740 1 -- start start 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 Processor -- start 2024-09-10T23:31:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcba3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcba4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556efca32ab0 con 0x556efcb9c190 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556efcaa0730 con 0x556efcb9ebd0 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556efcba1bb0 con 0x556efcb99860 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddbd406740 10 client.0 _ll_register_callbacks cb 0x556efcaf46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddb37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcba3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddb37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcba3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43592/0 (socket says 172.21.15.2:43592) 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddb37fe640 1 -- 172.21.15.2:0/3103965394 learned_addr learned my addr 172.21.15.2:0/3103965394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddb8afa640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcba4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.546+0000 7fddb3fff640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddb37fe640 1 -- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 msgr2=0x556efcba2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddb37fe640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddb37fe640 1 -- 172.21.15.2:0/3103965394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 msgr2=0x556efcba4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddb37fe640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcba4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddb37fe640 1 -- 172.21.15.2:0/3103965394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556efc85c790 con 0x556efcb9c190 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddb37fe640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcba3570 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009900 tx=0x7fdda8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b123b7ef7b757c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fdd937fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fdd937fe640 1 -- 172.21.15.2:0/3103965394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda804d070 con 0x556efcb9c190 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fdd937fe640 1 -- 172.21.15.2:0/3103965394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdda8004450 con 0x556efcb9c190 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556efcb0d640 con 0x556efcb9c190 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fdd937fe640 1 -- 172.21.15.2:0/3103965394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdda8035040 con 0x556efcb9c190 2024-09-10T23:31:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddbd406740 10 client.17988 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.547+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556efc8d5620 con 0x556efcb9c190 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fdd937fe640 1 -- 172.21.15.2:0/3103965394 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556efcb0d640 con 0x556efcb9c190 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fdd937fe640 1 -- 172.21.15.2:0/3103965394 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdda803a040 con 0x556efcb9c190 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddbd406740 10 client.17988 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddbd406740 10 client.17988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddbd406740 20 client.17988 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddbd406740 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcbae7b0 0x556efcbb0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddbd406740 4 client.17988 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556efcb090f0 con 0x556efcbae7b0 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddb3fff640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcbae7b0 0x556efcbb0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fdd937fe640 10 client.17988 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.548+0000 7fddb3fff640 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcbae7b0 0x556efcbb0c30 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5061887d26d0aa server_cookie=bb8db406ba186c99 in_seq=0 out_seq=0 2024-09-10T23:31:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.549+0000 7fdd937fe640 1 -- 172.21.15.2:0/3103965394 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556efcb090f0 con 0x556efcbae7b0 2024-09-10T23:31:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.549+0000 7fdd937fe640 10 client.17988 handle_command_reply: tid=0 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.549+0000 7fddbd406740 1 client.17988 shutdown 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 msgr2=0x556efcba3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcba3570 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009900 tx=0x7fdda8009260 comp rx=0 tx=0).stop 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 shutdown_connections 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcbae7b0 0x556efcbb0c30 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcba4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb9c190 0x556efcba3570 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fdd937fe640 0 client.17988 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 --2- 172.21.15.2:0/3103965394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 >> 172.21.15.2:0/3103965394 conn(0x556efcb949b0 msgr2=0x556efcb93bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 shutdown_connections 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 1 -- 172.21.15.2:0/3103965394 wait complete. 2024-09-10T23:31:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.550+0000 7fddbd406740 20 client.17988 trim_cache size 0 max 16384 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 Processor -- start 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 -- start start 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb95210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcb95750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcb977f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddb41a9f00 con 0x556efcb99400 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddb41aba40 con 0x556efcb99860 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddbd406740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddb41aa5d0 con 0x556efcb9ebd0 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcb977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcb977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43604/0 (socket says 172.21.15.2:43604) 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 -- 172.21.15.2:0/652716304 learned_addr learned my addr 172.21.15.2:0/652716304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb37fe640 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcb95750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb3fff640 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb95210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 -- 172.21.15.2:0/652716304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 msgr2=0x556efcb95750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcb95750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 -- 172.21.15.2:0/652716304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 msgr2=0x556efcb95210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb95210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.565+0000 7fddb8afa640 1 -- 172.21.15.2:0/652716304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efcba44b0 con 0x556efcb99400 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddb3fff640 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb95210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddb8afa640 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcb977f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fddac0a8f40 tx=0x7fddac005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babb022fac2ffe9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fdd99ffb640 1 -- 172.21.15.2:0/652716304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0d3020 con 0x556efcb99400 2024-09-10T23:31:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fdd99ffb640 1 -- 172.21.15.2:0/652716304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddac0ac480 con 0x556efcb99400 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fdd99ffb640 1 -- 172.21.15.2:0/652716304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0e5070 con 0x556efcb99400 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddbd406740 1 -- 172.21.15.2:0/652716304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 msgr2=0x556efcb977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddbd406740 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcb977f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fddac0a8f40 tx=0x7fddac005810 comp rx=0 tx=0).stop 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddbd406740 1 -- 172.21.15.2:0/652716304 shutdown_connections 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddbd406740 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcb977f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddbd406740 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb9ebd0 0x556efcb95750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.566+0000 7fddbd406740 1 --2- 172.21.15.2:0/652716304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb99860 0x556efcb95210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- 172.21.15.2:0/652716304 >> 172.21.15.2:0/652716304 conn(0x556efcb949b0 msgr2=0x556efcb98cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- 172.21.15.2:0/652716304 shutdown_connections 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- 172.21.15.2:0/652716304 wait complete. 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- start start 2024-09-10T23:31:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 Processor -- start 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcbaacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcbaa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddb41ab370 con 0x556efcb99400 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddb41aaca0 con 0x556efcb9ebd0 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddb41a7ee0 con 0x556efcb99860 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddbd406740 10 client.0 _ll_register_callbacks cb 0x7fdda8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcbaacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.567+0000 7fddb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcbaacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43606/0 (socket says 172.21.15.2:43606) 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 -- 172.21.15.2:0/1400673287 learned_addr learned my addr 172.21.15.2:0/1400673287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb8afa640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcbaa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 -- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 msgr2=0x556efcba9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 -- 172.21.15.2:0/1400673287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 msgr2=0x556efcbaa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcbaa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 -- 172.21.15.2:0/1400673287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556efcba8600 con 0x556efcb99400 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb8afa640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcbaa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddb3fff640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcbaacb0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fdda400bd20 tx=0x7fdda400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e6b4bc8b3023fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fdd937fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fdd937fe640 1 -- 172.21.15.2:0/1400673287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4005040 con 0x556efcb99400 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fdd937fe640 1 -- 172.21.15.2:0/1400673287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdda40051e0 con 0x556efcb99400 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddac0ac480 con 0x556efcb99400 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fdd937fe640 1 -- 172.21.15.2:0/1400673287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdda40053e0 con 0x556efcb99400 2024-09-10T23:31:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddbd406740 10 client.17994 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.568+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556efcc1ba50 con 0x556efcb99400 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fdd937fe640 1 -- 172.21.15.2:0/1400673287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddac0ac480 con 0x556efcb99400 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fdd937fe640 1 -- 172.21.15.2:0/1400673287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdda4004820 con 0x556efcb99400 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddbd406740 10 client.17994 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddbd406740 10 client.17994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddbd406740 20 client.17994 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddbd406740 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcc1c270 0x556efcc1e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddbd406740 4 client.17994 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556efcb06520 con 0x556efcc1c270 2024-09-10T23:31:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.569+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcc1c270 0x556efcc1e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.570+0000 7fddb37fe640 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcc1c270 0x556efcc1e690 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc8019ca0a7a2c9 server_cookie=fb06b5dcff074eb in_seq=0 out_seq=0 2024-09-10T23:31:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.570+0000 7fdd937fe640 10 client.17994 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.583+0000 7fdd937fe640 1 -- 172.21.15.2:0/1400673287 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556efcb06520 con 0x556efcc1c270 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.583+0000 7fdd937fe640 10 client.17994 handle_command_reply: tid=0 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.583+0000 7fddbd406740 1 client.17994 shutdown 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 msgr2=0x556efcbaacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcbaacb0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fdda400bd20 tx=0x7fdda400ba10 comp rx=0 tx=0).stop 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 shutdown_connections 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556efcc1c270 0x556efcc1e690 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efcb9ebd0 0x556efcbaa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fdd937fe640 0 client.17994 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556efcb99860 0x556efcba9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 --2- 172.21.15.2:0/1400673287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556efcb99400 0x556efcbaacb0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 >> 172.21.15.2:0/1400673287 conn(0x556efcb949b0 msgr2=0x556efcb9efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 shutdown_connections 2024-09-10T23:31:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 1 -- 172.21.15.2:0/1400673287 wait complete. 2024-09-10T23:31:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddbd406740 20 client.17994 trim_cache size 0 max 16384 2024-09-10T23:31:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:31:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:31:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:31:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdd9c0b52e0 msgr2=0x7fdd9c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddba55d640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdd9c0b52e0 0x7fdd9c0b77a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdda8005c40 tx=0x7fdda80056d0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 msgr2=0x7fddb419a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.584+0000 7fddba55d640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 0x7fddb419a000 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fddac00eb10 tx=0x7fddac00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 shutdown_connections 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdd9c0b52e0 0x7fdd9c0b77a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddb41086a0 0x7fddb419a000 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4105af0 0x7fddb41993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 --2- 172.21.15.2:0/2214775323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb406bfb0 0x7fddb4198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 >> 172.21.15.2:0/2214775323 conn(0x7fddb40fd170 msgr2=0x7fddb4103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 shutdown_connections 2024-09-10T23:31:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:46.585+0000 7fddba55d640 1 -- 172.21.15.2:0/2214775323 wait complete. 2024-09-10T23:31:48.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:48 smithi177 ceph-mon[35760]: pgmap v575: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T23:31:48.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:48 smithi002 ceph-mon[31150]: pgmap v575: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T23:31:48.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:48 smithi154 ceph-mon[35136]: pgmap v575: 97 pgs: 97 active+clean; 1.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T23:31:50.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:50 smithi177 ceph-mon[35760]: pgmap v576: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:31:50.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:50 smithi002 ceph-mon[31150]: pgmap v576: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:31:50.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:50 smithi154 ceph-mon[35136]: pgmap v576: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-10T23:31:52.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:52 smithi177 ceph-mon[35760]: pgmap v577: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:31:52.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:52 smithi002 ceph-mon[31150]: pgmap v577: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:31:52.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:52 smithi154 ceph-mon[35136]: pgmap v577: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:31:53.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:31:53.408 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:53 smithi002 ceph-mon[31150]: pgmap v578: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:31:53.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:53 smithi177 ceph-mon[35760]: pgmap v578: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:31:53.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:53 smithi154 ceph-mon[35136]: pgmap v578: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:31:53.653 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 -- 172.21.15.2:0/4165053010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c10d100 msgr2=0x7fda5c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 --2- 172.21.15.2:0/4165053010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c10d100 0x7fda5c10f560 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fda54009900 tx=0x7fda5402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 -- 172.21.15.2:0/4165053010 shutdown_connections 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 --2- 172.21.15.2:0/4165053010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c10d100 0x7fda5c10f560 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 --2- 172.21.15.2:0/4165053010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda5c1045c0 0x7fda5c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 --2- 172.21.15.2:0/4165053010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda5c103ca0 0x7fda5c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 -- 172.21.15.2:0/4165053010 >> 172.21.15.2:0/4165053010 conn(0x7fda5c0fd700 msgr2=0x7fda5c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 -- 172.21.15.2:0/4165053010 shutdown_connections 2024-09-10T23:31:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.315+0000 7fda634b4640 1 -- 172.21.15.2:0/4165053010 wait complete. 2024-09-10T23:31:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 Processor -- start 2024-09-10T23:31:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 -- start start 2024-09-10T23:31:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda5c103ca0 0x7fda5c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 0x7fda5c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda5c10d100 0x7fda5c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c112db0 con 0x7fda5c1045c0 2024-09-10T23:31:54.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c112c30 con 0x7fda5c103ca0 2024-09-10T23:31:54.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda634b4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c112f30 con 0x7fda5c10d100 2024-09-10T23:31:54.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 0x7fda5c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 0x7fda5c1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43936/0 (socket says 172.21.15.2:43936) 2024-09-10T23:31:54.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 -- 172.21.15.2:0/1053894341 learned_addr learned my addr 172.21.15.2:0/1053894341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:54.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda61250640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda5c103ca0 0x7fda5c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 -- 172.21.15.2:0/1053894341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda5c10d100 msgr2=0x7fda5c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda5c10d100 0x7fda5c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 -- 172.21.15.2:0/1053894341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda5c103ca0 msgr2=0x7fda5c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda5c103ca0 0x7fda5c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.316+0000 7fda60a4f640 1 -- 172.21.15.2:0/1053894341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c19f310 con 0x7fda5c1045c0 2024-09-10T23:31:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.317+0000 7fda60a4f640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 0x7fda5c1997a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00d750 tx=0x7fda4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.317+0000 7fda527fc640 1 -- 172.21.15.2:0/1053894341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c017070 con 0x7fda5c1045c0 2024-09-10T23:31:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.317+0000 7fda527fc640 1 -- 172.21.15.2:0/1053894341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda4c004020 con 0x7fda5c1045c0 2024-09-10T23:31:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.317+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c19f600 con 0x7fda5c1045c0 2024-09-10T23:31:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.317+0000 7fda527fc640 1 -- 172.21.15.2:0/1053894341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c003c00 con 0x7fda5c1045c0 2024-09-10T23:31:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.317+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c1a5e90 con 0x7fda5c1045c0 2024-09-10T23:31:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.319+0000 7fda65889740 1 Processor -- start 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.319+0000 7fda527fc640 1 -- 172.21.15.2:0/1053894341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fda4c009a30 con 0x7fda5c1045c0 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.319+0000 7fda65889740 1 -- start start 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda65889740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb50480 0x55b6dfb50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda65889740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb50da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda65889740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda65889740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6dfac6e50 con 0x55b6dfb653e0 2024-09-10T23:31:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda65889740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6dfab6280 con 0x55b6dfb50480 2024-09-10T23:31:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda65889740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6dfaba090 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43948/0 (socket says 172.21.15.2:43948) 2024-09-10T23:31:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 -- 172.21.15.2:0/2895616519 learned_addr learned my addr 172.21.15.2:0/2895616519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda61250640 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb50da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda61a51640 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb50480 0x55b6dfb50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 -- 172.21.15.2:0/2895616519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 msgr2=0x55b6dfb50da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb50da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 -- 172.21.15.2:0/2895616519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb50480 msgr2=0x55b6dfb50860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb50480 0x55b6dfb50860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.320+0000 7fda60a4f640 1 -- 172.21.15.2:0/2895616519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6df814650 con 0x55b6dfb653e0 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda527fc640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda480b5360 0x7fda480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda61a51640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda480b5360 0x7fda480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda527fc640 1 -- 172.21.15.2:0/1053894341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fda4c0e5420 con 0x7fda5c1045c0 2024-09-10T23:31:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb677d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0eb5a0 tx=0x7fda4c0eba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22d9493f437c4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda477fe640 1 -- 172.21.15.2:0/2895616519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c020030 con 0x55b6dfb653e0 2024-09-10T23:31:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda477fe640 1 -- 172.21.15.2:0/2895616519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda4c0a7350 con 0x55b6dfb653e0 2024-09-10T23:31:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.321+0000 7fda477fe640 1 -- 172.21.15.2:0/2895616519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0a7a90 con 0x55b6dfb653e0 2024-09-10T23:31:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 -- 172.21.15.2:0/2895616519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 msgr2=0x55b6dfb677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda61a51640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda480b5360 0x7fda480b7820 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fda540096c0 tx=0x7fda54031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb677d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0eb5a0 tx=0x7fda4c0eba60 comp rx=0 tx=0).stop 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 -- 172.21.15.2:0/2895616519 shutdown_connections 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb677d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb50da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 --2- 172.21.15.2:0/2895616519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb50480 0x55b6dfb50860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 -- 172.21.15.2:0/2895616519 >> 172.21.15.2:0/2895616519 conn(0x55b6dfb4e2b0 msgr2=0x55b6dfb4f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 -- 172.21.15.2:0/2895616519 shutdown_connections 2024-09-10T23:31:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 -- 172.21.15.2:0/2895616519 wait complete. 2024-09-10T23:31:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 -- start start 2024-09-10T23:31:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.322+0000 7fda65889740 1 Processor -- start 2024-09-10T23:31:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb50480 0x55b6dfb5a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb57ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6df917700 con 0x55b6dfb653e0 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6dfa51110 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6dfb681d0 con 0x55b6dfb50480 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda65889740 10 client.0 _ll_register_callbacks cb 0x55b6dfa6a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb57ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb57ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43954/0 (socket says 172.21.15.2:43954) 2024-09-10T23:31:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 -- 172.21.15.2:0/1080223574 learned_addr learned my addr 172.21.15.2:0/1080223574 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61250640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb50480 0x55b6dfb5a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda60a4f640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 -- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb50480 msgr2=0x55b6dfb5a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb50480 0x55b6dfb5a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 -- 172.21.15.2:0/1080223574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 msgr2=0x55b6dfb574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 -- 172.21.15.2:0/1080223574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6dfa7ec40 con 0x55b6dfb653e0 2024-09-10T23:31:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda61a51640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb57ad0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fda54031720 tx=0x7fda54005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac0fdbb7da1ae63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.323+0000 7fda44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda44ff9640 1 -- 172.21.15.2:0/1080223574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5404c070 con 0x55b6dfb653e0 2024-09-10T23:31:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda4c0a7350 con 0x55b6dfb653e0 2024-09-10T23:31:54.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda44ff9640 1 -- 172.21.15.2:0/1080223574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fda540035f0 con 0x55b6dfb653e0 2024-09-10T23:31:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda44ff9640 1 -- 172.21.15.2:0/1080223574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fda54058050 con 0x55b6dfb653e0 2024-09-10T23:31:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 10 client.18006 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6dfb73b30 con 0x55b6dfb653e0 2024-09-10T23:31:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda44ff9640 1 -- 172.21.15.2:0/1080223574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda4c0a7350 con 0x55b6dfb653e0 2024-09-10T23:31:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda44ff9640 1 -- 172.21.15.2:0/1080223574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fda5403c740 con 0x55b6dfb653e0 2024-09-10T23:31:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 10 client.18006 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 10 client.18006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 20 client.18006 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfb75000 0x55b6dfb77430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 4 client.18006 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.324+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6dfac8da0 con 0x55b6dfb75000 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.325+0000 7fda61250640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfb75000 0x55b6dfb77430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.325+0000 7fda61250640 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfb75000 0x55b6dfb77430 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c0c46a763b587ef server_cookie=d116d5041f9e061e in_seq=0 out_seq=0 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.325+0000 7fda44ff9640 10 client.18006 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda44ff9640 1 -- 172.21.15.2:0/1080223574 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6dfac8da0 con 0x55b6dfb75000 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda44ff9640 10 client.18006 handle_command_reply: tid=0 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 client.18006 shutdown 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 msgr2=0x55b6dfb57ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb57ad0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fda54031720 tx=0x7fda54005fd0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 shutdown_connections 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfb75000 0x55b6dfb77430 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb653e0 0x55b6dfb57ad0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 --2- 172.21.15.2:0/1080223574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb50480 0x55b6dfb5a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda44ff9640 0 client.18006 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 >> 172.21.15.2:0/1080223574 conn(0x55b6dfb4e2b0 msgr2=0x55b6dfb4cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 shutdown_connections 2024-09-10T23:31:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 1 -- 172.21.15.2:0/1080223574 wait complete. 2024-09-10T23:31:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.326+0000 7fda65889740 20 client.18006 trim_cache size 0 max 16384 2024-09-10T23:31:54.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 Processor -- start 2024-09-10T23:31:54.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 -- start start 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb4fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb71460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb653e0 0x55b6dfb7cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1ac230 con 0x55b6dfb50480 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1add70 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda65889740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1ac900 con 0x55b6dfb653e0 2024-09-10T23:31:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda61250640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb4fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda61250640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb4fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43962/0 (socket says 172.21.15.2:43962) 2024-09-10T23:31:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda61250640 1 -- 172.21.15.2:0/2975774672 learned_addr learned my addr 172.21.15.2:0/2975774672 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.345+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb71460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda61a51640 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb653e0 0x55b6dfb7cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda60a4f640 1 -- 172.21.15.2:0/2975774672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb653e0 msgr2=0x55b6dfb7cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb653e0 0x55b6dfb7cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda60a4f640 1 -- 172.21.15.2:0/2975774672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 msgr2=0x55b6dfb4fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb4fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda60a4f640 1 -- 172.21.15.2:0/2975774672 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6dfb5a410 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb71460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0e2f30 tx=0x7fda4c0eb160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e623ed22e8c5194 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda46ffd640 1 -- 172.21.15.2:0/2975774672 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c020040 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda46ffd640 1 -- 172.21.15.2:0/2975774672 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda4c0a7350 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.346+0000 7fda46ffd640 1 -- 172.21.15.2:0/2975774672 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0ab360 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 -- 172.21.15.2:0/2975774672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 msgr2=0x55b6dfb71460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb71460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0e2f30 tx=0x7fda4c0eb160 comp rx=0 tx=0).stop 2024-09-10T23:31:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 -- 172.21.15.2:0/2975774672 shutdown_connections 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb653e0 0x55b6dfb7cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb71460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 --2- 172.21.15.2:0/2975774672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb4fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 -- 172.21.15.2:0/2975774672 >> 172.21.15.2:0/2975774672 conn(0x55b6dfb4e2b0 msgr2=0x55b6dfb4f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 -- 172.21.15.2:0/2975774672 shutdown_connections 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.347+0000 7fda65889740 1 -- 172.21.15.2:0/2975774672 wait complete. 2024-09-10T23:31:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 -- start start 2024-09-10T23:31:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 Processor -- start 2024-09-10T23:31:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb6a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb6aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb653e0 0x55b6dfb6b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1ad6a0 con 0x55b6dfb50480 2024-09-10T23:31:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1acfd0 con 0x55b6dfb653e0 2024-09-10T23:31:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.348+0000 7fda65889740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1aa210 con 0x55b6dfb5a7e0 2024-09-10T23:31:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb6a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda65889740 10 client.0 _ll_register_callbacks cb 0x7fda54040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb6a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43974/0 (socket says 172.21.15.2:43974) 2024-09-10T23:31:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 -- 172.21.15.2:0/2754679043 learned_addr learned my addr 172.21.15.2:0/2754679043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb6aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61a51640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb653e0 0x55b6dfb6b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 -- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 msgr2=0x55b6dfb6aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb6aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 -- 172.21.15.2:0/2754679043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb653e0 msgr2=0x55b6dfb6b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb653e0 0x55b6dfb6b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 -- 172.21.15.2:0/2754679043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6dfbe1fe0 con 0x55b6dfb50480 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda61250640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb6a5a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x55b6dfb77ca0 tx=0x7fda580096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9b3d9aa1699088 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.349+0000 7fda44ff9640 1 -- 172.21.15.2:0/2754679043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda58028060 con 0x55b6dfb50480 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda44ff9640 1 -- 172.21.15.2:0/2754679043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fda58018ac0 con 0x55b6dfb50480 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda4c0a7350 con 0x55b6dfb50480 2024-09-10T23:31:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda44ff9640 1 -- 172.21.15.2:0/2754679043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fda58008040 con 0x55b6dfb50480 2024-09-10T23:31:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 10 client.18012 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6dfbe3350 con 0x55b6dfb50480 2024-09-10T23:31:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda44ff9640 1 -- 172.21.15.2:0/2754679043 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda4c0a7350 con 0x55b6dfb50480 2024-09-10T23:31:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda44ff9640 1 -- 172.21.15.2:0/2754679043 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fda5802d380 con 0x55b6dfb50480 2024-09-10T23:31:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 10 client.18012 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 10 client.18012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 20 client.18012 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfbe3b30 0x55b6dfbe5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 4 client.18012 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:31:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.350+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6dfac4850 con 0x55b6dfbe3b30 2024-09-10T23:31:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfbe3b30 0x55b6dfbe5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda60a4f640 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfbe3b30 0x55b6dfbe5f50 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6debc1efea65985f server_cookie=1ae8c965e659c6bd in_seq=0 out_seq=0 2024-09-10T23:31:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda44ff9640 10 client.18012 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda44ff9640 1 -- 172.21.15.2:0/2754679043 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55b6dfac4850 con 0x55b6dfbe3b30 2024-09-10T23:31:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda44ff9640 10 client.18012 handle_command_reply: tid=0 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 client.18012 shutdown 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 msgr2=0x55b6dfb6a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb6a5a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x55b6dfb77ca0 tx=0x7fda580096d0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 shutdown_connections 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b6dfbe3b30 0x55b6dfbe5f50 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6dfb653e0 0x55b6dfb6b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6dfb5a7e0 0x55b6dfb6aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.351+0000 7fda65889740 1 --2- 172.21.15.2:0/2754679043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6dfb50480 0x55b6dfb6a5a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 >> 172.21.15.2:0/2754679043 conn(0x55b6dfb4e2b0 msgr2=0x55b6dfb58b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda44ff9640 0 client.18012 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 shutdown_connections 2024-09-10T23:31:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda65889740 1 -- 172.21.15.2:0/2754679043 wait complete. 2024-09-10T23:31:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda65889740 20 client.18012 trim_cache size 0 max 16384 2024-09-10T23:31:54.386 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:31:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:31:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:31:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:31:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:31:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:31:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:31:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:31:54.389 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.389 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.389 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.389 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.389 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.390 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:31:54.390 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:31:54.390 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.390 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.390 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.391 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.391 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.391 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:31:54.391 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:31:54.391 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:31:54.392 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:31:54.393 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.393 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.393 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.393 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.393 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.394 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.395 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:31:54.395 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:31:54.395 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.395 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.396 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.396 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:31:54.396 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.399 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:31:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:31:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.400 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.401 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.401 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.401 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:31:54.401 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:31:54.401 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.402 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.402 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.402 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.402 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.402 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:31:54.403 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:31:54.403 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.403 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.403 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.403 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.403 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.404 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:31:54.404 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:31:54.404 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.404 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.404 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:31:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:31:54.406 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:31:54.406 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:31:54.406 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:54.406 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:31:54.406 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda480b5360 msgr2=0x7fda480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.352+0000 7fda634b4640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda480b5360 0x7fda480b7820 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fda540096c0 tx=0x7fda54031400 comp rx=0 tx=0).stop 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 msgr2=0x7fda5c1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 0x7fda5c1997a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00d750 tx=0x7fda4c00dc10 comp rx=0 tx=0).stop 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 shutdown_connections 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fda480b5360 0x7fda480b7820 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda5c10d100 0x7fda5c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda5c1045c0 0x7fda5c1997a0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 --2- 172.21.15.2:0/1053894341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda5c103ca0 0x7fda5c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 >> 172.21.15.2:0/1053894341 conn(0x7fda5c0fd700 msgr2=0x7fda5c10f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 shutdown_connections 2024-09-10T23:31:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:54.353+0000 7fda634b4640 1 -- 172.21.15.2:0/1053894341 wait complete. 2024-09-10T23:31:55.281 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:31:55.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:31:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:55.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:55 smithi002 ceph-mon[31150]: pgmap v579: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:55.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:55 smithi177 ceph-mon[35760]: pgmap v579: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:55.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:55 smithi154 ceph-mon[35136]: pgmap v579: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 -- 172.21.15.2:0/1817609251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 msgr2=0x7f607c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 --2- 172.21.15.2:0/1817609251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c1031a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f606c009900 tx=0x7f606c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 -- 172.21.15.2:0/1817609251 shutdown_connections 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 --2- 172.21.15.2:0/1817609251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607c109150 0x7f607c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 --2- 172.21.15.2:0/1817609251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c1087d0 0x7f607c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 --2- 172.21.15.2:0/1817609251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c1031a0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 -- 172.21.15.2:0/1817609251 >> 172.21.15.2:0/1817609251 conn(0x7f607c0fe830 msgr2=0x7f607c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 -- 172.21.15.2:0/1817609251 shutdown_connections 2024-09-10T23:31:56.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.106+0000 7f6081fd3640 1 -- 172.21.15.2:0/1817609251 wait complete. 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.107+0000 7f6081fd3640 1 Processor -- start 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.107+0000 7f6081fd3640 1 -- start start 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607c1087d0 0x7f607c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c109150 0x7f607c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f607c112e60 con 0x7f607c102dc0 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f607c112ce0 con 0x7f607c109150 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f607c112fe0 con 0x7f607c1087d0 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43990/0 (socket says 172.21.15.2:43990) 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 -- 172.21.15.2:0/939074769 learned_addr learned my addr 172.21.15.2:0/939074769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607affd640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607c1087d0 0x7f607c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607bfff640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c109150 0x7f607c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 -- 172.21.15.2:0/939074769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607c1087d0 msgr2=0x7f607c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607c1087d0 0x7f607c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 -- 172.21.15.2:0/939074769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c109150 msgr2=0x7f607c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c109150 0x7f607c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 -- 172.21.15.2:0/939074769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c1a76f0 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607bfff640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c109150 0x7f607c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f607b7fe640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c0754a0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f606c005ab0 tx=0x7f606c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c03f070 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c1a7980 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.108+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606c031d60 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.109+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c035030 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.109+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c1a7eb0 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.110+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607c1031a0 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.112+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f606c03b560 con 0x7f607c102dc0 2024-09-10T23:31:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.113+0000 7f6078ff9640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60640b52e0 0x7f60640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.113+0000 7f607affd640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60640b52e0 0x7f60640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.113+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f606c106d70 con 0x7f607c102dc0 2024-09-10T23:31:56.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.113+0000 7f607affd640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60640b52e0 0x7f60640b77a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f607c076f90 tx=0x7f607000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.116+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f606c0cdbe0 con 0x7f607c102dc0 2024-09-10T23:31:56.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.341+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f607c0767a0 con 0x7f607c102dc0 2024-09-10T23:31:56.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.342+0000 7f6078ff9640 1 -- 172.21.15.2:0/939074769 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f606c0cd4e0 con 0x7f607c102dc0 2024-09-10T23:31:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:31:56.343 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:31:56.343 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60640b52e0 msgr2=0x7f60640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60640b52e0 0x7f60640b77a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f607c076f90 tx=0x7f607000b390 comp rx=0 tx=0).stop 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 msgr2=0x7f607c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c0754a0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f606c005ab0 tx=0x7f606c003cd0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 shutdown_connections 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f60640b52e0 0x7f60640b77a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f607c109150 0x7f607c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607c1087d0 0x7f607c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 --2- 172.21.15.2:0/939074769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f607c102dc0 0x7f607c0754a0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.345+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 >> 172.21.15.2:0/939074769 conn(0x7f607c0fe830 msgr2=0x7f607c1000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.346+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 shutdown_connections 2024-09-10T23:31:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:56.346+0000 7f6081fd3640 1 -- 172.21.15.2:0/939074769 wait complete. 2024-09-10T23:31:56.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/939074769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:31:56.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/939074769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:31:56.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/939074769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:31:57.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:31:57.389 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:57.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:57 smithi177 ceph-mon[35760]: pgmap v580: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:57.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:57 smithi002 ceph-mon[31150]: pgmap v580: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:57.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:57 smithi154 ceph-mon[35136]: pgmap v580: 97 pgs: 97 active+clean; 1.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:31:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.859+0000 7fcee3278640 1 -- 172.21.15.2:0/2300921689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 msgr2=0x7fcedc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.859+0000 7fcee3278640 1 --2- 172.21.15.2:0/2300921689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc107ae0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009900 tx=0x7fcecc02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 -- 172.21.15.2:0/2300921689 shutdown_connections 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 --2- 172.21.15.2:0/2300921689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc108020 0x7fcedc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 --2- 172.21.15.2:0/2300921689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc107ae0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 --2- 172.21.15.2:0/2300921689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcedc101c90 0x7fcedc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 -- 172.21.15.2:0/2300921689 >> 172.21.15.2:0/2300921689 conn(0x7fcedc0fd700 msgr2=0x7fcedc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 -- 172.21.15.2:0/2300921689 shutdown_connections 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 -- 172.21.15.2:0/2300921689 wait complete. 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 Processor -- start 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.860+0000 7fcee3278640 1 -- start start 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee3278640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcedc101c90 0x7fcedc0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee3278640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee3278640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc108020 0x7fcedc0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee3278640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc111c70 con 0x7fcedc1076a0 2024-09-10T23:31:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee3278640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc111af0 con 0x7fcedc108020 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee3278640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc111df0 con 0x7fcedc101c90 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44002/0 (socket says 172.21.15.2:44002) 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 -- 172.21.15.2:0/3449571315 learned_addr learned my addr 172.21.15.2:0/3449571315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee1014640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcedc101c90 0x7fcedc0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee1815640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc108020 0x7fcedc0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 -- 172.21.15.2:0/3449571315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcedc101c90 msgr2=0x7fcedc0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcedc101c90 0x7fcedc0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 -- 172.21.15.2:0/3449571315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc108020 msgr2=0x7fcedc0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc108020 0x7fcedc0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 -- 172.21.15.2:0/3449571315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc1a7640 con 0x7fcedc1076a0 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fcee0813640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc0fe140 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005940 tx=0x7fcecc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.861+0000 7fced27fc640 1 -- 172.21.15.2:0/3449571315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc03f030 con 0x7fcedc1076a0 2024-09-10T23:31:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.862+0000 7fced27fc640 1 -- 172.21.15.2:0/3449571315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcecc003cb0 con 0x7fcedc1076a0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.862+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc1a78d0 con 0x7fcedc1076a0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.862+0000 7fced27fc640 1 -- 172.21.15.2:0/3449571315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc035070 con 0x7fcedc1076a0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.862+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcedc1a7db0 con 0x7fcedc1076a0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 Processor -- start 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fced27fc640 1 -- 172.21.15.2:0/3449571315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcecc003800 con 0x7fcedc1076a0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 -- start start 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d2344d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d240460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d242d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55785d1aaea0 con 0x55785d2409a0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55785d19a2d0 con 0x55785d234a10 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.864+0000 7fcee564d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55785d19e0e0 con 0x55785d2340f0 2024-09-10T23:31:57.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee0813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d242d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d240460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee0813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d242d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44012/0 (socket says 172.21.15.2:44012) 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1815640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d2344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee0813640 1 -- 172.21.15.2:0/2872124009 learned_addr learned my addr 172.21.15.2:0/2872124009 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 -- 172.21.15.2:0/2872124009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 msgr2=0x55785d2344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d2344d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 -- 172.21.15.2:0/2872124009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 msgr2=0x55785d242d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d242d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 -- 172.21.15.2:0/2872124009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55785cef8650 con 0x55785d234a10 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fced27fc640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcec80b52e0 0x7fcec80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1014640 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d240460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fced800abf0 tx=0x7fced800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=543910f30c2c9c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcee1815640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcec80b52e0 0x7fcec80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fced27fc640 1 -- 172.21.15.2:0/3449571315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcecc1067d0 con 0x7fcedc1076a0 2024-09-10T23:31:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.865+0000 7fcec77fe640 1 -- 172.21.15.2:0/2872124009 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8005220 con 0x55785d234a10 2024-09-10T23:31:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcec77fe640 1 -- 172.21.15.2:0/2872124009 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced8004c50 con 0x55785d234a10 2024-09-10T23:31:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcec77fe640 1 -- 172.21.15.2:0/2872124009 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8018800 con 0x55785d234a10 2024-09-10T23:31:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 -- 172.21.15.2:0/2872124009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 msgr2=0x55785d240460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee1815640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcec80b52e0 0x7fcec80b77a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0ffcc0 tx=0x7fced4009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d240460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fced800abf0 tx=0x7fced800f790 comp rx=0 tx=0).stop 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 -- 172.21.15.2:0/2872124009 shutdown_connections 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d242d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d240460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 --2- 172.21.15.2:0/2872124009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d2344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 -- 172.21.15.2:0/2872124009 >> 172.21.15.2:0/2872124009 conn(0x55785d231f20 msgr2=0x55785d2330c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 -- 172.21.15.2:0/2872124009 shutdown_connections 2024-09-10T23:31:57.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.866+0000 7fcee564d740 1 -- 172.21.15.2:0/2872124009 wait complete. 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 -- start start 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 Processor -- start 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d2401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d23db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55785cffb700 con 0x55785d2340f0 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55785d135160 con 0x55785d234a10 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55785d243620 con 0x55785d2409a0 2024-09-10T23:31:57.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee564d740 10 client.0 _ll_register_callbacks cb 0x55785d14e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee1014640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d2401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee1014640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d2401d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44020/0 (socket says 172.21.15.2:44020) 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee1014640 1 -- 172.21.15.2:0/1488903818 learned_addr learned my addr 172.21.15.2:0/1488903818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.867+0000 7fcee1815640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d23db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee0813640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee1014640 1 -- 172.21.15.2:0/1488903818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 msgr2=0x55785d23db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee1014640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d23db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee1014640 1 -- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 msgr2=0x55785d23d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee1014640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee1014640 1 -- 172.21.15.2:0/1488903818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55785d162c90 con 0x55785d2340f0 2024-09-10T23:31:57.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee1014640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d2401d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fced800abc0 tx=0x7fced80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448d7c24376d9b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcec4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcec4ff9640 1 -- 172.21.15.2:0/1488903818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8027070 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcec4ff9640 1 -- 172.21.15.2:0/1488903818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fced8018540 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced8004c50 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcec4ff9640 1 -- 172.21.15.2:0/1488903818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fced8033050 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee564d740 10 client.18030 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55785d24ee90 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.868+0000 7fcec4ff9640 1 -- 172.21.15.2:0/1488903818 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced8004c50 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcec4ff9640 1 -- 172.21.15.2:0/1488903818 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fced8023430 con 0x55785d2340f0 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee564d740 10 client.18030 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee564d740 10 client.18030 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee564d740 20 client.18030 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:57.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee564d740 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d250240 0x55785d252630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee564d740 4 client.18030 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55785d1acdf0 con 0x55785d250240 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.869+0000 7fcee0813640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d250240 0x55785d252630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee0813640 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d250240 0x55785d252630 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d5bdf4ea7d403705 server_cookie=3b1b0d0eed813343 in_seq=0 out_seq=0 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcec4ff9640 10 client.18030 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcec4ff9640 1 -- 172.21.15.2:0/1488903818 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55785d1acdf0 con 0x55785d250240 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcec4ff9640 10 client.18030 handle_command_reply: tid=0 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 client.18030 shutdown 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 msgr2=0x55785d2401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d2401d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fced800abc0 tx=0x7fced80050b0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 shutdown_connections 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d250240 0x55785d252630 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d23db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 --2- 172.21.15.2:0/1488903818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d2401d0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.870+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 >> 172.21.15.2:0/1488903818 conn(0x55785d231f20 msgr2=0x55785d237ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.871+0000 7fcec4ff9640 0 client.18030 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.871+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 shutdown_connections 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.871+0000 7fcee564d740 1 -- 172.21.15.2:0/1488903818 wait complete. 2024-09-10T23:31:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.871+0000 7fcee564d740 20 client.18030 trim_cache size 0 max 16384 2024-09-10T23:31:57.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 Processor -- start 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 -- start start 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d230e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d23ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1b0560 con 0x55785d2409a0 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1b20a0 con 0x55785d234a10 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee564d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1b0c30 con 0x55785d2340f0 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee1815640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d23ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee1815640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d23ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44032/0 (socket says 172.21.15.2:44032) 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee1815640 1 -- 172.21.15.2:0/3444572090 learned_addr learned my addr 172.21.15.2:0/3444572090 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.884+0000 7fcee1014640 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d230e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee0813640 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee1815640 1 -- 172.21.15.2:0/3444572090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 msgr2=0x55785d230e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee1815640 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d230e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee1815640 1 -- 172.21.15.2:0/3444572090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 msgr2=0x55785d23a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee1815640 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee1815640 1 -- 172.21.15.2:0/3444572090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55785d2329a0 con 0x55785d2409a0 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcee1815640 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d23ad70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fced4005f40 tx=0x7fced4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989456700321035 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcec6ffd640 1 -- 172.21.15.2:0/3444572090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced401f620 con 0x55785d2409a0 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcec6ffd640 1 -- 172.21.15.2:0/3444572090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced401fc70 con 0x55785d2409a0 2024-09-10T23:31:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.885+0000 7fcec6ffd640 1 -- 172.21.15.2:0/3444572090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced401ccd0 con 0x55785d2409a0 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 -- 172.21.15.2:0/3444572090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 msgr2=0x55785d23ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d23ad70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fced4005f40 tx=0x7fced4015000 comp rx=0 tx=0).stop 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 -- 172.21.15.2:0/3444572090 shutdown_connections 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2409a0 0x55785d23ad70 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d23a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 --2- 172.21.15.2:0/3444572090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2340f0 0x55785d230e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 -- 172.21.15.2:0/3444572090 >> 172.21.15.2:0/3444572090 conn(0x55785d231f20 msgr2=0x55785d230750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 -- 172.21.15.2:0/3444572090 shutdown_connections 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 -- 172.21.15.2:0/3444572090 wait complete. 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 -- start start 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.886+0000 7fcee564d740 1 Processor -- start 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d244c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d245170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d2bbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1b19d0 con 0x55785d2340f0 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1b1300 con 0x55785d234a10 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1ae540 con 0x55785d2409a0 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee564d740 10 client.0 _ll_register_callbacks cb 0x7fcecc10c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d244c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d244c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44042/0 (socket says 172.21.15.2:44042) 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 -- 172.21.15.2:0/3338025305 learned_addr learned my addr 172.21.15.2:0/3338025305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1815640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d2bbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee0813640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d245170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 -- 172.21.15.2:0/3338025305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 msgr2=0x55785d2bbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d2bbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 -- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 msgr2=0x55785d245170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d245170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.887+0000 7fcee1014640 1 -- 172.21.15.2:0/3338025305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55785d2bc3a0 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee1014640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d244c30 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fced8023950 tx=0x7fced8005190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1468a217713137f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcec4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcec4ff9640 1 -- 172.21.15.2:0/3338025305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8027040 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced401fc70 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcec4ff9640 1 -- 172.21.15.2:0/3338025305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fced8023430 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcec4ff9640 1 -- 172.21.15.2:0/3338025305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fced8046050 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 10 client.18036 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55785d2bd5c0 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcec4ff9640 1 -- 172.21.15.2:0/3338025305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced401fc70 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcec4ff9640 1 -- 172.21.15.2:0/3338025305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fced802c8f0 con 0x55785d2340f0 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 10 client.18036 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:57.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 10 client.18036 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 20 client.18036 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d2bdd60 0x55785d2c0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 4 client.18036 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.888+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55785d1a88a0 con 0x55785d2bdd60 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee0813640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d2bdd60 0x55785d2c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee0813640 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d2bdd60 0x55785d2c0180 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d654decd6292d50 server_cookie=f9a06620bca43abb in_seq=0 out_seq=0 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcec4ff9640 10 client.18036 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcec4ff9640 1 -- 172.21.15.2:0/3338025305 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55785d1a88a0 con 0x55785d2bdd60 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcec4ff9640 10 client.18036 handle_command_reply: tid=0 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 client.18036 shutdown 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 msgr2=0x55785d244c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d244c30 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fced8023950 tx=0x7fced8005190 comp rx=0 tx=0).stop 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 shutdown_connections 2024-09-10T23:31:57.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55785d2bdd60 0x55785d2c0180 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55785d2409a0 0x55785d2bbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55785d234a10 0x55785d245170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 --2- 172.21.15.2:0/3338025305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55785d2340f0 0x55785d244c30 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 >> 172.21.15.2:0/3338025305 conn(0x55785d231f20 msgr2=0x55785d23f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.889+0000 7fcec4ff9640 0 client.18036 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 shutdown_connections 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee564d740 1 -- 172.21.15.2:0/3338025305 wait complete. 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee564d740 20 client.18036 trim_cache size 0 max 16384 2024-09-10T23:31:57.898 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:57.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcec80b52e0 msgr2=0x7fcec80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcec80b52e0 0x7fcec80b77a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0ffcc0 tx=0x7fced4009760 comp rx=0 tx=0).stop 2024-09-10T23:31:57.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 msgr2=0x7fcedc0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc0fe140 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005940 tx=0x7fcecc0042f0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 shutdown_connections 2024-09-10T23:31:57.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcec80b52e0 0x7fcec80b77a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc108020 0x7fcedc0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcedc1076a0 0x7fcedc0fe140 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 --2- 172.21.15.2:0/3449571315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcedc101c90 0x7fcedc0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 >> 172.21.15.2:0/3449571315 conn(0x7fcedc0fd700 msgr2=0x7fcedc104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 shutdown_connections 2024-09-10T23:31:57.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:57.890+0000 7fcee3278640 1 -- 172.21.15.2:0/3449571315 wait complete. 2024-09-10T23:31:58.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:31:58.934 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 -- 172.21.15.2:0/2152975210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 msgr2=0x7f348c1117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 --2- 172.21.15.2:0/2152975210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1117d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3484009ca0 tx=0x7f348402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 -- 172.21.15.2:0/2152975210 shutdown_connections 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 --2- 172.21.15.2:0/2152975210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1117d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 --2- 172.21.15.2:0/2152975210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f348c075f40 0x7f348c10ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 --2- 172.21.15.2:0/2152975210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348c075540 0x7f348c075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.439+0000 7f3493bae640 1 -- 172.21.15.2:0/2152975210 >> 172.21.15.2:0/2152975210 conn(0x7f348c0fe830 msgr2=0x7f348c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 -- 172.21.15.2:0/2152975210 shutdown_connections 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 -- 172.21.15.2:0/2152975210 wait complete. 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 Processor -- start 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 -- start start 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348c075540 0x7f348c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f348c075f40 0x7f348c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f348c114fb0 con 0x7f348c10f3e0 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f348c114e30 con 0x7f348c075f40 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.440+0000 7f3493bae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f348c115130 con 0x7f348c075540 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44056/0 (socket says 172.21.15.2:44056) 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 -- 172.21.15.2:0/3691006160 learned_addr learned my addr 172.21.15.2:0/3691006160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f3491149640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f348c075f40 0x7f348c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349194a640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348c075540 0x7f348c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 -- 172.21.15.2:0/3691006160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348c075540 msgr2=0x7f348c19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348c075540 0x7f348c19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 -- 172.21.15.2:0/3691006160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f348c075f40 msgr2=0x7f348c19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f348c075f40 0x7f348c19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 -- 172.21.15.2:0/3691006160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c1a14f0 con 0x7f348c10f3e0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f349214b640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1a0d20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f3484005e30 tx=0x7f34840317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f3482ffd640 1 -- 172.21.15.2:0/3691006160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484003b70 con 0x7f348c10f3e0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f3482ffd640 1 -- 172.21.15.2:0/3691006160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3484003d10 con 0x7f348c10f3e0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c1a1780 con 0x7f348c10f3e0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.441+0000 7f3482ffd640 1 -- 172.21.15.2:0/3691006160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348402fa00 con 0x7f348c10f3e0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.442+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c1a7ea0 con 0x7f348c10f3e0 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 Processor -- start 2024-09-10T23:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3482ffd640 1 -- 172.21.15.2:0/3691006160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3484004580 con 0x7f348c10f3e0 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 -- start start 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b2488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b254840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b257170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56044b1beea0 con 0x56044b2484d0 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56044b1ae2d0 con 0x56044b254d80 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.444+0000 7f3495f83740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56044b1b20e0 con 0x56044b248df0 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b2488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b2488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44058/0 (socket says 172.21.15.2:44058) 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 -- 172.21.15.2:0/1842293067 learned_addr learned my addr 172.21.15.2:0/1842293067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f349194a640 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b254840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b257170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 -- 172.21.15.2:0/1842293067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 msgr2=0x56044b254840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b254840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 -- 172.21.15.2:0/1842293067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 msgr2=0x56044b257170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b257170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 -- 172.21.15.2:0/1842293067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56044af0c650 con 0x56044b2484d0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f349194a640 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b254840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3482ffd640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34780b5360 0x7f34780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3491149640 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b2488b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f347c013620 tx=0x7f347c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4cd7ba749e2f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f349194a640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34780b5360 0x7f34780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3482ffd640 1 -- 172.21.15.2:0/3691006160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3484106cc0 con 0x7f348c10f3e0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3477fff640 1 -- 172.21.15.2:0/1842293067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c004050 con 0x56044b2484d0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3477fff640 1 -- 172.21.15.2:0/1842293067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f347c0041f0 con 0x56044b2484d0 2024-09-10T23:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.445+0000 7f3477fff640 1 -- 172.21.15.2:0/1842293067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c00f8b0 con 0x56044b2484d0 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 -- 172.21.15.2:0/1842293067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 msgr2=0x56044b2488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f349194a640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34780b5360 0x7f34780b7820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x56044b2471e0 tx=0x7f348800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b2488b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f347c013620 tx=0x7f347c009850 comp rx=0 tx=0).stop 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 -- 172.21.15.2:0/1842293067 shutdown_connections 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b257170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b254840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 --2- 172.21.15.2:0/1842293067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b2488b0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 -- 172.21.15.2:0/1842293067 >> 172.21.15.2:0/1842293067 conn(0x56044b246300 msgr2=0x56044b2474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 -- 172.21.15.2:0/1842293067 shutdown_connections 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.446+0000 7f3495f83740 1 -- 172.21.15.2:0/1842293067 wait complete. 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 -- start start 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 Processor -- start 2024-09-10T23:31:59.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b254660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b251ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b2520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56044b00f700 con 0x56044b2484d0 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56044b149160 con 0x56044b254d80 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56044b2579a0 con 0x56044b248df0 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3495f83740 10 client.0 _ll_register_callbacks cb 0x56044b1629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b254660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b254660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44062/0 (socket says 172.21.15.2:44062) 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 -- 172.21.15.2:0/2006993129 learned_addr learned my addr 172.21.15.2:0/2006993129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f3491149640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b251ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349214b640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b2520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 -- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 msgr2=0x56044b251ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b251ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 -- 172.21.15.2:0/2006993129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 msgr2=0x56044b2520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b2520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.447+0000 7f349194a640 1 -- 172.21.15.2:0/2006993129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56044b176c90 con 0x56044b2484d0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f349194a640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b254660 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f348800b5a0 tx=0x7f34880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935b7959e78c84b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f34757fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f34757fa640 1 -- 172.21.15.2:0/2006993129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348801b660 con 0x56044b2484d0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f34757fa640 1 -- 172.21.15.2:0/2006993129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f348801b800 con 0x56044b2484d0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347c0041f0 con 0x56044b2484d0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f34757fa640 1 -- 172.21.15.2:0/2006993129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f348801ba00 con 0x56044b2484d0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f3495f83740 10 client.18048 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56044b263320 con 0x56044b2484d0 2024-09-10T23:31:59.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f34757fa640 1 -- 172.21.15.2:0/2006993129 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f347c0041f0 con 0x56044b2484d0 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.448+0000 7f34757fa640 1 -- 172.21.15.2:0/2006993129 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3488024070 con 0x56044b2484d0 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3495f83740 10 client.18048 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3495f83740 10 client.18048 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3495f83740 20 client.18048 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3495f83740 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b264820 0x56044b266c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3495f83740 4 client.18048 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56044b1c0df0 con 0x56044b264820 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3491149640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b264820 0x56044b266c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f34757fa640 10 client.18048 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.449+0000 7f3491149640 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b264820 0x56044b266c80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c8cfe75e6f955a4 server_cookie=28dcdf35d611932d in_seq=0 out_seq=0 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f34757fa640 1 -- 172.21.15.2:0/2006993129 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56044b1c0df0 con 0x56044b264820 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f34757fa640 10 client.18048 handle_command_reply: tid=0 2024-09-10T23:31:59.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 client.18048 shutdown 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 msgr2=0x56044b254660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b254660 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f348800b5a0 tx=0x7f34880046c0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 shutdown_connections 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b264820 0x56044b266c80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b254d80 0x56044b2520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b251ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 --2- 172.21.15.2:0/2006993129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b2484d0 0x56044b254660 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f34757fa640 0 client.18048 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 >> 172.21.15.2:0/2006993129 conn(0x56044b246300 msgr2=0x56044b24be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 shutdown_connections 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 1 -- 172.21.15.2:0/2006993129 wait complete. 2024-09-10T23:31:59.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.450+0000 7f3495f83740 20 client.18048 trim_cache size 0 max 16384 2024-09-10T23:31:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 Processor -- start 2024-09-10T23:31:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 -- start start 2024-09-10T23:31:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b2484d0 0x56044b245c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b248df0 0x56044b24bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b24c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1b0570 con 0x56044b254d80 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1b20b0 con 0x56044b248df0 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f3495f83740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1b0c40 con 0x56044b2484d0 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f349214b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b24c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f349214b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b24c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44078/0 (socket says 172.21.15.2:44078) 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.464+0000 7f349214b640 1 -- 172.21.15.2:0/3466998367 learned_addr learned my addr 172.21.15.2:0/3466998367 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349194a640 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b2484d0 0x56044b245c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349214b640 1 -- 172.21.15.2:0/3466998367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b2484d0 msgr2=0x56044b245c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f3491149640 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b248df0 0x56044b24bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349214b640 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b2484d0 0x56044b245c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349214b640 1 -- 172.21.15.2:0/3466998367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b248df0 msgr2=0x56044b24bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349214b640 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b248df0 0x56044b24bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349214b640 1 -- 172.21.15.2:0/3466998367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56044b246d80 con 0x56044b254d80 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349194a640 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b2484d0 0x56044b245c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f349214b640 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b24c180 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f348402ae80 tx=0x7f34840095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0099be52db5614 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f34777fe640 1 -- 172.21.15.2:0/3466998367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34840ccba0 con 0x56044b254d80 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f34777fe640 1 -- 172.21.15.2:0/3466998367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3484036040 con 0x56044b254d80 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.465+0000 7f34777fe640 1 -- 172.21.15.2:0/3466998367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34840d1f10 con 0x56044b254d80 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 -- 172.21.15.2:0/3466998367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 msgr2=0x56044b24c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b24c180 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f348402ae80 tx=0x7f34840095c0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 -- 172.21.15.2:0/3466998367 shutdown_connections 2024-09-10T23:31:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b24c180 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b248df0 0x56044b24bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 --2- 172.21.15.2:0/3466998367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b2484d0 0x56044b245c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 -- 172.21.15.2:0/3466998367 >> 172.21.15.2:0/3466998367 conn(0x56044b246300 msgr2=0x56044b24b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 -- 172.21.15.2:0/3466998367 shutdown_connections 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 -- 172.21.15.2:0/3466998367 wait complete. 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 -- start start 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 Processor -- start 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b2484d0 0x56044b257fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.466+0000 7f3495f83740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b258500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3495f83740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b258a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3495f83740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1b19e0 con 0x56044b254d80 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3495f83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1b1310 con 0x56044b2484d0 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3495f83740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1ae550 con 0x56044b248df0 2024-09-10T23:31:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3495f83740 10 client.0 _ll_register_callbacks cb 0x7f34880043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b258a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349194a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b2484d0 0x56044b257fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b258a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44080/0 (socket says 172.21.15.2:44080) 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 -- 172.21.15.2:0/512502102 learned_addr learned my addr 172.21.15.2:0/512502102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3491149640 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b258500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 -- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 msgr2=0x56044b258500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b258500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 -- 172.21.15.2:0/512502102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b2484d0 msgr2=0x56044b257fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b2484d0 0x56044b257fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 -- 172.21.15.2:0/512502102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56044b2d1a20 con 0x56044b254d80 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f349214b640 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b258a60 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f3484003fd0 tx=0x7f34840d6450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7abb46d14f94bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f34757fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f34757fa640 1 -- 172.21.15.2:0/512502102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34840e6020 con 0x56044b254d80 2024-09-10T23:31:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f34757fa640 1 -- 172.21.15.2:0/512502102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f34840cd890 con 0x56044b254d80 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.467+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3484036040 con 0x56044b254d80 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f34757fa640 1 -- 172.21.15.2:0/512502102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34840f43d0 con 0x56044b254d80 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 10 client.18054 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56044b2d2c90 con 0x56044b254d80 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f34757fa640 1 -- 172.21.15.2:0/512502102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3484036040 con 0x56044b254d80 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f34757fa640 1 -- 172.21.15.2:0/512502102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34840d6530 con 0x56044b254d80 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 10 client.18054 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 10 client.18054 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 20 client.18054 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b2d3360 0x56044b2d5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 4 client.18054 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56044b1bc8a0 con 0x56044b2d3360 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.468+0000 7f349194a640 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b2d3360 0x56044b2d5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f349194a640 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b2d3360 0x56044b2d5780 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=774556bcf56f8c38 server_cookie=28079d8f77d4a657 in_seq=0 out_seq=0 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f34757fa640 10 client.18054 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f34757fa640 1 -- 172.21.15.2:0/512502102 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56044b1bc8a0 con 0x56044b2d3360 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f34757fa640 10 client.18054 handle_command_reply: tid=0 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 client.18054 shutdown 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 msgr2=0x56044b258a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b258a60 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f3484003fd0 tx=0x7f34840d6450 comp rx=0 tx=0).stop 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 shutdown_connections 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x56044b2d3360 0x56044b2d5780 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56044b254d80 0x56044b258a60 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56044b248df0 0x56044b258500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f34757fa640 0 client.18054 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:31:59.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 --2- 172.21.15.2:0/512502102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56044b2484d0 0x56044b257fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 >> 172.21.15.2:0/512502102 conn(0x56044b246300 msgr2=0x56044b24bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 shutdown_connections 2024-09-10T23:31:59.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 1 -- 172.21.15.2:0/512502102 wait complete. 2024-09-10T23:31:59.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.469+0000 7f3495f83740 20 client.18054 trim_cache size 0 max 16384 2024-09-10T23:31:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34780b5360 msgr2=0x7f34780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34780b5360 0x7f34780b7820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x56044b2471e0 tx=0x7f348800b390 comp rx=0 tx=0).stop 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 msgr2=0x7f348c1a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1a0d20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f3484005e30 tx=0x7f34840317c0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 shutdown_connections 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34780b5360 0x7f34780b7820 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c10f3e0 0x7f348c1a0d20 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f348c075f40 0x7f348c19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 --2- 172.21.15.2:0/3691006160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348c075540 0x7f348c19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 >> 172.21.15.2:0/3691006160 conn(0x7f348c0fe830 msgr2=0x7f348c1115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 shutdown_connections 2024-09-10T23:31:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:31:59.470+0000 7f3493bae640 1 -- 172.21.15.2:0/3691006160 wait complete. 2024-09-10T23:31:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 -- 172.21.15.2:0/3990050935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48681086a0 msgr2=0x7f486810ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 --2- 172.21.15.2:0/3990050935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48681086a0 0x7f486810ab60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4860009ca0 tx=0x7f486002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 -- 172.21.15.2:0/3990050935 shutdown_connections 2024-09-10T23:31:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 --2- 172.21.15.2:0/3990050935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48681086a0 0x7f486810ab60 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 --2- 172.21.15.2:0/3990050935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868105af0 0x7f4868107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 --2- 172.21.15.2:0/3990050935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f486806bfb0 0x7f4868105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 -- 172.21.15.2:0/3990050935 >> 172.21.15.2:0/3990050935 conn(0x7f48680fd170 msgr2=0x7f48680ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 -- 172.21.15.2:0/3990050935 shutdown_connections 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.676+0000 7f486fa16640 1 -- 172.21.15.2:0/3990050935 wait complete. 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 Processor -- start 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 -- start start 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 0x7f4868198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4868105af0 0x7f48681991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48681086a0 0x7f4868199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f486810e620 con 0x7f486806bfb0 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f486810e4a0 con 0x7f4868105af0 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486fa16640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f486810e7a0 con 0x7f48681086a0 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 0x7f4868198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 0x7f4868198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44100/0 (socket says 172.21.15.2:44100) 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 -- 172.21.15.2:0/484436724 learned_addr learned my addr 172.21.15.2:0/484436724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 -- 172.21.15.2:0/484436724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48681086a0 msgr2=0x7f4868199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486dfb3640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48681086a0 0x7f4868199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486cfb1640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4868105af0 0x7f48681991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48681086a0 0x7f4868199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 -- 172.21.15.2:0/484436724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4868105af0 msgr2=0x7f48681991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4868105af0 0x7f48681991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486d7b2640 1 -- 172.21.15.2:0/484436724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486819a6d0 con 0x7f486806bfb0 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486dfb3640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48681086a0 0x7f4868199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.677+0000 7f486cfb1640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4868105af0 0x7f48681991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.678+0000 7f486d7b2640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 0x7f4868198b90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f486400c920 tx=0x7f486400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.678+0000 7f485e7fc640 1 -- 172.21.15.2:0/484436724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864007c70 con 0x7f486806bfb0 2024-09-10T23:31:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.678+0000 7f485e7fc640 1 -- 172.21.15.2:0/484436724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4864007e10 con 0x7f486806bfb0 2024-09-10T23:31:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.678+0000 7f485e7fc640 1 -- 172.21.15.2:0/484436724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864018820 con 0x7f486806bfb0 2024-09-10T23:31:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.678+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486819a9c0 con 0x7f486806bfb0 2024-09-10T23:31:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.678+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48681a1090 con 0x7f486806bfb0 2024-09-10T23:31:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.680+0000 7f48727ea740 1 Processor -- start 2024-09-10T23:31:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.680+0000 7f48727ea740 1 -- start start 2024-09-10T23:31:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f48727ea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da70860 0x563c7da72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f48727ea740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da75580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f48727ea740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 0x563c7da78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f48727ea740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563c7d9e26f0 con 0x563c7da75bd0 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f48727ea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563c7d9d1b20 con 0x563c7da70860 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f48727ea740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563c7d9d5930 con 0x563c7da73190 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f485e7fc640 1 -- 172.21.15.2:0/484436724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f486400f450 con 0x7f486806bfb0 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 0x563c7da78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 0x563c7da78090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44106/0 (socket says 172.21.15.2:44106) 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 -- 172.21.15.2:0/1338259192 learned_addr learned my addr 172.21.15.2:0/1338259192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486dfb3640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da70860 0x563c7da72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486d7b2640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da75580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 -- 172.21.15.2:0/1338259192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 msgr2=0x563c7da75580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da75580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 -- 172.21.15.2:0/1338259192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da70860 msgr2=0x563c7da72c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da70860 0x563c7da72c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 -- 172.21.15.2:0/1338259192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7d997530 con 0x563c7da75bd0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486dfb3640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da70860 0x563c7da72c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486d7b2640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da75580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.681+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 0x563c7da78090 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f485800bc20 tx=0x7f485800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270eff4af6f9d80b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48537fe640 1 -- 172.21.15.2:0/1338259192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858017620 con 0x563c7da75bd0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48537fe640 1 -- 172.21.15.2:0/1338259192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4858017c70 con 0x563c7da75bd0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48537fe640 1 -- 172.21.15.2:0/1338259192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485800fc60 con 0x563c7da75bd0 2024-09-10T23:31:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f485e7fc640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f48540b5360 0x7f48540b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f486dfb3640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f48540b5360 0x7f48540b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f485e7fc640 1 -- 172.21.15.2:0/484436724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f48640e5d40 con 0x7f486806bfb0 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 -- 172.21.15.2:0/1338259192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 msgr2=0x563c7da78090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f486dfb3640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f48540b5360 0x7f48540b7820 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4860009430 tx=0x7f4860009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 0x563c7da78090 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f485800bc20 tx=0x7f485800d710 comp rx=0 tx=0).stop 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 -- 172.21.15.2:0/1338259192 shutdown_connections 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da75bd0 0x563c7da78090 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da75580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 --2- 172.21.15.2:0/1338259192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da70860 0x563c7da72c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 -- 172.21.15.2:0/1338259192 >> 172.21.15.2:0/1338259192 conn(0x563c7da6b9b0 msgr2=0x563c7da6c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 -- 172.21.15.2:0/1338259192 shutdown_connections 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.682+0000 7f48727ea740 1 -- 172.21.15.2:0/1338259192 wait complete. 2024-09-10T23:31:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 -- start start 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 Processor -- start 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da79e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da73190 0x563c7da7a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da75bd0 0x563c7da7b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563c7d909ab0 con 0x563c7da70860 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563c7d977730 con 0x563c7da73190 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563c7da78bb0 con 0x563c7da75bd0 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f48727ea740 10 client.0 _ll_register_callbacks cb 0x563c7d9cb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da79e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da79e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44116/0 (socket says 172.21.15.2:44116) 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f486d7b2640 1 -- 172.21.15.2:0/3569950150 learned_addr learned my addr 172.21.15.2:0/3569950150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.683+0000 7f486dfb3640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da75bd0 0x563c7da7b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486cfb1640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da73190 0x563c7da7a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486d7b2640 1 -- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da75bd0 msgr2=0x563c7da7b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486d7b2640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da75bd0 0x563c7da7b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486d7b2640 1 -- 172.21.15.2:0/3569950150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da73190 msgr2=0x563c7da7a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486d7b2640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da73190 0x563c7da7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486d7b2640 1 -- 172.21.15.2:0/3569950150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7d733790 con 0x563c7da70860 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486cfb1640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da73190 0x563c7da7a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f486d7b2640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da79e40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f48640ac210 tx=0x7f48640abd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec2e035fd13d62f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f4850ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f4850ff9640 1 -- 172.21.15.2:0/3569950150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640ac970 con 0x563c7da70860 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f4850ff9640 1 -- 172.21.15.2:0/3569950150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f48640b5610 con 0x563c7da70860 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4858017c70 con 0x563c7da70860 2024-09-10T23:31:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f4850ff9640 1 -- 172.21.15.2:0/3569950150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48640acc10 con 0x563c7da70860 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 10 client.18066 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c7d7ac620 con 0x563c7da70860 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f4850ff9640 1 -- 172.21.15.2:0/3569950150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4858017c70 con 0x563c7da70860 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f4850ff9640 1 -- 172.21.15.2:0/3569950150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48640a7e60 con 0x563c7da70860 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 10 client.18066 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 10 client.18066 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 20 client.18066 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7da856f0 0x563c7da87b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 4 client.18066 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.684+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c7d9e4640 con 0x563c7da856f0 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.685+0000 7f486cfb1640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7da856f0 0x563c7da87b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.685+0000 7f486cfb1640 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7da856f0 0x563c7da87b20 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c14c3101dd3eddb server_cookie=b33e4a10afea9f51 in_seq=0 out_seq=0 2024-09-10T23:31:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.685+0000 7f4850ff9640 10 client.18066 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f4850ff9640 1 -- 172.21.15.2:0/3569950150 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c7d9e4640 con 0x563c7da856f0 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f4850ff9640 10 client.18066 handle_command_reply: tid=0 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 client.18066 shutdown 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 msgr2=0x563c7da79e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da79e40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f48640ac210 tx=0x7f48640abd40 comp rx=0 tx=0).stop 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 shutdown_connections 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7da856f0 0x563c7da87b20 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da75bd0 0x563c7da7b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da73190 0x563c7da7a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 --2- 172.21.15.2:0/3569950150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da79e40 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f4850ff9640 0 client.18066 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 >> 172.21.15.2:0/3569950150 conn(0x563c7da6b9b0 msgr2=0x563c7da6abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 shutdown_connections 2024-09-10T23:31:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.686+0000 7f48727ea740 1 -- 172.21.15.2:0/3569950150 wait complete. 2024-09-10T23:31:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.687+0000 7f48727ea740 20 client.18066 trim_cache size 0 max 16384 2024-09-10T23:31:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 Processor -- start 2024-09-10T23:31:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 -- start start 2024-09-10T23:31:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da6fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da70200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da6c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48681a9d90 con 0x563c7da70860 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48681ab8d0 con 0x563c7da75bd0 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f48727ea740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48681aa460 con 0x563c7da73190 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da6fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da6fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44122/0 (socket says 172.21.15.2:44122) 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.701+0000 7f486d7b2640 1 -- 172.21.15.2:0/315812784 learned_addr learned my addr 172.21.15.2:0/315812784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486cfb1640 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da70200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486d7b2640 1 -- 172.21.15.2:0/315812784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 msgr2=0x563c7da70200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486dfb3640 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da6c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486d7b2640 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da70200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486d7b2640 1 -- 172.21.15.2:0/315812784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 msgr2=0x563c7da6c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486d7b2640 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da6c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486d7b2640 1 -- 172.21.15.2:0/315812784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7da881a0 con 0x563c7da70860 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486dfb3640 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da6c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f486d7b2640 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da6fcc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f486401f000 tx=0x7f4864000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd91fabbbf99295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f4852ffd640 1 -- 172.21.15.2:0/315812784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640ac510 con 0x563c7da70860 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f4852ffd640 1 -- 172.21.15.2:0/315812784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48640b5aa0 con 0x563c7da70860 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f4852ffd640 1 -- 172.21.15.2:0/315812784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640ab1e0 con 0x563c7da70860 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f48727ea740 1 -- 172.21.15.2:0/315812784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 msgr2=0x563c7da6fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.702+0000 7f48727ea740 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da6fcc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f486401f000 tx=0x7f4864000bc0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- 172.21.15.2:0/315812784 shutdown_connections 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da6c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da70200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 --2- 172.21.15.2:0/315812784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da6fcc0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- 172.21.15.2:0/315812784 >> 172.21.15.2:0/315812784 conn(0x563c7da6b9b0 msgr2=0x563c7da6ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- 172.21.15.2:0/315812784 shutdown_connections 2024-09-10T23:31:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- 172.21.15.2:0/315812784 wait complete. 2024-09-10T23:31:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- start start 2024-09-10T23:31:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 Processor -- start 2024-09-10T23:31:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da81990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da80690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da80c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48681ab200 con 0x563c7da70860 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48681aab30 con 0x563c7da75bd0 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48681a7d70 con 0x563c7da73190 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f48727ea740 10 client.0 _ll_register_callbacks cb 0x7f486400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da81990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f486d7b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da81990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44128/0 (socket says 172.21.15.2:44128) 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.703+0000 7f486d7b2640 1 -- 172.21.15.2:0/1828748144 learned_addr learned my addr 172.21.15.2:0/1828748144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486dfb3640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da80c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da80690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486d7b2640 1 -- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 msgr2=0x563c7da80690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486d7b2640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da80690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486d7b2640 1 -- 172.21.15.2:0/1828748144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 msgr2=0x563c7da80c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486d7b2640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da80c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486d7b2640 1 -- 172.21.15.2:0/1828748144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7da81460 con 0x563c7da70860 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da80690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f486d7b2640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da81990 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f48640abfd0 tx=0x7f486400f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513b7171663d393b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f4850ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f4850ff9640 1 -- 172.21.15.2:0/1828748144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640b0ff0 con 0x563c7da70860 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f4850ff9640 1 -- 172.21.15.2:0/1828748144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f48640ac8e0 con 0x563c7da70860 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48640b5aa0 con 0x563c7da70860 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f4850ff9640 1 -- 172.21.15.2:0/1828748144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48640ac510 con 0x563c7da70860 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f48727ea740 10 client.18072 fetch_fsmap learned FSMap version 28 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c7daf2690 con 0x563c7da70860 2024-09-10T23:31:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.704+0000 7f4850ff9640 1 -- 172.21.15.2:0/1828748144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48640b5aa0 con 0x563c7da70860 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f4850ff9640 1 -- 172.21.15.2:0/1828748144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48640d3160 con 0x563c7da70860 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f48727ea740 10 client.18072 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f48727ea740 10 client.18072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f48727ea740 20 client.18072 populate_metadata read hostname 'smithi002' 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f48727ea740 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7daf2e20 0x563c7daf5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f48727ea740 4 client.18072 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c7d9e00f0 con 0x563c7daf2e20 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7daf2e20 0x563c7daf5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f486cfb1640 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7daf2e20 0x563c7daf5240 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd738aa8235dc1da server_cookie=f5a9fe030022c3fe in_seq=0 out_seq=0 2024-09-10T23:31:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.705+0000 7f4850ff9640 10 client.18072 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:59.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:31:59 smithi177 ceph-mon[35760]: pgmap v581: 97 pgs: 97 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.719+0000 7f4850ff9640 1 -- 172.21.15.2:0/1828748144 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c7d9e00f0 con 0x563c7daf2e20 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.719+0000 7f4850ff9640 10 client.18072 handle_command_reply: tid=0 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.719+0000 7f48727ea740 1 client.18072 shutdown 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.719+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 msgr2=0x563c7da81990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.719+0000 7f48727ea740 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da81990 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f48640abfd0 tx=0x7f486400f9a0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 shutdown_connections 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563c7daf2e20 0x563c7daf5240 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563c7da75bd0 0x563c7da80c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c7da73190 0x563c7da80690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f4850ff9640 0 client.18072 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 --2- 172.21.15.2:0/1828748144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c7da70860 0x563c7da81990 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 >> 172.21.15.2:0/1828748144 conn(0x563c7da6b9b0 msgr2=0x563c7da6ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 shutdown_connections 2024-09-10T23:31:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 1 -- 172.21.15.2:0/1828748144 wait complete. 2024-09-10T23:31:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f48727ea740 20 client.18072 trim_cache size 0 max 16384 2024-09-10T23:31:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:31:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:31:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:31:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f48540b5360 msgr2=0x7f48540b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f48540b5360 0x7f48540b7820 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4860009430 tx=0x7f4860009360 comp rx=0 tx=0).stop 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 msgr2=0x7f4868198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 0x7f4868198b90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f486400c920 tx=0x7f486400cde0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 shutdown_connections 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f48540b5360 0x7f48540b7820 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48681086a0 0x7f4868199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4868105af0 0x7f48681991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 --2- 172.21.15.2:0/484436724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f486806bfb0 0x7f4868198b90 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 >> 172.21.15.2:0/484436724 conn(0x7f48680fd170 msgr2=0x7f4868103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.720+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 shutdown_connections 2024-09-10T23:31:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:31:59.721+0000 7f486fa16640 1 -- 172.21.15.2:0/484436724 wait complete. 2024-09-10T23:31:59.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:31:59 smithi002 ceph-mon[31150]: pgmap v581: 97 pgs: 97 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:59.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:31:59 smithi154 ceph-mon[35136]: pgmap v581: 97 pgs: 97 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:00.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:32:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 -- 172.21.15.2:0/1023413626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74109170 msgr2=0x7f9f7410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/1023413626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74109170 0x7f9f7410f970 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009ca0 tx=0x7f9f6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 -- 172.21.15.2:0/1023413626 shutdown_connections 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/1023413626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74109170 0x7f9f7410f970 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/1023413626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f741087f0 0x7f9f74108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/1023413626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f74102de0 0x7f9f741031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 -- 172.21.15.2:0/1023413626 >> 172.21.15.2:0/1023413626 conn(0x7f9f740fe830 msgr2=0x7f9f74100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 -- 172.21.15.2:0/1023413626 shutdown_connections 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.131+0000 7f9f7acb4640 1 -- 172.21.15.2:0/1023413626 wait complete. 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 Processor -- start 2024-09-10T23:32:01.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 -- start start 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 0x7f9f74199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f741087f0 0x7f9f74199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f74109170 0x7f9f7419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74112e30 con 0x7f9f74102de0 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74112cb0 con 0x7f9f74109170 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f7acb4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74112fb0 con 0x7f9f741087f0 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f78a50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 0x7f9f74199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f78a50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 0x7f9f74199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40888/0 (socket says 172.21.15.2:40888) 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.132+0000 7f9f78a50640 1 -- 172.21.15.2:0/169404904 learned_addr learned my addr 172.21.15.2:0/169404904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f73fff640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f741087f0 0x7f9f74199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f79251640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f74109170 0x7f9f7419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f78a50640 1 -- 172.21.15.2:0/169404904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f741087f0 msgr2=0x7f9f74199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f78a50640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f741087f0 0x7f9f74199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f78a50640 1 -- 172.21.15.2:0/169404904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f74109170 msgr2=0x7f9f7419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f78a50640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f74109170 0x7f9f7419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f78a50640 1 -- 172.21.15.2:0/169404904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7419f2f0 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f78a50640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 0x7f9f74199240 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800e9f0 tx=0x7f9f6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f71ffb640 1 -- 172.21.15.2:0/169404904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800cd80 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f71ffb640 1 -- 172.21.15.2:0/169404904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f680054d0 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7419f5e0 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f71ffb640 1 -- 172.21.15.2:0/169404904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68010690 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.133+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741a5ca0 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.136+0000 7f9f7d089740 1 Processor -- start 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.136+0000 7f9f7d089740 1 -- start start 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.136+0000 7f9f71ffb640 1 -- 172.21.15.2:0/169404904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9f68004e90 con 0x7f9f74102de0 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa4174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa417a10 0x55c2fa427870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa427db0 0x55c2fa42a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f7d089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa38dea0 con 0x55c2fa4170f0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f7d089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa37d2d0 con 0x55c2fa417a10 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f7d089740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa3810e0 con 0x55c2fa427db0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa4174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa4174d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40896/0 (socket says 172.21.15.2:40896) 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 -- 172.21.15.2:0/2024131428 learned_addr learned my addr 172.21.15.2:0/2024131428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f73fff640 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa427db0 0x55c2fa42a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f78a50640 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa417a10 0x55c2fa427870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 -- 172.21.15.2:0/2024131428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa427db0 msgr2=0x55c2fa42a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa427db0 0x55c2fa42a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 -- 172.21.15.2:0/2024131428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa417a10 msgr2=0x55c2fa427870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa417a10 0x55c2fa427870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 -- 172.21.15.2:0/2024131428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fa0db650 con 0x55c2fa4170f0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f78a50640 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa417a10 0x55c2fa427870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.137+0000 7f9f79251640 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa4174d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009dc0 tx=0x7f9f6c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd798c7e780b2e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f5effd640 1 -- 172.21.15.2:0/2024131428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c031cf0 con 0x55c2fa4170f0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f5effd640 1 -- 172.21.15.2:0/2024131428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f6c036070 con 0x55c2fa4170f0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f5effd640 1 -- 172.21.15.2:0/2024131428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0042a0 con 0x55c2fa4170f0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f71ffb640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f640b5360 0x7f9f640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f78a50640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f640b5360 0x7f9f640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f71ffb640 1 -- 172.21.15.2:0/169404904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9f680e60e0 con 0x7f9f74102de0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 -- 172.21.15.2:0/2024131428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 msgr2=0x55c2fa4174d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa4174d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009dc0 tx=0x7f9f6c005ef0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f78a50640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f640b5360 0x7f9f640b7820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9f6801c000 tx=0x7f9f680eb040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 -- 172.21.15.2:0/2024131428 shutdown_connections 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa427db0 0x55c2fa42a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa417a10 0x55c2fa427870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 --2- 172.21.15.2:0/2024131428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa4174d0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 -- 172.21.15.2:0/2024131428 >> 172.21.15.2:0/2024131428 conn(0x55c2fa414f20 msgr2=0x55c2fa4160c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 -- 172.21.15.2:0/2024131428 shutdown_connections 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.138+0000 7f9f7d089740 1 -- 172.21.15.2:0/2024131428 wait complete. 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 -- start start 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 Processor -- start 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa4170f0 0x55c2fa4276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa424b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 0x55c2fa425110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa1de700 con 0x55c2fa427db0 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa318160 con 0x55c2fa4170f0 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa42aa00 con 0x55c2fa417a10 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f7d089740 10 client.0 _ll_register_callbacks cb 0x55c2fa3319e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f79251640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 0x55c2fa425110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f79251640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 0x55c2fa425110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40910/0 (socket says 172.21.15.2:40910) 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.139+0000 7f9f79251640 1 -- 172.21.15.2:0/1561299505 learned_addr learned my addr 172.21.15.2:0/1561299505 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa4170f0 0x55c2fa4276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f73fff640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa424b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 -- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 msgr2=0x55c2fa424b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa424b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 -- 172.21.15.2:0/1561299505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa4170f0 msgr2=0x55c2fa4276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa4170f0 0x55c2fa4276b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 -- 172.21.15.2:0/1561299505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fa345c90 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f79251640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 0x55c2fa425110 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009bf0 tx=0x7f9f6c009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3658cb6d2793f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f53fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f53fff640 1 -- 172.21.15.2:0/1561299505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c031450 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f53fff640 1 -- 172.21.15.2:0/1561299505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9f6c0315f0 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f6c036070 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f53fff640 1 -- 172.21.15.2:0/1561299505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f6c0317f0 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f7d089740 10 client.18084 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2fa436380 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.140+0000 7f9f53fff640 1 -- 172.21.15.2:0/1561299505 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f6c036070 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f53fff640 1 -- 172.21.15.2:0/1561299505 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f6c02f820 con 0x55c2fa427db0 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f7d089740 10 client.18084 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:01.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f7d089740 10 client.18084 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f7d089740 20 client.18084 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4376d0 0x55c2fa439ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f7d089740 4 client.18084 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2fa38fdf0 con 0x55c2fa4376d0 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f73fff640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4376d0 0x55c2fa439ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f73fff640 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4376d0 0x55c2fa439ac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1975b27396570ba7 server_cookie=9e22e487910a1511 in_seq=0 out_seq=0 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.141+0000 7f9f53fff640 10 client.18084 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f53fff640 1 -- 172.21.15.2:0/1561299505 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2fa38fdf0 con 0x55c2fa4376d0 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f53fff640 10 client.18084 handle_command_reply: tid=0 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 client.18084 shutdown 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 msgr2=0x55c2fa425110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 0x55c2fa425110 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009bf0 tx=0x7f9f6c009540 comp rx=0 tx=0).stop 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 shutdown_connections 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4376d0 0x55c2fa439ac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa427db0 0x55c2fa425110 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa424b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f53fff640 0 client.18084 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1561299505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa4170f0 0x55c2fa4276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.142+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 >> 172.21.15.2:0/1561299505 conn(0x55c2fa414f20 msgr2=0x55c2fa41aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.143+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 shutdown_connections 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.143+0000 7f9f7d089740 1 -- 172.21.15.2:0/1561299505 wait complete. 2024-09-10T23:32:01.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.143+0000 7f9f7d089740 20 client.18084 trim_cache size 0 max 16384 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 Processor -- start 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 -- start start 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa4170f0 0x55c2fa433cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 0x55c2fa414760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa43cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741ac030 con 0x55c2fa417a10 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741adb70 con 0x55c2fa427db0 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f7d089740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741ac700 con 0x55c2fa4170f0 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 0x55c2fa414760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 0x55c2fa414760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40922/0 (socket says 172.21.15.2:40922) 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f73fff640 1 -- 172.21.15.2:0/1836600737 learned_addr learned my addr 172.21.15.2:0/1836600737 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.156+0000 7f9f79251640 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa4170f0 0x55c2fa433cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f73fff640 1 -- 172.21.15.2:0/1836600737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa4170f0 msgr2=0x55c2fa433cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f73fff640 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa4170f0 0x55c2fa433cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f73fff640 1 -- 172.21.15.2:0/1836600737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 msgr2=0x55c2fa43cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f73fff640 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa43cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f73fff640 1 -- 172.21.15.2:0/1836600737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fa422a50 con 0x55c2fa417a10 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f79251640 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa4170f0 0x55c2fa433cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f73fff640 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 0x55c2fa414760 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x55c2fa38df30 tx=0x7f9f60010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42354eafeaadd7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f5e7fc640 1 -- 172.21.15.2:0/1836600737 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000cd90 con 0x55c2fa417a10 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f5e7fc640 1 -- 172.21.15.2:0/1836600737 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f600054d0 con 0x55c2fa417a10 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.157+0000 7f9f5e7fc640 1 -- 172.21.15.2:0/1836600737 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6001c430 con 0x55c2fa417a10 2024-09-10T23:32:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 -- 172.21.15.2:0/1836600737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 msgr2=0x55c2fa414760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 0x55c2fa414760 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x55c2fa38df30 tx=0x7f9f60010800 comp rx=0 tx=0).stop 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 -- 172.21.15.2:0/1836600737 shutdown_connections 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa43cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa417a10 0x55c2fa414760 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 --2- 172.21.15.2:0/1836600737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa4170f0 0x55c2fa433cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 -- 172.21.15.2:0/1836600737 >> 172.21.15.2:0/1836600737 conn(0x55c2fa414f20 msgr2=0x55c2fa415fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 -- 172.21.15.2:0/1836600737 shutdown_connections 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 -- 172.21.15.2:0/1836600737 wait complete. 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 -- start start 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.158+0000 7f9f7d089740 1 Processor -- start 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa43b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa43b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa4a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741ad4a0 con 0x55c2fa4170f0 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741acdd0 con 0x55c2fa427db0 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741aa030 con 0x55c2fa417a10 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f7d089740 10 client.0 _ll_register_callbacks cb 0x7f9f6000c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa43b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa43b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40932/0 (socket says 172.21.15.2:40932) 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 -- 172.21.15.2:0/720015258 learned_addr learned my addr 172.21.15.2:0/720015258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f73fff640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa43b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa4a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 -- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 msgr2=0x55c2fa43b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa43b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 -- 172.21.15.2:0/720015258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 msgr2=0x55c2fa4a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:01.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa4a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 -- 172.21.15.2:0/720015258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fa4a38b0 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f79251640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa43b2a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c030650 tx=0x7f9f6c0305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f656e115adf8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f53fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.159+0000 7f9f53fff640 1 -- 172.21.15.2:0/720015258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c031650 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f53fff640 1 -- 172.21.15.2:0/720015258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9f6c003970 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f600054d0 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f53fff640 1 -- 172.21.15.2:0/720015258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f6c02fe90 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 10 client.18090 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2fa4a4b90 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f53fff640 1 -- 172.21.15.2:0/720015258 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f600054d0 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f53fff640 1 -- 172.21.15.2:0/720015258 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f6c067030 con 0x55c2fa4170f0 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 10 client.18090 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 10 client.18090 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 20 client.18090 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4a5280 0x55c2fa4a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 4 client.18090 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2fa38b8a0 con 0x55c2fa4a5280 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.160+0000 7f9f73fff640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4a5280 0x55c2fa4a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f73fff640 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4a5280 0x55c2fa4a76a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6f50d6898b281aac server_cookie=a4570b118bd5dd52 in_seq=0 out_seq=0 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f53fff640 10 client.18090 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f53fff640 1 -- 172.21.15.2:0/720015258 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2fa38b8a0 con 0x55c2fa4a5280 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f53fff640 10 client.18090 handle_command_reply: tid=0 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 client.18090 shutdown 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 msgr2=0x55c2fa43b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa43b2a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c030650 tx=0x7f9f6c0305c0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 shutdown_connections 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55c2fa4a5280 0x55c2fa4a76a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2fa427db0 0x55c2fa4a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f53fff640 0 client.18090 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c2fa417a10 0x55c2fa43b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 --2- 172.21.15.2:0/720015258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2fa4170f0 0x55c2fa43b2a0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 >> 172.21.15.2:0/720015258 conn(0x55c2fa414f20 msgr2=0x55c2fa41a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 shutdown_connections 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 1 -- 172.21.15.2:0/720015258 wait complete. 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.161+0000 7f9f7d089740 20 client.18090 trim_cache size 0 max 16384 2024-09-10T23:32:01.169 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:01.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f640b5360 msgr2=0x7f9f640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f640b5360 0x7f9f640b7820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9f6801c000 tx=0x7f9f680eb040 comp rx=0 tx=0).stop 2024-09-10T23:32:01.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 msgr2=0x7f9f74199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 0x7f9f74199240 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800e9f0 tx=0x7f9f6800edf0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 shutdown_connections 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9f640b5360 0x7f9f640b7820 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f74109170 0x7f9f7419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f741087f0 0x7f9f74199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 --2- 172.21.15.2:0/169404904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f74102de0 0x7f9f74199240 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 >> 172.21.15.2:0/169404904 conn(0x7f9f740fe830 msgr2=0x7f9f74100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 shutdown_connections 2024-09-10T23:32:01.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:01.162+0000 7f9f7acb4640 1 -- 172.21.15.2:0/169404904 wait complete. 2024-09-10T23:32:01.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:01 smithi177 ceph-mon[35760]: pgmap v582: 97 pgs: 97 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:01.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:01 smithi002 ceph-mon[31150]: pgmap v582: 97 pgs: 97 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:01.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:01 smithi154 ceph-mon[35136]: pgmap v582: 97 pgs: 97 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:01.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:32:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.717+0000 7fe9a6e80640 1 -- 172.21.15.2:0/2187082901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0108060 msgr2=0x7fe9a010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.717+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/2187082901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0108060 0x7fe9a010e860 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe998009ca0 tx=0x7fe99802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 -- 172.21.15.2:0/2187082901 shutdown_connections 2024-09-10T23:32:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/2187082901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0108060 0x7fe9a010e860 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/2187082901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a01076e0 0x7fe9a0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/2187082901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0101cd0 0x7fe9a01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 -- 172.21.15.2:0/2187082901 >> 172.21.15.2:0/2187082901 conn(0x7fe9a00fd700 msgr2=0x7fe9a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 -- 172.21.15.2:0/2187082901 shutdown_connections 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 -- 172.21.15.2:0/2187082901 wait complete. 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 Processor -- start 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 -- start start 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 0x7fe9a00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.718+0000 7fe9a6e80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a01076e0 0x7fe9a00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a6e80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a0108060 0x7fe9a00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a6e80640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0111d60 con 0x7fe9a0101cd0 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a6e80640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0111be0 con 0x7fe9a0108060 2024-09-10T23:32:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a6e80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0111ee0 con 0x7fe9a01076e0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 0x7fe9a00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 0x7fe9a00fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40954/0 (socket says 172.21.15.2:40954) 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/1692465599 learned_addr learned my addr 172.21.15.2:0/1692465599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe99ffff640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a01076e0 0x7fe9a00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/1692465599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a01076e0 msgr2=0x7fe9a00fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a01076e0 0x7fe9a00fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/1692465599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a0108060 msgr2=0x7fe9a00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a0108060 0x7fe9a00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/1692465599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a01a7880 con 0x7fe9a0101cd0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 0x7fe9a00fdc00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe99000b4a0 tx=0x7fe99000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe99dffb640 1 -- 172.21.15.2:0/1692465599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990014070 con 0x7fe9a0101cd0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe99dffb640 1 -- 172.21.15.2:0/1692465599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe990010ac0 con 0x7fe9a0101cd0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a01a7b70 con 0x7fe9a0101cd0 2024-09-10T23:32:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.719+0000 7fe99dffb640 1 -- 172.21.15.2:0/1692465599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990017c30 con 0x7fe9a0101cd0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.720+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01a80b0 con 0x7fe9a0101cd0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe99dffb640 1 -- 172.21.15.2:0/1692465599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe990010610 con 0x7fe9a0101cd0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 Processor -- start 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 -- start start 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a5e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c979c8ea0 con 0x557c97a52df0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c979b82d0 con 0x557c97a5ed80 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.722+0000 7fe9a9255740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c979bc0e0 con 0x557c97a524d0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a5e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a541d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a5e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40970/0 (socket says 172.21.15.2:40970) 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/514075037 learned_addr learned my addr 172.21.15.2:0/514075037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe99ffff640 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/514075037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 msgr2=0x557c97a528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/514075037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 msgr2=0x557c97a61170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a61170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/514075037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c97716650 con 0x557c97a52df0 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe99dffb640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe9880b52e0 0x7fe9880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a541d640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe9880b52e0 0x7fe9880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a5e840 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe9900eb6d0 tx=0x7fe9900eb7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8415ecf366d6744 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe99dffb640 1 -- 172.21.15.2:0/1692465599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe9900e5560 con 0x7fe9a0101cd0 2024-09-10T23:32:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.723+0000 7fe986ffd640 1 -- 172.21.15.2:0/514075037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900a7bd0 con 0x557c97a52df0 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe986ffd640 1 -- 172.21.15.2:0/514075037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe990017360 con 0x557c97a52df0 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe986ffd640 1 -- 172.21.15.2:0/514075037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900ab4a0 con 0x557c97a52df0 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 -- 172.21.15.2:0/514075037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 msgr2=0x557c97a5e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a541d640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe9880b52e0 0x7fe9880b77a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe998009430 tx=0x7fe99802f3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a5e840 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe9900eb6d0 tx=0x7fe9900eb7c0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 -- 172.21.15.2:0/514075037 shutdown_connections 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a61170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a5e840 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 --2- 172.21.15.2:0/514075037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 -- 172.21.15.2:0/514075037 >> 172.21.15.2:0/514075037 conn(0x557c97a50300 msgr2=0x557c97a514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 -- 172.21.15.2:0/514075037 shutdown_connections 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.724+0000 7fe9a9255740 1 -- 172.21.15.2:0/514075037 wait complete. 2024-09-10T23:32:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 -- start start 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 Processor -- start 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 0x557c97a5e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a5baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a5c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c97819700 con 0x557c97a524d0 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c97953160 con 0x557c97a5ed80 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c97a61a00 con 0x557c97a52df0 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a9255740 10 client.0 _ll_register_callbacks cb 0x557c9796c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a4c1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 0x557c97a5e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a4c1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 0x557c97a5e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40976/0 (socket says 172.21.15.2:40976) 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.725+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/2977129849 learned_addr learned my addr 172.21.15.2:0/2977129849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe99ffff640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a5baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a541d640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a5c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/2977129849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 msgr2=0x557c97a5baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a5baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 msgr2=0x557c97a5c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a5c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a4c1c640 1 -- 172.21.15.2:0/2977129849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c97980c90 con 0x557c97a524d0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe99ffff640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a5baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 0x557c97a5e650 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe9900e30c0 tx=0x7fe9900a8230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a842b85e47a41ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe97ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe97ffff640 1 -- 172.21.15.2:0/2977129849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99001e030 con 0x557c97a524d0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe97ffff640 1 -- 172.21.15.2:0/2977129849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe990010c70 con 0x557c97a524d0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c979cadf0 con 0x557c97a524d0 2024-09-10T23:32:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe97ffff640 1 -- 172.21.15.2:0/2977129849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9900ab680 con 0x557c97a524d0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a9255740 10 client.18102 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c97a6d370 con 0x557c97a524d0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.726+0000 7fe97ffff640 1 -- 172.21.15.2:0/2977129849 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557c979cadf0 con 0x557c97a524d0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe97ffff640 1 -- 172.21.15.2:0/2977129849 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9900abf90 con 0x557c97a524d0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe9a9255740 10 client.18102 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe9a9255740 10 client.18102 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe9a9255740 20 client.18102 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe9a9255740 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97a6e6c0 0x557c97a70ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe9a9255740 4 client.18102 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c979c68a0 con 0x557c97a6e6c0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe99ffff640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97a6e6c0 0x557c97a70ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe99ffff640 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97a6e6c0 0x557c97a70ab0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14aa1e6486ba8d66 server_cookie=65f97a90a3d7101d in_seq=0 out_seq=0 2024-09-10T23:32:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.727+0000 7fe97ffff640 10 client.18102 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe97ffff640 1 -- 172.21.15.2:0/2977129849 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c979c68a0 con 0x557c97a6e6c0 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe97ffff640 10 client.18102 handle_command_reply: tid=0 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 client.18102 shutdown 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 msgr2=0x557c97a5e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 0x557c97a5e650 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe9900e30c0 tx=0x7fe9900a8230 comp rx=0 tx=0).stop 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 shutdown_connections 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a5c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a5baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97a6e6c0 0x557c97a70ab0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 --2- 172.21.15.2:0/2977129849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a524d0 0x557c97a5e650 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 >> 172.21.15.2:0/2977129849 conn(0x557c97a50300 msgr2=0x557c97a55ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.728+0000 7fe97ffff640 0 client.18102 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:02.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.729+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 shutdown_connections 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.729+0000 7fe9a9255740 1 -- 172.21.15.2:0/2977129849 wait complete. 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.729+0000 7fe9a9255740 20 client.18102 trim_cache size 0 max 16384 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 Processor -- start 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 -- start start 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a4fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a51350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a51890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01b0740 con 0x557c97a52df0 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01b2280 con 0x557c97a5ed80 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.742+0000 7fe9a9255740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01b0e10 con 0x557c97a524d0 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a51350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a51350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40984/0 (socket says 172.21.15.2:40984) 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 -- 172.21.15.2:0/1605618406 learned_addr learned my addr 172.21.15.2:0/1605618406 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a4fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe9a541d640 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a51890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 -- 172.21.15.2:0/1605618406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 msgr2=0x557c97a4fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a4fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 -- 172.21.15.2:0/1605618406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 msgr2=0x557c97a51890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a51890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 -- 172.21.15.2:0/1605618406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c97a4bbb0 con 0x557c97a52df0 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe9a541d640 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a51890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe99ffff640 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a51350 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe994004810 tx=0x7fe99400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283bfb9853162e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe9867fc640 1 -- 172.21.15.2:0/1605618406 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994021020 con 0x557c97a52df0 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe9867fc640 1 -- 172.21.15.2:0/1605618406 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe994017b70 con 0x557c97a52df0 2024-09-10T23:32:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.743+0000 7fe9867fc640 1 -- 172.21.15.2:0/1605618406 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99400f040 con 0x557c97a52df0 2024-09-10T23:32:02.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 -- 172.21.15.2:0/1605618406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 msgr2=0x557c97a51350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a51350 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe994004810 tx=0x7fe99400ee50 comp rx=0 tx=0).stop 2024-09-10T23:32:02.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 -- 172.21.15.2:0/1605618406 shutdown_connections 2024-09-10T23:32:02.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a5ed80 0x557c97a51890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a52df0 0x557c97a51350 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 --2- 172.21.15.2:0/1605618406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a524d0 0x557c97a4fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 -- 172.21.15.2:0/1605618406 >> 172.21.15.2:0/1605618406 conn(0x557c97a50300 msgr2=0x557c97a56cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 -- 172.21.15.2:0/1605618406 shutdown_connections 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 -- 172.21.15.2:0/1605618406 wait complete. 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 -- start start 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.744+0000 7fe9a9255740 1 Processor -- start 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a524d0 0x557c97a717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a71ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 0x557c97a72220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01b1bb0 con 0x557c97a5ed80 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01b14e0 con 0x557c97a524d0 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01ae720 con 0x557c97a52df0 2024-09-10T23:32:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a9255740 10 client.0 _ll_register_callbacks cb 0x7fe998009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 0x557c97a72220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 0x557c97a72220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40986/0 (socket says 172.21.15.2:40986) 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 -- 172.21.15.2:0/3123029081 learned_addr learned my addr 172.21.15.2:0/3123029081 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe99ffff640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a71ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a524d0 0x557c97a717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 -- 172.21.15.2:0/3123029081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 msgr2=0x557c97a71ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a71ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 -- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a524d0 msgr2=0x557c97a717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a524d0 0x557c97a717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a541d640 1 -- 172.21.15.2:0/3123029081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c97ada2b0 con 0x557c97a5ed80 2024-09-10T23:32:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a524d0 0x557c97a717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.745+0000 7fe99ffff640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a71ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a541d640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 0x557c97a72220 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe9980316d0 tx=0x7fe99803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0d9c04c8c81309 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe97ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe97ffff640 1 -- 172.21.15.2:0/3123029081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998054060 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe97ffff640 1 -- 172.21.15.2:0/3123029081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe9980047c0 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe994017b70 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe97ffff640 1 -- 172.21.15.2:0/3123029081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe998031910 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 10 client.18108 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c97adb5b0 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe97ffff640 1 -- 172.21.15.2:0/3123029081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe994017b70 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe97ffff640 1 -- 172.21.15.2:0/3123029081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe998043040 con 0x557c97a5ed80 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 10 client.18108 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:02.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 10 client.18108 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 20 client.18108 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97adbd90 0x557c97ade1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 4 client.18108 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.746+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c979c3cd0 con 0x557c97adbd90 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97adbd90 0x557c97ade1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe97ffff640 10 client.18108 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe9a4c1c640 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97adbd90 0x557c97ade1b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74471b9b7fb04cf7 server_cookie=57c67874ef041174 in_seq=0 out_seq=0 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe97ffff640 1 -- 172.21.15.2:0/3123029081 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c979c3cd0 con 0x557c97adbd90 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe97ffff640 10 client.18108 handle_command_reply: tid=0 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe9a9255740 1 client.18108 shutdown 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 msgr2=0x557c97a72220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.747+0000 7fe9a9255740 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 0x557c97a72220 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe9980316d0 tx=0x7fe99803e040 comp rx=0 tx=0).stop 2024-09-10T23:32:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 shutdown_connections 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x557c97adbd90 0x557c97ade1b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c97a5ed80 0x557c97a72220 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c97a52df0 0x557c97a71ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 --2- 172.21.15.2:0/3123029081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c97a524d0 0x557c97a717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe97ffff640 0 client.18108 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 >> 172.21.15.2:0/3123029081 conn(0x557c97a50300 msgr2=0x557c97a51350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 shutdown_connections 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 1 -- 172.21.15.2:0/3123029081 wait complete. 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a9255740 20 client.18108 trim_cache size 0 max 16384 2024-09-10T23:32:02.764 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe9880b52e0 msgr2=0x7fe9880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe9880b52e0 0x7fe9880b77a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe998009430 tx=0x7fe99802f3b0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 msgr2=0x7fe9a00fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 0x7fe9a00fdc00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe99000b4a0 tx=0x7fe99000b960 comp rx=0 tx=0).stop 2024-09-10T23:32:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 shutdown_connections 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe9880b52e0 0x7fe9880b77a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a0108060 0x7fe9a00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a01076e0 0x7fe9a00fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 --2- 172.21.15.2:0/1692465599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a0101cd0 0x7fe9a00fdc00 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.748+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 >> 172.21.15.2:0/1692465599 conn(0x7fe9a00fd700 msgr2=0x7fe9a006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.749+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 shutdown_connections 2024-09-10T23:32:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:02.749+0000 7fe9a6e80640 1 -- 172.21.15.2:0/1692465599 wait complete. 2024-09-10T23:32:03.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:32:03.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:03 smithi177 ceph-mon[35760]: pgmap v583: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:32:03.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:03 smithi002 ceph-mon[31150]: pgmap v583: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:32:03.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:03 smithi154 ceph-mon[35136]: pgmap v583: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:32:03.854 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 -- 172.21.15.2:0/740215797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 msgr2=0x7efd8c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 --2- 172.21.15.2:0/740215797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c1031a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7efd88009900 tx=0x7efd8802a410 comp rx=0 tx=0).stop 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 -- 172.21.15.2:0/740215797 shutdown_connections 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 --2- 172.21.15.2:0/740215797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 0x7efd8c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 --2- 172.21.15.2:0/740215797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 0x7efd8c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 --2- 172.21.15.2:0/740215797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c1031a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 -- 172.21.15.2:0/740215797 >> 172.21.15.2:0/740215797 conn(0x7efd8c0fe830 msgr2=0x7efd8c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 -- 172.21.15.2:0/740215797 shutdown_connections 2024-09-10T23:32:04.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 -- 172.21.15.2:0/740215797 wait complete. 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.345+0000 7efd934d1640 1 Processor -- start 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 -- start start 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 0x7efd8c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 0x7efd8c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c112e10 con 0x7efd8c102dc0 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c112c90 con 0x7efd8c1087d0 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd934d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c112f90 con 0x7efd8c109150 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40992/0 (socket says 172.21.15.2:40992) 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 -- 172.21.15.2:0/590187924 learned_addr learned my addr 172.21.15.2:0/590187924 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:04.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd91a6e640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 0x7efd8c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 -- 172.21.15.2:0/590187924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 msgr2=0x7efd8c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 0x7efd8c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd90a6c640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 0x7efd8c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 -- 172.21.15.2:0/590187924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 msgr2=0x7efd8c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 0x7efd8c199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 -- 172.21.15.2:0/590187924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c19f3b0 con 0x7efd8c102dc0 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd91a6e640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 0x7efd8c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd90a6c640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 0x7efd8c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.346+0000 7efd9126d640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c199300 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7efd88006010 tx=0x7efd880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.347+0000 7efd827fc640 1 -- 172.21.15.2:0/590187924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8803f030 con 0x7efd8c102dc0 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.347+0000 7efd827fc640 1 -- 172.21.15.2:0/590187924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd88003800 con 0x7efd8c102dc0 2024-09-10T23:32:04.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.347+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c19f640 con 0x7efd8c102dc0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.347+0000 7efd827fc640 1 -- 172.21.15.2:0/590187924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88035070 con 0x7efd8c102dc0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.347+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c1a5d60 con 0x7efd8c102dc0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 Processor -- start 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 -- start start 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127d74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd827fc640 1 -- 172.21.15.2:0/590187924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7efd88031b10 con 0x7efd8c102dc0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56351274dea0 con 0x5635127d70f0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56351273d2d0 con 0x5635127e39a0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd958a6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5635127410e0 con 0x5635127d7a10 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd91a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127d74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd91a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127d74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41002/0 (socket says 172.21.15.2:41002) 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.350+0000 7efd91a6e640 1 -- 172.21.15.2:0/3994193710 learned_addr learned my addr 172.21.15.2:0/3994193710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd90a6c640 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd9126d640 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd91a6e640 1 -- 172.21.15.2:0/3994193710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 msgr2=0x5635127e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd91a6e640 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd91a6e640 1 -- 172.21.15.2:0/3994193710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 msgr2=0x5635127e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd91a6e640 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd91a6e640 1 -- 172.21.15.2:0/3994193710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56351249b650 con 0x5635127d70f0 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd91a6e640 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127d74d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7efd84008dd0 tx=0x7efd8400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45516ff3b5d54496 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd777fe640 1 -- 172.21.15.2:0/3994193710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8400f830 con 0x5635127d70f0 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd777fe640 1 -- 172.21.15.2:0/3994193710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd8400de20 con 0x5635127d70f0 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd827fc640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd780b52e0 0x7efd780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd777fe640 1 -- 172.21.15.2:0/3994193710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8400ece0 con 0x5635127d70f0 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd9126d640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd780b52e0 0x7efd780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.351+0000 7efd827fc640 1 -- 172.21.15.2:0/590187924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efd88106600 con 0x7efd8c102dc0 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 -- 172.21.15.2:0/3994193710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 msgr2=0x5635127d74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd9126d640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd780b52e0 0x7efd780b77a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efd88104480 tx=0x7efd8802a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127d74d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7efd84008dd0 tx=0x7efd8400d710 comp rx=0 tx=0).stop 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 -- 172.21.15.2:0/3994193710 shutdown_connections 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 --2- 172.21.15.2:0/3994193710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127d74d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 -- 172.21.15.2:0/3994193710 >> 172.21.15.2:0/3994193710 conn(0x5635127d4f20 msgr2=0x5635127d60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 -- 172.21.15.2:0/3994193710 shutdown_connections 2024-09-10T23:32:04.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 -- 172.21.15.2:0/3994193710 wait complete. 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 -- start start 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.352+0000 7efd958a6740 1 Processor -- start 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127e3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56351259e700 con 0x5635127d70f0 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5635126d8160 con 0x5635127e39a0 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5635127e6620 con 0x5635127d7a10 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd958a6740 10 client.0 _ll_register_callbacks cb 0x5635126f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127e3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41010/0 (socket says 172.21.15.2:41010) 2024-09-10T23:32:04.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 -- 172.21.15.2:0/2285437900 learned_addr learned my addr 172.21.15.2:0/2285437900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 -- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 msgr2=0x5635127e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 -- 172.21.15.2:0/2285437900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 msgr2=0x5635127e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd91a6e640 1 -- 172.21.15.2:0/2285437900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563512705c90 con 0x5635127d70f0 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.353+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127e3210 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7efd8400e900 tx=0x7efd8400e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b266f764425eb4bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd74ff9640 1 -- 172.21.15.2:0/2285437900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8400f8f0 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd74ff9640 1 -- 172.21.15.2:0/2285437900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efd8400fa90 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd8400de20 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd74ff9640 1 -- 172.21.15.2:0/2285437900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd8400fc90 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 10 client.18120 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5635127f1f00 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd74ff9640 1 -- 172.21.15.2:0/2285437900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd8400de20 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd74ff9640 1 -- 172.21.15.2:0/2285437900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd8402b400 con 0x5635127d70f0 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 10 client.18120 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 10 client.18120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 20 client.18120 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635127f3710 0x5635127f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 4 client.18120 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.354+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56351274fdf0 con 0x5635127f3710 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.355+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635127f3710 0x5635127f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.355+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635127f3710 0x5635127f5b50 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a7f896d8c37570 server_cookie=35798e81290fee70 in_seq=0 out_seq=0 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.355+0000 7efd74ff9640 10 client.18120 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd74ff9640 1 -- 172.21.15.2:0/2285437900 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56351274fdf0 con 0x5635127f3710 2024-09-10T23:32:04.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd74ff9640 10 client.18120 handle_command_reply: tid=0 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 client.18120 shutdown 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 msgr2=0x5635127e3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127e3210 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7efd8400e900 tx=0x7efd8400e5e0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 shutdown_connections 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635127f3710 0x5635127f5b50 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127e39a0 0x5635127e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127d7a10 0x5635127e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd74ff9640 0 client.18120 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 --2- 172.21.15.2:0/2285437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d70f0 0x5635127e3210 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 >> 172.21.15.2:0/2285437900 conn(0x5635127d4f20 msgr2=0x5635127daa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 shutdown_connections 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 1 -- 172.21.15.2:0/2285437900 wait complete. 2024-09-10T23:32:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.356+0000 7efd958a6740 20 client.18120 trim_cache size 0 max 16384 2024-09-10T23:32:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 Processor -- start 2024-09-10T23:32:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 -- start start 2024-09-10T23:32:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127deee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127df420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c1ae3d0 con 0x5635127d7a10 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c1aff10 con 0x5635127d70f0 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.370+0000 7efd958a6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c1aeaa0 con 0x5635127e39a0 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127df420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127df420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41014/0 (socket says 172.21.15.2:41014) 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 -- 172.21.15.2:0/2565244348 learned_addr learned my addr 172.21.15.2:0/2565244348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 -- 172.21.15.2:0/2565244348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 msgr2=0x5635127e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 -- 172.21.15.2:0/2565244348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 msgr2=0x5635127deee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127deee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 -- 172.21.15.2:0/2565244348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635127d7840 con 0x5635127d7a10 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127df420 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x5635127f63d0 tx=0x7efd7c00a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68df7798ab011c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd76ffd640 1 -- 172.21.15.2:0/2565244348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c020020 con 0x5635127d7a10 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd76ffd640 1 -- 172.21.15.2:0/2565244348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd7c016ba0 con 0x5635127d7a10 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.371+0000 7efd76ffd640 1 -- 172.21.15.2:0/2565244348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c01cca0 con 0x5635127d7a10 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 -- 172.21.15.2:0/2565244348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 msgr2=0x5635127df420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127df420 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x5635127f63d0 tx=0x7efd7c00a780 comp rx=0 tx=0).stop 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 -- 172.21.15.2:0/2565244348 shutdown_connections 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127df420 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 --2- 172.21.15.2:0/2565244348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127deee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 -- 172.21.15.2:0/2565244348 >> 172.21.15.2:0/2565244348 conn(0x5635127d4f20 msgr2=0x5635127db910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 -- 172.21.15.2:0/2565244348 shutdown_connections 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 -- 172.21.15.2:0/2565244348 wait complete. 2024-09-10T23:32:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.372+0000 7efd958a6740 1 -- start start 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 Processor -- start 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127ec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c1af840 con 0x5635127d7a10 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c1af170 con 0x5635127d70f0 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c1ac3b0 con 0x5635127e39a0 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd958a6740 10 client.0 _ll_register_callbacks cb 0x7efd84008c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd90a6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd90a6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127ec150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41026/0 (socket says 172.21.15.2:41026) 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd90a6c640 1 -- 172.21.15.2:0/2951797482 learned_addr learned my addr 172.21.15.2:0/2951797482 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.373+0000 7efd90a6c640 1 -- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 msgr2=0x5635127e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd90a6c640 1 -- 172.21.15.2:0/2951797482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 msgr2=0x5635127ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd90a6c640 1 -- 172.21.15.2:0/2951797482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635127e7150 con 0x5635127d7a10 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd90a6c640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127ec150 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7efd7c008010 tx=0x7efd7c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684f63f6c71f532 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd74ff9640 1 -- 172.21.15.2:0/2951797482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c01c920 con 0x5635127d7a10 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd74ff9640 1 -- 172.21.15.2:0/2951797482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efd7c01cac0 con 0x5635127d7a10 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd7c016ba0 con 0x5635127d7a10 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd74ff9640 1 -- 172.21.15.2:0/2951797482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd7c01ccc0 con 0x5635127d7a10 2024-09-10T23:32:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd958a6740 10 client.18126 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563512861230 con 0x5635127d7a10 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.374+0000 7efd74ff9640 1 -- 172.21.15.2:0/2951797482 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd7c016ba0 con 0x5635127d7a10 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd74ff9640 1 -- 172.21.15.2:0/2951797482 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd7c025420 con 0x5635127d7a10 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd958a6740 10 client.18126 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd958a6740 10 client.18126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd958a6740 20 client.18126 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd958a6740 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635128619b0 0x563512863dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd958a6740 4 client.18126 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56351274b8a0 con 0x5635128619b0 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635128619b0 0x563512863dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd91a6e640 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635128619b0 0x563512863dd0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e08605cb7bc34d0 server_cookie=c71f0b0cf1a4357f in_seq=0 out_seq=0 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd74ff9640 10 client.18126 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.375+0000 7efd74ff9640 1 -- 172.21.15.2:0/2951797482 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56351274b8a0 con 0x5635128619b0 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd74ff9640 10 client.18126 handle_command_reply: tid=0 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 client.18126 shutdown 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 msgr2=0x5635127ec150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127ec150 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7efd7c008010 tx=0x7efd7c01c560 comp rx=0 tx=0).stop 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 shutdown_connections 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5635128619b0 0x563512863dd0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5635127e39a0 0x5635127e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd74ff9640 0 client.18126 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635127d7a10 0x5635127ec150 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 --2- 172.21.15.2:0/2951797482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635127d70f0 0x5635127ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 >> 172.21.15.2:0/2951797482 conn(0x5635127d4f20 msgr2=0x5635127deea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 shutdown_connections 2024-09-10T23:32:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 1 -- 172.21.15.2:0/2951797482 wait complete. 2024-09-10T23:32:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.376+0000 7efd958a6740 20 client.18126 trim_cache size 0 max 16384 2024-09-10T23:32:04.385 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd780b52e0 msgr2=0x7efd780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd780b52e0 0x7efd780b77a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efd88104480 tx=0x7efd8802a410 comp rx=0 tx=0).stop 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 msgr2=0x7efd8c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c199300 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7efd88006010 tx=0x7efd880042f0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 shutdown_connections 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd780b52e0 0x7efd780b77a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd8c109150 0x7efd8c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8c1087d0 0x7efd8c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 --2- 172.21.15.2:0/590187924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd8c102dc0 0x7efd8c199300 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 >> 172.21.15.2:0/590187924 conn(0x7efd8c0fe830 msgr2=0x7efd8c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 shutdown_connections 2024-09-10T23:32:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:04.377+0000 7efd934d1640 1 -- 172.21.15.2:0/590187924 wait complete. 2024-09-10T23:32:05.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:05 smithi177 ceph-mon[35760]: pgmap v584: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:05.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:05 smithi002 ceph-mon[31150]: pgmap v584: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:05.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:05 smithi154 ceph-mon[35136]: pgmap v584: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:06.183 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:32:06.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:32:06.458 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 -- 172.21.15.2:0/3918061676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 msgr2=0x7fb3d4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 --2- 172.21.15.2:0/3918061676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4102070 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009ca0 tx=0x7fb3c402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 -- 172.21.15.2:0/3918061676 shutdown_connections 2024-09-10T23:32:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 --2- 172.21.15.2:0/3918061676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d4108020 0x7fb3d410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 --2- 172.21.15.2:0/3918061676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d41076a0 0x7fb3d4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 --2- 172.21.15.2:0/3918061676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4102070 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 -- 172.21.15.2:0/3918061676 >> 172.21.15.2:0/3918061676 conn(0x7fb3d40fd700 msgr2=0x7fb3d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 -- 172.21.15.2:0/3918061676 shutdown_connections 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.001+0000 7fb3da061640 1 -- 172.21.15.2:0/3918061676 wait complete. 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 Processor -- start 2024-09-10T23:32:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 -- start start 2024-09-10T23:32:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d41076a0 0x7fb3d4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d4108020 0x7fb3d419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4111ce0 con 0x7fb3d4101c90 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4111b60 con 0x7fb3d41076a0 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3da061640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4111e60 con 0x7fb3d4108020 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41050/0 (socket says 172.21.15.2:41050) 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.002+0000 7fb3d37fe640 1 -- 172.21.15.2:0/3784582041 learned_addr learned my addr 172.21.15.2:0/3784582041 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d41076a0 0x7fb3d4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d37fe640 1 -- 172.21.15.2:0/3784582041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d4108020 msgr2=0x7fb3d419ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d4108020 0x7fb3d419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d4108020 0x7fb3d419ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d37fe640 1 -- 172.21.15.2:0/3784582041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d41076a0 msgr2=0x7fb3d4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d41076a0 0x7fb3d4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d37fe640 1 -- 172.21.15.2:0/3784582041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d419f3c0 con 0x7fb3d4101c90 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d41076a0 0x7fb3d4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d4108020 0x7fb3d419ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4199310 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb3c402ade0 tx=0x7fb3c4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d0ff9640 1 -- 172.21.15.2:0/3784582041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4003d60 con 0x7fb3d4101c90 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d0ff9640 1 -- 172.21.15.2:0/3784582041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3c40044f0 con 0x7fb3d4101c90 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d419f650 con 0x7fb3d4101c90 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3d0ff9640 1 -- 172.21.15.2:0/3784582041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c402fd10 con 0x7fb3d4101c90 2024-09-10T23:32:07.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.003+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d41a5df0 con 0x7fb3d4101c90 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3d0ff9640 1 -- 172.21.15.2:0/3784582041 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb3c4004040 con 0x7fb3d4101c90 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 Processor -- start 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 -- start start 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e71922f0 0x55d9e71926d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e7192c10 0x55d9e719e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9e7104e60 con 0x55d9e719eba0 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9e70f4290 con 0x55d9e71922f0 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3dc436740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9e70f80a0 con 0x55d9e7192c10 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71a0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41058/0 (socket says 172.21.15.2:41058) 2024-09-10T23:32:07.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2976556 learned_addr learned my addr 172.21.15.2:0/2976556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e71922f0 0x55d9e71926d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.006+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e7192c10 0x55d9e719e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2976556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e7192c10 msgr2=0x55d9e719e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e7192c10 0x55d9e719e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2976556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e71922f0 msgr2=0x55d9e71926d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e71922f0 0x55d9e71926d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2976556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e6e52930 con 0x55d9e719eba0 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d0ff9640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3c00b5360 0x7fb3c00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3c00b5360 0x7fb3c00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71a0f90 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00a9d0 tx=0x7fb3bc00ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9050ddb11eec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3d0ff9640 1 -- 172.21.15.2:0/3784582041 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb3c4107120 con 0x7fb3d4101c90 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3c9ffb640 1 -- 172.21.15.2:0/2976556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc015070 con 0x55d9e719eba0 2024-09-10T23:32:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3c9ffb640 1 -- 172.21.15.2:0/2976556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3bc00cc60 con 0x55d9e719eba0 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.007+0000 7fb3c9ffb640 1 -- 172.21.15.2:0/2976556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0185c0 con 0x55d9e719eba0 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 -- 172.21.15.2:0/2976556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 msgr2=0x55d9e71a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71a0f90 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00a9d0 tx=0x7fb3bc00ae90 comp rx=0 tx=0).stop 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3c00b5360 0x7fb3c00b7820 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00bba0 tx=0x7fb3cc005e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 -- 172.21.15.2:0/2976556 shutdown_connections 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71a0f90 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e7192c10 0x55d9e719e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2976556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e71922f0 0x55d9e71926d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 -- 172.21.15.2:0/2976556 >> 172.21.15.2:0/2976556 conn(0x55d9e7190120 msgr2=0x55d9e71912c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 -- 172.21.15.2:0/2976556 shutdown_connections 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 -- 172.21.15.2:0/2976556 wait complete. 2024-09-10T23:32:07.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.008+0000 7fb3dc436740 1 -- start start 2024-09-10T23:32:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 Processor -- start 2024-09-10T23:32:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e719bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e719c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e719c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9e6f55890 con 0x55d9e719eba0 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9e708ed40 con 0x55d9e7192c10 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9e71a1820 con 0x55d9e71922f0 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3dc436740 10 client.0 _ll_register_callbacks cb 0x55d9e70f2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e719c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e719bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e719c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41066/0 (socket says 172.21.15.2:41066) 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 -- 172.21.15.2:0/3720606412 learned_addr learned my addr 172.21.15.2:0/3720606412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:07.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e719c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 -- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 msgr2=0x55d9e719bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e719bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 -- 172.21.15.2:0/3720606412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 msgr2=0x55d9e719c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e719c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.009+0000 7fb3d3fff640 1 -- 172.21.15.2:0/3720606412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e71aac30 con 0x55d9e719eba0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e719c5d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc010a90 tx=0x7fb3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3341f755930843 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/3720606412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00dd40 con 0x55d9e719eba0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3bc00cc60 con 0x55d9e719eba0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/3720606412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb3cc01d420 con 0x55d9e719eba0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/3720606412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb3cc01d620 con 0x55d9e719eba0 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 10 client.18138 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:07.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9e71ad620 con 0x55d9e719eba0 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/3720606412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3bc00cc60 con 0x55d9e719eba0 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/3720606412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb3cc025840 con 0x55d9e719eba0 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 10 client.18138 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 10 client.18138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 20 client.18138 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e71aeb30 0x55d9e71b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 4 client.18138 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.010+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9e7106db0 con 0x55d9e71aeb30 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.011+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e71aeb30 0x55d9e71b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.011+0000 7fb3b2ffd640 10 client.18138 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.011+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e71aeb30 0x55d9e71b0f70 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e853b750ff0530dc server_cookie=9f35525c4e919317 in_seq=0 out_seq=0 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/3720606412 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9e7106db0 con 0x55d9e71aeb30 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3b2ffd640 10 client.18138 handle_command_reply: tid=0 2024-09-10T23:32:07.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 client.18138 shutdown 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 msgr2=0x55d9e719c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e719c5d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc010a90 tx=0x7fb3cc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 shutdown_connections 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e71aeb30 0x55d9e71b0f70 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e719c5d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e719c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 --2- 172.21.15.2:0/3720606412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e719bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 >> 172.21.15.2:0/3720606412 conn(0x55d9e7190120 msgr2=0x55d9e7195470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3b2ffd640 0 client.18138 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 shutdown_connections 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.012+0000 7fb3dc436740 1 -- 172.21.15.2:0/3720606412 wait complete. 2024-09-10T23:32:07.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.013+0000 7fb3dc436740 20 client.18138 trim_cache size 0 max 16384 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.030+0000 7fb3dc436740 1 Processor -- start 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.030+0000 7fb3dc436740 1 -- start start 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.030+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e718ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.030+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e7198d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71992a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3dc436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41ac200 con 0x55d9e719eba0 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3dc436740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41add40 con 0x55d9e7192c10 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3dc436740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41ac8d0 con 0x55d9e71922f0 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41068/0 (socket says 172.21.15.2:41068) 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 -- 172.21.15.2:0/930613271 learned_addr learned my addr 172.21.15.2:0/930613271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e718ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 -- 172.21.15.2:0/930613271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 msgr2=0x55d9e718ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e7198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e718ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 -- 172.21.15.2:0/930613271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 msgr2=0x55d9e7198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e7198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 -- 172.21.15.2:0/930613271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e7190ba0 con 0x55d9e719eba0 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e718ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71992a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc025c30 tx=0x7fb3cc00b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad24b2d55421b102 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3c97fa640 1 -- 172.21.15.2:0/930613271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00d780 con 0x55d9e719eba0 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3c97fa640 1 -- 172.21.15.2:0/930613271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3cc01d420 con 0x55d9e719eba0 2024-09-10T23:32:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.031+0000 7fb3c97fa640 1 -- 172.21.15.2:0/930613271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc01da20 con 0x55d9e719eba0 2024-09-10T23:32:07.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 -- 172.21.15.2:0/930613271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 msgr2=0x55d9e71992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71992a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc025c30 tx=0x7fb3cc00b9b0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 -- 172.21.15.2:0/930613271 shutdown_connections 2024-09-10T23:32:07.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e719eba0 0x55d9e71992a0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e7192c10 0x55d9e7198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 --2- 172.21.15.2:0/930613271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e718ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 -- 172.21.15.2:0/930613271 >> 172.21.15.2:0/930613271 conn(0x55d9e7190120 msgr2=0x55d9e718a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 -- 172.21.15.2:0/930613271 shutdown_connections 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 -- 172.21.15.2:0/930613271 wait complete. 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.032+0000 7fb3dc436740 1 -- start start 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 Processor -- start 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e71a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 0x55d9e71a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e719eba0 0x55d9e71a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41ad670 con 0x55d9e7192c10 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41acfa0 con 0x55d9e719eba0 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41aa1e0 con 0x55d9e71922f0 2024-09-10T23:32:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3dc436740 10 client.0 _ll_register_callbacks cb 0x7fb3cc00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 0x55d9e71a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 0x55d9e71a3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41084/0 (socket says 172.21.15.2:41084) 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2065273953 learned_addr learned my addr 172.21.15.2:0/2065273953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e71a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e719eba0 0x55d9e71a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 msgr2=0x55d9e71a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e71a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2065273953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e719eba0 msgr2=0x55d9e71a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e719eba0 0x55d9e71a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d2ffd640 1 -- 172.21.15.2:0/2065273953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e71a44a0 con 0x55d9e7192c10 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d3fff640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e719eba0 0x55d9e71a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.033+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e71a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:07.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3d2ffd640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 0x55d9e71a3750 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc004700 tx=0x7fb3bc00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c1f7a179ca408f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/2065273953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc015040 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/2065273953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb3bc011800 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3cc01d420 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/2065273953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb3bc011a00 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 10 client.18144 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9e721cab0 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/2065273953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3cc01d420 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/2065273953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb3bc024070 con 0x55d9e7192c10 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 10 client.18144 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 10 client.18144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 20 client.18144 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e721cfa0 0x55d9e721f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 4 client.18144 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:32:07.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.034+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d9e7102860 con 0x55d9e721cfa0 2024-09-10T23:32:07.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.035+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e721cfa0 0x55d9e721f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.035+0000 7fb3d37fe640 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e721cfa0 0x55d9e721f390 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe725ec813cb3ab server_cookie=e277c65b4123a1bd in_seq=0 out_seq=0 2024-09-10T23:32:07.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.035+0000 7fb3b2ffd640 10 client.18144 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3b2ffd640 1 -- 172.21.15.2:0/2065273953 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d9e7102860 con 0x55d9e721cfa0 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3b2ffd640 10 client.18144 handle_command_reply: tid=0 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 client.18144 shutdown 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 msgr2=0x55d9e71a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 0x55d9e71a3750 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc004700 tx=0x7fb3bc00cf80 comp rx=0 tx=0).stop 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 shutdown_connections 2024-09-10T23:32:07.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d9e721cfa0 0x55d9e721f390 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e719eba0 0x55d9e71a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3b2ffd640 0 client.18144 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9e7192c10 0x55d9e71a3750 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 --2- 172.21.15.2:0/2065273953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d9e71922f0 0x55d9e71a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 >> 172.21.15.2:0/2065273953 conn(0x55d9e7190120 msgr2=0x55d9e719d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 shutdown_connections 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 1 -- 172.21.15.2:0/2065273953 wait complete. 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.037+0000 7fb3dc436740 20 client.18144 trim_cache size 0 max 16384 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:32:07.042 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "22551de4-dce0-4301-af81-91cac1191329", 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3c00b5360 msgr2=0x7fb3c00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3c00b5360 0x7fb3c00b7820 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00bba0 tx=0x7fb3cc005e10 comp rx=0 tx=0).stop 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 msgr2=0x7fb3d4199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4199310 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb3c402ade0 tx=0x7fb3c4003970 comp rx=0 tx=0).stop 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 shutdown_connections 2024-09-10T23:32:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb3c00b5360 0x7fb3c00b7820 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3d4108020 0x7fb3d419ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d41076a0 0x7fb3d4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 --2- 172.21.15.2:0/3784582041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d4101c90 0x7fb3d4199310 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 >> 172.21.15.2:0/3784582041 conn(0x7fb3d40fd700 msgr2=0x7fb3d406adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 shutdown_connections 2024-09-10T23:32:07.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:07.038+0000 7fb3da061640 1 -- 172.21.15.2:0/3784582041 wait complete. 2024-09-10T23:32:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:07 smithi177 ceph-mon[35760]: pgmap v585: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:07 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:32:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:07.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:07 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:32:07.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:07.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:07 smithi002 ceph-mon[31150]: pgmap v585: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:07.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:07 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:32:07.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:07.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:07 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:32:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:07 smithi154 ceph-mon[35136]: pgmap v585: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:07 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:32:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:07 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:32:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:07.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:32:08.092 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:08.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:08 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 -- 172.21.15.2:0/424505152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 msgr2=0x7f53a41040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 --2- 172.21.15.2:0/424505152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a41040c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5394009900 tx=0x7f539402a410 comp rx=0 tx=0).stop 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 -- 172.21.15.2:0/424505152 shutdown_connections 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 --2- 172.21.15.2:0/424505152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a410d140 0x7f53a410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 --2- 172.21.15.2:0/424505152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 0x7f53a410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 --2- 172.21.15.2:0/424505152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a41040c0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 -- 172.21.15.2:0/424505152 >> 172.21.15.2:0/424505152 conn(0x7f53a40fd700 msgr2=0x7f53a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 -- 172.21.15.2:0/424505152 shutdown_connections 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 -- 172.21.15.2:0/424505152 wait complete. 2024-09-10T23:32:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.615+0000 7f53a9d12640 1 Processor -- start 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 -- start start 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a4101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 0x7f53a4101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a410d140 0x7f53a4102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112e90 con 0x7f53a4103ce0 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112d10 con 0x7f53a4104600 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a9d12640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4113010 con 0x7f53a410d140 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a4101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a4101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41102/0 (socket says 172.21.15.2:41102) 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 -- 172.21.15.2:0/3520157158 learned_addr learned my addr 172.21.15.2:0/3520157158 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a3fff640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a410d140 0x7f53a4102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 0x7f53a4101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 -- 172.21.15.2:0/3520157158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a410d140 msgr2=0x7f53a4102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a410d140 0x7f53a4102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 -- 172.21.15.2:0/3520157158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 msgr2=0x7f53a4101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 0x7f53a4101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a37fe640 1 -- 172.21.15.2:0/3520157158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a41a7820 con 0x7f53a4103ce0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.616+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 0x7f53a4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.617+0000 7f53a37fe640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a4101990 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5394006010 tx=0x7f53940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.617+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3520157158 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539403f030 con 0x7f53a4103ce0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.617+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3520157158 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5394003800 con 0x7f53a4103ce0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.617+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a41a7ab0 con 0x7f53a4103ce0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.617+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3520157158 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394035070 con 0x7f53a4103ce0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.617+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41a7fe0 con 0x7f53a4103ce0 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.619+0000 7f53ac0e7740 1 Processor -- start 2024-09-10T23:32:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.619+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3520157158 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5394031b10 con 0x7f53a4103ce0 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.619+0000 7f53ac0e7740 1 -- start start 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efcda480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efce6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efce6950 0x5638efce8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5638efc50e50 con 0x5638efcda0a0 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5638efc40280 con 0x5638efce6950 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5638efc44090 con 0x5638efcda9c0 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efcda480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efcda480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41110/0 (socket says 172.21.15.2:41110) 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 -- 172.21.15.2:0/1416803659 learned_addr learned my addr 172.21.15.2:0/1416803659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efce6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efce6950 0x5638efce8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a0ff9640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f538c0b5360 0x7f538c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 -- 172.21.15.2:0/1416803659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 msgr2=0x5638efce6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efce6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 -- 172.21.15.2:0/1416803659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efce6950 msgr2=0x5638efce8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efce6950 0x5638efce8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 -- 172.21.15.2:0/1416803659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638ef99e650 con 0x5638efcda0a0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a0ff9640 1 -- 172.21.15.2:0/3520157158 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5394106480 con 0x7f53a4103ce0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.620+0000 7f53a3fff640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f538c0b5360 0x7f538c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.621+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efcda480 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f539c00a400 tx=0x7f539c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a10f6fa774b595d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.621+0000 7f5389ffb640 1 -- 172.21.15.2:0/1416803659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c010b70 con 0x5638efcda0a0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.621+0000 7f5389ffb640 1 -- 172.21.15.2:0/1416803659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f539c010e50 con 0x5638efcda0a0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.621+0000 7f5389ffb640 1 -- 172.21.15.2:0/1416803659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c020390 con 0x5638efcda0a0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1416803659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 msgr2=0x5638efcda480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53a3fff640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f538c0b5360 0x7f538c0b7820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f539c01e000 tx=0x7f539c021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efcda480 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f539c00a400 tx=0x7f539c009650 comp rx=0 tx=0).stop 2024-09-10T23:32:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1416803659 shutdown_connections 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efce6950 0x5638efce8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efce6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1416803659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efcda480 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1416803659 >> 172.21.15.2:0/1416803659 conn(0x5638efcd7ed0 msgr2=0x5638efcd9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1416803659 shutdown_connections 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1416803659 wait complete. 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- start start 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 Processor -- start 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efce61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda9c0 0x5638efce3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5638efaa1700 con 0x5638efcda0a0 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5638efbdb110 con 0x5638efcda9c0 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.622+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5638efce95d0 con 0x5638efce6950 2024-09-10T23:32:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53ac0e7740 10 client.0 _ll_register_callbacks cb 0x5638efbf4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efce61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efce61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41112/0 (socket says 172.21.15.2:41112) 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 -- 172.21.15.2:0/1481213472 learned_addr learned my addr 172.21.15.2:0/1481213472 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda9c0 0x5638efce3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 -- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 msgr2=0x5638efce3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 -- 172.21.15.2:0/1481213472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda9c0 msgr2=0x5638efce3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda9c0 0x5638efce3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 -- 172.21.15.2:0/1481213472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638efc08c40 con 0x5638efcda0a0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efce61e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5394004650 tx=0x7f5394031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2ef3bb024de1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f5382ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f5382ffd640 1 -- 172.21.15.2:0/1481213472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394049040 con 0x5638efcda0a0 2024-09-10T23:32:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f5382ffd640 1 -- 172.21.15.2:0/1481213472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53940c8ec0 con 0x5638efcda0a0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f539c010e50 con 0x5638efcda0a0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f5382ffd640 1 -- 172.21.15.2:0/1481213472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53940cc5a0 con 0x5638efcda0a0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53ac0e7740 10 client.18156 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.623+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5638efcf4ea0 con 0x5638efcda0a0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f5382ffd640 1 -- 172.21.15.2:0/1481213472 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f539c010e50 con 0x5638efcda0a0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f5382ffd640 1 -- 172.21.15.2:0/1481213472 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53940cceb0 con 0x5638efcda0a0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53ac0e7740 10 client.18156 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53ac0e7740 10 client.18156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53ac0e7740 20 client.18156 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efcf62b0 0x5638efcf8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53ac0e7740 4 client.18156 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638efc52da0 con 0x5638efcf62b0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efcf62b0 0x5638efcf8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efcf62b0 0x5638efcf8750 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=572ebddf1ead5f7c server_cookie=5aea4ba1ac6f26af in_seq=0 out_seq=0 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.624+0000 7f5382ffd640 10 client.18156 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f5382ffd640 1 -- 172.21.15.2:0/1481213472 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638efc52da0 con 0x5638efcf62b0 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f5382ffd640 10 client.18156 handle_command_reply: tid=0 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 client.18156 shutdown 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 msgr2=0x5638efce61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efce61e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5394004650 tx=0x7f5394031ef0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 shutdown_connections 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efcf62b0 0x5638efcf8750 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda9c0 0x5638efce3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1481213472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda0a0 0x5638efce61e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 >> 172.21.15.2:0/1481213472 conn(0x5638efcd7ed0 msgr2=0x5638efcdda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.625+0000 7f5382ffd640 0 client.18156 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.626+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 shutdown_connections 2024-09-10T23:32:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.626+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1481213472 wait complete. 2024-09-10T23:32:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.626+0000 7f53ac0e7740 20 client.18156 trim_cache size 0 max 16384 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 Processor -- start 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 -- start start 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efce5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 0x5638efce7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41b0650 con 0x5638efcda9c0 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41b2190 con 0x5638efcda0a0 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.643+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41b0d20 con 0x5638efce6950 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 0x5638efce7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 0x5638efce7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41126/0 (socket says 172.21.15.2:41126) 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 -- 172.21.15.2:0/78138659 learned_addr learned my addr 172.21.15.2:0/78138659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a3fff640 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a37fe640 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efce5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 -- 172.21.15.2:0/78138659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 msgr2=0x5638efce8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 -- 172.21.15.2:0/78138659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 msgr2=0x5638efce5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efce5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 -- 172.21.15.2:0/78138659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638efce94b0 con 0x5638efcda9c0 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a37fe640 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efce5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 0x5638efce7d40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x5638efcf8f70 tx=0x7f5398008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a7ffc8b0785d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53897fa640 1 -- 172.21.15.2:0/78138659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398007d70 con 0x5638efcda9c0 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53897fa640 1 -- 172.21.15.2:0/78138659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5398014860 con 0x5638efcda9c0 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.644+0000 7f53897fa640 1 -- 172.21.15.2:0/78138659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398023490 con 0x5638efcda9c0 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 -- 172.21.15.2:0/78138659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 msgr2=0x5638efce7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 0x5638efce7d40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x5638efcf8f70 tx=0x7f5398008040 comp rx=0 tx=0).stop 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 -- 172.21.15.2:0/78138659 shutdown_connections 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efce6950 0x5638efce8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efcda9c0 0x5638efce7d40 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/78138659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efce5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 -- 172.21.15.2:0/78138659 >> 172.21.15.2:0/78138659 conn(0x5638efcd7ed0 msgr2=0x5638efce4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 -- 172.21.15.2:0/78138659 shutdown_connections 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 -- 172.21.15.2:0/78138659 wait complete. 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.645+0000 7f53ac0e7740 1 -- start start 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 Processor -- start 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efceead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efcef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 0x5638efcdf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41b1ac0 con 0x5638efce6950 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41b13f0 con 0x5638efcda0a0 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41ae630 con 0x5638efcda9c0 2024-09-10T23:32:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53ac0e7740 10 client.0 _ll_register_callbacks cb 0x7f5394005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 0x5638efcdf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 0x5638efcdf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41134/0 (socket says 172.21.15.2:41134) 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 -- 172.21.15.2:0/1212356425 learned_addr learned my addr 172.21.15.2:0/1212356425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efceead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a2ffd640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efcef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 -- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 msgr2=0x5638efcef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efcef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 -- 172.21.15.2:0/1212356425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 msgr2=0x5638efceead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.646+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efceead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f53a3fff640 1 -- 172.21.15.2:0/1212356425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638efce00a0 con 0x5638efce6950 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efceead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f53a3fff640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 0x5638efcdf870 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f539c006000 tx=0x7f539c0049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2246e933b1d569d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f5382ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f5382ffd640 1 -- 172.21.15.2:0/1212356425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c020390 con 0x5638efce6950 2024-09-10T23:32:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f5382ffd640 1 -- 172.21.15.2:0/1212356425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f539c021d40 con 0x5638efce6950 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5398014860 con 0x5638efce6950 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f5382ffd640 1 -- 172.21.15.2:0/1212356425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f539c010e50 con 0x5638efce6950 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f53ac0e7740 10 client.18162 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5638efce1320 con 0x5638efce6950 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.647+0000 7f5382ffd640 1 -- 172.21.15.2:0/1212356425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5398014860 con 0x5638efce6950 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f5382ffd640 1 -- 172.21.15.2:0/1212356425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f539c02a040 con 0x5638efce6950 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53ac0e7740 10 client.18162 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53ac0e7740 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53ac0e7740 20 client.18162 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efd641e0 0x5638efd665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53ac0e7740 4 client.18162 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5638efc4e850 con 0x5638efd641e0 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efd641e0 0x5638efd665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f53a37fe640 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efd641e0 0x5638efd665d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84b4cf1ee2771e5 server_cookie=d25a7c761bdbc45e in_seq=0 out_seq=0 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.648+0000 7f5382ffd640 10 client.18162 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f5382ffd640 1 -- 172.21.15.2:0/1212356425 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x5638efc4e850 con 0x5638efd641e0 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f5382ffd640 10 client.18162 handle_command_reply: tid=0 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 client.18162 shutdown 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 msgr2=0x5638efcdf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 0x5638efcdf870 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f539c006000 tx=0x7f539c0049c0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 shutdown_connections 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5638efd641e0 0x5638efd665d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f5382ffd640 0 client.18162 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638efce6950 0x5638efcdf870 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638efcda9c0 0x5638efcef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 --2- 172.21.15.2:0/1212356425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638efcda0a0 0x5638efceead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 >> 172.21.15.2:0/1212356425 conn(0x5638efcd7ed0 msgr2=0x5638efcd6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 shutdown_connections 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 1 -- 172.21.15.2:0/1212356425 wait complete. 2024-09-10T23:32:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.649+0000 7f53ac0e7740 20 client.18162 trim_cache size 0 max 16384 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:32:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:32:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:32:08.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f538c0b5360 msgr2=0x7f538c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f538c0b5360 0x7f538c0b7820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f539c01e000 tx=0x7f539c021000 comp rx=0 tx=0).stop 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 msgr2=0x7f53a4101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a4101990 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5394006010 tx=0x7f53940042f0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 shutdown_connections 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f538c0b5360 0x7f538c0b7820 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a410d140 0x7f53a4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a4104600 0x7f53a4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 --2- 172.21.15.2:0/3520157158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53a4103ce0 0x7f53a4101990 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 >> 172.21.15.2:0/3520157158 conn(0x7f53a40fd700 msgr2=0x7f53a40fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 shutdown_connections 2024-09-10T23:32:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:08.650+0000 7f53a9d12640 1 -- 172.21.15.2:0/3520157158 wait complete. 2024-09-10T23:32:08.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:08 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:32:08.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:08 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:32:09.473 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:32:09.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:32:09.735 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:10.159 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:09 smithi002 ceph-mon[31150]: pgmap v586: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:10.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:09 smithi177 ceph-mon[35760]: pgmap v586: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.242+0000 7f80b6010640 1 -- 172.21.15.2:0/623173168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b0101cd0 msgr2=0x7f80b01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.242+0000 7f80b6010640 1 --2- 172.21.15.2:0/623173168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b0101cd0 0x7f80b01020b0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009900 tx=0x7f80a002a410 comp rx=0 tx=0).stop 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 -- 172.21.15.2:0/623173168 shutdown_connections 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 --2- 172.21.15.2:0/623173168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80b0108060 0x7f80b010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 --2- 172.21.15.2:0/623173168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b01076e0 0x7f80b0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 --2- 172.21.15.2:0/623173168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b0101cd0 0x7f80b01020b0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 -- 172.21.15.2:0/623173168 >> 172.21.15.2:0/623173168 conn(0x7f80b00fd700 msgr2=0x7f80b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 -- 172.21.15.2:0/623173168 shutdown_connections 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 -- 172.21.15.2:0/623173168 wait complete. 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 Processor -- start 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.243+0000 7f80b6010640 1 -- start start 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80b6010640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80b0101cd0 0x7f80b0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80b6010640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 0x7f80b0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80b6010640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b0108060 0x7f80b019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80b6010640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80b0111d20 con 0x7f80b01076e0 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80b6010640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80b0111ba0 con 0x7f80b0108060 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80b6010640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80b0111ea0 con 0x7f80b0101cd0 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 0x7f80b0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80af7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80b0101cd0 0x7f80b0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 0x7f80b0199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41156/0 (socket says 172.21.15.2:41156) 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 -- 172.21.15.2:0/1790757307 learned_addr learned my addr 172.21.15.2:0/1790757307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80affff640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b0108060 0x7f80b019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 -- 172.21.15.2:0/1790757307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80b0101cd0 msgr2=0x7f80b0199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80b0101cd0 0x7f80b0199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 -- 172.21.15.2:0/1790757307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b0108060 msgr2=0x7f80b019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b0108060 0x7f80b019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 -- 172.21.15.2:0/1790757307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b019f2b0 con 0x7f80b01076e0 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.244+0000 7f80aeffd640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 0x7f80b0199740 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c920 tx=0x7f80a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.245+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4007c70 con 0x7f80b01076e0 2024-09-10T23:32:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.245+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4007e10 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.245+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b019f5a0 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.245+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4018820 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.245+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b01a5c60 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.246+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b01020b0 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.247+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f80a400f450 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.248+0000 7f80acff9640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80980b52e0 0x7f80980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.248+0000 7f80af7fe640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80980b52e0 0x7f80980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.248+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f80a40e5fa0 con 0x7f80b01076e0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.249+0000 7f80af7fe640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80980b52e0 0x7f80980b77a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f80a0031440 tx=0x7f80a0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.251+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80a4014030 con 0x7f80b01076e0 2024-09-10T23:32:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:09 smithi154 ceph-mon[35136]: pgmap v586: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:10.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.474+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80b01a5f80 con 0x7f80b01076e0 2024-09-10T23:32:10.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.475+0000 7f80acff9640 1 -- 172.21.15.2:0/1790757307 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f80a40acf00 con 0x7f80b01076e0 2024-09-10T23:32:10.476 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:32:10.476 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:32:10.476 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:32:10.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80980b52e0 msgr2=0x7f80980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80980b52e0 0x7f80980b77a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f80a0031440 tx=0x7f80a0005b50 comp rx=0 tx=0).stop 2024-09-10T23:32:10.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 msgr2=0x7f80b0199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 0x7f80b0199740 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c920 tx=0x7f80a400cde0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 shutdown_connections 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80980b52e0 0x7f80980b77a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b0108060 0x7f80b019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b01076e0 0x7f80b0199740 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 --2- 172.21.15.2:0/1790757307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80b0101cd0 0x7f80b0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.477+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 >> 172.21.15.2:0/1790757307 conn(0x7f80b00fd700 msgr2=0x7f80b006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.478+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 shutdown_connections 2024-09-10T23:32:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:10.478+0000 7f80b6010640 1 -- 172.21.15.2:0/1790757307 wait complete. 2024-09-10T23:32:11.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1790757307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:32:11.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:32:11.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1790757307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:32:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1790757307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:32:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:11.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.919+0000 7f0b475e1640 1 -- 172.21.15.2:0/2570596197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40101870 msgr2=0x7f0b40101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.919+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2570596197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40101870 0x7f0b40101c50 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009900 tx=0x7f0b3c02a480 comp rx=0 tx=0).stop 2024-09-10T23:32:11.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 -- 172.21.15.2:0/2570596197 shutdown_connections 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2570596197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b4010f420 0x7f0b40111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2570596197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40102190 0x7f0b4010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2570596197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40101870 0x7f0b40101c50 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 -- 172.21.15.2:0/2570596197 >> 172.21.15.2:0/2570596197 conn(0x7f0b400fd720 msgr2=0x7f0b400ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 -- 172.21.15.2:0/2570596197 shutdown_connections 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 -- 172.21.15.2:0/2570596197 wait complete. 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 Processor -- start 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 -- start start 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40101870 0x7f0b4019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.920+0000 7f0b475e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b40102190 0x7f0b4019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b475e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 0x7f0b401a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b475e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40114f80 con 0x7f0b4010f420 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b475e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40114e00 con 0x7f0b40101870 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b475e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40115100 con 0x7f0b40102190 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 0x7f0b401a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 0x7f0b401a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53478/0 (socket says 172.21.15.2:53478) 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 -- 172.21.15.2:0/2386839784 learned_addr learned my addr 172.21.15.2:0/2386839784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b4537d640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40101870 0x7f0b4019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b40102190 0x7f0b4019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 -- 172.21.15.2:0/2386839784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b40102190 msgr2=0x7f0b4019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b40102190 0x7f0b4019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 -- 172.21.15.2:0/2386839784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40101870 msgr2=0x7f0b4019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40101870 0x7f0b4019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 -- 172.21.15.2:0/2386839784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b401a1580 con 0x7f0b4010f420 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b40102190 0x7f0b4019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b4537d640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40101870 0x7f0b4019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 0x7f0b401a0db0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800eaa0 tx=0x7f0b3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b367fc640 1 -- 172.21.15.2:0/2386839784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800cdb0 con 0x7f0b4010f420 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b367fc640 1 -- 172.21.15.2:0/2386839784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b38005020 con 0x7f0b4010f420 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b401a1870 con 0x7f0b4010f420 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.921+0000 7f0b367fc640 1 -- 172.21.15.2:0/2386839784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b380116d0 con 0x7f0b4010f420 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.922+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b401a7f30 con 0x7f0b4010f420 2024-09-10T23:32:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.924+0000 7f0b499b6740 1 Processor -- start 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.924+0000 7f0b367fc640 1 -- 172.21.15.2:0/2386839784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0b3800f040 con 0x7f0b4010f420 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.924+0000 7f0b499b6740 1 -- start start 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f955234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f95531d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b499b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557f95499ea0 con 0x557f95523a10 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b499b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f954892d0 con 0x557f9552f9a0 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b499b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f9548d0e0 con 0x557f955230f0 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53484/0 (socket says 172.21.15.2:53484) 2024-09-10T23:32:11.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 -- 172.21.15.2:0/1483687962 learned_addr learned my addr 172.21.15.2:0/1483687962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f955234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f95531d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 -- 172.21.15.2:0/1483687962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 msgr2=0x557f955234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f955234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 -- 172.21.15.2:0/1483687962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 msgr2=0x557f95531d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f95531d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 -- 172.21.15.2:0/1483687962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f951e7650 con 0x557f95523a10 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b367fc640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b2c0b5360 0x7f0b2c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.925+0000 7f0b4537d640 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552f460 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009900 tx=0x7f0b3c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becbf0bb032617f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b2c0b5360 0x7f0b2c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b367fc640 1 -- 172.21.15.2:0/2386839784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0b380e5a50 con 0x7f0b4010f420 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b2b7fe640 1 -- 172.21.15.2:0/1483687962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c03f070 con 0x557f95523a10 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b2b7fe640 1 -- 172.21.15.2:0/1483687962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b3c0316a0 con 0x557f95523a10 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b2b7fe640 1 -- 172.21.15.2:0/1483687962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c035070 con 0x557f95523a10 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b499b6740 1 -- 172.21.15.2:0/1483687962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 msgr2=0x557f9552f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552f460 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009900 tx=0x7f0b3c032cd0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b2c0b5360 0x7f0b2c0b7820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0b300058c0 tx=0x7f0b30005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b499b6740 1 -- 172.21.15.2:0/1483687962 shutdown_connections 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.926+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f95531d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552f460 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1483687962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f955234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- 172.21.15.2:0/1483687962 >> 172.21.15.2:0/1483687962 conn(0x557f95520f20 msgr2=0x557f955220c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- 172.21.15.2:0/1483687962 shutdown_connections 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- 172.21.15.2:0/1483687962 wait complete. 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- start start 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 Processor -- start 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f9552f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f9552cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557f952ea700 con 0x557f95523a10 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f95424160 con 0x557f9552f9a0 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.927+0000 7f0b499b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f955325c0 con 0x557f955230f0 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b499b6740 10 client.0 _ll_register_callbacks cb 0x557f9543d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:11.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53500/0 (socket says 172.21.15.2:53500) 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 -- 172.21.15.2:0/541689161 learned_addr learned my addr 172.21.15.2:0/541689161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f9552cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b4537d640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f9552f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 -- 172.21.15.2:0/541689161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 msgr2=0x557f9552f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f9552f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 -- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 msgr2=0x557f9552cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f9552cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 -- 172.21.15.2:0/541689161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f95451c90 con 0x557f95523a10 2024-09-10T23:32:11.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552c6c0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0b300038a0 tx=0x7f0b3000c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae4ebb0aac873e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b28ff9640 1 -- 172.21.15.2:0/541689161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30025070 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b28ff9640 1 -- 172.21.15.2:0/541689161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0b30011d00 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.928+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b3c0316a0 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b28ff9640 1 -- 172.21.15.2:0/541689161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b30031050 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 10 client.18180 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f9553df60 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b28ff9640 1 -- 172.21.15.2:0/541689161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b3c0316a0 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b28ff9640 1 -- 172.21.15.2:0/541689161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0b3001d070 con 0x557f95523a10 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 10 client.18180 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:11.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 10 client.18180 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 20 client.18180 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f9553f410 0x557f955418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 4 client.18180 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f9549bdf0 con 0x557f9553f410 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.929+0000 7f0b4537d640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f9553f410 0x557f955418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.930+0000 7f0b28ff9640 10 client.18180 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.930+0000 7f0b4537d640 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f9553f410 0x557f955418b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=895323aabd4ae730 server_cookie=fbc75a8fcafcfa5 in_seq=0 out_seq=0 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b28ff9640 1 -- 172.21.15.2:0/541689161 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f9549bdf0 con 0x557f9553f410 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b28ff9640 10 client.18180 handle_command_reply: tid=0 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 client.18180 shutdown 2024-09-10T23:32:11.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 msgr2=0x557f9552c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552c6c0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0b300038a0 tx=0x7f0b3000c6f0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 shutdown_connections 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f9553f410 0x557f955418b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f9552f9a0 0x557f9552cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b28ff9640 0 client.18180 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552c6c0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 --2- 172.21.15.2:0/541689161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f9552f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 >> 172.21.15.2:0/541689161 conn(0x557f95520f20 msgr2=0x557f95526ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 shutdown_connections 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 1 -- 172.21.15.2:0/541689161 wait complete. 2024-09-10T23:32:11.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.931+0000 7f0b499b6740 20 client.18180 trim_cache size 0 max 16384 2024-09-10T23:32:11.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 Processor -- start 2024-09-10T23:32:11.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 -- start start 2024-09-10T23:32:11.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f955230f0 0x557f9553b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f9552f9a0 0x557f955298d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401b0510 con 0x557f95523a10 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401b2050 con 0x557f955230f0 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b499b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401b0be0 con 0x557f9552f9a0 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53502/0 (socket says 172.21.15.2:53502) 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 -- 172.21.15.2:0/3420303120 learned_addr learned my addr 172.21.15.2:0/3420303120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b4537d640 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f955230f0 0x557f9553b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f9552f9a0 0x557f955298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 -- 172.21.15.2:0/3420303120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f9552f9a0 msgr2=0x557f955298d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f9552f9a0 0x557f955298d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 -- 172.21.15.2:0/3420303120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f955230f0 msgr2=0x557f9553b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f955230f0 0x557f9553b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.945+0000 7f0b44b7c640 1 -- 172.21.15.2:0/3420303120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9552d010 con 0x557f95523a10 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.946+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552e400 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f0b30000c00 tx=0x7f0b30005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620f2d259c7eea2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.946+0000 7f0b2affd640 1 -- 172.21.15.2:0/3420303120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30025070 con 0x557f95523a10 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.946+0000 7f0b2affd640 1 -- 172.21.15.2:0/3420303120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b3000f680 con 0x557f95523a10 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.946+0000 7f0b2affd640 1 -- 172.21.15.2:0/3420303120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30019070 con 0x557f95523a10 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.946+0000 7f0b499b6740 1 -- 172.21.15.2:0/3420303120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 msgr2=0x557f9552e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.946+0000 7f0b499b6740 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552e400 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f0b30000c00 tx=0x7f0b30005690 comp rx=0 tx=0).stop 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- 172.21.15.2:0/3420303120 shutdown_connections 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f9552f9a0 0x557f955298d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f95523a10 0x557f9552e400 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 --2- 172.21.15.2:0/3420303120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f955230f0 0x557f9553b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- 172.21.15.2:0/3420303120 >> 172.21.15.2:0/3420303120 conn(0x557f95520f20 msgr2=0x557f9552dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- 172.21.15.2:0/3420303120 shutdown_connections 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- 172.21.15.2:0/3420303120 wait complete. 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- start start 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 Processor -- start 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f95533f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f95523a10 0x557f955344b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 0x557f955ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401b1980 con 0x557f9552f9a0 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401b12b0 con 0x557f95523a10 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.947+0000 7f0b499b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401ae4f0 con 0x557f955230f0 2024-09-10T23:32:11.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b499b6740 10 client.0 _ll_register_callbacks cb 0x7f0b3000c8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 0x557f955ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 0x557f955ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53512/0 (socket says 172.21.15.2:53512) 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 -- 172.21.15.2:0/1557916561 learned_addr learned my addr 172.21.15.2:0/1557916561 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b4537d640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f95533f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b44b7c640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f95523a10 0x557f955344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 -- 172.21.15.2:0/1557916561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 msgr2=0x557f95533f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f95533f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 -- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f95523a10 msgr2=0x557f955344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f95523a10 0x557f955344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 -- 172.21.15.2:0/1557916561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f955ab970 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b45b7e640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 0x557f955ab380 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0b380a89e0 tx=0x7f0b38005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff4ee6992cf9843 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b28ff9640 1 -- 172.21.15.2:0/1557916561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3801f040 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b28ff9640 1 -- 172.21.15.2:0/1557916561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0b380b5520 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.948+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b3000f680 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b28ff9640 1 -- 172.21.15.2:0/1557916561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b380ac920 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 10 client.18186 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f955acc70 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b28ff9640 1 -- 172.21.15.2:0/1557916561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b3000f680 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b28ff9640 1 -- 172.21.15.2:0/1557916561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0b380a7b70 con 0x557f9552f9a0 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 10 client.18186 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:11.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 10 client.18186 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 20 client.18186 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f955ad3a0 0x557f955af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 4 client.18186 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f954978a0 con 0x557f955ad3a0 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.952+0000 7f0b4537d640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f955ad3a0 0x557f955af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b4537d640 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f955ad3a0 0x557f955af7c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=117b965b4baa9c89 server_cookie=9a3a5c9072412a4 in_seq=0 out_seq=0 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b28ff9640 10 client.18186 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b28ff9640 1 -- 172.21.15.2:0/1557916561 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f954978a0 con 0x557f955ad3a0 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b28ff9640 10 client.18186 handle_command_reply: tid=0 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 client.18186 shutdown 2024-09-10T23:32:11.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 msgr2=0x557f955ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 0x557f955ab380 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0b380a89e0 tx=0x7f0b38005450 comp rx=0 tx=0).stop 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 shutdown_connections 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557f955ad3a0 0x557f955af7c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f9552f9a0 0x557f955ab380 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f95523a10 0x557f955344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 --2- 172.21.15.2:0/1557916561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f955230f0 0x557f95533f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 >> 172.21.15.2:0/1557916561 conn(0x557f95520f20 msgr2=0x557f9552e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b28ff9640 0 client.18186 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.953+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 shutdown_connections 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b499b6740 1 -- 172.21.15.2:0/1557916561 wait complete. 2024-09-10T23:32:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b499b6740 20 client.18186 trim_cache size 0 max 16384 2024-09-10T23:32:11.968 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:11.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b2c0b5360 msgr2=0x7f0b2c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b2c0b5360 0x7f0b2c0b7820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0b300058c0 tx=0x7f0b30005850 comp rx=0 tx=0).stop 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 msgr2=0x7f0b401a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 0x7f0b401a0db0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800eaa0 tx=0x7f0b3800ef60 comp rx=0 tx=0).stop 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 shutdown_connections 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0b2c0b5360 0x7f0b2c0b7820 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4010f420 0x7f0b401a0db0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b40102190 0x7f0b4019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 --2- 172.21.15.2:0/2386839784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b40101870 0x7f0b4019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 >> 172.21.15.2:0/2386839784 conn(0x7f0b400fd720 msgr2=0x7f0b40110770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 shutdown_connections 2024-09-10T23:32:11.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:11.954+0000 7f0b475e1640 1 -- 172.21.15.2:0/2386839784 wait complete. 2024-09-10T23:32:12.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:11 smithi177 ceph-mon[35760]: pgmap v587: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:11 smithi002 ceph-mon[31150]: pgmap v587: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:11 smithi154 ceph-mon[35136]: pgmap v587: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:12.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:32:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 -- 172.21.15.2:0/3049495599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff868103370 msgr2=0x7ff868109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/3049495599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff868103370 0x7ff868109cf0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ff860009cd0 tx=0x7ff86002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 -- 172.21.15.2:0/3049495599 shutdown_connections 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/3049495599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff868103370 0x7ff868109cf0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/3049495599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8681029b0 0x7ff868102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/3049495599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868101860 0x7ff868101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 -- 172.21.15.2:0/3049495599 >> 172.21.15.2:0/3049495599 conn(0x7ff8680fd140 msgr2=0x7ff8680ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 -- 172.21.15.2:0/3049495599 shutdown_connections 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.812+0000 7ff86e2e6640 1 -- 172.21.15.2:0/3049495599 wait complete. 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 Processor -- start 2024-09-10T23:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 -- start start 2024-09-10T23:32:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868101860 0x7ff86819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 0x7ff86819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868103370 0x7ff86819c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff86810d4d0 con 0x7ff8681029b0 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff86810d350 con 0x7ff868101860 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff86e2e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff86810d650 con 0x7ff868103370 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 0x7ff86819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 0x7ff86819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53532/0 (socket says 172.21.15.2:53532) 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.813+0000 7ff8677fe640 1 -- 172.21.15.2:0/174158591 learned_addr learned my addr 172.21.15.2:0/174158591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff867fff640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868101860 0x7ff86819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff86c883640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868103370 0x7ff86819c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8677fe640 1 -- 172.21.15.2:0/174158591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868103370 msgr2=0x7ff86819c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8677fe640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868103370 0x7ff86819c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8677fe640 1 -- 172.21.15.2:0/174158591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868101860 msgr2=0x7ff86819af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8677fe640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868101860 0x7ff86819af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8677fe640 1 -- 172.21.15.2:0/174158591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86819ca80 con 0x7ff8681029b0 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff86c883640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868103370 0x7ff86819c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8677fe640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 0x7ff86819b590 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00d950 tx=0x7ff85c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8657fa640 1 -- 172.21.15.2:0/174158591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c017070 con 0x7ff8681029b0 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8657fa640 1 -- 172.21.15.2:0/174158591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff85c009c30 con 0x7ff8681029b0 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff8657fa640 1 -- 172.21.15.2:0/174158591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00f620 con 0x7ff8681029b0 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86819cd70 con 0x7ff8681029b0 2024-09-10T23:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.814+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8681a3440 con 0x7ff8681029b0 2024-09-10T23:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 Processor -- start 2024-09-10T23:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 -- start start 2024-09-10T23:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8657fa640 1 -- 172.21.15.2:0/174158591 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff85c010460 con 0x7ff8681029b0 2024-09-10T23:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cbfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cc5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559234c2f6f0 con 0x559234cc2bd0 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559234c1eb20 con 0x559234cbd860 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8710bc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559234c22930 con 0x559234cc0190 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cc5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cc5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53536/0 (socket says 172.21.15.2:53536) 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.817+0000 7ff8677fe640 1 -- 172.21.15.2:0/2268489815 learned_addr learned my addr 172.21.15.2:0/2268489815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff86c883640 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cbfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff867fff640 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8677fe640 1 -- 172.21.15.2:0/2268489815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 msgr2=0x559234cc2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8677fe640 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8677fe640 1 -- 172.21.15.2:0/2268489815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 msgr2=0x559234cbfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8677fe640 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cbfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8677fe640 1 -- 172.21.15.2:0/2268489815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559234be4530 con 0x559234cc2bd0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8677fe640 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cc5090 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0ebc10 tx=0x7ff85c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdad50ab24749f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8657fa640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff8500b5360 0x7ff8500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff86c883640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff8500b5360 0x7ff8500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff84e7fc640 1 -- 172.21.15.2:0/2268489815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0f4070 con 0x559234cc2bd0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff8657fa640 1 -- 172.21.15.2:0/174158591 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff85c0e57e0 con 0x7ff8681029b0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff84e7fc640 1 -- 172.21.15.2:0/2268489815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff85c07aa00 con 0x559234cc2bd0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.818+0000 7ff84e7fc640 1 -- 172.21.15.2:0/2268489815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0a7e50 con 0x559234cc2bd0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 -- 172.21.15.2:0/2268489815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 msgr2=0x559234cc5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff86c883640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff8500b5360 0x7ff8500b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff86819bcc0 tx=0x7ff860009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cc5090 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0ebc10 tx=0x7ff85c0ed690 comp rx=0 tx=0).stop 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 -- 172.21.15.2:0/2268489815 shutdown_connections 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cc5090 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2268489815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cbfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 -- 172.21.15.2:0/2268489815 >> 172.21.15.2:0/2268489815 conn(0x559234cb89b0 msgr2=0x559234cb9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 -- 172.21.15.2:0/2268489815 shutdown_connections 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.819+0000 7ff8710bc740 1 -- 172.21.15.2:0/2268489815 wait complete. 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 -- start start 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 Processor -- start 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 0x559234cc6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cc2bd0 0x559234cc8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559234b56ab0 con 0x559234cbd860 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559234bc4730 con 0x559234cc2bd0 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559234cc5bb0 con 0x559234cc0190 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8710bc740 10 client.0 _ll_register_callbacks cb 0x559234c186b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff867fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 0x559234cc6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff867fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 0x559234cc6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53552/0 (socket says 172.21.15.2:53552) 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff867fff640 1 -- 172.21.15.2:0/6814181 learned_addr learned my addr 172.21.15.2:0/6814181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff8677fe640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.820+0000 7ff86c883640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cc2bd0 0x559234cc8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff867fff640 1 -- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 msgr2=0x559234cc75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff867fff640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff867fff640 1 -- 172.21.15.2:0/6814181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cc2bd0 msgr2=0x559234cc8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff867fff640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cc2bd0 0x559234cc8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff867fff640 1 -- 172.21.15.2:0/6814181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559234980790 con 0x559234cbd860 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff867fff640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 0x559234cc6f20 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff85800b920 tx=0x7ff85800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4470faa9992209b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8477fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8477fe640 1 -- 172.21.15.2:0/6814181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85801b440 con 0x559234cbd860 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8477fe640 1 -- 172.21.15.2:0/6814181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff858011440 con 0x559234cbd860 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85c07aa00 con 0x559234cbd860 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8477fe640 1 -- 172.21.15.2:0/6814181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff858011680 con 0x559234cbd860 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8710bc740 10 client.18198 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.821+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592349f9620 con 0x559234cbd860 2024-09-10T23:32:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8477fe640 1 -- 172.21.15.2:0/6814181 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff85c07aa00 con 0x559234cbd860 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8477fe640 1 -- 172.21.15.2:0/6814181 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff858019020 con 0x559234cbd860 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8710bc740 10 client.18198 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8710bc740 10 client.18198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8710bc740 20 client.18198 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8710bc740 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234cd27a0 0x559234cd4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8710bc740 4 client.18198 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559234c31640 con 0x559234cd27a0 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.822+0000 7ff8677fe640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234cd27a0 0x559234cd4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.823+0000 7ff8677fe640 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234cd27a0 0x559234cd4bd0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf7df85a10bb352 server_cookie=9534df07af6bf4e8 in_seq=0 out_seq=0 2024-09-10T23:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.823+0000 7ff8477fe640 10 client.18198 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.823+0000 7ff8477fe640 1 -- 172.21.15.2:0/6814181 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559234c31640 con 0x559234cd27a0 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.823+0000 7ff8477fe640 10 client.18198 handle_command_reply: tid=0 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.823+0000 7ff8710bc740 1 client.18198 shutdown 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 msgr2=0x559234cc6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 0x559234cc6f20 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff85800b920 tx=0x7ff85800bde0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 shutdown_connections 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234cd27a0 0x559234cd4bd0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cc2bd0 0x559234cc8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cc75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 --2- 172.21.15.2:0/6814181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cbd860 0x559234cc6f20 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 >> 172.21.15.2:0/6814181 conn(0x559234cb89b0 msgr2=0x559234cb7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8477fe640 0 client.18198 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 shutdown_connections 2024-09-10T23:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 1 -- 172.21.15.2:0/6814181 wait complete. 2024-09-10T23:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.824+0000 7ff8710bc740 20 client.18198 trim_cache size 0 max 16384 2024-09-10T23:32:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 Processor -- start 2024-09-10T23:32:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 -- start start 2024-09-10T23:32:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cb73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cb7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681ac170 con 0x559234cc2bd0 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681adcb0 con 0x559234cbd860 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.838+0000 7ff8710bc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681ac840 con 0x559234cc0190 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cba7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53554/0 (socket says 172.21.15.2:53554) 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 -- 172.21.15.2:0/4072420014 learned_addr learned my addr 172.21.15.2:0/4072420014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff8677fe640 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cb7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff867fff640 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cb73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 -- 172.21.15.2:0/4072420014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 msgr2=0x559234cb7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cb7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 -- 172.21.15.2:0/4072420014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 msgr2=0x559234cb73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cb73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 -- 172.21.15.2:0/4072420014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559234cbffc0 con 0x559234cc2bd0 2024-09-10T23:32:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff86c883640 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cba7e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff860009cd0 tx=0x7ff86003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c202ecef96048 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff84dffb640 1 -- 172.21.15.2:0/4072420014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860031530 con 0x559234cc2bd0 2024-09-10T23:32:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff84dffb640 1 -- 172.21.15.2:0/4072420014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff860055070 con 0x559234cc2bd0 2024-09-10T23:32:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.839+0000 7ff84dffb640 1 -- 172.21.15.2:0/4072420014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860030aa0 con 0x559234cc2bd0 2024-09-10T23:32:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 -- 172.21.15.2:0/4072420014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 msgr2=0x559234cba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cba7e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff860009cd0 tx=0x7ff86003f000 comp rx=0 tx=0).stop 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 -- 172.21.15.2:0/4072420014 shutdown_connections 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cba7e0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234cb7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 --2- 172.21.15.2:0/4072420014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234cb73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 -- 172.21.15.2:0/4072420014 >> 172.21.15.2:0/4072420014 conn(0x559234cb89b0 msgr2=0x559234cbcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 -- 172.21.15.2:0/4072420014 shutdown_connections 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 -- 172.21.15.2:0/4072420014 wait complete. 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.840+0000 7ff8710bc740 1 -- start start 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 Processor -- start 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234ccda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234ccdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681ad5e0 con 0x559234cc2bd0 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681acf10 con 0x559234cbd860 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681aa150 con 0x559234cc0190 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8710bc740 10 client.0 _ll_register_callbacks cb 0x7ff858004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53562/0 (socket says 172.21.15.2:53562) 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 -- 172.21.15.2:0/2605965428 learned_addr learned my addr 172.21.15.2:0/2605965428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff8677fe640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234ccdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff867fff640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234ccda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 -- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 msgr2=0x559234ccdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234ccdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 -- 172.21.15.2:0/2605965428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 msgr2=0x559234ccda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234ccda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff86c883640 1 -- 172.21.15.2:0/2605965428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559234cc8490 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.841+0000 7ff867fff640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234ccda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff86c883640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cce480 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff860031780 tx=0x7ff8600044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f321dca89bd9a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8477fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8477fe640 1 -- 172.21.15.2:0/2605965428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86005f020 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8477fe640 1 -- 172.21.15.2:0/2605965428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff8600307e0 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff860055070 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8477fe640 1 -- 172.21.15.2:0/2605965428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff860004640 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 10 client.18204 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559234d3f8f0 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8477fe640 1 -- 172.21.15.2:0/2605965428 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff860055070 con 0x559234cc2bd0 2024-09-10T23:32:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8477fe640 1 -- 172.21.15.2:0/2605965428 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff860030070 con 0x559234cc2bd0 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 10 client.18204 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 10 client.18204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 20 client.18204 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234d402d0 0x559234d426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 4 client.18204 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.842+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559234c2d0f0 con 0x559234d402d0 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.843+0000 7ff867fff640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234d402d0 0x559234d426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.843+0000 7ff867fff640 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234d402d0 0x559234d426f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7989a82992d99d68 server_cookie=f1a30d1448d70f6c in_seq=0 out_seq=0 2024-09-10T23:32:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.843+0000 7ff8477fe640 10 client.18204 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8477fe640 1 -- 172.21.15.2:0/2605965428 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559234c2d0f0 con 0x559234d402d0 2024-09-10T23:32:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8477fe640 10 client.18204 handle_command_reply: tid=0 2024-09-10T23:32:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 client.18204 shutdown 2024-09-10T23:32:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 msgr2=0x559234cce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cce480 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff860031780 tx=0x7ff8600044d0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 shutdown_connections 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559234d402d0 0x559234d426f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559234cc2bd0 0x559234cce480 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559234cc0190 0x559234ccdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8477fe640 0 client.18204 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 --2- 172.21.15.2:0/2605965428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559234cbd860 0x559234ccda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 >> 172.21.15.2:0/2605965428 conn(0x559234cb89b0 msgr2=0x559234cbd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 shutdown_connections 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 1 -- 172.21.15.2:0/2605965428 wait complete. 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.858+0000 7ff8710bc740 20 client.18204 trim_cache size 0 max 16384 2024-09-10T23:32:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:32:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:32:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:32:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:32:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff8500b5360 msgr2=0x7ff8500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff8500b5360 0x7ff8500b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff86819bcc0 tx=0x7ff860009360 comp rx=0 tx=0).stop 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 msgr2=0x7ff86819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 0x7ff86819b590 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00d950 tx=0x7ff85c00de10 comp rx=0 tx=0).stop 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 shutdown_connections 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff8500b5360 0x7ff8500b7820 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff868103370 0x7ff86819c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8681029b0 0x7ff86819b590 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 --2- 172.21.15.2:0/174158591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868101860 0x7ff86819af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 >> 172.21.15.2:0/174158591 conn(0x7ff8680fd140 msgr2=0x7ff8680feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 shutdown_connections 2024-09-10T23:32:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:12.859+0000 7ff86e2e6640 1 -- 172.21.15.2:0/174158591 wait complete. 2024-09-10T23:32:12.962 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:13.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 -- 172.21.15.2:0/1907353713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 msgr2=0x7f67c8107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 --2- 172.21.15.2:0/1907353713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8107af0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009900 tx=0x7f67b802a410 comp rx=0 tx=0).stop 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 -- 172.21.15.2:0/1907353713 shutdown_connections 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 --2- 172.21.15.2:0/1907353713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67c8108030 0x7f67c810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 --2- 172.21.15.2:0/1907353713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8107af0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 --2- 172.21.15.2:0/1907353713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c8101ca0 0x7f67c8102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 -- 172.21.15.2:0/1907353713 >> 172.21.15.2:0/1907353713 conn(0x7f67c80fd730 msgr2=0x7f67c80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 -- 172.21.15.2:0/1907353713 shutdown_connections 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.463+0000 7f67d0223640 1 -- 172.21.15.2:0/1907353713 wait complete. 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 Processor -- start 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 -- start start 2024-09-10T23:32:13.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c8101ca0 0x7f67c8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67c8108030 0x7f67c819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67c8111c80 con 0x7f67c81076b0 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67c8111b00 con 0x7f67c8101ca0 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67d0223640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f67c8111e00 con 0x7f67c8108030 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67cd7be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67cd7be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53576/0 (socket says 172.21.15.2:53576) 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67cd7be640 1 -- 172.21.15.2:0/3258115180 learned_addr learned my addr 172.21.15.2:0/3258115180 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.464+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c8101ca0 0x7f67c8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67c8108030 0x7f67c819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67cd7be640 1 -- 172.21.15.2:0/3258115180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67c8108030 msgr2=0x7f67c819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67cd7be640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67c8108030 0x7f67c819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67cd7be640 1 -- 172.21.15.2:0/3258115180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c8101ca0 msgr2=0x7f67c8198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67cd7be640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c8101ca0 0x7f67c8198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67cd7be640 1 -- 172.21.15.2:0/3258115180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c819e200 con 0x7f67c81076b0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67cd7be640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8198690 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005940 tx=0x7f67b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67beffd640 1 -- 172.21.15.2:0/3258115180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b803f030 con 0x7f67c81076b0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67beffd640 1 -- 172.21.15.2:0/3258115180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67b8003cb0 con 0x7f67c81076b0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c819e490 con 0x7f67c81076b0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67beffd640 1 -- 172.21.15.2:0/3258115180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b8035070 con 0x7f67c81076b0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.465+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c81a4bb0 con 0x7f67c81076b0 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.468+0000 7f67d25f8740 1 Processor -- start 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 -- start start 2024-09-10T23:32:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67beffd640 1 -- 172.21.15.2:0/3258115180 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f67b803bbf0 con 0x7f67c81076b0 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acda4d0 0x55cd0acda8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acdadf0 0x55cd0ace8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0aceb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ac50ea0 con 0x55cd0ace8f90 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ac402d0 con 0x55cd0acda4d0 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67d25f8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ac440e0 con 0x55cd0acdadf0 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0aceb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0aceb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53592/0 (socket says 172.21.15.2:53592) 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 -- 172.21.15.2:0/1803704445 learned_addr learned my addr 172.21.15.2:0/1803704445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acdadf0 0x55cd0ace8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acda4d0 0x55cd0acda8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 -- 172.21.15.2:0/1803704445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acdadf0 msgr2=0x55cd0ace8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acdadf0 0x55cd0ace8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 -- 172.21.15.2:0/1803704445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acda4d0 msgr2=0x55cd0acda8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acda4d0 0x55cd0acda8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cd7be640 1 -- 172.21.15.2:0/1803704445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0a99e650 con 0x55cd0ace8f90 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acdadf0 0x55cd0ace8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.469+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acda4d0 0x55cd0acda8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67cd7be640 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0aceb380 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f67b810cc40 tx=0x7f67b810cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d8e0d93fc36735 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67beffd640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67b40b52e0 0x7f67b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67b3fff640 1 -- 172.21.15.2:0/1803704445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b8115070 con 0x55cd0ace8f90 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67b40b52e0 0x7f67b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67b3fff640 1 -- 172.21.15.2:0/1803704445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67b80b2ae0 con 0x55cd0ace8f90 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67b3fff640 1 -- 172.21.15.2:0/1803704445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b80cc860 con 0x55cd0ace8f90 2024-09-10T23:32:13.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.470+0000 7f67beffd640 1 -- 172.21.15.2:0/3258115180 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f67b8106690 con 0x7f67c81076b0 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 -- 172.21.15.2:0/1803704445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 msgr2=0x55cd0aceb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67b40b52e0 0x7f67b40b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f67c0005fd0 tx=0x7f67c0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0aceb380 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f67b810cc40 tx=0x7f67b810cd30 comp rx=0 tx=0).stop 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 -- 172.21.15.2:0/1803704445 shutdown_connections 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0aceb380 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acdadf0 0x55cd0ace8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1803704445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acda4d0 0x55cd0acda8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 -- 172.21.15.2:0/1803704445 >> 172.21.15.2:0/1803704445 conn(0x55cd0acd8300 msgr2=0x55cd0acd94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 -- 172.21.15.2:0/1803704445 shutdown_connections 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 -- 172.21.15.2:0/1803704445 wait complete. 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 -- start start 2024-09-10T23:32:13.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.471+0000 7f67d25f8740 1 Processor -- start 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acda4d0 0x55cd0ace8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0ace6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd0aaa1700 con 0x55cd0ace8f90 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd0abdb160 con 0x55cd0acdadf0 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cd0aceba00 con 0x55cd0acda4d0 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67d25f8740 10 client.0 _ll_register_callbacks cb 0x55cd0abf49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0ace6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0ace6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53604/0 (socket says 172.21.15.2:53604) 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 -- 172.21.15.2:0/3715928569 learned_addr learned my addr 172.21.15.2:0/3715928569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acda4d0 0x55cd0ace8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67cd7be640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 -- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acda4d0 msgr2=0x55cd0ace8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acda4d0 0x55cd0ace8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 -- 172.21.15.2:0/3715928569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 msgr2=0x55cd0ace5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67ce7c0640 1 -- 172.21.15.2:0/3715928569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0ac08c90 con 0x55cd0ace8f90 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.472+0000 7f67cd7be640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0ace6110 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f67c0010710 tx=0x7f67c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481993fe6e21539f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67b17fa640 1 -- 172.21.15.2:0/3715928569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c001d910 con 0x55cd0ace8f90 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67b17fa640 1 -- 172.21.15.2:0/3715928569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f67c001dab0 con 0x55cd0ace8f90 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67b80b2ae0 con 0x55cd0ace8f90 2024-09-10T23:32:13.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67b17fa640 1 -- 172.21.15.2:0/3715928569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67c001dcb0 con 0x55cd0ace8f90 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 10 client.18216 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd0acf7210 con 0x55cd0ace8f90 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67b17fa640 1 -- 172.21.15.2:0/3715928569 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67b80b2ae0 con 0x55cd0ace8f90 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67b17fa640 1 -- 172.21.15.2:0/3715928569 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67c000f040 con 0x55cd0ace8f90 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 10 client.18216 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 10 client.18216 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 20 client.18216 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0acf8720 0x55cd0acfab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 4 client.18216 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.473+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd0ac52df0 con 0x55cd0acf8720 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.474+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0acf8720 0x55cd0acfab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.474+0000 7f67b17fa640 10 client.18216 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.474+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0acf8720 0x55cd0acfab10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fa153b8fa7a1ba49 server_cookie=fcdc4c92d2e13100 in_seq=0 out_seq=0 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67b17fa640 1 -- 172.21.15.2:0/3715928569 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd0ac52df0 con 0x55cd0acf8720 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67b17fa640 10 client.18216 handle_command_reply: tid=0 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 client.18216 shutdown 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 msgr2=0x55cd0ace6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0ace6110 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f67c0010710 tx=0x7f67c0004a40 comp rx=0 tx=0).stop 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 shutdown_connections 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0acf8720 0x55cd0acfab10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0ace8f90 0x55cd0ace6110 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 --2- 172.21.15.2:0/3715928569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0acda4d0 0x55cd0ace8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67b17fa640 0 client.18216 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 >> 172.21.15.2:0/3715928569 conn(0x55cd0acd8300 msgr2=0x55cd0acddea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 shutdown_connections 2024-09-10T23:32:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 1 -- 172.21.15.2:0/3715928569 wait complete. 2024-09-10T23:32:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.475+0000 7f67d25f8740 20 client.18216 trim_cache size 0 max 16384 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 Processor -- start 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 -- start start 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0ace4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0aceac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67c81ac100 con 0x55cd0acda4d0 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67c81adc40 con 0x55cd0acdadf0 2024-09-10T23:32:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67d25f8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f67c81ac7d0 con 0x55cd0ace8f90 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0ace4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0ace4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53618/0 (socket says 172.21.15.2:53618) 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 -- 172.21.15.2:0/1263002095 learned_addr learned my addr 172.21.15.2:0/1263002095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0aceac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 -- 172.21.15.2:0/1263002095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 msgr2=0x55cd0aceac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cd7be640 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0aceac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 -- 172.21.15.2:0/1263002095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 msgr2=0x55cd0ace49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 -- 172.21.15.2:0/1263002095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0ace8af0 con 0x55cd0acda4d0 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0aceac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.489+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0ace4470 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000c00 tx=0x7f67c400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b96e543d0f1869d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67b37fe640 1 -- 172.21.15.2:0/1263002095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4029070 con 0x55cd0acda4d0 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67b37fe640 1 -- 172.21.15.2:0/1263002095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67c4003d00 con 0x55cd0acda4d0 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67b37fe640 1 -- 172.21.15.2:0/1263002095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4024690 con 0x55cd0acda4d0 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 -- 172.21.15.2:0/1263002095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 msgr2=0x55cd0ace4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0ace4470 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000c00 tx=0x7f67c400b390 comp rx=0 tx=0).stop 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 -- 172.21.15.2:0/1263002095 shutdown_connections 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0aceac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0ace49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 --2- 172.21.15.2:0/1263002095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0ace4470 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 -- 172.21.15.2:0/1263002095 >> 172.21.15.2:0/1263002095 conn(0x55cd0acd8300 msgr2=0x55cd0ace9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 -- 172.21.15.2:0/1263002095 shutdown_connections 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.490+0000 7f67d25f8740 1 -- 172.21.15.2:0/1263002095 wait complete. 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 -- start start 2024-09-10T23:32:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 Processor -- start 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0acf0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0acf11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0acedc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67c81ad570 con 0x55cd0acda4d0 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67c81acea0 con 0x55cd0acdadf0 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f67c81aa0e0 con 0x55cd0ace8f90 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67d25f8740 10 client.0 _ll_register_callbacks cb 0x7f67c0009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67cdfbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0acf0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67cdfbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0acf0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53632/0 (socket says 172.21.15.2:53632) 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.491+0000 7f67cdfbf640 1 -- 172.21.15.2:0/364796584 learned_addr learned my addr 172.21.15.2:0/364796584 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67ce7c0640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0acedc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cd7be640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0acf11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cdfbf640 1 -- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 msgr2=0x55cd0acedc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0acedc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cdfbf640 1 -- 172.21.15.2:0/364796584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 msgr2=0x55cd0acf11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0acf11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cdfbf640 1 -- 172.21.15.2:0/364796584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0acee1e0 con 0x55cd0acda4d0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67cdfbf640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0acf0c50 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f67c4004010 tx=0x7f67c4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26ed7d64c7febb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67b17fa640 1 -- 172.21.15.2:0/364796584 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4029070 con 0x55cd0acda4d0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67b17fa640 1 -- 172.21.15.2:0/364796584 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f67c4005450 con 0x55cd0acda4d0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67c4003d00 con 0x55cd0acda4d0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67b17fa640 1 -- 172.21.15.2:0/364796584 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67c4005650 con 0x55cd0acda4d0 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67d25f8740 10 client.18222 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.492+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd0ad65e20 con 0x55cd0acda4d0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67b17fa640 1 -- 172.21.15.2:0/364796584 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67c4003d00 con 0x55cd0acda4d0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67b17fa640 1 -- 172.21.15.2:0/364796584 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67c4037080 con 0x55cd0acda4d0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67d25f8740 10 client.18222 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67d25f8740 10 client.18222 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67d25f8740 20 client.18222 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67d25f8740 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0ad663e0 0x55cd0ad687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67d25f8740 4 client.18222 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd0ac4e8a0 con 0x55cd0ad663e0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67cd7be640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0ad663e0 0x55cd0ad687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67b17fa640 10 client.18222 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.493+0000 7f67cd7be640 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0ad663e0 0x55cd0ad687d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=71d7b9b84c66d5da server_cookie=8a46f51e47f38e0d in_seq=0 out_seq=0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67b17fa640 1 -- 172.21.15.2:0/364796584 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd0ac4e8a0 con 0x55cd0ad663e0 2024-09-10T23:32:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67b17fa640 10 client.18222 handle_command_reply: tid=0 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 client.18222 shutdown 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 msgr2=0x55cd0acf0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0acf0c50 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f67c4004010 tx=0x7f67c4003b90 comp rx=0 tx=0).stop 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 shutdown_connections 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55cd0ad663e0 0x55cd0ad687d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cd0ace8f90 0x55cd0acedc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd0acdadf0 0x55cd0acf11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 --2- 172.21.15.2:0/364796584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0acda4d0 0x55cd0acf0c50 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67b17fa640 0 client.18222 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 >> 172.21.15.2:0/364796584 conn(0x55cd0acd8300 msgr2=0x55cd0ace9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 shutdown_connections 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 1 -- 172.21.15.2:0/364796584 wait complete. 2024-09-10T23:32:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.494+0000 7f67d25f8740 20 client.18222 trim_cache size 0 max 16384 2024-09-10T23:32:13.503 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67b40b52e0 msgr2=0x7f67b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67b40b52e0 0x7f67b40b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f67c0005fd0 tx=0x7f67c0009600 comp rx=0 tx=0).stop 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 msgr2=0x7f67c8198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8198690 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005940 tx=0x7f67b80042f0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 shutdown_connections 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f67b40b52e0 0x7f67b40b77a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67c8108030 0x7f67c819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c81076b0 0x7f67c8198690 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 --2- 172.21.15.2:0/3258115180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c8101ca0 0x7f67c8198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 >> 172.21.15.2:0/3258115180 conn(0x7f67c80fd730 msgr2=0x7f67c80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:13.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 shutdown_connections 2024-09-10T23:32:13.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:13.495+0000 7f67d0223640 1 -- 172.21.15.2:0/3258115180 wait complete. 2024-09-10T23:32:14.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:13 smithi177 ceph-mon[35760]: pgmap v588: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:32:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:13 smithi002 ceph-mon[31150]: pgmap v588: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:32:14.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:32:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:13 smithi154 ceph-mon[35136]: pgmap v588: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:32:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:14.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 -- 172.21.15.2:0/1930298733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c101076e0 msgr2=0x7f7c10107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1930298733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c101076e0 0x7f7c10107b20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009900 tx=0x7f7c0402a410 comp rx=0 tx=0).stop 2024-09-10T23:32:14.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 -- 172.21.15.2:0/1930298733 shutdown_connections 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1930298733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c10108060 0x7f7c1010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1930298733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c101076e0 0x7f7c10107b20 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1930298733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c10101cd0 0x7f7c101020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 -- 172.21.15.2:0/1930298733 >> 172.21.15.2:0/1930298733 conn(0x7f7c100fd700 msgr2=0x7f7c100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 -- 172.21.15.2:0/1930298733 shutdown_connections 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.939+0000 7f7c159cb640 1 -- 172.21.15.2:0/1930298733 wait complete. 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 Processor -- start 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 -- start start 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c10101cd0 0x7f7c101992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c101076e0 0x7f7c10199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 0x7f7c1019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10111ce0 con 0x7f7c10108060 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10111b60 con 0x7f7c10101cd0 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c159cb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10111e60 con 0x7f7c101076e0 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 0x7f7c1019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 0x7f7c1019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53658/0 (socket says 172.21.15.2:53658) 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/1074130171 learned_addr learned my addr 172.21.15.2:0/1074130171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.940+0000 7f7c0effd640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c10101cd0 0x7f7c101992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c101076e0 0x7f7c10199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/1074130171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c101076e0 msgr2=0x7f7c10199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c101076e0 0x7f7c10199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/1074130171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c10101cd0 msgr2=0x7f7c101992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c10101cd0 0x7f7c101992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/1074130171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1019f3a0 con 0x7f7c10108060 2024-09-10T23:32:14.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c101076e0 0x7f7c10199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 0x7f7c1019ebd0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800eaa0 tx=0x7f7c0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c149c9640 1 -- 172.21.15.2:0/1074130171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800cdb0 con 0x7f7c10108060 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c149c9640 1 -- 172.21.15.2:0/1074130171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c08005020 con 0x7f7c10108060 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c149c9640 1 -- 172.21.15.2:0/1074130171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c080116d0 con 0x7f7c10108060 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1019f690 con 0x7f7c10108060 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.941+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c101a5f20 con 0x7f7c10108060 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 Processor -- start 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c149c9640 1 -- 172.21.15.2:0/1074130171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7c0800f040 con 0x7f7c10108060 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 -- start start 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81894d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 0x55a1e8199870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8199db0 0x55a1e819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a1e80ffea0 con 0x55a1e8189a10 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a1e80ef2d0 con 0x55a1e81890f0 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c17da0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a1e80f30e0 con 0x55a1e8199db0 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 0x55a1e8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 0x55a1e8199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53664/0 (socket says 172.21.15.2:53664) 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c0effd640 1 -- 172.21.15.2:0/2196522683 learned_addr learned my addr 172.21.15.2:0/2196522683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81894d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.944+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8199db0 0x55a1e819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0effd640 1 -- 172.21.15.2:0/2196522683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8199db0 msgr2=0x55a1e819c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8199db0 0x55a1e819c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0effd640 1 -- 172.21.15.2:0/2196522683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 msgr2=0x55a1e81894d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81894d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0effd640 1 -- 172.21.15.2:0/2196522683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1e7e4d650 con 0x55a1e8189a10 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c149c9640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7bf80b5360 0x7f7bf80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 0x55a1e8199870 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000bd40 tx=0x7f7c000107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71b6294d1603b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7bf80b5360 0x7f7bf80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7c149c9640 1 -- 172.21.15.2:0/1074130171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7c080e5960 con 0x7f7c10108060 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7bf5ffb640 1 -- 172.21.15.2:0/2196522683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00004230 con 0x55a1e8189a10 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7bf5ffb640 1 -- 172.21.15.2:0/2196522683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c0000be30 con 0x55a1e8189a10 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.945+0000 7f7bf5ffb640 1 -- 172.21.15.2:0/2196522683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0001a7e0 con 0x55a1e8189a10 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 -- 172.21.15.2:0/2196522683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 msgr2=0x55a1e8199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7bf80b5360 0x7f7bf80b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c040096c0 tx=0x7f7c04031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 0x55a1e8199870 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000bd40 tx=0x7f7c000107a0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 -- 172.21.15.2:0/2196522683 shutdown_connections 2024-09-10T23:32:14.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8199db0 0x55a1e819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8189a10 0x55a1e8199870 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2196522683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 -- 172.21.15.2:0/2196522683 >> 172.21.15.2:0/2196522683 conn(0x55a1e8186f20 msgr2=0x55a1e81880c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 -- 172.21.15.2:0/2196522683 shutdown_connections 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 -- 172.21.15.2:0/2196522683 wait complete. 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.946+0000 7f7c17da0740 1 -- start start 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 Processor -- start 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e81890f0 0x55a1e81996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8189a10 0x55a1e8196b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e8197110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a1e7f50700 con 0x55a1e8199db0 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a1e808a160 con 0x55a1e8189a10 2024-09-10T23:32:14.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a1e819ca60 con 0x55a1e81890f0 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c17da0740 10 client.0 _ll_register_callbacks cb 0x55a1e80a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e8197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e8197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53680/0 (socket says 172.21.15.2:53680) 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/2760064718 learned_addr learned my addr 172.21.15.2:0/2760064718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e81890f0 0x55a1e81996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8189a10 0x55a1e8196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e81890f0 msgr2=0x55a1e81996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e81890f0 0x55a1e81996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/2760064718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8189a10 msgr2=0x55a1e8196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8189a10 0x55a1e8196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/2760064718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1e80b7c90 con 0x55a1e8199db0 2024-09-10T23:32:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.947+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8189a10 0x55a1e8196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e8197110 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7c080a8700 tx=0x7f7c080abd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47fb664a7438099 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7beeffd640 1 -- 172.21.15.2:0/2760064718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801f040 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7beeffd640 1 -- 172.21.15.2:0/2760064718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7c080054f0 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c0000be30 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7beeffd640 1 -- 172.21.15.2:0/2760064718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c080b0c10 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 10 client.18234 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1e81a8490 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7beeffd640 1 -- 172.21.15.2:0/2760064718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c0000be30 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7beeffd640 1 -- 172.21.15.2:0/2760064718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7c080971a0 con 0x55a1e8199db0 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 10 client.18234 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 10 client.18234 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:32:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 20 client.18234 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e81a9950 0x55a1e81abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 4 client.18234 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.948+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1e8101df0 con 0x55a1e81a9950 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.949+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e81a9950 0x55a1e81abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.949+0000 7f7beeffd640 10 client.18234 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.949+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e81a9950 0x55a1e81abda0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9928a26a111b669 server_cookie=81c671e38fa6a6ec in_seq=0 out_seq=0 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7beeffd640 1 -- 172.21.15.2:0/2760064718 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1e8101df0 con 0x55a1e81a9950 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7beeffd640 10 client.18234 handle_command_reply: tid=0 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 client.18234 shutdown 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 msgr2=0x55a1e8197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e8197110 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7c080a8700 tx=0x7f7c080abd00 comp rx=0 tx=0).stop 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 shutdown_connections 2024-09-10T23:32:14.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e81a9950 0x55a1e81abda0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e8197110 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8189a10 0x55a1e8196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2760064718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e81890f0 0x55a1e81996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7beeffd640 0 client.18234 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 >> 172.21.15.2:0/2760064718 conn(0x55a1e8186f20 msgr2=0x55a1e818ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 shutdown_connections 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 1 -- 172.21.15.2:0/2760064718 wait complete. 2024-09-10T23:32:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.950+0000 7f7c17da0740 20 client.18234 trim_cache size 0 max 16384 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.964+0000 7f7c17da0740 1 Processor -- start 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.964+0000 7f7c17da0740 1 -- start start 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 0x55a1e81a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8199db0 0x55a1e81b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c17da0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ac200 con 0x55a1e81890f0 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c17da0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101add40 con 0x55a1e8199db0 2024-09-10T23:32:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c17da0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ac8d0 con 0x55a1e8189a10 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 0x55a1e81a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 0x55a1e81a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53684/0 (socket says 172.21.15.2:53684) 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 -- 172.21.15.2:0/2173946834 learned_addr learned my addr 172.21.15.2:0/2173946834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8199db0 0x55a1e81b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 -- 172.21.15.2:0/2173946834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 msgr2=0x55a1e81883f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81883f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 -- 172.21.15.2:0/2173946834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8199db0 msgr2=0x55a1e81b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8199db0 0x55a1e81b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 -- 172.21.15.2:0/2173946834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1e8186d50 con 0x55a1e81890f0 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.965+0000 7f7c0effd640 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 0x55a1e81a5cc0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f7c00003e70 tx=0x7f7c00003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d6436f7471e4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7bf57fa640 1 -- 172.21.15.2:0/2173946834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00004080 con 0x55a1e81890f0 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7bf57fa640 1 -- 172.21.15.2:0/2173946834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c000054f0 con 0x55a1e81890f0 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7bf57fa640 1 -- 172.21.15.2:0/2173946834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00003ba0 con 0x55a1e81890f0 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 -- 172.21.15.2:0/2173946834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 msgr2=0x55a1e81a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 0x55a1e81a5cc0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f7c00003e70 tx=0x7f7c00003ea0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 -- 172.21.15.2:0/2173946834 shutdown_connections 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e8199db0 0x55a1e81b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81883f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 --2- 172.21.15.2:0/2173946834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e81890f0 0x55a1e81a5cc0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 -- 172.21.15.2:0/2173946834 >> 172.21.15.2:0/2173946834 conn(0x55a1e8186f20 msgr2=0x55a1e8187ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.966+0000 7f7c17da0740 1 -- 172.21.15.2:0/2173946834 shutdown_connections 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 -- 172.21.15.2:0/2173946834 wait complete. 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 -- start start 2024-09-10T23:32:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 Processor -- start 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ad670 con 0x55a1e8199db0 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101acfa0 con 0x55a1e81890f0 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101aa1e0 con 0x55a1e8189a10 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c17da0740 10 client.0 _ll_register_callbacks cb 0x7f7c08091f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.967+0000 7f7c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53692/0 (socket says 172.21.15.2:53692) 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/919620734 learned_addr learned my addr 172.21.15.2:0/919620734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0e7fc640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0effd640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 msgr2=0x55a1e81a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/919620734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 msgr2=0x55a1e81a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 -- 172.21.15.2:0/919620734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1e819f230 con 0x55a1e8199db0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c0f7fe640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e819ecf0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7c08097540 tx=0x7f7c08000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c89bdaafbe11c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7beeffd640 1 -- 172.21.15.2:0/919620734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801f050 con 0x55a1e8199db0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7beeffd640 1 -- 172.21.15.2:0/919620734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7c080a7bd0 con 0x55a1e8199db0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c000054f0 con 0x55a1e8199db0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7beeffd640 1 -- 172.21.15.2:0/919620734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c080a7fd0 con 0x55a1e8199db0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c17da0740 10 client.18240 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.968+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1e8217060 con 0x55a1e8199db0 2024-09-10T23:32:14.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7beeffd640 1 -- 172.21.15.2:0/919620734 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c000054f0 con 0x55a1e8199db0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7beeffd640 1 -- 172.21.15.2:0/919620734 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7c080aae00 con 0x55a1e8199db0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c17da0740 10 client.18240 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c17da0740 10 client.18240 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c17da0740 20 client.18240 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c17da0740 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e82177e0 0x55a1e8219c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c17da0740 4 client.18240 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1e80fd8a0 con 0x55a1e82177e0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.969+0000 7f7c0effd640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e82177e0 0x55a1e8219c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c0effd640 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e82177e0 0x55a1e8219c00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cc4f35cd977b184 server_cookie=83edcf2e53c4c02a in_seq=0 out_seq=0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7beeffd640 10 client.18240 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7beeffd640 1 -- 172.21.15.2:0/919620734 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1e80fd8a0 con 0x55a1e82177e0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7beeffd640 10 client.18240 handle_command_reply: tid=0 2024-09-10T23:32:14.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 client.18240 shutdown 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 msgr2=0x55a1e819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e819ecf0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7c08097540 tx=0x7f7c08000f40 comp rx=0 tx=0).stop 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 shutdown_connections 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55a1e82177e0 0x55a1e8219c00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a1e8199db0 0x55a1e819ecf0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a1e8189a10 0x55a1e81a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 --2- 172.21.15.2:0/919620734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a1e81890f0 0x55a1e81a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7beeffd640 0 client.18240 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 >> 172.21.15.2:0/919620734 conn(0x55a1e8186f20 msgr2=0x55a1e8198130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 shutdown_connections 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 1 -- 172.21.15.2:0/919620734 wait complete. 2024-09-10T23:32:14.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.970+0000 7f7c17da0740 20 client.18240 trim_cache size 0 max 16384 2024-09-10T23:32:14.978 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7bf80b5360 msgr2=0x7f7bf80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7bf80b5360 0x7f7bf80b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c040096c0 tx=0x7f7c04031400 comp rx=0 tx=0).stop 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 msgr2=0x7f7c1019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 0x7f7c1019ebd0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800eaa0 tx=0x7f7c0800ef60 comp rx=0 tx=0).stop 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 shutdown_connections 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7bf80b5360 0x7f7bf80b7820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10108060 0x7f7c1019ebd0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c101076e0 0x7f7c10199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 --2- 172.21.15.2:0/1074130171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c10101cd0 0x7f7c101992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 >> 172.21.15.2:0/1074130171 conn(0x7f7c100fd700 msgr2=0x7f7c1006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 shutdown_connections 2024-09-10T23:32:14.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:14.971+0000 7f7c159cb640 1 -- 172.21.15.2:0/1074130171 wait complete. 2024-09-10T23:32:15.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:32:15.990 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:16.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:15 smithi177 ceph-mon[35760]: pgmap v589: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-10T23:32:16.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:15 smithi002 ceph-mon[31150]: pgmap v589: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-10T23:32:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:15 smithi154 ceph-mon[35136]: pgmap v589: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-10T23:32:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 -- 172.21.15.2:0/2364314880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 msgr2=0x7f7904107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 --2- 172.21.15.2:0/2364314880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f7904107ae0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009900 tx=0x7f78f402a410 comp rx=0 tx=0).stop 2024-09-10T23:32:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 -- 172.21.15.2:0/2364314880 shutdown_connections 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 --2- 172.21.15.2:0/2364314880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 0x7f790410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 --2- 172.21.15.2:0/2364314880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f7904107ae0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 --2- 172.21.15.2:0/2364314880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 0x7f7904102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 -- 172.21.15.2:0/2364314880 >> 172.21.15.2:0/2364314880 conn(0x7f79040fd700 msgr2=0x7f79040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 -- 172.21.15.2:0/2364314880 shutdown_connections 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 -- 172.21.15.2:0/2364314880 wait complete. 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.483+0000 7f790b66b640 1 Processor -- start 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 -- start start 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 0x7f790419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f790419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 0x7f790419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7904111ce0 con 0x7f79041076a0 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7904111b60 con 0x7f7904101c90 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f790b66b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7904111e60 con 0x7f7904108020 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f790419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f790419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53702/0 (socket says 172.21.15.2:53702) 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 -- 172.21.15.2:0/3019566791 learned_addr learned my addr 172.21.15.2:0/3019566791 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7909407640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 0x7f790419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7909c08640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 0x7f790419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 -- 172.21.15.2:0/3019566791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 msgr2=0x7f790419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 0x7f790419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 -- 172.21.15.2:0/3019566791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 msgr2=0x7f790419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 0x7f790419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 -- 172.21.15.2:0/3019566791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041a54d0 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7909c08640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 0x7f790419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7909407640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 0x7f790419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.484+0000 7f7908c06640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f790419a630 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005940 tx=0x7f78f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.485+0000 7f78fa7fc640 1 -- 172.21.15.2:0/3019566791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f403f030 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.485+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79041a5760 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.485+0000 7f78fa7fc640 1 -- 172.21.15.2:0/3019566791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4003cb0 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.485+0000 7f78fa7fc640 1 -- 172.21.15.2:0/3019566791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4035070 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.485+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79041a5c40 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.487+0000 7f790da40740 1 Processor -- start 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.487+0000 7f790da40740 1 -- start start 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.487+0000 7f78fa7fc640 1 -- 172.21.15.2:0/3019566791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f78f403bb70 con 0x7f79041076a0 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f790da40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa207f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f790da40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa207fdf0 0x555aa208fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f790da40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa2090190 0x555aa2092580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f790da40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa1ff5ea0 con 0x555aa207f4d0 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f790da40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555aa1fe52d0 con 0x555aa207fdf0 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f790da40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555aa1fe90e0 con 0x555aa2090190 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa207f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa207f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53718/0 (socket says 172.21.15.2:53718) 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 -- 172.21.15.2:0/1873816912 learned_addr learned my addr 172.21.15.2:0/1873816912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7908c06640 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa2090190 0x555aa2092580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 -- 172.21.15.2:0/1873816912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa2090190 msgr2=0x555aa2092580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa2090190 0x555aa2092580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 -- 172.21.15.2:0/1873816912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa207fdf0 msgr2=0x555aa208fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909407640 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa207fdf0 0x555aa208fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa207fdf0 0x555aa208fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 -- 172.21.15.2:0/1873816912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa1d43650 con 0x555aa207f4d0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909407640 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa207fdf0 0x555aa208fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f7909c08640 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa207f8b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009f00 tx=0x7f78fc00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73330f9c6dc15726 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f78fa7fc640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78f00b52e0 0x7f78f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.488+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1873816912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc003b70 con 0x555aa207f4d0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f7909407640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78f00b52e0 0x7f78f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1873816912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc003d10 con 0x555aa207f4d0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1873816912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011a10 con 0x555aa207f4d0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f78fa7fc640 1 -- 172.21.15.2:0/3019566791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78f41067f0 con 0x7f79041076a0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 -- 172.21.15.2:0/1873816912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 msgr2=0x555aa207f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f7909407640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78f00b52e0 0x7f78f00b77a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7900005fd0 tx=0x7f7900005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa207f8b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009f00 tx=0x7f78fc00e6c0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 -- 172.21.15.2:0/1873816912 shutdown_connections 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa2090190 0x555aa2092580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa207fdf0 0x555aa208fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 --2- 172.21.15.2:0/1873816912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa207f8b0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 -- 172.21.15.2:0/1873816912 >> 172.21.15.2:0/1873816912 conn(0x555aa207d300 msgr2=0x555aa207e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.489+0000 7f790da40740 1 -- 172.21.15.2:0/1873816912 shutdown_connections 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.490+0000 7f790da40740 1 -- 172.21.15.2:0/1873816912 wait complete. 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.490+0000 7f790da40740 1 -- start start 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.490+0000 7f790da40740 1 Processor -- start 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.490+0000 7f790da40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa208f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.490+0000 7f790da40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207fdf0 0x555aa208cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f790da40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa208d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f790da40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa1e46700 con 0x555aa207f4d0 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f790da40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555aa1f80160 con 0x555aa2090190 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f790da40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555aa2092e40 con 0x555aa207fdf0 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f790da40740 10 client.0 _ll_register_callbacks cb 0x555aa1f999e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa208f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa208f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53720/0 (socket says 172.21.15.2:53720) 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 -- 172.21.15.2:0/2560192195 learned_addr learned my addr 172.21.15.2:0/2560192195 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7908c06640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207fdf0 0x555aa208cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909c08640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa208d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 -- 172.21.15.2:0/2560192195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207fdf0 msgr2=0x555aa208cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207fdf0 0x555aa208cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 -- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 msgr2=0x555aa208d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa208d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 -- 172.21.15.2:0/2560192195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa1fadc90 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909c08640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa208d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f7909407640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa208f900 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7900011490 tx=0x7f7900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60749b0c8d0de24c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f78ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f78ecff9640 1 -- 172.21.15.2:0/2560192195 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900022070 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f78ecff9640 1 -- 172.21.15.2:0/2560192195 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f790001e860 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.491+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78fc003d10 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f78ecff9640 1 -- 172.21.15.2:0/2560192195 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f790002e050 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 10 client.18252 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555aa209e680 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f78ecff9640 1 -- 172.21.15.2:0/2560192195 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc003d10 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f78ecff9640 1 -- 172.21.15.2:0/2560192195 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7900010a60 con 0x555aa207f4d0 2024-09-10T23:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 10 client.18252 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 10 client.18252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 20 client.18252 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa209fb30 0x555aa20a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 4 client.18252 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa1ff7df0 con 0x555aa209fb30 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.492+0000 7f7908c06640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa209fb30 0x555aa20a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.493+0000 7f7908c06640 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa209fb30 0x555aa20a1f80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da9bc69fe7aebafa server_cookie=3f8fdf7efef55c35 in_seq=0 out_seq=0 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.493+0000 7f78ecff9640 10 client.18252 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f78ecff9640 1 -- 172.21.15.2:0/2560192195 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555aa1ff7df0 con 0x555aa209fb30 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f78ecff9640 10 client.18252 handle_command_reply: tid=0 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 client.18252 shutdown 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 msgr2=0x555aa208f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa208f900 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7900011490 tx=0x7f7900004730 comp rx=0 tx=0).stop 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 shutdown_connections 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa208d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207fdf0 0x555aa208cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa209fb30 0x555aa20a1f80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 --2- 172.21.15.2:0/2560192195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207f4d0 0x555aa208f900 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f78ecff9640 0 client.18252 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 >> 172.21.15.2:0/2560192195 conn(0x555aa207d300 msgr2=0x555aa2082e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 shutdown_connections 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 1 -- 172.21.15.2:0/2560192195 wait complete. 2024-09-10T23:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.494+0000 7f790da40740 20 client.18252 trim_cache size 0 max 16384 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.507+0000 7f790da40740 1 Processor -- start 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.507+0000 7f790da40740 1 -- start start 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f790da40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa207eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f790da40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa20a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f790da40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f790da40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79041ac1c0 con 0x555aa207fdf0 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f790da40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79041add00 con 0x555aa2090190 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f790da40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79041ac890 con 0x555aa207f4d0 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa20a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa20a7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53732/0 (socket says 172.21.15.2:53732) 2024-09-10T23:32:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 -- 172.21.15.2:0/2351380960 learned_addr learned my addr 172.21.15.2:0/2351380960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7909407640 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa207eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7909c08640 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 -- 172.21.15.2:0/2351380960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 msgr2=0x555aa207eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa207eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 -- 172.21.15.2:0/2351380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 msgr2=0x555aa20a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20a7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 -- 172.21.15.2:0/2351380960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa208cba0 con 0x555aa207fdf0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.508+0000 7f7908c06640 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa20a7850 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f78f40ccf50 tx=0x7f78f4032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4977b49f7e3ebf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f78eeffd640 1 -- 172.21.15.2:0/2351380960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4049040 con 0x555aa207fdf0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f78eeffd640 1 -- 172.21.15.2:0/2351380960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f403b460 con 0x555aa207fdf0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f78eeffd640 1 -- 172.21.15.2:0/2351380960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f40d1aa0 con 0x555aa207fdf0 2024-09-10T23:32:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 -- 172.21.15.2:0/2351380960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 msgr2=0x555aa20a7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa20a7850 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f78f40ccf50 tx=0x7f78f4032f60 comp rx=0 tx=0).stop 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 -- 172.21.15.2:0/2351380960 shutdown_connections 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa20a7850 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 --2- 172.21.15.2:0/2351380960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa207eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 -- 172.21.15.2:0/2351380960 >> 172.21.15.2:0/2351380960 conn(0x555aa207d300 msgr2=0x555aa207e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.509+0000 7f790da40740 1 -- 172.21.15.2:0/2351380960 shutdown_connections 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 -- 172.21.15.2:0/2351380960 wait complete. 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 -- start start 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 Processor -- start 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa20982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa2098820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20950d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79041ad630 con 0x555aa207fdf0 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79041acf60 con 0x555aa2090190 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79041aa1a0 con 0x555aa207f4d0 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f790da40740 10 client.0 _ll_register_callbacks cb 0x7f7900015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.510+0000 7f7908c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa2098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa2098820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53736/0 (socket says 172.21.15.2:53736) 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 -- 172.21.15.2:0/704403244 learned_addr learned my addr 172.21.15.2:0/704403244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7909407640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa20982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7909c08640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 -- 172.21.15.2:0/704403244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 msgr2=0x555aa20982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa20982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 -- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 msgr2=0x555aa20950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 -- 172.21.15.2:0/704403244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa2095740 con 0x555aa207fdf0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f7908c06640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa2098820 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f78f403d040 tx=0x7f78f403bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc021293681de8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f78ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f78ecff9640 1 -- 172.21.15.2:0/704403244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4049070 con 0x555aa207fdf0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f78ecff9640 1 -- 172.21.15.2:0/704403244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f78f40cd420 con 0x555aa207fdf0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555aa1ff38a0 con 0x555aa207fdf0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f78ecff9640 1 -- 172.21.15.2:0/704403244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78f40cd6c0 con 0x555aa207fdf0 2024-09-10T23:32:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f790da40740 10 client.18258 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.511+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555aa210d3c0 con 0x555aa207fdf0 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f78ecff9640 1 -- 172.21.15.2:0/704403244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555aa1ff38a0 con 0x555aa207fdf0 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f78ecff9640 1 -- 172.21.15.2:0/704403244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78f40cf030 con 0x555aa207fdf0 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f790da40740 10 client.18258 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f790da40740 10 client.18258 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f790da40740 20 client.18258 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f790da40740 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa210dad0 0x555aa210fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f790da40740 4 client.18258 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555aa1ff0cd0 con 0x555aa210dad0 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f7909407640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa210dad0 0x555aa210fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f7909407640 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa210dad0 0x555aa210fef0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be42e04a381dc563 server_cookie=3fa590a51ee144ed in_seq=0 out_seq=0 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.512+0000 7f78ecff9640 10 client.18258 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f78ecff9640 1 -- 172.21.15.2:0/704403244 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555aa1ff0cd0 con 0x555aa210dad0 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f78ecff9640 10 client.18258 handle_command_reply: tid=0 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 client.18258 shutdown 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 msgr2=0x555aa2098820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa2098820 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f78f403d040 tx=0x7f78f403bed0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 shutdown_connections 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa2090190 0x555aa20950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x555aa210dad0 0x555aa210fef0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa207fdf0 0x555aa2098820 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 --2- 172.21.15.2:0/704403244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555aa207f4d0 0x555aa20982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f78ecff9640 0 client.18258 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 >> 172.21.15.2:0/704403244 conn(0x555aa207d300 msgr2=0x555aa207e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 shutdown_connections 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 1 -- 172.21.15.2:0/704403244 wait complete. 2024-09-10T23:32:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.513+0000 7f790da40740 20 client.18258 trim_cache size 0 max 16384 2024-09-10T23:32:16.521 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78f00b52e0 msgr2=0x7f78f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78f00b52e0 0x7f78f00b77a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7900005fd0 tx=0x7f7900005f60 comp rx=0 tx=0).stop 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 msgr2=0x7f790419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f790419a630 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005940 tx=0x7f78f40042f0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 shutdown_connections 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f78f00b52e0 0x7f78f00b77a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7904108020 0x7f790419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79041076a0 0x7f790419a630 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 --2- 172.21.15.2:0/3019566791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7904101c90 0x7f790419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 >> 172.21.15.2:0/3019566791 conn(0x7f79040fd700 msgr2=0x7f79040ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 shutdown_connections 2024-09-10T23:32:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:16.514+0000 7f790b66b640 1 -- 172.21.15.2:0/3019566791 wait complete. 2024-09-10T23:32:17.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:32:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:18.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 -- 172.21.15.2:0/1157528293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f630410f420 msgr2=0x7f6304111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 --2- 172.21.15.2:0/1157528293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f630410f420 0x7f6304111810 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009ca0 tx=0x7f62fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 -- 172.21.15.2:0/1157528293 shutdown_connections 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 --2- 172.21.15.2:0/1157528293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f630410f420 0x7f6304111810 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 --2- 172.21.15.2:0/1157528293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6304102190 0x7f630410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 --2- 172.21.15.2:0/1157528293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6304101870 0x7f6304101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 -- 172.21.15.2:0/1157528293 >> 172.21.15.2:0/1157528293 conn(0x7f63040fd700 msgr2=0x7f63040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 -- 172.21.15.2:0/1157528293 shutdown_connections 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.976+0000 7f630bcbd640 1 -- 172.21.15.2:0/1157528293 wait complete. 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 Processor -- start 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 -- start start 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 0x7f630419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6304102190 0x7f630419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f630410f420 0x7f63041a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6304114f80 con 0x7f6304101870 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6304114e00 con 0x7f6304102190 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f630bcbd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6304115100 con 0x7f630410f420 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f6309a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 0x7f630419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.977+0000 7f6309a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 0x7f630419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53760/0 (socket says 172.21.15.2:53760) 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 -- 172.21.15.2:0/485500116 learned_addr learned my addr 172.21.15.2:0/485500116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f630a25a640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f630410f420 0x7f63041a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309258640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6304102190 0x7f630419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 -- 172.21.15.2:0/485500116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f630410f420 msgr2=0x7f63041a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f630410f420 0x7f63041a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 -- 172.21.15.2:0/485500116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6304102190 msgr2=0x7f630419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6304102190 0x7f630419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 -- 172.21.15.2:0/485500116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63041a1520 con 0x7f6304101870 2024-09-10T23:32:18.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f6309a59640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 0x7f630419b470 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f630000d950 tx=0x7f630000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f62faffd640 1 -- 172.21.15.2:0/485500116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300017030 con 0x7f6304101870 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f62faffd640 1 -- 172.21.15.2:0/485500116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6300004020 con 0x7f6304101870 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63041a1810 con 0x7f6304101870 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f62faffd640 1 -- 172.21.15.2:0/485500116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000047a0 con 0x7f6304101870 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.978+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63041a7ed0 con 0x7f6304101870 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 Processor -- start 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f62faffd640 1 -- 172.21.15.2:0/485500116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6300009a30 con 0x7f6304101870 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 -- start start 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1d29a0 0x56326b1d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56326b13cea0 con 0x56326b1c60f0 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56326b12c2d0 con 0x56326b1c6a10 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630e092740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56326b1300e0 con 0x56326b1d29a0 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.981+0000 7f630a25a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53766/0 (socket says 172.21.15.2:53766) 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 -- 172.21.15.2:0/2283282504 learned_addr learned my addr 172.21.15.2:0/2283282504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f6309a59640 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f6309258640 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1d29a0 0x56326b1d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f62faffd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62f00b52e0 0x7f62f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 -- 172.21.15.2:0/2283282504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1d29a0 msgr2=0x56326b1d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1d29a0 0x56326b1d4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 -- 172.21.15.2:0/2283282504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 msgr2=0x56326b1d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1d2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 -- 172.21.15.2:0/2283282504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326ae8a650 con 0x56326b1c60f0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f6309258640 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1d29a0 0x56326b1d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f62faffd640 1 -- 172.21.15.2:0/485500116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63000e56a0 con 0x7f6304101870 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1c64d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6304102850 tx=0x7f62fc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0eca33b7c1de26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f630a25a640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62f00b52e0 0x7f62f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.982+0000 7f62effff640 1 -- 172.21.15.2:0/2283282504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc031450 con 0x56326b1c60f0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f62effff640 1 -- 172.21.15.2:0/2283282504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62fc036030 con 0x56326b1c60f0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f62effff640 1 -- 172.21.15.2:0/2283282504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc02f660 con 0x56326b1c60f0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 -- 172.21.15.2:0/2283282504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 msgr2=0x56326b1c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630a25a640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62f00b52e0 0x7f62f00b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f62fc04a000 tx=0x7f62fc04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1c64d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6304102850 tx=0x7f62fc009800 comp rx=0 tx=0).stop 2024-09-10T23:32:18.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 -- 172.21.15.2:0/2283282504 shutdown_connections 2024-09-10T23:32:18.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1d29a0 0x56326b1d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1d2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 --2- 172.21.15.2:0/2283282504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1c64d0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 -- 172.21.15.2:0/2283282504 >> 172.21.15.2:0/2283282504 conn(0x56326b1c3f20 msgr2=0x56326b1c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:18.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 -- 172.21.15.2:0/2283282504 shutdown_connections 2024-09-10T23:32:18.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.983+0000 7f630e092740 1 -- 172.21.15.2:0/2283282504 wait complete. 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 -- start start 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 Processor -- start 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c60f0 0x56326b1d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56326af8d700 con 0x56326b1d29a0 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56326b0c7160 con 0x56326b1c60f0 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56326b1d54a0 con 0x56326b1c6a10 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630e092740 10 client.0 _ll_register_callbacks cb 0x56326b0e09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630a25a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630a25a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53776/0 (socket says 172.21.15.2:53776) 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.984+0000 7f630a25a640 1 -- 172.21.15.2:0/3349962488 learned_addr learned my addr 172.21.15.2:0/3349962488 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f6309258640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f6309a59640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c60f0 0x56326b1d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630a25a640 1 -- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 msgr2=0x56326b1cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630a25a640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630a25a640 1 -- 172.21.15.2:0/3349962488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c60f0 msgr2=0x56326b1d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630a25a640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c60f0 0x56326b1d2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630a25a640 1 -- 172.21.15.2:0/3349962488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326b0f4c90 con 0x56326b1d29a0 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f6309a59640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c60f0 0x56326b1d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f6309258640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630a25a640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cfc50 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f62fc006010 tx=0x7f62fc004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a16447d8faeb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:18.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f62ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3349962488 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc004670 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3349962488 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f62fc02f660 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62fc036030 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3349962488 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62fc02f860 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630e092740 10 client.18270 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56326b1e0dc0 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.985+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3349962488 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62fc036030 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3349962488 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f62fc030a70 con 0x56326b1d29a0 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f630e092740 10 client.18270 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f630e092740 10 client.18270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f630e092740 20 client.18270 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f630e092740 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b1e2110 0x56326b1e4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f630e092740 4 client.18270 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56326b13edf0 con 0x56326b1e2110 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f6309a59640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b1e2110 0x56326b1e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f62ed7fa640 10 client.18270 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.986+0000 7f6309a59640 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b1e2110 0x56326b1e4500 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ade12d0a7d429b1 server_cookie=b42e9a42ee6ba661 in_seq=0 out_seq=0 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.987+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3349962488 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56326b13edf0 con 0x56326b1e2110 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.987+0000 7f62ed7fa640 10 client.18270 handle_command_reply: tid=0 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.987+0000 7f630e092740 1 client.18270 shutdown 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.987+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 msgr2=0x56326b1cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.987+0000 7f630e092740 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cfc50 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f62fc006010 tx=0x7f62fc004590 comp rx=0 tx=0).stop 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 shutdown_connections 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b1e2110 0x56326b1e4500 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cfc50 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 --2- 172.21.15.2:0/3349962488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c60f0 0x56326b1d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f62ed7fa640 0 client.18270 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 >> 172.21.15.2:0/3349962488 conn(0x56326b1c3f20 msgr2=0x56326b1c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 shutdown_connections 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 1 -- 172.21.15.2:0/3349962488 wait complete. 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:17.988+0000 7f630e092740 20 client.18270 trim_cache size 0 max 16384 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 Processor -- start 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 -- start start 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c60f0 0x56326b1de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b0520 con 0x56326b1d29a0 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b2060 con 0x56326b1c6a10 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630e092740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b0bf0 con 0x56326b1c60f0 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630a25a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630a25a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53790/0 (socket says 172.21.15.2:53790) 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f630a25a640 1 -- 172.21.15.2:0/944358600 learned_addr learned my addr 172.21.15.2:0/944358600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f6309a59640 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c60f0 0x56326b1de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.001+0000 7f6309258640 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f630a25a640 1 -- 172.21.15.2:0/944358600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c60f0 msgr2=0x56326b1de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f630a25a640 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c60f0 0x56326b1de700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f630a25a640 1 -- 172.21.15.2:0/944358600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 msgr2=0x56326b1ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f630a25a640 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f630a25a640 1 -- 172.21.15.2:0/944358600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326b1c55e0 con 0x56326b1d29a0 2024-09-10T23:32:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f630a25a640 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cc8a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009430 tx=0x7f62fc031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe83aeb8f4a3bca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f62ef7fe640 1 -- 172.21.15.2:0/944358600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc02f660 con 0x56326b1d29a0 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f62ef7fe640 1 -- 172.21.15.2:0/944358600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62fc036040 con 0x56326b1d29a0 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.002+0000 7f62ef7fe640 1 -- 172.21.15.2:0/944358600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc030c70 con 0x56326b1d29a0 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 -- 172.21.15.2:0/944358600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 msgr2=0x56326b1cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cc8a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009430 tx=0x7f62fc031f10 comp rx=0 tx=0).stop 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 -- 172.21.15.2:0/944358600 shutdown_connections 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1d29a0 0x56326b1cc8a0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1c6a10 0x56326b1ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 --2- 172.21.15.2:0/944358600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c60f0 0x56326b1de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 -- 172.21.15.2:0/944358600 >> 172.21.15.2:0/944358600 conn(0x56326b1c3f20 msgr2=0x56326b1ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 -- 172.21.15.2:0/944358600 shutdown_connections 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 -- 172.21.15.2:0/944358600 wait complete. 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 -- start start 2024-09-10T23:32:18.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.003+0000 7f630e092740 1 Processor -- start 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1d6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1d29a0 0x56326b1d7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b1990 con 0x56326b1c60f0 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b12c0 con 0x56326b1d29a0 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63041ae500 con 0x56326b1c6a10 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630e092740 10 client.0 _ll_register_callbacks cb 0x7f62fc049020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1d6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53800/0 (socket says 172.21.15.2:53800) 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 -- 172.21.15.2:0/3269435759 learned_addr learned my addr 172.21.15.2:0/3269435759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630a25a640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1d29a0 0x56326b1d7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309258640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1d6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 -- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 msgr2=0x56326b1d6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1d6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 -- 172.21.15.2:0/3269435759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1d29a0 msgr2=0x56326b1d7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1d29a0 0x56326b1d7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 -- 172.21.15.2:0/3269435759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326b24dfa0 con 0x56326b1c60f0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f630a25a640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1d29a0 0x56326b1d7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f6309a59640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1d6810 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f63000abb70 tx=0x7f63000e58a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccce56fcca625c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.004+0000 7f62ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3269435759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000ab980 con 0x56326b1c60f0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3269435759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f63000a80e0 con 0x56326b1c60f0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62fc036040 con 0x56326b1c60f0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3269435759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63000eb320 con 0x56326b1c60f0 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 10 client.18276 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56326b24f2e0 con 0x56326b1c60f0 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3269435759 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62fc036040 con 0x56326b1c60f0 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3269435759 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63000b4f70 con 0x56326b1c60f0 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 10 client.18276 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 10 client.18276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 20 client.18276 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b24fa10 0x56326b251e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 4 client.18276 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.005+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56326b13a8a0 con 0x56326b24fa10 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f6309258640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b24fa10 0x56326b251e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f6309258640 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b24fa10 0x56326b251e30 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f6c3ac6d75f312f server_cookie=fc0efbce873349e0 in_seq=0 out_seq=0 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f62ed7fa640 10 client.18276 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f62ed7fa640 1 -- 172.21.15.2:0/3269435759 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56326b13a8a0 con 0x56326b24fa10 2024-09-10T23:32:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f62ed7fa640 10 client.18276 handle_command_reply: tid=0 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 client.18276 shutdown 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 msgr2=0x56326b1d6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1d6810 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f63000abb70 tx=0x7f63000e58a0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 shutdown_connections 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56326b24fa10 0x56326b251e30 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56326b1d29a0 0x56326b1d7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56326b1c6a10 0x56326b1d6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f62ed7fa640 0 client.18276 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 --2- 172.21.15.2:0/3269435759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56326b1c60f0 0x56326b1d6810 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.006+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 >> 172.21.15.2:0/3269435759 conn(0x56326b1c3f20 msgr2=0x56326b1d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 shutdown_connections 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630e092740 1 -- 172.21.15.2:0/3269435759 wait complete. 2024-09-10T23:32:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630e092740 20 client.18276 trim_cache size 0 max 16384 2024-09-10T23:32:18.023 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:18.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62f00b52e0 msgr2=0x7f62f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62f00b52e0 0x7f62f00b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f62fc04a000 tx=0x7f62fc04b000 comp rx=0 tx=0).stop 2024-09-10T23:32:18.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 msgr2=0x7f630419b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:18.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 0x7f630419b470 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f630000d950 tx=0x7f630000de10 comp rx=0 tx=0).stop 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 shutdown_connections 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62f00b52e0 0x7f62f00b77a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f630410f420 0x7f63041a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6304102190 0x7f630419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 --2- 172.21.15.2:0/485500116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6304101870 0x7f630419b470 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 >> 172.21.15.2:0/485500116 conn(0x7f63040fd700 msgr2=0x7f63040ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 shutdown_connections 2024-09-10T23:32:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:18.007+0000 7f630bcbd640 1 -- 172.21.15.2:0/485500116 wait complete. 2024-09-10T23:32:18.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:17 smithi177 ceph-mon[35760]: pgmap v590: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:17 smithi002 ceph-mon[31150]: pgmap v590: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:18.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:17 smithi154 ceph-mon[35136]: pgmap v590: 97 pgs: 97 active+clean; 2.0 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:19.797 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:32:19.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:32:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:20.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:19 smithi002 ceph-mon[31150]: pgmap v591: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:32:20.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:19 smithi177 ceph-mon[35760]: pgmap v591: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:32:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:19 smithi154 ceph-mon[35136]: pgmap v591: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:32:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 -- 172.21.15.2:0/3404585284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c1045c0 msgr2=0x7fdf8c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 --2- 172.21.15.2:0/3404585284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c1045c0 0x7fdf8c10cab0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009ca0 tx=0x7fdf8002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 -- 172.21.15.2:0/3404585284 shutdown_connections 2024-09-10T23:32:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 --2- 172.21.15.2:0/3404585284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c10d100 0x7fdf8c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 --2- 172.21.15.2:0/3404585284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c1045c0 0x7fdf8c10cab0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 --2- 172.21.15.2:0/3404585284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf8c103ca0 0x7fdf8c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 -- 172.21.15.2:0/3404585284 >> 172.21.15.2:0/3404585284 conn(0x7fdf8c0fd700 msgr2=0x7fdf8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 -- 172.21.15.2:0/3404585284 shutdown_connections 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.633+0000 7fdf90de0640 1 -- 172.21.15.2:0/3404585284 wait complete. 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.634+0000 7fdf90de0640 1 Processor -- start 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.634+0000 7fdf90de0640 1 -- start start 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.634+0000 7fdf90de0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c103ca0 0x7fdf8c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.634+0000 7fdf90de0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf8c1045c0 0x7fdf8c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.634+0000 7fdf90de0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 0x7fdf8c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf90de0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c112d70 con 0x7fdf8c10d100 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf90de0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c112bf0 con 0x7fdf8c1045c0 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf90de0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c112ef0 con 0x7fdf8c103ca0 2024-09-10T23:32:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 0x7fdf8c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 0x7fdf8c19ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53820/0 (socket says 172.21.15.2:53820) 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 -- 172.21.15.2:0/2031687163 learned_addr learned my addr 172.21.15.2:0/2031687163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c103ca0 0x7fdf8c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf8c1045c0 0x7fdf8c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 -- 172.21.15.2:0/2031687163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c103ca0 msgr2=0x7fdf8c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c103ca0 0x7fdf8c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 -- 172.21.15.2:0/2031687163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf8c1045c0 msgr2=0x7fdf8c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf8c1045c0 0x7fdf8c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 -- 172.21.15.2:0/2031687163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c19f3d0 con 0x7fdf8c10d100 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.635+0000 7fdf8ad9d640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 0x7fdf8c19ec00 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400e970 tx=0x7fdf8400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.636+0000 7fdf7b7fe640 1 -- 172.21.15.2:0/2031687163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400ccc0 con 0x7fdf8c10d100 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.636+0000 7fdf7b7fe640 1 -- 172.21.15.2:0/2031687163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf8400ce60 con 0x7fdf8c10d100 2024-09-10T23:32:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.636+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8c19f6c0 con 0x7fdf8c10d100 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.636+0000 7fdf7b7fe640 1 -- 172.21.15.2:0/2031687163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84010430 con 0x7fdf8c10d100 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.636+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8c1a5d80 con 0x7fdf8c10d100 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.639+0000 7fdf931b5740 1 Processor -- start 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf7b7fe640 1 -- 172.21.15.2:0/2031687163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdf84004f70 con 0x7fdf8c10d100 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 -- start start 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 0x560af68922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560af6808e60 con 0x560af6891ee0 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560af67f8290 con 0x560af6892800 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf931b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560af67fc0a0 con 0x560af68a2ba0 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.640+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 0x560af68922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 0x560af68922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53834/0 (socket says 172.21.15.2:53834) 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 -- 172.21.15.2:0/3106119521 learned_addr learned my addr 172.21.15.2:0/3106119521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 -- 172.21.15.2:0/3106119521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 msgr2=0x560af68a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68a4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf7b7fe640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf740b52e0 0x7fdf740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 -- 172.21.15.2:0/3106119521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 msgr2=0x560af68a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 -- 172.21.15.2:0/3106119521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af6556930 con 0x560af6891ee0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf8ad9d640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf740b52e0 0x7fdf740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 0x560af68922c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fdf80035000 tx=0x7fdf80005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29f38a35c05724c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.641+0000 7fdf7b7fe640 1 -- 172.21.15.2:0/2031687163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdf840e5ed0 con 0x7fdf8c10d100 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf78ff9640 1 -- 172.21.15.2:0/3106119521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf80031650 con 0x560af6891ee0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf78ff9640 1 -- 172.21.15.2:0/3106119521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf80036040 con 0x560af6891ee0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf78ff9640 1 -- 172.21.15.2:0/3106119521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf800046d0 con 0x560af6891ee0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 -- 172.21.15.2:0/3106119521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 msgr2=0x560af68922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 0x560af68922c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fdf80035000 tx=0x7fdf80005f60 comp rx=0 tx=0).stop 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf8ad9d640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf740b52e0 0x7fdf740b77a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf840a1bb0 tx=0x7fdf840a0040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 -- 172.21.15.2:0/3106119521 shutdown_connections 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 --2- 172.21.15.2:0/3106119521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6891ee0 0x560af68922c0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.642+0000 7fdf931b5740 1 -- 172.21.15.2:0/3106119521 >> 172.21.15.2:0/3106119521 conn(0x560af688fd10 msgr2=0x560af6890eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.643+0000 7fdf931b5740 1 -- 172.21.15.2:0/3106119521 shutdown_connections 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.643+0000 7fdf931b5740 1 -- 172.21.15.2:0/3106119521 wait complete. 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.643+0000 7fdf931b5740 1 -- start start 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.643+0000 7fdf931b5740 1 Processor -- start 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af689fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af68a2ba0 0x560af68a0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560af6659890 con 0x560af6892800 2024-09-10T23:32:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560af6792d40 con 0x560af68a2ba0 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560af68a5790 con 0x560af6891ee0 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53850/0 (socket says 172.21.15.2:53850) 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 -- 172.21.15.2:0/1172117357 learned_addr learned my addr 172.21.15.2:0/1172117357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af689fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af68a2ba0 0x560af68a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 -- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 msgr2=0x560af689fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af689fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 -- 172.21.15.2:0/1172117357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af68a2ba0 msgr2=0x560af68a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af68a2ba0 0x560af68a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 -- 172.21.15.2:0/1172117357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af68aec20 con 0x560af6892800 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68a0130 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c010820 tx=0x7fdf7c010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cec7ea2014d95c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.644+0000 7fdf931b5740 10 client.0 _ll_register_callbacks cb 0x560af67f6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1172117357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00fb90 con 0x560af6892800 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1172117357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdf7c00fd30 con 0x560af6892800 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf80036040 con 0x560af6892800 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1172117357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdf7c005020 con 0x560af6892800 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 10 client.18288 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560af68b13e0 con 0x560af6892800 2024-09-10T23:32:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1172117357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdf7c0051c0 con 0x560af6892800 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 10 client.18288 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 10 client.18288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 20 client.18288 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af68b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 4 client.18288 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.645+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560af680adb0 con 0x560af68b27d0 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.646+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af68b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.646+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af68b4c90 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd1765afc1cf9617 server_cookie=7ce6d55c39e9ca9a in_seq=0 out_seq=0 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.646+0000 7fdf71ffb640 10 client.18288 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1172117357 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560af680adb0 con 0x560af68b27d0 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf71ffb640 10 client.18288 handle_command_reply: tid=0 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 client.18288 shutdown 2024-09-10T23:32:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 msgr2=0x560af68a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68a0130 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c010820 tx=0x7fdf7c010ce0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 shutdown_connections 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af68b4c90 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af68a2ba0 0x560af68a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf71ffb640 0 client.18288 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68a0130 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1172117357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af689fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 >> 172.21.15.2:0/1172117357 conn(0x560af688fd10 msgr2=0x560af688ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 shutdown_connections 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 1 -- 172.21.15.2:0/1172117357 wait complete. 2024-09-10T23:32:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.647+0000 7fdf931b5740 20 client.18288 trim_cache size 0 max 16384 2024-09-10T23:32:20.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 Processor -- start 2024-09-10T23:32:20.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 -- start start 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6891ee0 0x560af6891120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68ba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1ac130 con 0x560af6892800 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1adc70 con 0x560af6891ee0 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf931b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1ac800 con 0x560af68a2ba0 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68ba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6891ee0 0x560af6891120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68ba5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53866/0 (socket says 172.21.15.2:53866) 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf8a59c640 1 -- 172.21.15.2:0/367988952 learned_addr learned my addr 172.21.15.2:0/367988952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.665+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf8a59c640 1 -- 172.21.15.2:0/367988952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 msgr2=0x560af68baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68baae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf8a59c640 1 -- 172.21.15.2:0/367988952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6891ee0 msgr2=0x560af6891120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6891ee0 0x560af6891120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf8a59c640 1 -- 172.21.15.2:0/367988952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af688fb40 con 0x560af6892800 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68ba5a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c000c00 tx=0x7fdf7c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e01ad89684be374 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf73fff640 1 -- 172.21.15.2:0/367988952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00fb90 con 0x560af6892800 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf73fff640 1 -- 172.21.15.2:0/367988952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf80036040 con 0x560af6892800 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.666+0000 7fdf73fff640 1 -- 172.21.15.2:0/367988952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c023680 con 0x560af6892800 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 -- 172.21.15.2:0/367988952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 msgr2=0x560af68ba5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68ba5a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c000c00 tx=0x7fdf7c012000 comp rx=0 tx=0).stop 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 -- 172.21.15.2:0/367988952 shutdown_connections 2024-09-10T23:32:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af68a2ba0 0x560af68baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af6892800 0x560af68ba5a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 --2- 172.21.15.2:0/367988952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6891ee0 0x560af6891120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 -- 172.21.15.2:0/367988952 >> 172.21.15.2:0/367988952 conn(0x560af688fd10 msgr2=0x560af6890a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 -- 172.21.15.2:0/367988952 shutdown_connections 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 -- 172.21.15.2:0/367988952 wait complete. 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 -- start start 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.667+0000 7fdf931b5740 1 Processor -- start 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af68ab440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 0x560af68a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1ad5a0 con 0x560af68a2ba0 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1aced0 con 0x560af6892800 2024-09-10T23:32:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1aa110 con 0x560af6891ee0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf931b5740 10 client.0 _ll_register_callbacks cb 0x7fdf7c00a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 0x560af68a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 0x560af68a80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53878/0 (socket says 172.21.15.2:53878) 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 -- 172.21.15.2:0/1851444456 learned_addr learned my addr 172.21.15.2:0/1851444456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af68ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 -- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 msgr2=0x560af68ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af68ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 -- 172.21.15.2:0/1851444456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 msgr2=0x560af68a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 -- 172.21.15.2:0/1851444456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af6898040 con 0x560af68a2ba0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf89d9b640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 0x560af68a80b0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009620 tx=0x7fdf80031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e65a0e20ae9be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.668+0000 7fdf71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1851444456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8002f660 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1851444456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdf8002f800 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf80036040 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1851444456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdf8002fa00 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 10 client.18294 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560af69208d0 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1851444456 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf80036040 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1851444456 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdf80003970 con 0x560af68a2ba0 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 10 client.18294 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 10 client.18294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 20 client.18294 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af6922bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 4 client.18294 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:32:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.669+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560af68a3800 con 0x560af68b27d0 2024-09-10T23:32:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.670+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af6922bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.670+0000 7fdf8a59c640 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af6922bc0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7fa0ea823d439d server_cookie=c57968013553ee56 in_seq=0 out_seq=0 2024-09-10T23:32:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.670+0000 7fdf71ffb640 10 client.18294 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.671+0000 7fdf71ffb640 1 -- 172.21.15.2:0/1851444456 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560af68a3800 con 0x560af68b27d0 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.671+0000 7fdf71ffb640 10 client.18294 handle_command_reply: tid=0 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.671+0000 7fdf931b5740 1 client.18294 shutdown 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 msgr2=0x560af68a80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 0x560af68a80b0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009620 tx=0x7fdf80031d10 comp rx=0 tx=0).stop 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 shutdown_connections 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560af68b27d0 0x560af6922bc0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af68a2ba0 0x560af68a80b0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560af6892800 0x560af68a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 --2- 172.21.15.2:0/1851444456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560af6891ee0 0x560af68ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 >> 172.21.15.2:0/1851444456 conn(0x560af688fd10 msgr2=0x560af6897850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf71ffb640 0 client.18294 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 shutdown_connections 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 1 -- 172.21.15.2:0/1851444456 wait complete. 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.672+0000 7fdf931b5740 20 client.18294 trim_cache size 0 max 16384 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:32:20.679 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec", 2024-09-10T23:32:20.680 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:32:20.680 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:32:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf740b52e0 msgr2=0x7fdf740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf740b52e0 0x7fdf740b77a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf840a1bb0 tx=0x7fdf840a0040 comp rx=0 tx=0).stop 2024-09-10T23:32:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 msgr2=0x7fdf8c19ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 0x7fdf8c19ec00 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400e970 tx=0x7fdf8400ed70 comp rx=0 tx=0).stop 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 shutdown_connections 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdf740b52e0 0x7fdf740b77a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf8c10d100 0x7fdf8c19ec00 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf8c1045c0 0x7fdf8c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 --2- 172.21.15.2:0/2031687163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c103ca0 0x7fdf8c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 >> 172.21.15.2:0/2031687163 conn(0x7fdf8c0fd700 msgr2=0x7fdf8c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 shutdown_connections 2024-09-10T23:32:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:20.673+0000 7fdf90de0640 1 -- 172.21.15.2:0/2031687163 wait complete. 2024-09-10T23:32:21.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:32:21.694 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:22.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:21 smithi002 ceph-mon[31150]: pgmap v592: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:32:22.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:32:22.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:22.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:32:22.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:21 smithi177 ceph-mon[35760]: pgmap v592: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:32:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:32:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:22.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:32:22.215 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 -- 172.21.15.2:0/2842010894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc109150 msgr2=0x7efcfc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 --2- 172.21.15.2:0/2842010894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc109150 0x7efcfc10f950 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009ca0 tx=0x7efcf402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 -- 172.21.15.2:0/2842010894 shutdown_connections 2024-09-10T23:32:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 --2- 172.21.15.2:0/2842010894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc109150 0x7efcfc10f950 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 --2- 172.21.15.2:0/2842010894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcfc1087d0 0x7efcfc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 --2- 172.21.15.2:0/2842010894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcfc102dc0 0x7efcfc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 -- 172.21.15.2:0/2842010894 >> 172.21.15.2:0/2842010894 conn(0x7efcfc0fe830 msgr2=0x7efcfc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 -- 172.21.15.2:0/2842010894 shutdown_connections 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.190+0000 7efd0119e640 1 -- 172.21.15.2:0/2842010894 wait complete. 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 Processor -- start 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 -- start start 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 0x7efcfc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcfc1087d0 0x7efcfc199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcfc109150 0x7efcfc19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc112e60 con 0x7efcfc102dc0 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc112ce0 con 0x7efcfc1087d0 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efd0119e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc112fe0 con 0x7efcfc109150 2024-09-10T23:32:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 0x7efcfc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 0x7efcfc199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34644/0 (socket says 172.21.15.2:34644) 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 -- 172.21.15.2:0/4098654214 learned_addr learned my addr 172.21.15.2:0/4098654214 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfb59e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcfc109150 0x7efcfc19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfa59c640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcfc1087d0 0x7efcfc199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 -- 172.21.15.2:0/4098654214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcfc109150 msgr2=0x7efcfc19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcfc109150 0x7efcfc19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 -- 172.21.15.2:0/4098654214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcfc1087d0 msgr2=0x7efcfc199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.191+0000 7efcfad9d640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcfc1087d0 0x7efcfc199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efcfad9d640 1 -- 172.21.15.2:0/4098654214 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc19f3c0 con 0x7efcfc102dc0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efcfad9d640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 0x7efcfc199310 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efcec00b4a0 tx=0x7efcec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efce3fff640 1 -- 172.21.15.2:0/4098654214 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec014070 con 0x7efcfc102dc0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc19f6b0 con 0x7efcfc102dc0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efce3fff640 1 -- 172.21.15.2:0/4098654214 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcec010ac0 con 0x7efcfc102dc0 2024-09-10T23:32:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efce3fff640 1 -- 172.21.15.2:0/4098654214 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec017c30 con 0x7efcfc102dc0 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.192+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc1a5f40 con 0x7efcfc102dc0 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efce3fff640 1 -- 172.21.15.2:0/4098654214 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7efcec010610 con 0x7efcfc102dc0 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 Processor -- start 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 -- start start 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a53602860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a53611120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a53578e50 con 0x562a5360ed30 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a53568280 con 0x562a53602480 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efd03573740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562a5356c090 con 0x562a53602da0 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a53611120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a53611120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34654/0 (socket says 172.21.15.2:34654) 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 -- 172.21.15.2:0/2276214670 learned_addr learned my addr 172.21.15.2:0/2276214670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfad9d640 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfb59e640 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a53602860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efce3fff640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efce40b52e0 0x7efce40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 -- 172.21.15.2:0/2276214670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 msgr2=0x562a5360e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 -- 172.21.15.2:0/2276214670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 msgr2=0x562a53602860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.195+0000 7efcfa59c640 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a53602860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efcfa59c640 1 -- 172.21.15.2:0/2276214670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a532c6650 con 0x562a5360ed30 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efcfb59e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efce40b52e0 0x7efce40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efce3fff640 1 -- 172.21.15.2:0/4098654214 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efcec0e5530 con 0x7efcfc102dc0 2024-09-10T23:32:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efcfa59c640 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a53611120 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7efcf000cbb0 tx=0x7efcf000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dfd2fb47ab0bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efce17fa640 1 -- 172.21.15.2:0/2276214670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0010630 con 0x562a5360ed30 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efce17fa640 1 -- 172.21.15.2:0/2276214670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf0010c80 con 0x562a5360ed30 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.196+0000 7efce17fa640 1 -- 172.21.15.2:0/2276214670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf001aaf0 con 0x562a5360ed30 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 -- 172.21.15.2:0/2276214670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 msgr2=0x562a53611120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efcfb59e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efce40b52e0 0x7efce40b77a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009430 tx=0x7efcf40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a53611120 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7efcf000cbb0 tx=0x7efcf000e720 comp rx=0 tx=0).stop 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 -- 172.21.15.2:0/2276214670 shutdown_connections 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a53611120 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 --2- 172.21.15.2:0/2276214670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a53602860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 -- 172.21.15.2:0/2276214670 >> 172.21.15.2:0/2276214670 conn(0x562a536002b0 msgr2=0x562a53601450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 -- 172.21.15.2:0/2276214670 shutdown_connections 2024-09-10T23:32:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 -- 172.21.15.2:0/2276214670 wait complete. 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 -- start start 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.197+0000 7efd03573740 1 Processor -- start 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5360e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a5360bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a533c9700 con 0x562a5360ed30 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a53503110 con 0x562a53602480 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562a536119b0 con 0x562a53602da0 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 10 client.0 _ll_register_callbacks cb 0x562a5351c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a5360bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a5360bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34666/0 (socket says 172.21.15.2:34666) 2024-09-10T23:32:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 -- 172.21.15.2:0/1763457702 learned_addr learned my addr 172.21.15.2:0/1763457702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfa59c640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfad9d640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5360e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 -- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 msgr2=0x562a5360b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 -- 172.21.15.2:0/1763457702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 msgr2=0x562a5360e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5360e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 -- 172.21.15.2:0/1763457702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a53530c40 con 0x562a5360ed30 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcfb59e640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a5360bf70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7efcf4035000 tx=0x7efcf402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4317d33f15fd98a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcdeff5640 1 -- 172.21.15.2:0/1763457702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4003970 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efcdeff5640 1 -- 172.21.15.2:0/1763457702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efcf4003b10 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.198+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf0010c80 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efcdeff5640 1 -- 172.21.15.2:0/1763457702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efcf4003d10 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 10 client.18306 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a5361d290 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efcdeff5640 1 -- 172.21.15.2:0/1763457702 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf0010c80 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efcdeff5640 1 -- 172.21.15.2:0/1763457702 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efcf40306c0 con 0x562a5360ed30 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 10 client.18306 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 10 client.18306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 20 client.18306 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a5361e7c0 0x562a53620c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 4 client.18306 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a5357ada0 con 0x562a5361e7c0 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.199+0000 7efcfad9d640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a5361e7c0 0x562a53620c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.200+0000 7efcfad9d640 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a5361e7c0 0x562a53620c00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c578a9d2d3cb2964 server_cookie=674da1551600d3c7 in_seq=0 out_seq=0 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.200+0000 7efcdeff5640 10 client.18306 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efcdeff5640 1 -- 172.21.15.2:0/1763457702 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a5357ada0 con 0x562a5361e7c0 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efcdeff5640 10 client.18306 handle_command_reply: tid=0 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 client.18306 shutdown 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 msgr2=0x562a5360bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a5360bf70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7efcf4035000 tx=0x7efcf402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 shutdown_connections 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a5361e7c0 0x562a53620c00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a5360bf70 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602da0 0x562a5360b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 --2- 172.21.15.2:0/1763457702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5360e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 >> 172.21.15.2:0/1763457702 conn(0x562a536002b0 msgr2=0x562a53605e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efcdeff5640 0 client.18306 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 shutdown_connections 2024-09-10T23:32:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 1 -- 172.21.15.2:0/1763457702 wait complete. 2024-09-10T23:32:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.201+0000 7efd03573740 20 client.18306 trim_cache size 0 max 16384 2024-09-10T23:32:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.218+0000 7efd03573740 1 Processor -- start 2024-09-10T23:32:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 -- start start 2024-09-10T23:32:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5361ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 0x562a53617050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a5360ed30 0x562a53617590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc1ae440 con 0x562a53602da0 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc1aff80 con 0x562a53602480 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efd03573740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc1aeb10 con 0x562a5360ed30 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 0x562a53617050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 0x562a53617050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34672/0 (socket says 172.21.15.2:34672) 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 -- 172.21.15.2:0/1113574179 learned_addr learned my addr 172.21.15.2:0/1113574179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfb59e640 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a5360ed30 0x562a53617590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 -- 172.21.15.2:0/1113574179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a5360ed30 msgr2=0x562a53617590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a5360ed30 0x562a53617590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 -- 172.21.15.2:0/1113574179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 msgr2=0x562a5361ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfad9d640 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5361ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5361ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 -- 172.21.15.2:0/1113574179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a53600d30 con 0x562a53602da0 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.219+0000 7efcfa59c640 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 0x562a53617050 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7efcf001a740 tx=0x7efcf001a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5915812a415177c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efce0ff9640 1 -- 172.21.15.2:0/1113574179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf001a480 con 0x562a53602da0 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efce0ff9640 1 -- 172.21.15.2:0/1113574179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf000c690 con 0x562a53602da0 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efce0ff9640 1 -- 172.21.15.2:0/1113574179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf001a7e0 con 0x562a53602da0 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 -- 172.21.15.2:0/1113574179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 msgr2=0x562a53617050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 0x562a53617050 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7efcf001a740 tx=0x7efcf001a770 comp rx=0 tx=0).stop 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 -- 172.21.15.2:0/1113574179 shutdown_connections 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a5360ed30 0x562a53617590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a53602da0 0x562a53617050 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 --2- 172.21.15.2:0/1113574179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602480 0x562a5361ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 -- 172.21.15.2:0/1113574179 >> 172.21.15.2:0/1113574179 conn(0x562a536002b0 msgr2=0x562a5360a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 -- 172.21.15.2:0/1113574179 shutdown_connections 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.220+0000 7efd03573740 1 -- 172.21.15.2:0/1113574179 wait complete. 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 -- start start 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 Processor -- start 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602480 0x562a536256e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602da0 0x562a53625c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a536262f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc1af8b0 con 0x562a5360ed30 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc1af1e0 con 0x562a53602da0 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc1ac420 con 0x562a53602480 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efd03573740 10 client.0 _ll_register_callbacks cb 0x7efcf4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a536262f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a536262f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34684/0 (socket says 172.21.15.2:34684) 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 -- 172.21.15.2:0/2305066725 learned_addr learned my addr 172.21.15.2:0/2305066725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfad9d640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602480 0x562a536256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfa59c640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602da0 0x562a53625c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 -- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602480 msgr2=0x562a536256e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602480 0x562a536256e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 -- 172.21.15.2:0/2305066725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602da0 msgr2=0x562a53625c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602da0 0x562a53625c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfb59e640 1 -- 172.21.15.2:0/2305066725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a53626b20 con 0x562a5360ed30 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfa59c640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602da0 0x562a53625c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.221+0000 7efcfad9d640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602480 0x562a536256e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcfb59e640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a536262f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7efcf4030d40 tx=0x7efcf402f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b932c32e85de01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcdeff5640 1 -- 172.21.15.2:0/2305066725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4031b70 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcdeff5640 1 -- 172.21.15.2:0/2305066725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efcf4030dc0 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf000c690 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcdeff5640 1 -- 172.21.15.2:0/2305066725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efcf40305c0 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 10 client.18312 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a53690120 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcdeff5640 1 -- 172.21.15.2:0/2305066725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf000c690 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efcdeff5640 1 -- 172.21.15.2:0/2305066725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efcf4004630 con 0x562a5360ed30 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 10 client.18312 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 10 client.18312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 20 client.18312 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a53690840 0x562a53692c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 4 client.18312 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.222+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a53576850 con 0x562a53690840 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.223+0000 7efcfad9d640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a53690840 0x562a53692c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.223+0000 7efcfad9d640 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a53690840 0x562a53692c60 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a71e3992c66e85 server_cookie=ca8a5870d742c3e9 in_seq=0 out_seq=0 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.223+0000 7efcdeff5640 10 client.18312 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.223+0000 7efcdeff5640 1 -- 172.21.15.2:0/2305066725 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x562a53576850 con 0x562a53690840 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.223+0000 7efcdeff5640 10 client.18312 handle_command_reply: tid=0 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.223+0000 7efd03573740 1 client.18312 shutdown 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 msgr2=0x562a536262f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a536262f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7efcf4030d40 tx=0x7efcf402f9e0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 shutdown_connections 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a53690840 0x562a53692c60 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a5360ed30 0x562a536262f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a53602da0 0x562a53625c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efcdeff5640 0 client.18312 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 --2- 172.21.15.2:0/2305066725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a53602480 0x562a536256e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 >> 172.21.15.2:0/2305066725 conn(0x562a536002b0 msgr2=0x562a5360d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 shutdown_connections 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 1 -- 172.21.15.2:0/2305066725 wait complete. 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd03573740 20 client.18312 trim_cache size 0 max 16384 2024-09-10T23:32:22.236 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec", 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.237 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.238 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.239 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.240 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.241 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.242 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.243 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:32:22.244 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:32:22.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efce40b52e0 msgr2=0x7efce40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efce40b52e0 0x7efce40b77a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009430 tx=0x7efcf40095c0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 msgr2=0x7efcfc199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 0x7efcfc199310 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efcec00b4a0 tx=0x7efcec00b960 comp rx=0 tx=0).stop 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 shutdown_connections 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efce40b52e0 0x7efce40b77a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcfc109150 0x7efcfc19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcfc1087d0 0x7efcfc199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 --2- 172.21.15.2:0/4098654214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc102dc0 0x7efcfc199310 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 >> 172.21.15.2:0/4098654214 conn(0x7efcfc0fe830 msgr2=0x7efcfc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.224+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 shutdown_connections 2024-09-10T23:32:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:22.225+0000 7efd0119e640 1 -- 172.21.15.2:0/4098654214 wait complete. 2024-09-10T23:32:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:21 smithi154 ceph-mon[35136]: pgmap v592: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:32:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:32:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:32:22.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:32:23.051 INFO:tasks.cephfs.filesystem:scrub status for tag:6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec - {'path': '/', 'tag': '6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec', 'options': 'recursive,force'} 2024-09-10T23:32:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:23 smithi002 ceph-mon[31150]: pgmap v593: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:32:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:23 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:32:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:23 smithi154 ceph-mon[35136]: pgmap v593: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:32:24.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:23 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:32:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:23 smithi177 ceph-mon[35760]: pgmap v593: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:32:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:23 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 -- 172.21.15.2:0/1952130512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80681029b0 msgr2=0x7f8068102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 --2- 172.21.15.2:0/1952130512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80681029b0 0x7f8068102e30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f8058009cd0 tx=0x7f805802a8e0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 -- 172.21.15.2:0/1952130512 shutdown_connections 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 --2- 172.21.15.2:0/1952130512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8068103370 0x7f8068109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 --2- 172.21.15.2:0/1952130512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80681029b0 0x7f8068102e30 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 --2- 172.21.15.2:0/1952130512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8068101860 0x7f8068101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 -- 172.21.15.2:0/1952130512 >> 172.21.15.2:0/1952130512 conn(0x7f80680fd140 msgr2=0x7f80680ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 -- 172.21.15.2:0/1952130512 shutdown_connections 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.959+0000 7f806ed65640 1 -- 172.21.15.2:0/1952130512 wait complete. 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 Processor -- start 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 -- start start 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8068101860 0x7f8068198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80681029b0 0x7f8068199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 0x7f8068199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f806810d4b0 con 0x7f8068103370 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f806810d330 con 0x7f8068101860 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806ed65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f806810d630 con 0x7f80681029b0 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 0x7f8068199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 0x7f8068199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34694/0 (socket says 172.21.15.2:34694) 2024-09-10T23:32:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.960+0000 7f806d302640 1 -- 172.21.15.2:0/2474836061 learned_addr learned my addr 172.21.15.2:0/2474836061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806cb01640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8068101860 0x7f8068198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f8067fff640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80681029b0 0x7f8068199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806d302640 1 -- 172.21.15.2:0/2474836061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80681029b0 msgr2=0x7f8068199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806d302640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80681029b0 0x7f8068199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806d302640 1 -- 172.21.15.2:0/2474836061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8068101860 msgr2=0x7f8068198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806d302640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8068101860 0x7f8068198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806d302640 1 -- 172.21.15.2:0/2474836061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806819a850 con 0x7f8068103370 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f8067fff640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80681029b0 0x7f8068199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806d302640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 0x7f8068199f90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f806000d750 tx=0x7f806000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f8065ffb640 1 -- 172.21.15.2:0/2474836061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060017070 con 0x7f8068103370 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f8065ffb640 1 -- 172.21.15.2:0/2474836061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80600097c0 con 0x7f8068103370 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806819ab40 con 0x7f8068103370 2024-09-10T23:32:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.961+0000 7f8065ffb640 1 -- 172.21.15.2:0/2474836061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060004ba0 con 0x7f8068103370 2024-09-10T23:32:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.962+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80681a1210 con 0x7f8068103370 2024-09-10T23:32:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 Processor -- start 2024-09-10T23:32:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8065ffb640 1 -- 172.21.15.2:0/2474836061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8060009c90 con 0x7f8068103370 2024-09-10T23:32:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 -- start start 2024-09-10T23:32:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e33060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 0x560d63e35990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e35fe0 0x560d63e384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d63d9e6f0 con 0x560d63e335a0 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d63d8db20 con 0x560d63e30c70 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.964+0000 7f8071c08740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d63d91930 con 0x560d63e35fe0 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 0x560d63e35990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 0x560d63e35990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34706/0 (socket says 172.21.15.2:34706) 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 -- 172.21.15.2:0/1798215956 learned_addr learned my addr 172.21.15.2:0/1798215956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f8067fff640 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e35fe0 0x560d63e384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f8067fff640 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e33060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 -- 172.21.15.2:0/1798215956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e35fe0 msgr2=0x560d63e384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e35fe0 0x560d63e384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 -- 172.21.15.2:0/1798215956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 msgr2=0x560d63e33060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e33060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 -- 172.21.15.2:0/1798215956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d63d53530 con 0x560d63e335a0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f8065ffb640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80540b5360 0x7f80540b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f806cb01640 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 0x560d63e35990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f805000ad00 tx=0x7f805000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b765923bfd3f0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f8067fff640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80540b5360 0x7f80540b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f8065ffb640 1 -- 172.21.15.2:0/2474836061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f80600e55b0 con 0x7f8068103370 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f805effd640 1 -- 172.21.15.2:0/1798215956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805001d070 con 0x560d63e335a0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f805effd640 1 -- 172.21.15.2:0/1798215956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8050018af0 con 0x560d63e335a0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.965+0000 7f805effd640 1 -- 172.21.15.2:0/1798215956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050010b50 con 0x560d63e335a0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8067fff640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80540b5360 0x7f80540b7820 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8058033040 tx=0x7f805802a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 -- 172.21.15.2:0/1798215956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 msgr2=0x560d63e35990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 0x560d63e35990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f805000ad00 tx=0x7f805000f790 comp rx=0 tx=0).stop 2024-09-10T23:32:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 -- 172.21.15.2:0/1798215956 shutdown_connections 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e35fe0 0x560d63e384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e335a0 0x560d63e35990 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 --2- 172.21.15.2:0/1798215956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e33060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 -- 172.21.15.2:0/1798215956 >> 172.21.15.2:0/1798215956 conn(0x560d63e279b0 msgr2=0x560d63e28740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 -- 172.21.15.2:0/1798215956 shutdown_connections 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.966+0000 7f8071c08740 1 -- 172.21.15.2:0/1798215956 wait complete. 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 -- start start 2024-09-10T23:32:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 Processor -- start 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e335a0 0x560d63e3aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e3b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d63cc5ab0 con 0x560d63e35fe0 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d63d33730 con 0x560d63e335a0 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d63e38fc0 con 0x560d63e30c70 2024-09-10T23:32:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.967+0000 7f8071c08740 10 client.0 _ll_register_callbacks cb 0x560d63d876b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e3b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806cb01640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f8067fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e335a0 0x560d63e3aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e3b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34718/0 (socket says 172.21.15.2:34718) 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 -- 172.21.15.2:0/3313167250 learned_addr learned my addr 172.21.15.2:0/3313167250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 -- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e30c70 msgr2=0x560d63e3a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 -- 172.21.15.2:0/3313167250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e335a0 msgr2=0x560d63e3aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e335a0 0x560d63e3aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 -- 172.21.15.2:0/3313167250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d63aef790 con 0x560d63e35fe0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f806d302640 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e3b5d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f80600a8350 tx=0x7f80600ab9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16a2f829f044665 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.968+0000 7f8047fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.969+0000 7f8047fff640 1 -- 172.21.15.2:0/3313167250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060020070 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.969+0000 7f8047fff640 1 -- 172.21.15.2:0/3313167250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f80600970e0 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.969+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8050018af0 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.969+0000 7f8047fff640 1 -- 172.21.15.2:0/3313167250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80600b0860 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.969+0000 7f8071c08740 10 client.18324 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.969+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d63b68620 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8047fff640 1 -- 172.21.15.2:0/3313167250 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8050018af0 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8047fff640 1 -- 172.21.15.2:0/3313167250 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8060091ba0 con 0x560d63e35fe0 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8071c08740 10 client.18324 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8071c08740 10 client.18324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8071c08740 20 client.18324 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8071c08740 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63e45c40 0x560d63e48030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8071c08740 4 client.18324 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d63da0640 con 0x560d63e45c40 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.970+0000 7f806cb01640 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63e45c40 0x560d63e48030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f8047fff640 10 client.18324 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f806cb01640 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63e45c40 0x560d63e48030 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c423993ae9cd66d server_cookie=f818a9a3d5f3c607 in_seq=0 out_seq=0 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f8047fff640 1 -- 172.21.15.2:0/3313167250 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d63da0640 con 0x560d63e45c40 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f8047fff640 10 client.18324 handle_command_reply: tid=0 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f8071c08740 1 client.18324 shutdown 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 msgr2=0x560d63e3b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.971+0000 7f8071c08740 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e3b5d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f80600a8350 tx=0x7f80600ab9d0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 shutdown_connections 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63e45c40 0x560d63e48030 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e3b5d0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e335a0 0x560d63e3aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8047fff640 0 client.18324 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 --2- 172.21.15.2:0/3313167250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 >> 172.21.15.2:0/3313167250 conn(0x560d63e279b0 msgr2=0x560d63e26bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 shutdown_connections 2024-09-10T23:32:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 1 -- 172.21.15.2:0/3313167250 wait complete. 2024-09-10T23:32:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.972+0000 7f8071c08740 20 client.18324 trim_cache size 0 max 16384 2024-09-10T23:32:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 Processor -- start 2024-09-10T23:32:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 -- start start 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e39ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80681a7b90 con 0x560d63e35fe0 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80681a96d0 con 0x560d63e30c70 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8071c08740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80681a8260 con 0x560d63e335a0 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e39ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e39ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34724/0 (socket says 172.21.15.2:34724) 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 -- 172.21.15.2:0/1721077880 learned_addr learned my addr 172.21.15.2:0/1721077880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f8067fff640 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 -- 172.21.15.2:0/1721077880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 msgr2=0x560d63e395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 -- 172.21.15.2:0/1721077880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 msgr2=0x560d63e3a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 -- 172.21.15.2:0/1721077880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d63e3ad70 con 0x560d63e35fe0 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f806d302640 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e39ae0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8060009610 tx=0x7f80600ac5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16d64abe42632f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.987+0000 7f805e7fc640 1 -- 172.21.15.2:0/1721077880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060014020 con 0x560d63e35fe0 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f805e7fc640 1 -- 172.21.15.2:0/1721077880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80600b5310 con 0x560d63e35fe0 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f805e7fc640 1 -- 172.21.15.2:0/1721077880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060020070 con 0x560d63e35fe0 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 -- 172.21.15.2:0/1721077880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 msgr2=0x560d63e39ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e39ae0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8060009610 tx=0x7f80600ac5c0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 -- 172.21.15.2:0/1721077880 shutdown_connections 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e39ae0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 --2- 172.21.15.2:0/1721077880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e3a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 -- 172.21.15.2:0/1721077880 >> 172.21.15.2:0/1721077880 conn(0x560d63e279b0 msgr2=0x560d63e363c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 -- 172.21.15.2:0/1721077880 shutdown_connections 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 -- 172.21.15.2:0/1721077880 wait complete. 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.988+0000 7f8071c08740 1 -- start start 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 Processor -- start 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e41c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e40930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e40e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80681a9000 con 0x560d63e35fe0 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80681a8930 con 0x560d63e30c70 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80681a5b70 con 0x560d63e335a0 2024-09-10T23:32:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8071c08740 10 client.0 _ll_register_callbacks cb 0x7f80600a83d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e40e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e40e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34736/0 (socket says 172.21.15.2:34736) 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 -- 172.21.15.2:0/3799805299 learned_addr learned my addr 172.21.15.2:0/3799805299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f8067fff640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e40930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 -- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 msgr2=0x560d63e40930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e40930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806cb01640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e41c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 -- 172.21.15.2:0/3799805299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 msgr2=0x560d63e41c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e41c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806d302640 1 -- 172.21.15.2:0/3799805299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d63e333d0 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.989+0000 7f806cb01640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e41c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f806d302640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e40e70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8060091f60 tx=0x7f80600b4e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2346381520ff9c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8047fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8047fff640 1 -- 172.21.15.2:0/3799805299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060014020 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8047fff640 1 -- 172.21.15.2:0/3799805299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f80600930b0 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80600b5310 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8047fff640 1 -- 172.21.15.2:0/3799805299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8060020070 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 10 client.18330 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d63e400c0 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8047fff640 1 -- 172.21.15.2:0/3799805299 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80600b5310 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8047fff640 1 -- 172.21.15.2:0/3799805299 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f80600a76d0 con 0x560d63e35fe0 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 10 client.18330 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 10 client.18330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 20 client.18330 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63eb2f20 0x560d63eb5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 4 client.18330 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.990+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d63d9c0f0 con 0x560d63eb2f20 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.991+0000 7f806cb01640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63eb2f20 0x560d63eb5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.991+0000 7f806cb01640 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63eb2f20 0x560d63eb5310 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=282eb35183433693 server_cookie=f286b42f0927ed7e in_seq=0 out_seq=0 2024-09-10T23:32:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:25.991+0000 7f8047fff640 10 client.18330 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8047fff640 1 -- 172.21.15.2:0/3799805299 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d63d9c0f0 con 0x560d63eb2f20 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8047fff640 10 client.18330 handle_command_reply: tid=0 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 client.18330 shutdown 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 msgr2=0x560d63e40e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e40e70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8060091f60 tx=0x7f80600b4e80 comp rx=0 tx=0).stop 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 shutdown_connections 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x560d63eb2f20 0x560d63eb5310 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d63e35fe0 0x560d63e40e70 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d63e335a0 0x560d63e40930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8047fff640 0 client.18330 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 --2- 172.21.15.2:0/3799805299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d63e30c70 0x560d63e41c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 >> 172.21.15.2:0/3799805299 conn(0x560d63e279b0 msgr2=0x560d63e263d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 shutdown_connections 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 1 -- 172.21.15.2:0/3799805299 wait complete. 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.006+0000 7f8071c08740 20 client.18330 trim_cache size 0 max 16384 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:32:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:32:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:32:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80540b5360 msgr2=0x7f80540b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80540b5360 0x7f80540b7820 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8058033040 tx=0x7f805802a8e0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 msgr2=0x7f8068199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 0x7f8068199f90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f806000d750 tx=0x7f806000db50 comp rx=0 tx=0).stop 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 shutdown_connections 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f80540b5360 0x7f80540b7820 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8068103370 0x7f8068199f90 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80681029b0 0x7f8068199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 --2- 172.21.15.2:0/2474836061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8068101860 0x7f8068198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 >> 172.21.15.2:0/2474836061 conn(0x7f80680fd140 msgr2=0x7f80680feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 shutdown_connections 2024-09-10T23:32:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:26.007+0000 7f806ed65640 1 -- 172.21.15.2:0/2474836061 wait complete. 2024-09-10T23:32:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:25 smithi002 ceph-mon[31150]: pgmap v594: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:32:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:25 smithi154 ceph-mon[35136]: pgmap v594: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:32:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:25 smithi177 ceph-mon[35760]: pgmap v594: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:32:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:27 smithi002 ceph-mon[31150]: pgmap v595: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:27 smithi154 ceph-mon[35136]: pgmap v595: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:27 smithi177 ceph-mon[35760]: pgmap v595: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:30.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:29 smithi002 ceph-mon[31150]: pgmap v596: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:29 smithi154 ceph-mon[35136]: pgmap v596: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:29 smithi177 ceph-mon[35760]: pgmap v596: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:31 smithi002 ceph-mon[31150]: pgmap v597: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:32.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:32.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:32.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:32.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:31 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:32:32.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:31 smithi154 ceph-mon[35136]: pgmap v597: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:32.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:32.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:32.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:32.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:31 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:32:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:31 smithi177 ceph-mon[35760]: pgmap v597: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:31 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:32:34.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:33 smithi002 ceph-mon[31150]: pgmap v598: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:32:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:33 smithi154 ceph-mon[35136]: pgmap v598: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:32:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:33 smithi177 ceph-mon[35760]: pgmap v598: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:32:34.765 INFO:tasks.workunit.client.0.smithi002.stdout:375/600: open fd = 3 2024-09-10T23:32:34.765 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.765 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.765 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.765 INFO:tasks.workunit.client.0.smithi002.stdout:376/600: open fd = 3 2024-09-10T23:32:34.765 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:377/600: open fd = 3 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:378/600: open fd = 3 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:379/600: open fd = 3 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:380/600: open fd = 3 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:381/600: open fd = 3 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:382/600: open fd = 3 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:383/600: open fd = 3 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:384/600: open fd = 3 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:385/600: open fd = 3 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:386/600: open fd = 3 2024-09-10T23:32:34.768 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:387/600: open fd = 3 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:388/600: open fd = 3 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:389/600: open fd = 3 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:390/600: open fd = 3 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:391/600: open fd = 3 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:392/600: open fd = 3 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.770 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:393/600: open fd = 3 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:394/600: open fd = 3 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:395/600: open fd = 3 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:396/600: open fd = 3 2024-09-10T23:32:34.771 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:397/600: open fd = 3 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:398/600: open fd = 3 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:399/600: open fd = 3 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.772 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:400/600: open fd = 3 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:401/600: open fd = 3 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:402/600: open fd = 3 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:403/600: open fd = 3 2024-09-10T23:32:34.773 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:404/600: open fd = 3 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:405/600: open fd = 3 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:406/600: open fd = 3 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.774 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:407/600: open fd = 3 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:408/600: open fd = 3 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:409/600: open fd = 3 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:410/600: open fd = 3 2024-09-10T23:32:34.775 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:411/600: open fd = 3 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:412/600: open fd = 3 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:413/600: open fd = 3 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.776 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:414/600: open fd = 3 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:415/600: open fd = 3 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:416/600: open fd = 3 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.777 INFO:tasks.workunit.client.0.smithi002.stdout:417/600: open fd = 3 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:418/600: open fd = 3 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:419/600: open fd = 3 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:420/600: open fd = 3 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.778 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:421/600: open fd = 3 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:422/600: open fd = 3 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:423/600: open fd = 3 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.779 INFO:tasks.workunit.client.0.smithi002.stdout:424/600: open fd = 3 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:425/600: open fd = 3 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:426/600: open fd = 3 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:427/600: open fd = 3 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.780 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:428/600: open fd = 3 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:429/600: open fd = 3 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:430/600: open fd = 3 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:431/600: open fd = 3 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:432/600: open fd = 3 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:433/600: open fd = 3 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:434/600: open fd = 3 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.782 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:435/600: open fd = 3 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:436/600: open fd = 3 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:32:34.783 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:32:36.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:35 smithi002 ceph-mon[31150]: pgmap v599: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:32:36.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:35 smithi154 ceph-mon[35136]: pgmap v599: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:32:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:35 smithi177 ceph-mon[35760]: pgmap v599: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:32:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:37 smithi002 ceph-mon[31150]: pgmap v600: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:38.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:37 smithi154 ceph-mon[35136]: pgmap v600: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:38.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:37 smithi177 ceph-mon[35760]: pgmap v600: 97 pgs: 97 active+clean; 2.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:32:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 -- 172.21.15.2:0/3351269539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce806b3b0 msgr2=0x7fcce81055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 --2- 172.21.15.2:0/3351269539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce806b3b0 0x7fcce81055f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009900 tx=0x7fccd802a410 comp rx=0 tx=0).stop 2024-09-10T23:32:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 -- 172.21.15.2:0/3351269539 shutdown_connections 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 --2- 172.21.15.2:0/3351269539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce8108680 0x7fcce810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 --2- 172.21.15.2:0/3351269539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce8105b30 0x7fcce8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 --2- 172.21.15.2:0/3351269539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce806b3b0 0x7fcce81055f0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 -- 172.21.15.2:0/3351269539 >> 172.21.15.2:0/3351269539 conn(0x7fcce80fd140 msgr2=0x7fcce80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 -- 172.21.15.2:0/3351269539 shutdown_connections 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.108+0000 7fccee310640 1 -- 172.21.15.2:0/3351269539 wait complete. 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 Processor -- start 2024-09-10T23:32:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 -- start start 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce806b3b0 0x7fcce8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 0x7fcce81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce8108680 0x7fcce819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810e5f0 con 0x7fcce8105b30 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810e470 con 0x7fcce806b3b0 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fccee310640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810e770 con 0x7fcce8108680 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.109+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 0x7fcce81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 0x7fcce81993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55332/0 (socket says 172.21.15.2:55332) 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 -- 172.21.15.2:0/3150008324 learned_addr learned my addr 172.21.15.2:0/3150008324 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce7fff640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce806b3b0 0x7fcce8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fccec8ad640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce8108680 0x7fcce819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 -- 172.21.15.2:0/3150008324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce8108680 msgr2=0x7fcce819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce8108680 0x7fcce819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 -- 172.21.15.2:0/3150008324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce806b3b0 msgr2=0x7fcce8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce806b3b0 0x7fcce8198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 -- 172.21.15.2:0/3150008324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce819a8e0 con 0x7fcce8105b30 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce77fe640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 0x7fcce81993f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00e9f0 tx=0x7fccdc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce57fa640 1 -- 172.21.15.2:0/3150008324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00ccc0 con 0x7fcce8105b30 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce819abd0 con 0x7fcce8105b30 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce57fa640 1 -- 172.21.15.2:0/3150008324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccdc0054d0 con 0x7fcce8105b30 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fcce57fa640 1 -- 172.21.15.2:0/3150008324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc010430 con 0x7fcce8105b30 2024-09-10T23:32:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.110+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce81a12a0 con 0x7fcce8105b30 2024-09-10T23:32:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 Processor -- start 2024-09-10T23:32:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 -- start start 2024-09-10T23:32:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fcce57fa640 1 -- 172.21.15.2:0/3150008324 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fccdc0046c0 con 0x7fcce8105b30 2024-09-10T23:32:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fe3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fe6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fe9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ebf4f536f0 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ebf4f42b20 con 0x55ebf4fe4190 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fccf11bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ebf4f46930 con 0x55ebf4fe1860 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fe9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fe9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55334/0 (socket says 172.21.15.2:55334) 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.113+0000 7fcce77fe640 1 -- 172.21.15.2:0/107025859 learned_addr learned my addr 172.21.15.2:0/107025859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fe3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fcce7fff640 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fe6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 -- 172.21.15.2:0/107025859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 msgr2=0x55ebf4fe6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fe6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 -- 172.21.15.2:0/107025859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 msgr2=0x55ebf4fe9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fe9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 -- 172.21.15.2:0/107025859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf4f08530 con 0x55ebf4fe1860 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fcce7fff640 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fe6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fcce57fa640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccd00b52e0 0x7fccd00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccec8ad640 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fe3c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcce0005fd0 tx=0x7fcce0010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9195afabb0d275 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fcce7fff640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccd00b52e0 0x7fccd00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fcce57fa640 1 -- 172.21.15.2:0/3150008324 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fccdc0e5f00 con 0x7fcce8105b30 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccce7fc640 1 -- 172.21.15.2:0/107025859 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0016070 con 0x55ebf4fe1860 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccce7fc640 1 -- 172.21.15.2:0/107025859 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce0004d20 con 0x55ebf4fe1860 2024-09-10T23:32:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.114+0000 7fccce7fc640 1 -- 172.21.15.2:0/107025859 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0012760 con 0x55ebf4fe1860 2024-09-10T23:32:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 -- 172.21.15.2:0/107025859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 msgr2=0x55ebf4fe3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fe3c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcce0005fd0 tx=0x7fcce0010740 comp rx=0 tx=0).stop 2024-09-10T23:32:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fcce7fff640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccd00b52e0 0x7fccd00b77a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000c00 tx=0x7fccd80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 -- 172.21.15.2:0/107025859 shutdown_connections 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fe9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fe6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 --2- 172.21.15.2:0/107025859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fe3c50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 -- 172.21.15.2:0/107025859 >> 172.21.15.2:0/107025859 conn(0x55ebf4fdc9b0 msgr2=0x55ebf4fdd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 -- 172.21.15.2:0/107025859 shutdown_connections 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.115+0000 7fccf11bb740 1 -- 172.21.15.2:0/107025859 wait complete. 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 -- start start 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 Processor -- start 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 0x55ebf4feaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe4190 0x55ebf4feb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ebf4e7aab0 con 0x55ebf4fe1860 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ebf4ee8730 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ebf4fe9bb0 con 0x55ebf4fe4190 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fccf11bb740 10 client.0 _ll_register_callbacks cb 0x55ebf4f3c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fcce7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 0x55ebf4feaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fcce7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 0x55ebf4feaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55346/0 (socket says 172.21.15.2:55346) 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.116+0000 7fcce7fff640 1 -- 172.21.15.2:0/1499646059 learned_addr learned my addr 172.21.15.2:0/1499646059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe4190 0x55ebf4feb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccec8ad640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce7fff640 1 -- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe4190 msgr2=0x55ebf4feb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce7fff640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe4190 0x55ebf4feb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce7fff640 1 -- 172.21.15.2:0/1499646059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 msgr2=0x55ebf4fec150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce7fff640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fec150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce7fff640 1 -- 172.21.15.2:0/1499646059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf4ca4790 con 0x55ebf4fe1860 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe4190 0x55ebf4feb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fcce7fff640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 0x55ebf4feaf50 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fccd8033000 tx=0x7fccd8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35500faee12bcf92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccc77fe640 1 -- 172.21.15.2:0/1499646059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8035040 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccc77fe640 1 -- 172.21.15.2:0/1499646059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fccd80035f0 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce0004d20 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccc77fe640 1 -- 172.21.15.2:0/1499646059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccd80037f0 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccf11bb740 10 client.18342 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.117+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ebf4d1d620 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccc77fe640 1 -- 172.21.15.2:0/1499646059 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce0004d20 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccc77fe640 1 -- 172.21.15.2:0/1499646059 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fccd8044030 con 0x55ebf4fe1860 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccf11bb740 10 client.18342 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccf11bb740 10 client.18342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccf11bb740 20 client.18342 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf4ff6840 0x55ebf4ff8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccf11bb740 4 client.18342 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebf4f55640 con 0x55ebf4ff6840 2024-09-10T23:32:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.118+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf4ff6840 0x55ebf4ff8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.119+0000 7fccc77fe640 10 client.18342 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.119+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf4ff6840 0x55ebf4ff8ca0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c7e49fd7c5fd34f server_cookie=8e0a91ba77a2eca7 in_seq=0 out_seq=0 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.119+0000 7fccc77fe640 1 -- 172.21.15.2:0/1499646059 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ebf4f55640 con 0x55ebf4ff6840 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.119+0000 7fccc77fe640 10 client.18342 handle_command_reply: tid=0 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.119+0000 7fccf11bb740 1 client.18342 shutdown 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 msgr2=0x55ebf4feaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 0x55ebf4feaf50 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fccd8033000 tx=0x7fccd8009260 comp rx=0 tx=0).stop 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 shutdown_connections 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf4ff6840 0x55ebf4ff8ca0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fec150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe4190 0x55ebf4feb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccc77fe640 0 client.18342 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1499646059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe1860 0x55ebf4feaf50 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 >> 172.21.15.2:0/1499646059 conn(0x55ebf4fdc9b0 msgr2=0x55ebf4fdbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 shutdown_connections 2024-09-10T23:32:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 1 -- 172.21.15.2:0/1499646059 wait complete. 2024-09-10T23:32:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.120+0000 7fccf11bb740 20 client.18342 trim_cache size 0 max 16384 2024-09-10T23:32:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 Processor -- start 2024-09-10T23:32:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 -- start start 2024-09-10T23:32:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fdf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fdfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fdb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81a9e20 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81ab960 con 0x55ebf4fe4190 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccf11bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81aa4f0 con 0x55ebf4fe1860 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fdb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fdb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55354/0 (socket says 172.21.15.2:55354) 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 -- 172.21.15.2:0/3841330513 learned_addr learned my addr 172.21.15.2:0/3841330513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fcce7fff640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fdf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fcce77fe640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fdfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 -- 172.21.15.2:0/3841330513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 msgr2=0x55ebf4fdf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fdf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 -- 172.21.15.2:0/3841330513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 msgr2=0x55ebf4fdfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fdfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fccec8ad640 1 -- 172.21.15.2:0/3841330513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf4fe3fc0 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fcce7fff640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fdf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.135+0000 7fcce77fe640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fdfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccec8ad640 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fdb3d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009c10 tx=0x7fcce0009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6df372c55fabdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fcccdffb640 1 -- 172.21.15.2:0/3841330513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0016050 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fcccdffb640 1 -- 172.21.15.2:0/3841330513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce0005580 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fcccdffb640 1 -- 172.21.15.2:0/3841330513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0012980 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 -- 172.21.15.2:0/3841330513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 msgr2=0x55ebf4fdb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fdb3d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009c10 tx=0x7fcce0009c40 comp rx=0 tx=0).stop 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 -- 172.21.15.2:0/3841330513 shutdown_connections 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4fdb3d0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe4190 0x55ebf4fdfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 --2- 172.21.15.2:0/3841330513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4fdf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 -- 172.21.15.2:0/3841330513 >> 172.21.15.2:0/3841330513 conn(0x55ebf4fdc9b0 msgr2=0x55ebf4fe6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 -- 172.21.15.2:0/3841330513 shutdown_connections 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.136+0000 7fccf11bb740 1 -- 172.21.15.2:0/3841330513 wait complete. 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 -- start start 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 Processor -- start 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4ff2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 0x55ebf4ff1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4ff1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81ab290 con 0x55ebf4fe4190 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81aabc0 con 0x55ebf4fe6bd0 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81a7e00 con 0x55ebf4fe1860 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccf11bb740 10 client.0 _ll_register_callbacks cb 0x7fccd8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 0x55ebf4ff1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 0x55ebf4ff1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55364/0 (socket says 172.21.15.2:55364) 2024-09-10T23:32:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fcce77fe640 1 -- 172.21.15.2:0/1907254744 learned_addr learned my addr 172.21.15.2:0/1907254744 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fcce7fff640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4ff2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.137+0000 7fccec8ad640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4ff1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fcce77fe640 1 -- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 msgr2=0x55ebf4ff2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4ff2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fcce77fe640 1 -- 172.21.15.2:0/1907254744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 msgr2=0x55ebf4ff1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4ff1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fcce77fe640 1 -- 172.21.15.2:0/1907254744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf4ff21b0 con 0x55ebf4fe4190 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fcce77fe640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 0x55ebf4ff1580 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ac660 tx=0x7fccdc0e62c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216f3f8b17ad24c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccc77fe640 1 -- 172.21.15.2:0/1907254744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0ac4a0 con 0x55ebf4fe4190 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccc77fe640 1 -- 172.21.15.2:0/1907254744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fccdc0b59d0 con 0x55ebf4fe4190 2024-09-10T23:32:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce0005580 con 0x55ebf4fe4190 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccc77fe640 1 -- 172.21.15.2:0/1907254744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccdc0abe40 con 0x55ebf4fe4190 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccf11bb740 10 client.18348 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ebf50637d0 con 0x55ebf4fe4190 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccc77fe640 1 -- 172.21.15.2:0/1907254744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce0005580 con 0x55ebf4fe4190 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.138+0000 7fccc77fe640 1 -- 172.21.15.2:0/1907254744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fccdc0e9b90 con 0x55ebf4fe4190 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccf11bb740 10 client.18348 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccf11bb740 10 client.18348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccf11bb740 20 client.18348 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf50640e0 0x55ebf5066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccf11bb740 4 client.18348 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:32:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ebf4f510f0 con 0x55ebf50640e0 2024-09-10T23:32:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fcce7fff640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf50640e0 0x55ebf5066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fcce7fff640 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf50640e0 0x55ebf5066500 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6bdfcfdeb7792a server_cookie=9b06f243ddfd3e38 in_seq=0 out_seq=0 2024-09-10T23:32:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.139+0000 7fccc77fe640 10 client.18348 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccc77fe640 1 -- 172.21.15.2:0/1907254744 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ebf4f510f0 con 0x55ebf50640e0 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccc77fe640 10 client.18348 handle_command_reply: tid=0 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 client.18348 shutdown 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 msgr2=0x55ebf4ff1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 0x55ebf4ff1580 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ac660 tx=0x7fccdc0e62c0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 shutdown_connections 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ebf50640e0 0x55ebf5066500 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebf4fe6bd0 0x55ebf4ff1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ebf4fe4190 0x55ebf4ff1580 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 --2- 172.21.15.2:0/1907254744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ebf4fe1860 0x55ebf4ff2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccc77fe640 0 client.18348 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 >> 172.21.15.2:0/1907254744 conn(0x55ebf4fdc9b0 msgr2=0x55ebf4fe1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 shutdown_connections 2024-09-10T23:32:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 1 -- 172.21.15.2:0/1907254744 wait complete. 2024-09-10T23:32:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.154+0000 7fccf11bb740 20 client.18348 trim_cache size 0 max 16384 2024-09-10T23:32:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:32:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:32:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:32:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:32:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccd00b52e0 msgr2=0x7fccd00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccd00b52e0 0x7fccd00b77a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000c00 tx=0x7fccd80314a0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 msgr2=0x7fcce81993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 0x7fcce81993f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00e9f0 tx=0x7fccdc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 shutdown_connections 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccd00b52e0 0x7fccd00b77a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce8108680 0x7fcce819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce8105b30 0x7fcce81993f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 --2- 172.21.15.2:0/3150008324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce806b3b0 0x7fcce8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 >> 172.21.15.2:0/3150008324 conn(0x7fcce80fd140 msgr2=0x7fcce8103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 shutdown_connections 2024-09-10T23:32:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:39.155+0000 7fccee310640 1 -- 172.21.15.2:0/3150008324 wait complete. 2024-09-10T23:32:40.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:39 smithi154 ceph-mon[35136]: pgmap v601: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:39 smithi177 ceph-mon[35760]: pgmap v601: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:40.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:39 smithi002 ceph-mon[31150]: pgmap v601: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:42.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:41 smithi154 ceph-mon[35136]: pgmap v602: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:42.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:41 smithi177 ceph-mon[35760]: pgmap v602: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:42.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:41 smithi002 ceph-mon[31150]: pgmap v602: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:44.266 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:43 smithi177 ceph-mon[35760]: pgmap v603: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:44.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:43 smithi154 ceph-mon[35136]: pgmap v603: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:44.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:43 smithi002 ceph-mon[31150]: pgmap v603: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:46.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:45 smithi154 ceph-mon[35136]: pgmap v604: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:46.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:45 smithi177 ceph-mon[35760]: pgmap v604: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:46.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:45 smithi002 ceph-mon[31150]: pgmap v604: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:48.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:48 smithi154 ceph-mon[35136]: pgmap v605: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:48.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:48 smithi177 ceph-mon[35760]: pgmap v605: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:48.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:48 smithi002 ceph-mon[31150]: pgmap v605: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:32:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:50 smithi154 ceph-mon[35136]: pgmap v606: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:50.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:50 smithi177 ceph-mon[35760]: pgmap v606: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:50.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:50 smithi002 ceph-mon[31150]: pgmap v606: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:32:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 -- 172.21.15.2:0/651996458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 msgr2=0x7f5b60109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/651996458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60109ed0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009ca0 tx=0x7f5b5802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 -- 172.21.15.2:0/651996458 shutdown_connections 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/651996458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60109ed0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/651996458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b60102820 0x7f5b60102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/651996458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101ee0 0x7f5b601022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 -- 172.21.15.2:0/651996458 >> 172.21.15.2:0/651996458 conn(0x7f5b600fc8f0 msgr2=0x7f5b600fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 -- 172.21.15.2:0/651996458 shutdown_connections 2024-09-10T23:32:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.257+0000 7f5b64f3d640 1 -- 172.21.15.2:0/651996458 wait complete. 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 Processor -- start 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 -- start start 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101ee0 0x7f5b60198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b60102820 0x7f5b60199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010d4f0 con 0x7f5b60103390 2024-09-10T23:32:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010d370 con 0x7f5b60101ee0 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.258+0000 7f5b64f3d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010d670 con 0x7f5b60102820 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37422/0 (socket says 172.21.15.2:37422) 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b60102820 0x7f5b60199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/3079803112 learned_addr learned my addr 172.21.15.2:0/3079803112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101ee0 0x7f5b60198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/3079803112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b60102820 msgr2=0x7f5b60199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b60102820 0x7f5b60199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/3079803112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101ee0 msgr2=0x7f5b60198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101ee0 0x7f5b60198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/3079803112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6019a840 con 0x7f5b60103390 2024-09-10T23:32:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60199f80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f5b580097b0 tx=0x7f5b58003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b4f7fe640 1 -- 172.21.15.2:0/3079803112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58004240 con 0x7f5b60103390 2024-09-10T23:32:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b4f7fe640 1 -- 172.21.15.2:0/3079803112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b580317c0 con 0x7f5b60103390 2024-09-10T23:32:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6019aad0 con 0x7f5b60103390 2024-09-10T23:32:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b4f7fe640 1 -- 172.21.15.2:0/3079803112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5802fd80 con 0x7f5b60103390 2024-09-10T23:32:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.259+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b601a1200 con 0x7f5b60103390 2024-09-10T23:32:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.262+0000 7f5b4f7fe640 1 -- 172.21.15.2:0/3079803112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f5b580043e0 con 0x7f5b60103390 2024-09-10T23:32:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.262+0000 7f5b67de7740 1 Processor -- start 2024-09-10T23:32:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.262+0000 7f5b67de7740 1 -- start start 2024-09-10T23:32:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae004860 0x5629ae006c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 0x5629ae009580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae009bd0 0x5629ae00c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b67de7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5629adf766f0 con 0x5629ae007190 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b67de7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5629adf65b20 con 0x5629ae009bd0 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b67de7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5629adf69930 con 0x5629ae004860 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 0x5629ae009580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 0x5629ae009580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37438/0 (socket says 172.21.15.2:37438) 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 -- 172.21.15.2:0/3617604199 learned_addr learned my addr 172.21.15.2:0/3617604199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae004860 0x5629ae006c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae009bd0 0x5629ae00c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 -- 172.21.15.2:0/3617604199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae004860 msgr2=0x5629ae006c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae004860 0x5629ae006c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 -- 172.21.15.2:0/3617604199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae009bd0 msgr2=0x5629ae00c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae009bd0 0x5629ae00c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 -- 172.21.15.2:0/3617604199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629adf2b530 con 0x5629ae007190 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b4f7fe640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b480b52e0 0x7f5b480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 0x5629ae009580 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000bd10 tx=0x7f5b500107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b02dc9065b36948 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.263+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b480b52e0 0x7f5b480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b4f7fe640 1 -- 172.21.15.2:0/3079803112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b58107280 con 0x7f5b60103390 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b4cff9640 1 -- 172.21.15.2:0/3617604199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50004030 con 0x5629ae007190 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b4cff9640 1 -- 172.21.15.2:0/3617604199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b500035f0 con 0x5629ae007190 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b4cff9640 1 -- 172.21.15.2:0/3617604199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b500117b0 con 0x5629ae007190 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 -- 172.21.15.2:0/3617604199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 msgr2=0x5629ae009580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b480b52e0 0x7f5b480b77a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5b54005d00 tx=0x7f5b54014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 0x5629ae009580 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000bd10 tx=0x7f5b500107a0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 -- 172.21.15.2:0/3617604199 shutdown_connections 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae009bd0 0x5629ae00c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae007190 0x5629ae009580 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 --2- 172.21.15.2:0/3617604199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae004860 0x5629ae006c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.264+0000 7f5b67de7740 1 -- 172.21.15.2:0/3617604199 >> 172.21.15.2:0/3617604199 conn(0x5629adfff9b0 msgr2=0x5629ae000740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 -- 172.21.15.2:0/3617604199 shutdown_connections 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 -- 172.21.15.2:0/3617604199 wait complete. 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 -- start start 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 Processor -- start 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae00dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae00e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae00f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5629ade9dab0 con 0x5629ae009bd0 2024-09-10T23:32:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5629adf0b730 con 0x5629ae004860 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5629ae00cbb0 con 0x5629ae007190 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b67de7740 10 client.0 _ll_register_callbacks cb 0x5629adf5f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae00f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae00f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37442/0 (socket says 172.21.15.2:37442) 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/627572541 learned_addr learned my addr 172.21.15.2:0/627572541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.265+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae00e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae00dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 msgr2=0x5629ae00e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae00e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/627572541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 msgr2=0x5629ae00dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae00dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/627572541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629adcc7790 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae00f130 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cd980 tx=0x7f5b580cd160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14c7f4b654437f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b45ffb640 1 -- 172.21.15.2:0/627572541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580cd500 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b45ffb640 1 -- 172.21.15.2:0/627572541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b580c9c60 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b500035f0 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b45ffb640 1 -- 172.21.15.2:0/627572541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b580ce0f0 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b67de7740 10 client.18360 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629add40620 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.266+0000 7f5b45ffb640 1 -- 172.21.15.2:0/627572541 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b500035f0 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b45ffb640 1 -- 172.21.15.2:0/627572541 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b580d6af0 con 0x5629ae009bd0 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b67de7740 10 client.18360 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b67de7740 10 client.18360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b67de7740 20 client.18360 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b67de7740 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae019740 0x5629ae01bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b67de7740 4 client.18360 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629adf78640 con 0x5629ae019740 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae019740 0x5629ae01bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b45ffb640 10 client.18360 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.267+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae019740 0x5629ae01bb50 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f1dc1dc98f6b4e server_cookie=49eb9395ea9fbdc8 in_seq=0 out_seq=0 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b45ffb640 1 -- 172.21.15.2:0/627572541 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629adf78640 con 0x5629ae019740 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b45ffb640 10 client.18360 handle_command_reply: tid=0 2024-09-10T23:32:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 client.18360 shutdown 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 msgr2=0x5629ae00f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae00f130 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cd980 tx=0x7f5b580cd160 comp rx=0 tx=0).stop 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 shutdown_connections 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae019740 0x5629ae01bb50 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae00f130 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b45ffb640 0 client.18360 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae00e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 --2- 172.21.15.2:0/627572541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae00dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 >> 172.21.15.2:0/627572541 conn(0x5629adfff9b0 msgr2=0x5629adffebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 shutdown_connections 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.268+0000 7f5b67de7740 1 -- 172.21.15.2:0/627572541 wait complete. 2024-09-10T23:32:52.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.269+0000 7f5b67de7740 20 client.18360 trim_cache size 0 max 16384 2024-09-10T23:32:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:52 smithi154 ceph-mon[35136]: pgmap v607: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:32:52.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.283+0000 7f5b67de7740 1 Processor -- start 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.283+0000 7f5b67de7740 1 -- start start 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae01bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae002a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae002f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b67de7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601a9e90 con 0x5629ae009bd0 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b67de7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601ab9d0 con 0x5629ae004860 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b67de7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601aa560 con 0x5629ae007190 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae002f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae002f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37450/0 (socket says 172.21.15.2:37450) 2024-09-10T23:32:52.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/521007032 learned_addr learned my addr 172.21.15.2:0/521007032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae002a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae01bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/521007032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 msgr2=0x5629ae002a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae002a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/521007032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 msgr2=0x5629ae01bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae01bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/521007032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629adfff740 con 0x5629ae009bd0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae002f40 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cd6f0 tx=0x7f5b580ccc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ea1922168a7097 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b47fff640 1 -- 172.21.15.2:0/521007032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580cd500 con 0x5629ae009bd0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b47fff640 1 -- 172.21.15.2:0/521007032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b58036070 con 0x5629ae009bd0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.284+0000 7f5b47fff640 1 -- 172.21.15.2:0/521007032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580cd9f0 con 0x5629ae009bd0 2024-09-10T23:32:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 -- 172.21.15.2:0/521007032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 msgr2=0x5629ae002f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae002f40 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cd6f0 tx=0x7f5b580ccc50 comp rx=0 tx=0).stop 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 -- 172.21.15.2:0/521007032 shutdown_connections 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae002f40 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae002a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 --2- 172.21.15.2:0/521007032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae01bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 -- 172.21.15.2:0/521007032 >> 172.21.15.2:0/521007032 conn(0x5629adfff9b0 msgr2=0x5629ae000650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 -- 172.21.15.2:0/521007032 shutdown_connections 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 -- 172.21.15.2:0/521007032 wait complete. 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.285+0000 7f5b67de7740 1 -- start start 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 Processor -- start 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae012ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae013340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae013f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601ab300 con 0x5629ae009bd0 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601aac30 con 0x5629ae004860 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601a7e70 con 0x5629ae007190 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b67de7740 10 client.0 _ll_register_callbacks cb 0x7f5b58005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae013f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae013f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37462/0 (socket says 172.21.15.2:37462) 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/2080008529 learned_addr learned my addr 172.21.15.2:0/2080008529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5dd9b640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae013340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae012ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 msgr2=0x5629ae013340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae013340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/2080008529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 msgr2=0x5629ae012ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae012ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 -- 172.21.15.2:0/2080008529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ae014740 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b5ed9d640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae013f10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cd980 tx=0x7f5b5802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f64b837fd9f005 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.286+0000 7f5b45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b45ffb640 1 -- 172.21.15.2:0/2080008529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580cd500 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b45ffb640 1 -- 172.21.15.2:0/2080008529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f5b580d6af0 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b58036070 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b45ffb640 1 -- 172.21.15.2:0/2080008529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b580cd9f0 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 10 client.18366 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629ae014740 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b45ffb640 1 -- 172.21.15.2:0/2080008529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b58036070 con 0x5629ae009bd0 2024-09-10T23:32:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b45ffb640 1 -- 172.21.15.2:0/2080008529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b580da020 con 0x5629ae009bd0 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 10 client.18366 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 10 client.18366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 20 client.18366 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae086660 0x5629ae088a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 4 client.18366 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.287+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629adf740f0 con 0x5629ae086660 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.288+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae086660 0x5629ae088a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.288+0000 7f5b5e59c640 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae086660 0x5629ae088a50 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1278f29d3b1d0ea1 server_cookie=a95cfd240a6d5352 in_seq=0 out_seq=0 2024-09-10T23:32:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.288+0000 7f5b45ffb640 10 client.18366 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b45ffb640 1 -- 172.21.15.2:0/2080008529 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629adf740f0 con 0x5629ae086660 2024-09-10T23:32:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b45ffb640 10 client.18366 handle_command_reply: tid=0 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 client.18366 shutdown 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 msgr2=0x5629ae013f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae013f10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cd980 tx=0x7f5b5802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 shutdown_connections 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5629ae086660 0x5629ae088a50 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629ae009bd0 0x5629ae013f10 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b45ffb640 0 client.18366 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5629ae007190 0x5629ae013340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 --2- 172.21.15.2:0/2080008529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629ae004860 0x5629ae012ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 >> 172.21.15.2:0/2080008529 conn(0x5629adfff9b0 msgr2=0x5629ae00d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 shutdown_connections 2024-09-10T23:32:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.303+0000 7f5b67de7740 1 -- 172.21.15.2:0/2080008529 wait complete. 2024-09-10T23:32:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b67de7740 20 client.18366 trim_cache size 0 max 16384 2024-09-10T23:32:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:32:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:32:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:32:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b480b52e0 msgr2=0x7f5b480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b480b52e0 0x7f5b480b77a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5b54005d00 tx=0x7f5b54014040 comp rx=0 tx=0).stop 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 msgr2=0x7f5b60199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60199f80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f5b580097b0 tx=0x7f5b58003c20 comp rx=0 tx=0).stop 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 shutdown_connections 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f5b480b52e0 0x7f5b480b77a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b60103390 0x7f5b60199f80 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b60102820 0x7f5b60199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 --2- 172.21.15.2:0/3079803112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101ee0 0x7f5b60198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 >> 172.21.15.2:0/3079803112 conn(0x7f5b600fc8f0 msgr2=0x7f5b60100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 shutdown_connections 2024-09-10T23:32:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:32:52.304+0000 7f5b64f3d640 1 -- 172.21.15.2:0/3079803112 wait complete. 2024-09-10T23:32:52.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:52 smithi177 ceph-mon[35760]: pgmap v607: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:32:52.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:52 smithi002 ceph-mon[31150]: pgmap v607: 97 pgs: 97 active+clean; 2.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:32:53.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:32:53.326 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:53.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 -- 172.21.15.2:0/4119899955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e8109150 msgr2=0x7f30e810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/4119899955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e8109150 0x7f30e810f950 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009ca0 tx=0x7f30e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 -- 172.21.15.2:0/4119899955 shutdown_connections 2024-09-10T23:32:53.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/4119899955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e8109150 0x7f30e810f950 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/4119899955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e81087d0 0x7f30e8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/4119899955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e8102dc0 0x7f30e81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 -- 172.21.15.2:0/4119899955 >> 172.21.15.2:0/4119899955 conn(0x7f30e80fe830 msgr2=0x7f30e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 -- 172.21.15.2:0/4119899955 shutdown_connections 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.858+0000 7f30ee9f8640 1 -- 172.21.15.2:0/4119899955 wait complete. 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 Processor -- start 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 -- start start 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e8102dc0 0x7f30e8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 0x7f30e8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e8109150 0x7f30e819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112e10 con 0x7f30e81087d0 2024-09-10T23:32:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112c90 con 0x7f30e8109150 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.859+0000 7f30ee9f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112f90 con 0x7f30e8102dc0 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 0x7f30e8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 0x7f30e8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37482/0 (socket says 172.21.15.2:37482) 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 -- 172.21.15.2:0/1923589910 learned_addr learned my addr 172.21.15.2:0/1923589910 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e7fff640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e8102dc0 0x7f30e8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30ecf95640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e8109150 0x7f30e819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 -- 172.21.15.2:0/1923589910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e8102dc0 msgr2=0x7f30e8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e8102dc0 0x7f30e8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 -- 172.21.15.2:0/1923589910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e8109150 msgr2=0x7f30e819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e8109150 0x7f30e819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 -- 172.21.15.2:0/1923589910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e819f3b0 con 0x7f30e81087d0 2024-09-10T23:32:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e77fe640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 0x7f30e8199840 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00d950 tx=0x7f30dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e57fa640 1 -- 172.21.15.2:0/1923589910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc017030 con 0x7f30e81087d0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e57fa640 1 -- 172.21.15.2:0/1923589910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30dc004020 con 0x7f30e81087d0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e819f6a0 con 0x7f30e81087d0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30e57fa640 1 -- 172.21.15.2:0/1923589910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0047a0 con 0x7f30e81087d0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.860+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81a5f30 con 0x7f30e81087d0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30e57fa640 1 -- 172.21.15.2:0/1923589910 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f30dc009a30 con 0x7f30e81087d0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 Processor -- start 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 -- start start 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b026480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b036820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b039150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56008af9ce50 con 0x56008b0269c0 2024-09-10T23:32:53.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56008af8c280 con 0x56008b036d60 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56008af90090 con 0x56008b0260a0 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b036820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b036820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37492/0 (socket says 172.21.15.2:37492) 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.863+0000 7f30e7fff640 1 -- 172.21.15.2:0/3208565129 learned_addr learned my addr 172.21.15.2:0/3208565129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e77fe640 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b039150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30ecf95640 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b026480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e57fa640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30d00b5360 0x7f30d00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e7fff640 1 -- 172.21.15.2:0/3208565129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 msgr2=0x56008b026480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e7fff640 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b026480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e7fff640 1 -- 172.21.15.2:0/3208565129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 msgr2=0x56008b039150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e7fff640 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b039150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e7fff640 1 -- 172.21.15.2:0/3208565129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008acea650 con 0x56008b0269c0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30ecf95640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30d00b5360 0x7f30d00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e57fa640 1 -- 172.21.15.2:0/1923589910 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f30dc0e5580 con 0x7f30e81087d0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30e7fff640 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b036820 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f30d800b790 tx=0x7f30d800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76e4aded63438bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30ce7fc640 1 -- 172.21.15.2:0/3208565129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8003dd0 con 0x56008b0269c0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30ce7fc640 1 -- 172.21.15.2:0/3208565129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30d8015070 con 0x56008b0269c0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.864+0000 7f30ce7fc640 1 -- 172.21.15.2:0/3208565129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8004e00 con 0x56008b0269c0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 -- 172.21.15.2:0/3208565129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 msgr2=0x56008b036820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30ecf95640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30d00b5360 0x7f30d00b7820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f30e0005cc0 tx=0x7f30e00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b036820 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f30d800b790 tx=0x7f30d800bc50 comp rx=0 tx=0).stop 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 -- 172.21.15.2:0/3208565129 shutdown_connections 2024-09-10T23:32:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b039150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b036820 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/3208565129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b026480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 -- 172.21.15.2:0/3208565129 >> 172.21.15.2:0/3208565129 conn(0x56008b023ed0 msgr2=0x56008b025070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 -- 172.21.15.2:0/3208565129 shutdown_connections 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 -- 172.21.15.2:0/3208565129 wait complete. 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.865+0000 7f30f0dcd740 1 -- start start 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 Processor -- start 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b036690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b033ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b034160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56008aded700 con 0x56008b0269c0 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56008af27110 con 0x56008b036d60 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56008b039a10 con 0x56008b0260a0 2024-09-10T23:32:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30f0dcd740 10 client.0 _ll_register_callbacks cb 0x56008af40990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b033ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b033ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37508/0 (socket says 172.21.15.2:37508) 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 -- 172.21.15.2:0/127500535 learned_addr learned my addr 172.21.15.2:0/127500535 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e7fff640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b036690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30ecf95640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b034160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 -- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 msgr2=0x56008b036690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b036690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 -- 172.21.15.2:0/127500535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 msgr2=0x56008b034160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b034160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30e77fe640 1 -- 172.21.15.2:0/127500535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008af54c40 con 0x56008b0269c0 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.866+0000 7f30ecf95640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b034160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30e77fe640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b033ae0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0abc80 tx=0x7f30dc0abbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208e138f9d14baac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30c77fe640 1 -- 172.21.15.2:0/127500535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0056a0 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30c77fe640 1 -- 172.21.15.2:0/127500535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f30dc093070 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30d8015070 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30c77fe640 1 -- 172.21.15.2:0/127500535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30dc0ab800 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 10 client.18378 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56008b0453b0 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30c77fe640 1 -- 172.21.15.2:0/127500535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30d8015070 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30c77fe640 1 -- 172.21.15.2:0/127500535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f30dc0a7f60 con 0x56008b0269c0 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 10 client.18378 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 10 client.18378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 20 client.18378 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b046870 0x56008b048c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 4 client.18378 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.867+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56008af9eda0 con 0x56008b046870 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.868+0000 7f30e7fff640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b046870 0x56008b048c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.868+0000 7f30c77fe640 10 client.18378 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.868+0000 7f30e7fff640 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b046870 0x56008b048c60 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47124a90e7ae0b9 server_cookie=29135534c4312c1b in_seq=0 out_seq=0 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30c77fe640 1 -- 172.21.15.2:0/127500535 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56008af9eda0 con 0x56008b046870 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30c77fe640 10 client.18378 handle_command_reply: tid=0 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 client.18378 shutdown 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 msgr2=0x56008b033ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b033ae0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0abc80 tx=0x7f30dc0abbb0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 shutdown_connections 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b046870 0x56008b048c60 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b034160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b033ae0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/127500535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b036690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30c77fe640 0 client.18378 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 >> 172.21.15.2:0/127500535 conn(0x56008b023ed0 msgr2=0x56008b029a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 shutdown_connections 2024-09-10T23:32:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 1 -- 172.21.15.2:0/127500535 wait complete. 2024-09-10T23:32:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.869+0000 7f30f0dcd740 20 client.18378 trim_cache size 0 max 16384 2024-09-10T23:32:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 Processor -- start 2024-09-10T23:32:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 -- start start 2024-09-10T23:32:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b042c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b0252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b04e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ac270 con 0x56008b0269c0 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81addb0 con 0x56008b036d60 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ac940 con 0x56008b0260a0 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b0252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b0252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37512/0 (socket says 172.21.15.2:37512) 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.887+0000 7f30e77fe640 1 -- 172.21.15.2:0/108850591 learned_addr learned my addr 172.21.15.2:0/108850591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e7fff640 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b042c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e77fe640 1 -- 172.21.15.2:0/108850591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 msgr2=0x56008b042c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e77fe640 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b042c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30ecf95640 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b04e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e77fe640 1 -- 172.21.15.2:0/108850591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 msgr2=0x56008b04e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e77fe640 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b04e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e77fe640 1 -- 172.21.15.2:0/108850591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008b049290 con 0x56008b0269c0 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30ecf95640 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b04e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30e77fe640 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b0252c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f30dc004770 tx=0x7f30dc005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d03b3ba680c1b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30cdffb640 1 -- 172.21.15.2:0/108850591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0ab460 con 0x56008b0269c0 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30cdffb640 1 -- 172.21.15.2:0/108850591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30dc0056a0 con 0x56008b0269c0 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.888+0000 7f30cdffb640 1 -- 172.21.15.2:0/108850591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0a7f60 con 0x56008b0269c0 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 -- 172.21.15.2:0/108850591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 msgr2=0x56008b0252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b0252c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f30dc004770 tx=0x7f30dc005ab0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 -- 172.21.15.2:0/108850591 shutdown_connections 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b036d60 0x56008b04e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b0269c0 0x56008b0252c0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/108850591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b042c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 -- 172.21.15.2:0/108850591 >> 172.21.15.2:0/108850591 conn(0x56008b023ed0 msgr2=0x56008b024bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 -- 172.21.15.2:0/108850591 shutdown_connections 2024-09-10T23:32:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 -- 172.21.15.2:0/108850591 wait complete. 2024-09-10T23:32:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.889+0000 7f30f0dcd740 1 -- start start 2024-09-10T23:32:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 Processor -- start 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b03eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b0269c0 0x56008b03f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 0x56008b03bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ad6e0 con 0x56008b036d60 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ad010 con 0x56008b0269c0 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81aa250 con 0x56008b0260a0 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30f0dcd740 10 client.0 _ll_register_callbacks cb 0x7f30dc0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 0x56008b03bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 0x56008b03bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37524/0 (socket says 172.21.15.2:37524) 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 -- 172.21.15.2:0/655412610 learned_addr learned my addr 172.21.15.2:0/655412610 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30e7fff640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b03eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30e77fe640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b0269c0 0x56008b03f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 -- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 msgr2=0x56008b03eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b03eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 -- 172.21.15.2:0/655412610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b0269c0 msgr2=0x56008b03f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b0269c0 0x56008b03f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 -- 172.21.15.2:0/655412610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008b0376a0 con 0x56008b036d60 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30ecf95640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 0x56008b03bca0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f30e0035000 tx=0x7f30e002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea05a37c8850cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.890+0000 7f30c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30c77fe640 1 -- 172.21.15.2:0/655412610 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e00044c0 con 0x56008b036d60 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30c77fe640 1 -- 172.21.15.2:0/655412610 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f30e0004660 con 0x56008b036d60 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30dc0056a0 con 0x56008b036d60 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30c77fe640 1 -- 172.21.15.2:0/655412610 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30e0004860 con 0x56008b036d60 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 10 client.18384 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56008b0b3fd0 con 0x56008b036d60 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30c77fe640 1 -- 172.21.15.2:0/655412610 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30dc0056a0 con 0x56008b036d60 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30c77fe640 1 -- 172.21.15.2:0/655412610 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f30e005b020 con 0x56008b036d60 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 10 client.18384 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 10 client.18384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 20 client.18384 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b0b47b0 0x56008b0b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 4 client.18384 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.891+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56008af9a850 con 0x56008b0b47b0 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.892+0000 7f30e7fff640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b0b47b0 0x56008b0b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.892+0000 7f30e7fff640 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b0b47b0 0x56008b0b6bd0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=560890dc409c1416 server_cookie=a6eb1d580ffd3bd8 in_seq=0 out_seq=0 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.892+0000 7f30c77fe640 10 client.18384 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.892+0000 7f30c77fe640 1 -- 172.21.15.2:0/655412610 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x56008af9a850 con 0x56008b0b47b0 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.892+0000 7f30c77fe640 10 client.18384 handle_command_reply: tid=0 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.892+0000 7f30f0dcd740 1 client.18384 shutdown 2024-09-10T23:32:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 msgr2=0x56008b03bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 0x56008b03bca0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f30e0035000 tx=0x7f30e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 shutdown_connections 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56008b0b47b0 0x56008b0b6bd0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56008b036d60 0x56008b03bca0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56008b0269c0 0x56008b03f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 --2- 172.21.15.2:0/655412610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56008b0260a0 0x56008b03eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30c77fe640 0 client.18384 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 >> 172.21.15.2:0/655412610 conn(0x56008b023ed0 msgr2=0x56008b0253d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 shutdown_connections 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 1 -- 172.21.15.2:0/655412610 wait complete. 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30f0dcd740 20 client.18384 trim_cache size 0 max 16384 2024-09-10T23:32:53.899 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:32:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:32:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:32:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:32:53.910 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30d00b5360 msgr2=0x7f30d00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30d00b5360 0x7f30d00b7820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f30e0005cc0 tx=0x7f30e00095c0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 msgr2=0x7f30e8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.893+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 0x7f30e8199840 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00d950 tx=0x7f30dc00de10 comp rx=0 tx=0).stop 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 shutdown_connections 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f30d00b5360 0x7f30d00b7820 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e8109150 0x7f30e819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30e81087d0 0x7f30e8199840 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 --2- 172.21.15.2:0/1923589910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e8102dc0 0x7f30e8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 >> 172.21.15.2:0/1923589910 conn(0x7f30e80fe830 msgr2=0x7f30e8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 shutdown_connections 2024-09-10T23:32:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:53.894+0000 7f30ee9f8640 1 -- 172.21.15.2:0/1923589910 wait complete. 2024-09-10T23:32:54.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:54 smithi002 ceph-mon[31150]: pgmap v608: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:32:54.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:54 smithi154 ceph-mon[35136]: pgmap v608: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:32:54.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:54 smithi177 ceph-mon[35760]: pgmap v608: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:32:54.772 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:32:54.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:32:55.037 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 -- 172.21.15.2:0/1508603197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f401087d0 msgr2=0x7f0f40108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 --2- 172.21.15.2:0/1508603197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f401087d0 0x7f0f40108c10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009900 tx=0x7f0f3002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 -- 172.21.15.2:0/1508603197 shutdown_connections 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 --2- 172.21.15.2:0/1508603197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f40109150 0x7f0f4010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 --2- 172.21.15.2:0/1508603197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f401087d0 0x7f0f40108c10 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 --2- 172.21.15.2:0/1508603197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f40102dc0 0x7f0f401031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 -- 172.21.15.2:0/1508603197 >> 172.21.15.2:0/1508603197 conn(0x7f0f400fe830 msgr2=0x7f0f40100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 -- 172.21.15.2:0/1508603197 shutdown_connections 2024-09-10T23:32:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.549+0000 7f0f473ca640 1 -- 172.21.15.2:0/1508603197 wait complete. 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 Processor -- start 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 -- start start 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 0x7f0f400754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f401087d0 0x7f0f400759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f40109150 0x7f0f40075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40112e10 con 0x7f0f40102dc0 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40112c90 con 0x7f0f40109150 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f473ca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40112f90 con 0x7f0f401087d0 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 0x7f0f400754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 0x7f0f400754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37540/0 (socket says 172.21.15.2:37540) 2024-09-10T23:32:55.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 -- 172.21.15.2:0/339549751 learned_addr learned my addr 172.21.15.2:0/339549751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f44965640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f401087d0 0x7f0f400759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45967640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f40109150 0x7f0f40075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 -- 172.21.15.2:0/339549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f401087d0 msgr2=0x7f0f400759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f401087d0 0x7f0f400759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 -- 172.21.15.2:0/339549751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f40109150 msgr2=0x7f0f40075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f40109150 0x7f0f40075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.550+0000 7f0f45166640 1 -- 172.21.15.2:0/339549751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f401a7700 con 0x7f0f40102dc0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.551+0000 7f0f45166640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 0x7f0f400754a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b4a0 tx=0x7f0f3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.551+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c014070 con 0x7f0f40102dc0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.551+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c010ac0 con 0x7f0f40102dc0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.551+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f401a79f0 con 0x7f0f40102dc0 2024-09-10T23:32:55.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.551+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c017c30 con 0x7f0f40102dc0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.551+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f401a7fd0 con 0x7f0f40102dc0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.552+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f401031a0 con 0x7f0f40102dc0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.553+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0f3c010610 con 0x7f0f40102dc0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.554+0000 7f0f367fc640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0f2c0b5360 0x7f0f2c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.554+0000 7f0f44965640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0f2c0b5360 0x7f0f2c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.554+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0f3c0e5310 con 0x7f0f40102dc0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.555+0000 7f0f44965640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0f2c0b5360 0x7f0f2c0b7820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0f30031440 tx=0x7f0f30005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:55.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.557+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f3c0abb90 con 0x7f0f40102dc0 2024-09-10T23:32:55.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.780+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f400767a0 con 0x7f0f40102dc0 2024-09-10T23:32:55.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.781+0000 7f0f367fc640 1 -- 172.21.15.2:0/339549751 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f0f3c0b05c0 con 0x7f0f40102dc0 2024-09-10T23:32:55.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:32:55.782 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:32:55.782 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:32:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0f2c0b5360 msgr2=0x7f0f2c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0f2c0b5360 0x7f0f2c0b7820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0f30031440 tx=0x7f0f30005b50 comp rx=0 tx=0).stop 2024-09-10T23:32:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 msgr2=0x7f0f400754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 0x7f0f400754a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b4a0 tx=0x7f0f3c00b960 comp rx=0 tx=0).stop 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 shutdown_connections 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0f2c0b5360 0x7f0f2c0b7820 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f40109150 0x7f0f40075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f401087d0 0x7f0f400759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 --2- 172.21.15.2:0/339549751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f40102dc0 0x7f0f400754a0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.783+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 >> 172.21.15.2:0/339549751 conn(0x7f0f400fe830 msgr2=0x7f0f40105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.784+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 shutdown_connections 2024-09-10T23:32:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:55.784+0000 7f0f473ca640 1 -- 172.21.15.2:0/339549751 wait complete. 2024-09-10T23:32:56.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:56 smithi002 ceph-mon[31150]: pgmap v609: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:56.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/339549751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:32:56.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:56 smithi154 ceph-mon[35136]: pgmap v609: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/339549751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:32:56.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:56 smithi177 ceph-mon[35760]: pgmap v609: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:56.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/339549751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:32:56.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:32:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 -- 172.21.15.2:0/1194352496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105590 msgr2=0x7fb7001059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 --2- 172.21.15.2:0/1194352496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105590 0x7fb7001059d0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009900 tx=0x7fb6f402a410 comp rx=0 tx=0).stop 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 -- 172.21.15.2:0/1194352496 shutdown_connections 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 --2- 172.21.15.2:0/1194352496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb700105f10 0x7fb70010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 --2- 172.21.15.2:0/1194352496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105590 0x7fb7001059d0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 --2- 172.21.15.2:0/1194352496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7001011e0 0x7fb7001015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 -- 172.21.15.2:0/1194352496 >> 172.21.15.2:0/1194352496 conn(0x7fb700078060 msgr2=0x7fb7000ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 -- 172.21.15.2:0/1194352496 shutdown_connections 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 -- 172.21.15.2:0/1194352496 wait complete. 2024-09-10T23:32:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.346+0000 7fb705136640 1 Processor -- start 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 -- start start 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7001011e0 0x7fb7001992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb700105590 0x7fb700199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 0x7fb70019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb700112e60 con 0x7fb700105f10 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb700112ce0 con 0x7fb7001011e0 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb705136640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb700112fe0 con 0x7fb700105590 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 0x7fb70019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 0x7fb70019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37558/0 (socket says 172.21.15.2:37558) 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 -- 172.21.15.2:0/2620879894 learned_addr learned my addr 172.21.15.2:0/2620879894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7001011e0 0x7fb7001992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb700105590 0x7fb700199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 -- 172.21.15.2:0/2620879894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb700105590 msgr2=0x7fb700199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb700105590 0x7fb700199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 -- 172.21.15.2:0/2620879894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7001011e0 msgr2=0x7fb7001992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7001011e0 0x7fb7001992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.347+0000 7fb6ff59e640 1 -- 172.21.15.2:0/2620879894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70019f3a0 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.348+0000 7fb6ff59e640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 0x7fb70019ebd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009fd0 tx=0x7fb6f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.348+0000 7fb6e7fff640 1 -- 172.21.15.2:0/2620879894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8017070 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.348+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70019f690 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.348+0000 7fb6e7fff640 1 -- 172.21.15.2:0/2620879894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f8003e20 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.348+0000 7fb6e7fff640 1 -- 172.21.15.2:0/2620879894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8010460 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.348+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7001a5d50 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.350+0000 7fb6e7fff640 1 -- 172.21.15.2:0/2620879894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb6f8003970 con 0x7fb700105f10 2024-09-10T23:32:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.350+0000 7fb70750b740 1 Processor -- start 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.350+0000 7fb70750b740 1 -- start start 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb70750b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a91578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb70750b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9157df0 0x5592a9163840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb70750b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9163d80 0x5592a9166170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb70750b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5592a90cdea0 con 0x5592a91574d0 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb70750b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5592a90bd2d0 con 0x5592a9163d80 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb70750b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5592a90c10e0 con 0x5592a9157df0 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a91578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a91578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37562/0 (socket says 172.21.15.2:37562) 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 -- 172.21.15.2:0/3611902496 learned_addr learned my addr 172.21.15.2:0/3611902496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9157df0 0x5592a9163840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 -- 172.21.15.2:0/3611902496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9157df0 msgr2=0x5592a9163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6e7fff640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6e80b52e0 0x7fb6e80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9157df0 0x5592a9163840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 -- 172.21.15.2:0/3611902496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9163d80 msgr2=0x5592a9166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9163d80 0x5592a9166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 -- 172.21.15.2:0/3611902496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592a8e1b650 con 0x5592a91574d0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9157df0 0x5592a9163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6ff59e640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6e80b52e0 0x7fb6e80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.351+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a91578b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4006010 tx=0x7fb6f40095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713b0479ee5b75a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb6e7fff640 1 -- 172.21.15.2:0/2620879894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb6f80e5820 con 0x7fb700105f10 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb6e57fa640 1 -- 172.21.15.2:0/3611902496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4041070 con 0x5592a91574d0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb6e57fa640 1 -- 172.21.15.2:0/3611902496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f40054f0 con 0x5592a91574d0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb6e57fa640 1 -- 172.21.15.2:0/3611902496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4035040 con 0x5592a91574d0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb70750b740 1 -- 172.21.15.2:0/3611902496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 msgr2=0x5592a91578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb6ff59e640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6e80b52e0 0x7fb6e80b77a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80e3380 tx=0x7fb6f8070810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.352+0000 7fb70750b740 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a91578b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4006010 tx=0x7fb6f40095a0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- 172.21.15.2:0/3611902496 shutdown_connections 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9163d80 0x5592a9166170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9157df0 0x5592a9163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 --2- 172.21.15.2:0/3611902496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a91578b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- 172.21.15.2:0/3611902496 >> 172.21.15.2:0/3611902496 conn(0x5592a9155300 msgr2=0x5592a91564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- 172.21.15.2:0/3611902496 shutdown_connections 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- 172.21.15.2:0/3611902496 wait complete. 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- start start 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 Processor -- start 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a9163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5592a8f1e700 con 0x5592a9163d80 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5592a9058160 con 0x5592a9157df0 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5592a91669a0 con 0x5592a91574d0 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.353+0000 7fb70750b740 10 client.0 _ll_register_callbacks cb 0x5592a90719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37568/0 (socket says 172.21.15.2:37568) 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 -- 172.21.15.2:0/857780486 learned_addr learned my addr 172.21.15.2:0/857780486 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a9163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 -- 172.21.15.2:0/857780486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 msgr2=0x5592a9163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a9163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 -- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 msgr2=0x5592a9160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 -- 172.21.15.2:0/857780486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592a9085c90 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91610e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4004d90 tx=0x7fb6f4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5d4ef05e5f464f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/857780486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4035070 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/857780486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb6f4004770 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6f40054f0 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/857780486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6f4041070 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb70750b740 10 client.18402 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.354+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592a91722f0 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/857780486 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f40054f0 con 0x5592a9163d80 2024-09-10T23:32:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/857780486 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6f4052020 con 0x5592a9163d80 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb70750b740 10 client.18402 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb70750b740 10 client.18402 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb70750b740 20 client.18402 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb70750b740 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a9173640 0x5592a9175a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb70750b740 4 client.18402 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592a90cfdf0 con 0x5592a9173640 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.355+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a9173640 0x5592a9175a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a9173640 0x5592a9175a30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=490801d1353fcaec server_cookie=796dfb1c614bf08a in_seq=0 out_seq=0 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb6e2ff5640 10 client.18402 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/857780486 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592a90cfdf0 con 0x5592a9173640 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb6e2ff5640 10 client.18402 handle_command_reply: tid=0 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb70750b740 1 client.18402 shutdown 2024-09-10T23:32:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 msgr2=0x5592a91610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.356+0000 7fb70750b740 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91610e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4004d90 tx=0x7fb6f4009260 comp rx=0 tx=0).stop 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 shutdown_connections 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a9173640 0x5592a9175a30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91610e0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 --2- 172.21.15.2:0/857780486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a9163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 >> 172.21.15.2:0/857780486 conn(0x5592a9155300 msgr2=0x5592a915ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb6e2ff5640 0 client.18402 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 shutdown_connections 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 1 -- 172.21.15.2:0/857780486 wait complete. 2024-09-10T23:32:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.357+0000 7fb70750b740 20 client.18402 trim_cache size 0 max 16384 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 Processor -- start 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 -- start start 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a916fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a91627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9163d80 0x5592a9165170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001ae370 con 0x5592a91574d0 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001afeb0 con 0x5592a9157df0 2024-09-10T23:32:57.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb70750b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001aea40 con 0x5592a9163d80 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a916fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a916fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37584/0 (socket says 172.21.15.2:37584) 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.370+0000 7fb6fe59c640 1 -- 172.21.15.2:0/2641031711 learned_addr learned my addr 172.21.15.2:0/2641031711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6fe59c640 1 -- 172.21.15.2:0/2641031711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9163d80 msgr2=0x5592a9165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9163d80 0x5592a9165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6fe59c640 1 -- 172.21.15.2:0/2641031711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 msgr2=0x5592a91627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a91627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6fe59c640 1 -- 172.21.15.2:0/2641031711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592a9157c20 con 0x5592a91574d0 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a916fc70 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4031d80 tx=0x7fb6f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41986e8af6a21d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6e4ff9640 1 -- 172.21.15.2:0/2641031711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4035070 con 0x5592a91574d0 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6e4ff9640 1 -- 172.21.15.2:0/2641031711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f4004f90 con 0x5592a91574d0 2024-09-10T23:32:57.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb6e4ff9640 1 -- 172.21.15.2:0/2641031711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4046850 con 0x5592a91574d0 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb70750b740 1 -- 172.21.15.2:0/2641031711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 msgr2=0x5592a916fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.371+0000 7fb70750b740 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a916fc70 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4031d80 tx=0x7fb6f4000bc0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- 172.21.15.2:0/2641031711 shutdown_connections 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a9163d80 0x5592a9165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a91627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 --2- 172.21.15.2:0/2641031711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a91574d0 0x5592a916fc70 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- 172.21.15.2:0/2641031711 >> 172.21.15.2:0/2641031711 conn(0x5592a9155300 msgr2=0x5592a91620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- 172.21.15.2:0/2641031711 shutdown_connections 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- 172.21.15.2:0/2641031711 wait complete. 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- start start 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 Processor -- start 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a91748e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9174e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001af7e0 con 0x5592a9163d80 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001af110 con 0x5592a9157df0 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001ac350 con 0x5592a91574d0 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.372+0000 7fb70750b740 10 client.0 _ll_register_callbacks cb 0x7fb6f000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91df1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37592/0 (socket says 172.21.15.2:37592) 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 -- 172.21.15.2:0/1561145192 learned_addr learned my addr 172.21.15.2:0/1561145192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9174e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a91748e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 -- 172.21.15.2:0/1561145192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 msgr2=0x5592a91748e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a91748e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 -- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 msgr2=0x5592a9174e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:57.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9174e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 -- 172.21.15.2:0/1561145192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592a91756f0 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9174e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6fe59c640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91df1a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4004650 tx=0x7fb6f4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aec39d3ea19e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/1561145192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4035040 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/1561145192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb6f4046c60 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.373+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6f4004f90 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/1561145192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6f4046e60 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 10 client.18408 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592a91e07e0 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/1561145192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f4004f90 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/1561145192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6f406b050 con 0x5592a9163d80 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 10 client.18408 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:57.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 10 client.18408 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 20 client.18408 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a91e0bf0 0x5592a91e3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 4 client.18408 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592a90cb8a0 con 0x5592a91e0bf0 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.374+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a91e0bf0 0x5592a91e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb6e2ff5640 10 client.18408 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb6fed9d640 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a91e0bf0 0x5592a91e3010 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8ebec46d61ab2e1e server_cookie=d1dc6ccef568c897 in_seq=0 out_seq=0 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb6e2ff5640 1 -- 172.21.15.2:0/1561145192 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592a90cb8a0 con 0x5592a91e0bf0 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb6e2ff5640 10 client.18408 handle_command_reply: tid=0 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 client.18408 shutdown 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 msgr2=0x5592a91df1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91df1a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4004650 tx=0x7fb6f4005760 comp rx=0 tx=0).stop 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 shutdown_connections 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5592a91e0bf0 0x5592a91e3010 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5592a9163d80 0x5592a91df1a0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592a9157df0 0x5592a9174e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 --2- 172.21.15.2:0/1561145192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592a91574d0 0x5592a91748e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 >> 172.21.15.2:0/1561145192 conn(0x5592a9155300 msgr2=0x5592a9162900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb6e2ff5640 0 client.18408 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 shutdown_connections 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.375+0000 7fb70750b740 1 -- 172.21.15.2:0/1561145192 wait complete. 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb70750b740 20 client.18408 trim_cache size 0 max 16384 2024-09-10T23:32:57.383 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6e80b52e0 msgr2=0x7fb6e80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6e80b52e0 0x7fb6e80b77a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80e3380 tx=0x7fb6f8070810 comp rx=0 tx=0).stop 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 msgr2=0x7fb70019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 0x7fb70019ebd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009fd0 tx=0x7fb6f800b260 comp rx=0 tx=0).stop 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 shutdown_connections 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6e80b52e0 0x7fb6e80b77a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb700105f10 0x7fb70019ebd0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb700105590 0x7fb700199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 --2- 172.21.15.2:0/2620879894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7001011e0 0x7fb7001992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 >> 172.21.15.2:0/2620879894 conn(0x7fb700078060 msgr2=0x7fb700108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 shutdown_connections 2024-09-10T23:32:57.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:57.376+0000 7fb705136640 1 -- 172.21.15.2:0/2620879894 wait complete. 2024-09-10T23:32:58.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:32:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:32:58 smithi154 ceph-mon[35136]: pgmap v610: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:58.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:32:58 smithi177 ceph-mon[35760]: pgmap v610: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:58.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:32:58 smithi002 ceph-mon[31150]: pgmap v610: 97 pgs: 97 active+clean; 2.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:32:58.501 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 -- 172.21.15.2:0/2442123193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c102dc0 msgr2=0x7f9e9c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/2442123193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c102dc0 0x7f9e9c1031a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009ca0 tx=0x7f9e9802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 -- 172.21.15.2:0/2442123193 shutdown_connections 2024-09-10T23:32:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/2442123193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e9c109150 0x7f9e9c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/2442123193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e9c1087d0 0x7f9e9c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/2442123193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c102dc0 0x7f9e9c1031a0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 -- 172.21.15.2:0/2442123193 >> 172.21.15.2:0/2442123193 conn(0x7f9e9c0fe830 msgr2=0x7f9e9c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 -- 172.21.15.2:0/2442123193 shutdown_connections 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.016+0000 7f9ea33b4640 1 -- 172.21.15.2:0/2442123193 wait complete. 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 Processor -- start 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 -- start start 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e9c102dc0 0x7f9e9c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e9c1087d0 0x7f9e9c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 0x7f9e9c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c112e10 con 0x7f9e9c109150 2024-09-10T23:32:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c112c90 con 0x7f9e9c1087d0 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea33b4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c112f90 con 0x7f9e9c102dc0 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.017+0000 7f9ea1951640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 0x7f9e9c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 0x7f9e9c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37612/0 (socket says 172.21.15.2:37612) 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 -- 172.21.15.2:0/1664449661 learned_addr learned my addr 172.21.15.2:0/1664449661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e9c102dc0 0x7f9e9c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e9c1087d0 0x7f9e9c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 -- 172.21.15.2:0/1664449661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e9c102dc0 msgr2=0x7f9e9c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e9c102dc0 0x7f9e9c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 -- 172.21.15.2:0/1664449661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e9c1087d0 msgr2=0x7f9e9c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e9c1087d0 0x7f9e9c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 -- 172.21.15.2:0/1664449661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c19f330 con 0x7f9e9c109150 2024-09-10T23:32:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.018+0000 7f9ea1951640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 0x7f9e9c19eb60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400d750 tx=0x7f9e9400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.019+0000 7f9e8e7fc640 1 -- 172.21.15.2:0/1664449661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94017070 con 0x7f9e9c109150 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.019+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c19f620 con 0x7f9e9c109150 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.019+0000 7f9e8e7fc640 1 -- 172.21.15.2:0/1664449661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e940054d0 con 0x7f9e9c109150 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.019+0000 7f9e8e7fc640 1 -- 172.21.15.2:0/1664449661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94004c60 con 0x7f9e9c109150 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.019+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c1a5eb0 con 0x7f9e9c109150 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.021+0000 7f9e8e7fc640 1 -- 172.21.15.2:0/1664449661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9e94004e00 con 0x7f9e9c109150 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.021+0000 7f9ea5789740 1 Processor -- start 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 -- start start 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea60840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 0x55ae1ea63170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae1e9caea0 con 0x55ae1ea544d0 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae1e9ba2d0 con 0x55ae1ea60d80 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea5789740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ae1e9be0e0 con 0x55ae1ea54df0 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37624/0 (socket says 172.21.15.2:37624) 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 -- 172.21.15.2:0/1132741679 learned_addr learned my addr 172.21.15.2:0/1132741679 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea60840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9e8e7fc640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9e880b52e0 0x7f9e880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 -- 172.21.15.2:0/1132741679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 msgr2=0x55ae1ea60840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea60840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 -- 172.21.15.2:0/1132741679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 msgr2=0x55ae1ea63170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 0x55ae1ea63170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea094f640 1 -- 172.21.15.2:0/1132741679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae1e718650 con 0x55ae1ea544d0 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.022+0000 7f9ea1951640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9e880b52e0 0x7f9e880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.023+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea548b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000bd50 tx=0x7f9e900127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1381a824fcae223 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.023+0000 7f9e8e7fc640 1 -- 172.21.15.2:0/1664449661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9e940e5550 con 0x7f9e9c109150 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.023+0000 7f9e877fe640 1 -- 172.21.15.2:0/1132741679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900120d0 con 0x55ae1ea544d0 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.023+0000 7f9e877fe640 1 -- 172.21.15.2:0/1132741679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e90016070 con 0x55ae1ea544d0 2024-09-10T23:32:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.023+0000 7f9e877fe640 1 -- 172.21.15.2:0/1132741679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90010780 con 0x55ae1ea544d0 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 -- 172.21.15.2:0/1132741679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 msgr2=0x55ae1ea548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea1951640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9e880b52e0 0x7f9e880b77a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e940a8fe0 tx=0x7f9e940dc130 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea548b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000bd50 tx=0x7f9e900127c0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 -- 172.21.15.2:0/1132741679 shutdown_connections 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 0x55ae1ea63170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea60840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1132741679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea548b0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 -- 172.21.15.2:0/1132741679 >> 172.21.15.2:0/1132741679 conn(0x55ae1ea52300 msgr2=0x55ae1ea534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 -- 172.21.15.2:0/1132741679 shutdown_connections 2024-09-10T23:32:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 -- 172.21.15.2:0/1132741679 wait complete. 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 -- start start 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.024+0000 7f9ea5789740 1 Processor -- start 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea60710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea54df0 0x55ae1ea5db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea5e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae1e81b700 con 0x55ae1ea544d0 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae1e955160 con 0x55ae1ea54df0 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ae1ea63a00 con 0x55ae1ea60d80 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 10 client.0 _ll_register_callbacks cb 0x55ae1e96e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea60710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea60710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37634/0 (socket says 172.21.15.2:37634) 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 -- 172.21.15.2:0/1698457644 learned_addr learned my addr 172.21.15.2:0/1698457644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea54df0 0x55ae1ea5db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea5e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 -- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 msgr2=0x55ae1ea5e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea5e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 -- 172.21.15.2:0/1698457644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea54df0 msgr2=0x55ae1ea5db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea54df0 0x55ae1ea5db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 -- 172.21.15.2:0/1698457644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1e982c90 con 0x55ae1ea544d0 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea60710 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9e90005ce0 tx=0x7f9e90005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e933b952e242f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9e84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1698457644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9001b880 con 0x55ae1ea544d0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1698457644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9e90005040 con 0x55ae1ea544d0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.025+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e90016070 con 0x55ae1ea544d0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1698457644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e90031050 con 0x55ae1ea544d0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 10 client.18420 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae1ea6f3d0 con 0x55ae1ea544d0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1698457644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e90016070 con 0x55ae1ea544d0 2024-09-10T23:32:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1698457644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9e90004b00 con 0x55ae1ea544d0 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 10 client.18420 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 10 client.18420 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 20 client.18420 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1ea70720 0x55ae1ea72b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 4 client.18420 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae1e9ccdf0 con 0x55ae1ea70720 2024-09-10T23:32:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.026+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1ea70720 0x55ae1ea72b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.027+0000 7f9e84ff9640 10 client.18420 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.027+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1ea70720 0x55ae1ea72b10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=83ee1209f60ea7c3 server_cookie=56466f68fb604e72 in_seq=0 out_seq=0 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1698457644 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae1e9ccdf0 con 0x55ae1ea70720 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9e84ff9640 10 client.18420 handle_command_reply: tid=0 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 client.18420 shutdown 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 msgr2=0x55ae1ea60710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea60710 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9e90005ce0 tx=0x7f9e90005c50 comp rx=0 tx=0).stop 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 shutdown_connections 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1ea70720 0x55ae1ea72b10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea5e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea54df0 0x55ae1ea5db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9e84ff9640 0 client.18420 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1698457644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea60710 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 >> 172.21.15.2:0/1698457644 conn(0x55ae1ea52300 msgr2=0x55ae1ea57e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 shutdown_connections 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 1 -- 172.21.15.2:0/1698457644 wait complete. 2024-09-10T23:32:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.028+0000 7f9ea5789740 20 client.18420 trim_cache size 0 max 16384 2024-09-10T23:32:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 Processor -- start 2024-09-10T23:32:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 -- start start 2024-09-10T23:32:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea544d0 0x55ae1ea6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 0x55ae1ea51310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea62170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1ae310 con 0x55ae1ea54df0 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1afe50 con 0x55ae1ea544d0 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea5789740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1ae9e0 con 0x55ae1ea60d80 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 0x55ae1ea51310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 0x55ae1ea51310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37648/0 (socket says 172.21.15.2:37648) 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 -- 172.21.15.2:0/85898904 learned_addr learned my addr 172.21.15.2:0/85898904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea094f640 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea544d0 0x55ae1ea6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea094f640 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea62170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 -- 172.21.15.2:0/85898904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 msgr2=0x55ae1ea62170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea62170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 -- 172.21.15.2:0/85898904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea544d0 msgr2=0x55ae1ea6cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea544d0 0x55ae1ea6cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.042+0000 7f9ea1150640 1 -- 172.21.15.2:0/85898904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae1ea5df90 con 0x55ae1ea54df0 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.043+0000 7f9ea1150640 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 0x55ae1ea51310 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9e9802ade0 tx=0x7f9e98005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7be93cce2cf8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.043+0000 7f9e86ffd640 1 -- 172.21.15.2:0/85898904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98053070 con 0x55ae1ea54df0 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.043+0000 7f9e86ffd640 1 -- 172.21.15.2:0/85898904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e98036040 con 0x55ae1ea54df0 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.043+0000 7f9e86ffd640 1 -- 172.21.15.2:0/85898904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e980046c0 con 0x55ae1ea54df0 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- 172.21.15.2:0/85898904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 msgr2=0x55ae1ea51310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 0x55ae1ea51310 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9e9802ade0 tx=0x7f9e98005ef0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- 172.21.15.2:0/85898904 shutdown_connections 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea60d80 0x55ae1ea62170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea54df0 0x55ae1ea51310 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- 172.21.15.2:0/85898904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea544d0 0x55ae1ea6cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- 172.21.15.2:0/85898904 >> 172.21.15.2:0/85898904 conn(0x55ae1ea52300 msgr2=0x55ae1ea50c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- 172.21.15.2:0/85898904 shutdown_connections 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- 172.21.15.2:0/85898904 wait complete. 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- start start 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 Processor -- start 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 0x55ae1ea63c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1af780 con 0x55ae1ea544d0 2024-09-10T23:32:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.044+0000 7f9ea5789740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1af0b0 con 0x55ae1ea60d80 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea5789740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1ac2f0 con 0x55ae1ea54df0 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea5789740 10 client.0 _ll_register_callbacks cb 0x7f9e98009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea68f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37658/0 (socket says 172.21.15.2:37658) 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 -- 172.21.15.2:0/1835752875 learned_addr learned my addr 172.21.15.2:0/1835752875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 -- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 msgr2=0x55ae1ea694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 -- 172.21.15.2:0/1835752875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 msgr2=0x55ae1ea63c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 0x55ae1ea63c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 -- 172.21.15.2:0/1835752875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1ea644c0 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea094f640 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea68f30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000b8a0 tx=0x7f9e9000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51463063e90e82df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9e84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1835752875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9003b020 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1835752875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9e9001b680 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e98036040 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.045+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1835752875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e9001b880 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 10 client.18426 fetch_fsmap learned FSMap version 28 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae1eadde40 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1835752875 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e98036040 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1835752875 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9e90003850 con 0x55ae1ea544d0 2024-09-10T23:32:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 10 client.18426 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 10 client.18426 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 20 client.18426 populate_metadata read hostname 'smithi002' 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1eade560 0x55ae1eae0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 4 client.18426 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae1e9c88a0 con 0x55ae1eade560 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.046+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1eade560 0x55ae1eae0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea1150640 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1eade560 0x55ae1eae0980 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=76ff676997c0a34d server_cookie=3b3df6765508a1d2 in_seq=0 out_seq=0 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9e84ff9640 10 client.18426 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9e84ff9640 1 -- 172.21.15.2:0/1835752875 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae1e9c88a0 con 0x55ae1eade560 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9e84ff9640 10 client.18426 handle_command_reply: tid=0 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 client.18426 shutdown 2024-09-10T23:32:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 msgr2=0x55ae1ea68f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea68f30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000b8a0 tx=0x7f9e9000bc50 comp rx=0 tx=0).stop 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 shutdown_connections 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55ae1eade560 0x55ae1eae0980 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae1ea60d80 0x55ae1ea63c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ae1ea54df0 0x55ae1ea694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 --2- 172.21.15.2:0/1835752875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae1ea544d0 0x55ae1ea68f30 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 >> 172.21.15.2:0/1835752875 conn(0x55ae1ea52300 msgr2=0x55ae1ea5f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:59.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9e84ff9640 0 client.18426 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:32:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 shutdown_connections 2024-09-10T23:32:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 1 -- 172.21.15.2:0/1835752875 wait complete. 2024-09-10T23:32:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.047+0000 7f9ea5789740 20 client.18426 trim_cache size 0 max 16384 2024-09-10T23:32:59.058 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:32:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9e880b52e0 msgr2=0x7f9e880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9e880b52e0 0x7f9e880b77a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e940a8fe0 tx=0x7f9e940dc130 comp rx=0 tx=0).stop 2024-09-10T23:32:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 msgr2=0x7f9e9c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 0x7f9e9c19eb60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400d750 tx=0x7f9e9400dc10 comp rx=0 tx=0).stop 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 shutdown_connections 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9e880b52e0 0x7f9e880b77a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c109150 0x7f9e9c19eb60 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e9c1087d0 0x7f9e9c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 --2- 172.21.15.2:0/1664449661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e9c102dc0 0x7f9e9c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 >> 172.21.15.2:0/1664449661 conn(0x7f9e9c0fe830 msgr2=0x7f9e9c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 shutdown_connections 2024-09-10T23:32:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:32:59.048+0000 7f9ea33b4640 1 -- 172.21.15.2:0/1664449661 wait complete. 2024-09-10T23:32:59.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:33:00.075 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:00.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:00 smithi154 ceph-mon[35136]: pgmap v611: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:00.292 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:00 smithi002 ceph-mon[31150]: pgmap v611: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:00.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:00 smithi177 ceph-mon[35760]: pgmap v611: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 -- 172.21.15.2:0/1918440099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76410d100 msgr2=0x7fe76410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 --2- 172.21.15.2:0/1918440099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76410d100 0x7fe76410f560 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009ca0 tx=0x7fe75c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 -- 172.21.15.2:0/1918440099 shutdown_connections 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 --2- 172.21.15.2:0/1918440099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76410d100 0x7fe76410f560 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 --2- 172.21.15.2:0/1918440099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7641045c0 0x7fe76410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 --2- 172.21.15.2:0/1918440099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 0x7fe764104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 -- 172.21.15.2:0/1918440099 >> 172.21.15.2:0/1918440099 conn(0x7fe7640fd700 msgr2=0x7fe7640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 -- 172.21.15.2:0/1918440099 shutdown_connections 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 -- 172.21.15.2:0/1918440099 wait complete. 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.517+0000 7fe769581640 1 Processor -- start 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 -- start start 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 0x7fe764199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 0x7fe7641997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76410d100 0x7fe76419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe764112d70 con 0x7fe7641045c0 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe764112bf0 con 0x7fe764103ca0 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe769581640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe764112ef0 con 0x7fe76410d100 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 0x7fe7641997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 0x7fe7641997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37676/0 (socket says 172.21.15.2:37676) 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 -- 172.21.15.2:0/3447904827 learned_addr learned my addr 172.21.15.2:0/3447904827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe762ffd640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 0x7fe764199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7637fe640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76410d100 0x7fe76419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 -- 172.21.15.2:0/3447904827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76410d100 msgr2=0x7fe76419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76410d100 0x7fe76419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 -- 172.21.15.2:0/3447904827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 msgr2=0x7fe764199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 0x7fe764199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 -- 172.21.15.2:0/3447904827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76419f330 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe762ffd640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 0x7fe764199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.518+0000 7fe7627fc640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 0x7fe7641997c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe75800d740 tx=0x7fe75800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.519+0000 7fe74bfff640 1 -- 172.21.15.2:0/3447904827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758017020 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.519+0000 7fe74bfff640 1 -- 172.21.15.2:0/3447904827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75800de50 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.519+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76419f620 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.519+0000 7fe74bfff640 1 -- 172.21.15.2:0/3447904827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75800f620 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.519+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7641a5ce0 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 Processor -- start 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe74bfff640 1 -- 172.21.15.2:0/3447904827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe758010460 con 0x7fe7641045c0 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 -- start start 2024-09-10T23:33:00.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 0x563f54c4b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4bdf0 0x563f54c57840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c57d80 0x563f54c5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563f54bc1ea0 con 0x563f54c4b4d0 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f54bb12d0 con 0x563f54c57d80 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe76b956740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563f54bb50e0 con 0x563f54c4bdf0 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.521+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 0x563f54c4b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 0x563f54c4b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37692/0 (socket says 172.21.15.2:37692) 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 -- 172.21.15.2:0/3754352443 learned_addr learned my addr 172.21.15.2:0/3754352443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7627fc640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c57d80 0x563f54c5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe762ffd640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4bdf0 0x563f54c57840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 -- 172.21.15.2:0/3754352443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4bdf0 msgr2=0x563f54c57840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4bdf0 0x563f54c57840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 -- 172.21.15.2:0/3754352443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c57d80 msgr2=0x563f54c5a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c57d80 0x563f54c5a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 -- 172.21.15.2:0/3754352443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5490f650 con 0x563f54c4b4d0 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7627fc640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c57d80 0x563f54c5a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe762ffd640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4bdf0 0x563f54c57840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7637fe640 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 0x563f54c4b8b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe75c005cc0 tx=0x7fe75c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b99364f41167a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe74bfff640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe74c0b52e0 0x7fe74c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe762ffd640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe74c0b52e0 0x7fe74c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7497fa640 1 -- 172.21.15.2:0/3754352443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c031cf0 con 0x563f54c4b4d0 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe74bfff640 1 -- 172.21.15.2:0/3447904827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe7580e5d30 con 0x7fe7641045c0 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7497fa640 1 -- 172.21.15.2:0/3754352443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c036040 con 0x563f54c4b4d0 2024-09-10T23:33:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.522+0000 7fe7497fa640 1 -- 172.21.15.2:0/3754352443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c003e60 con 0x563f54c4b4d0 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 -- 172.21.15.2:0/3754352443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 msgr2=0x563f54c4b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe762ffd640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe74c0b52e0 0x7fe74c0b77a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x563f54c4a1e0 tx=0x7fe754005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 0x563f54c4b8b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe75c005cc0 tx=0x7fe75c009360 comp rx=0 tx=0).stop 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 -- 172.21.15.2:0/3754352443 shutdown_connections 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c57d80 0x563f54c5a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4bdf0 0x563f54c57840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 --2- 172.21.15.2:0/3754352443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4b4d0 0x563f54c4b8b0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 -- 172.21.15.2:0/3754352443 >> 172.21.15.2:0/3754352443 conn(0x563f54c49300 msgr2=0x563f54c4a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 -- 172.21.15.2:0/3754352443 shutdown_connections 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 -- 172.21.15.2:0/3754352443 wait complete. 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.523+0000 7fe76b956740 1 -- start start 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 Processor -- start 2024-09-10T23:33:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c57670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c54ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563f54a12700 con 0x563f54c57d80 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f54b4c160 con 0x563f54c4bdf0 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563f54c5a9a0 con 0x563f54c4b4d0 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe76b956740 10 client.0 _ll_register_callbacks cb 0x563f54b659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37702/0 (socket says 172.21.15.2:37702) 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 -- 172.21.15.2:0/2227988228 learned_addr learned my addr 172.21.15.2:0/2227988228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7627fc640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c54ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe762ffd640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c57670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 -- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 msgr2=0x563f54c57670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c57670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 -- 172.21.15.2:0/2227988228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 msgr2=0x563f54c54ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c54ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 -- 172.21.15.2:0/2227988228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f54b79c90 con 0x563f54c57d80 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe7637fe640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c550f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe75c003bc0 tx=0x7fe75c009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3274af1e4b57f15f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.524+0000 7fe746ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe746ff5640 1 -- 172.21.15.2:0/2227988228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c052020 con 0x563f54c57d80 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe746ff5640 1 -- 172.21.15.2:0/2227988228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe75c031cf0 con 0x563f54c57d80 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c036040 con 0x563f54c57d80 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe746ff5640 1 -- 172.21.15.2:0/2227988228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe75c04a040 con 0x563f54c57d80 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 10 client.18438 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563f54c66300 con 0x563f54c57d80 2024-09-10T23:33:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe746ff5640 1 -- 172.21.15.2:0/2227988228 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c036040 con 0x563f54c57d80 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe746ff5640 1 -- 172.21.15.2:0/2227988228 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe75c04d030 con 0x563f54c57d80 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 10 client.18438 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 10 client.18438 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 20 client.18438 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54c69a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 4 client.18438 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.525+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f54bc3df0 con 0x563f54c67650 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.526+0000 7fe762ffd640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54c69a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.526+0000 7fe746ff5640 10 client.18438 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.526+0000 7fe762ffd640 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54c69a40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc4e9910a70ec043 server_cookie=ebdc0e79c9081fb0 in_seq=0 out_seq=0 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe746ff5640 1 -- 172.21.15.2:0/2227988228 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f54bc3df0 con 0x563f54c67650 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe746ff5640 10 client.18438 handle_command_reply: tid=0 2024-09-10T23:33:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 client.18438 shutdown 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 msgr2=0x563f54c550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c550f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe75c003bc0 tx=0x7fe75c009c60 comp rx=0 tx=0).stop 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 shutdown_connections 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54c69a40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c550f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c54ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe746ff5640 0 client.18438 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 --2- 172.21.15.2:0/2227988228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c57670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 >> 172.21.15.2:0/2227988228 conn(0x563f54c49300 msgr2=0x563f54c4ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 shutdown_connections 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 1 -- 172.21.15.2:0/2227988228 wait complete. 2024-09-10T23:33:00.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.527+0000 7fe76b956740 20 client.18438 trim_cache size 0 max 16384 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.540+0000 7fe76b956740 1 Processor -- start 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.540+0000 7fe76b956740 1 -- start start 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.540+0000 7fe76b956740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c48310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe76b956740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c59170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe76b956740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe76b956740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ae400 con 0x563f54c57d80 2024-09-10T23:33:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe76b956740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641aff40 con 0x563f54c4bdf0 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe76b956740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641aead0 con 0x563f54c4b4d0 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37710/0 (socket says 172.21.15.2:37710) 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 -- 172.21.15.2:0/1235756357 learned_addr learned my addr 172.21.15.2:0/1235756357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe762ffd640 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c48310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7627fc640 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c59170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 -- 172.21.15.2:0/1235756357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 msgr2=0x563f54c48310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c48310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 -- 172.21.15.2:0/1235756357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 msgr2=0x563f54c59170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c59170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 -- 172.21.15.2:0/1235756357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f54c49fe0 con 0x563f54c57d80 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe7637fe640 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c596b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe75c05b040 tx=0x7fe75c02f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2012dd9fecdd52cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe748ff9640 1 -- 172.21.15.2:0/1235756357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c052070 con 0x563f54c57d80 2024-09-10T23:33:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe748ff9640 1 -- 172.21.15.2:0/1235756357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c036070 con 0x563f54c57d80 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.541+0000 7fe748ff9640 1 -- 172.21.15.2:0/1235756357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0317c0 con 0x563f54c57d80 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 -- 172.21.15.2:0/1235756357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 msgr2=0x563f54c596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c596b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe75c05b040 tx=0x7fe75c02f390 comp rx=0 tx=0).stop 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 -- 172.21.15.2:0/1235756357 shutdown_connections 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c57d80 0x563f54c596b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4bdf0 0x563f54c59170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 --2- 172.21.15.2:0/1235756357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c4b4d0 0x563f54c48310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 -- 172.21.15.2:0/1235756357 >> 172.21.15.2:0/1235756357 conn(0x563f54c49300 msgr2=0x563f54c47c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 -- 172.21.15.2:0/1235756357 shutdown_connections 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.542+0000 7fe76b956740 1 -- 172.21.15.2:0/1235756357 wait complete. 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 -- start start 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 Processor -- start 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4b4d0 0x563f54c69240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 0x563f54c697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c57d80 0x563f54cd31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641af870 con 0x563f54c4bdf0 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641af1a0 con 0x563f54c4b4d0 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ac3e0 con 0x563f54c57d80 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe76b956740 10 client.0 _ll_register_callbacks cb 0x7fe75c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe7627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 0x563f54c697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe762ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4b4d0 0x563f54c69240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe7627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 0x563f54c697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37726/0 (socket says 172.21.15.2:37726) 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe7627fc640 1 -- 172.21.15.2:0/2187705030 learned_addr learned my addr 172.21.15.2:0/2187705030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.543+0000 7fe7637fe640 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c57d80 0x563f54cd31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe7627fc640 1 -- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c57d80 msgr2=0x563f54cd31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe7627fc640 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c57d80 0x563f54cd31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe7627fc640 1 -- 172.21.15.2:0/2187705030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4b4d0 msgr2=0x563f54c69240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe7627fc640 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4b4d0 0x563f54c69240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe7627fc640 1 -- 172.21.15.2:0/2187705030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f54cd38a0 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe7627fc640 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 0x563f54c697a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fe7580e3840 tx=0x7fe7580a83a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e770161b440990 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe746ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe746ff5640 1 -- 172.21.15.2:0/2187705030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7580abc70 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe746ff5640 1 -- 172.21.15.2:0/2187705030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe758010780 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c036070 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe746ff5640 1 -- 172.21.15.2:0/2187705030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7580b53d0 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe76b956740 10 client.18444 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563f54cd4c00 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.544+0000 7fe746ff5640 1 -- 172.21.15.2:0/2187705030 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c036070 con 0x563f54c4bdf0 2024-09-10T23:33:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe746ff5640 1 -- 172.21.15.2:0/2187705030 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7580b5600 con 0x563f54c4bdf0 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe76b956740 10 client.18444 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe76b956740 10 client.18444 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe76b956740 20 client.18444 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe76b956740 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54cd7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe76b956740 4 client.18444 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f54bbf8a0 con 0x563f54c67650 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe762ffd640 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54cd7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe746ff5640 10 client.18444 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.545+0000 7fe762ffd640 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54cd7410 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acda34a1a00499ad server_cookie=76461ba09068df75 in_seq=0 out_seq=0 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe746ff5640 1 -- 172.21.15.2:0/2187705030 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f54bbf8a0 con 0x563f54c67650 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe746ff5640 10 client.18444 handle_command_reply: tid=0 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 client.18444 shutdown 2024-09-10T23:33:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 msgr2=0x563f54c697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 0x563f54c697a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fe7580e3840 tx=0x7fe7580a83a0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 shutdown_connections 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x563f54c67650 0x563f54cd7410 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563f54c57d80 0x563f54cd31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563f54c4bdf0 0x563f54c697a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 --2- 172.21.15.2:0/2187705030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f54c4b4d0 0x563f54c69240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe746ff5640 0 client.18444 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 >> 172.21.15.2:0/2187705030 conn(0x563f54c49300 msgr2=0x563f54c56910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 shutdown_connections 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 1 -- 172.21.15.2:0/2187705030 wait complete. 2024-09-10T23:33:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.546+0000 7fe76b956740 20 client.18444 trim_cache size 0 max 16384 2024-09-10T23:33:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe74c0b52e0 msgr2=0x7fe74c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe74c0b52e0 0x7fe74c0b77a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x563f54c4a1e0 tx=0x7fe754005f90 comp rx=0 tx=0).stop 2024-09-10T23:33:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 msgr2=0x7fe7641997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 0x7fe7641997c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe75800d740 tx=0x7fe75800dc00 comp rx=0 tx=0).stop 2024-09-10T23:33:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 shutdown_connections 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe74c0b52e0 0x7fe74c0b77a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76410d100 0x7fe76419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7641045c0 0x7fe7641997c0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 --2- 172.21.15.2:0/3447904827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe764103ca0 0x7fe764199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 >> 172.21.15.2:0/3447904827 conn(0x7fe7640fd700 msgr2=0x7fe7640fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 shutdown_connections 2024-09-10T23:33:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:00.547+0000 7fe769581640 1 -- 172.21.15.2:0/3447904827 wait complete. 2024-09-10T23:33:01.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:33:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 -- 172.21.15.2:0/156464654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac10d100 msgr2=0x7f44ac10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 --2- 172.21.15.2:0/156464654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac10d100 0x7f44ac10f560 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009ca0 tx=0x7f44a402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 -- 172.21.15.2:0/156464654 shutdown_connections 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 --2- 172.21.15.2:0/156464654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac10d100 0x7f44ac10f560 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 --2- 172.21.15.2:0/156464654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac1045c0 0x7f44ac10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 --2- 172.21.15.2:0/156464654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac103ca0 0x7f44ac104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 -- 172.21.15.2:0/156464654 >> 172.21.15.2:0/156464654 conn(0x7f44ac0fd700 msgr2=0x7f44ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 -- 172.21.15.2:0/156464654 shutdown_connections 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.143+0000 7f44b2308640 1 -- 172.21.15.2:0/156464654 wait complete. 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 Processor -- start 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 -- start start 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 0x7f44ac101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac1045c0 0x7f44ac101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac10d100 0x7f44ac1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac112d70 con 0x7f44ac103ca0 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac112bf0 con 0x7f44ac10d100 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44b2308640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac112ef0 con 0x7f44ac1045c0 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 0x7f44ac101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 0x7f44ac101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33968/0 (socket says 172.21.15.2:33968) 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44abfff640 1 -- 172.21.15.2:0/3263697944 learned_addr learned my addr 172.21.15.2:0/3263697944 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.144+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac1045c0 0x7f44ac101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44b08a5640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac10d100 0x7f44ac1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44abfff640 1 -- 172.21.15.2:0/3263697944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac1045c0 msgr2=0x7f44ac101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44abfff640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac1045c0 0x7f44ac101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44abfff640 1 -- 172.21.15.2:0/3263697944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac10d100 msgr2=0x7f44ac1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44abfff640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac10d100 0x7f44ac1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44abfff640 1 -- 172.21.15.2:0/3263697944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ac1a7680 con 0x7f44ac103ca0 2024-09-10T23:33:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44abfff640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 0x7f44ac101950 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9f0 tx=0x7f449c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44a97fa640 1 -- 172.21.15.2:0/3263697944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c00cd80 con 0x7f44ac103ca0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44a97fa640 1 -- 172.21.15.2:0/3263697944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f449c0054d0 con 0x7f44ac103ca0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ac1a7970 con 0x7f44ac103ca0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44a97fa640 1 -- 172.21.15.2:0/3263697944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c010690 con 0x7f44ac103ca0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.145+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ac1a7eb0 con 0x7f44ac103ca0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.148+0000 7f44b46dd740 1 Processor -- start 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.148+0000 7f44b46dd740 1 -- start start 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b21c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b228840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b228d80 0x55e73b22b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b46dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e73b192ea0 con 0x55e73b21c4d0 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b46dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e73b1822d0 con 0x55e73b228d80 2024-09-10T23:33:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b46dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e73b1860e0 con 0x55e73b21cdf0 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b21c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b21c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33978/0 (socket says 172.21.15.2:33978) 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44a97fa640 1 -- 172.21.15.2:0/3263697944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f449c004e90 con 0x7f44ac103ca0 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 -- 172.21.15.2:0/527298895 learned_addr learned my addr 172.21.15.2:0/527298895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b228d80 0x55e73b22b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 -- 172.21.15.2:0/527298895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 msgr2=0x55e73b228840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b228840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 -- 172.21.15.2:0/527298895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b228d80 msgr2=0x55e73b22b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b228d80 0x55e73b22b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 -- 172.21.15.2:0/527298895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73aee0650 con 0x55e73b21c4d0 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44b08a5640 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b21c8b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005cc0 tx=0x7f44a4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148f5f474f3377e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44927fc640 1 -- 172.21.15.2:0/527298895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4031cf0 con 0x55e73b21c4d0 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44927fc640 1 -- 172.21.15.2:0/527298895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44a4036040 con 0x55e73b21c4d0 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.149+0000 7f44927fc640 1 -- 172.21.15.2:0/527298895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4004040 con 0x55e73b21c4d0 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44a97fa640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f44940b5360 0x7f44940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44abfff640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f44940b5360 0x7f44940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44a97fa640 1 -- 172.21.15.2:0/3263697944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f449c0e6000 con 0x7f44ac103ca0 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 -- 172.21.15.2:0/527298895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 msgr2=0x55e73b21c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44abfff640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f44940b5360 0x7f44940b7820 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9c0 tx=0x7f449c004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b21c8b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005cc0 tx=0x7f44a4009360 comp rx=0 tx=0).stop 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 -- 172.21.15.2:0/527298895 shutdown_connections 2024-09-10T23:33:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b228d80 0x55e73b22b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b228840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 --2- 172.21.15.2:0/527298895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b21c8b0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 -- 172.21.15.2:0/527298895 >> 172.21.15.2:0/527298895 conn(0x55e73b21a300 msgr2=0x55e73b21b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 -- 172.21.15.2:0/527298895 shutdown_connections 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.150+0000 7f44b46dd740 1 -- 172.21.15.2:0/527298895 wait complete. 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 -- start start 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 Processor -- start 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b228610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21cdf0 0x55e73b225a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b226000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e73afe3700 con 0x55e73b21c4d0 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e73b11d160 con 0x55e73b21cdf0 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e73b22b9a0 con 0x55e73b228d80 2024-09-10T23:33:02.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b46dd740 10 client.0 _ll_register_callbacks cb 0x55e73b1369e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b08a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b228610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.151+0000 7f44b08a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b228610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33992/0 (socket says 172.21.15.2:33992) 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 -- 172.21.15.2:0/4018125496 learned_addr learned my addr 172.21.15.2:0/4018125496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21cdf0 0x55e73b225a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 -- 172.21.15.2:0/4018125496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 msgr2=0x55e73b226000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b226000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 -- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21cdf0 msgr2=0x55e73b225a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21cdf0 0x55e73b225a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 -- 172.21.15.2:0/4018125496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73b14ac90 con 0x55e73b21c4d0 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b08a5640 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b228610 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f44a4003ac0 tx=0x7f44a4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f72f889eca5915 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f448b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f448b7fe640 1 -- 172.21.15.2:0/4018125496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4031510 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f448b7fe640 1 -- 172.21.15.2:0/4018125496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f44a40316b0 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44a4036040 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f448b7fe640 1 -- 172.21.15.2:0/4018125496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44a40318b0 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b46dd740 10 client.18456 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.152+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e73b2372d0 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f448b7fe640 1 -- 172.21.15.2:0/4018125496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44a4036040 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f448b7fe640 1 -- 172.21.15.2:0/4018125496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f44a4058030 con 0x55e73b21c4d0 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44b46dd740 10 client.18456 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44b46dd740 10 client.18456 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44b46dd740 20 client.18456 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44b46dd740 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b238620 0x55e73b23aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44b46dd740 4 client.18456 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e73b194df0 con 0x55e73b238620 2024-09-10T23:33:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.153+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b238620 0x55e73b23aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.154+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b238620 0x55e73b23aa10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f4b322aa668f398 server_cookie=37a47c45412438f7 in_seq=0 out_seq=0 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.154+0000 7f448b7fe640 10 client.18456 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.154+0000 7f448b7fe640 1 -- 172.21.15.2:0/4018125496 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e73b194df0 con 0x55e73b238620 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.154+0000 7f448b7fe640 10 client.18456 handle_command_reply: tid=0 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 client.18456 shutdown 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 msgr2=0x55e73b228610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b228610 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f44a4003ac0 tx=0x7f44a4005d80 comp rx=0 tx=0).stop 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 shutdown_connections 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b226000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21cdf0 0x55e73b225a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b238620 0x55e73b23aa10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 --2- 172.21.15.2:0/4018125496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21c4d0 0x55e73b228610 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f448b7fe640 0 client.18456 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:02.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 >> 172.21.15.2:0/4018125496 conn(0x55e73b21a300 msgr2=0x55e73b21fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:02.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 shutdown_connections 2024-09-10T23:33:02.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 1 -- 172.21.15.2:0/4018125496 wait complete. 2024-09-10T23:33:02.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.155+0000 7f44b46dd740 20 client.18456 trim_cache size 0 max 16384 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 Processor -- start 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 -- start start 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b2277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b222c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 0x55e73b2231b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac1b0560 con 0x55e73b228d80 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac1b20a0 con 0x55e73b21c4d0 2024-09-10T23:33:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b46dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac1b0c30 con 0x55e73b21cdf0 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b08a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 0x55e73b2231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b08a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 0x55e73b2231b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33994/0 (socket says 172.21.15.2:33994) 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b08a5640 1 -- 172.21.15.2:0/1191953086 learned_addr learned my addr 172.21.15.2:0/1191953086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.169+0000 7f44b08a5640 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b2277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b08a5640 1 -- 172.21.15.2:0/1191953086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 msgr2=0x55e73b222c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b222c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b08a5640 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b222c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b08a5640 1 -- 172.21.15.2:0/1191953086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 msgr2=0x55e73b2277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b08a5640 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b2277a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b08a5640 1 -- 172.21.15.2:0/1191953086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73b220780 con 0x55e73b228d80 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b222c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b08a5640 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 0x55e73b2231b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006010 tx=0x7f44a4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602aacd122c6924d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f4491ffb640 1 -- 172.21.15.2:0/1191953086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4031510 con 0x55e73b228d80 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f4491ffb640 1 -- 172.21.15.2:0/1191953086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44a4036040 con 0x55e73b228d80 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f4491ffb640 1 -- 172.21.15.2:0/1191953086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a402fbe0 con 0x55e73b228d80 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b46dd740 1 -- 172.21.15.2:0/1191953086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 msgr2=0x55e73b2231b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.170+0000 7f44b46dd740 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 0x55e73b2231b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006010 tx=0x7f44a4031a50 comp rx=0 tx=0).stop 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- 172.21.15.2:0/1191953086 shutdown_connections 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b228d80 0x55e73b2231b0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b21cdf0 0x55e73b222c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 --2- 172.21.15.2:0/1191953086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b2277a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- 172.21.15.2:0/1191953086 >> 172.21.15.2:0/1191953086 conn(0x55e73b21a300 msgr2=0x55e73b227090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- 172.21.15.2:0/1191953086 shutdown_connections 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- 172.21.15.2:0/1191953086 wait complete. 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- start start 2024-09-10T23:33:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 Processor -- start 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b22d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 0x55e73b22daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b29e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac1b19d0 con 0x55e73b21cdf0 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac1b1300 con 0x55e73b21c4d0 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.171+0000 7f44b46dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac1ae540 con 0x55e73b228d80 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44b46dd740 10 client.0 _ll_register_callbacks cb 0x7f44a4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 0x55e73b22daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 0x55e73b22daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34010/0 (socket says 172.21.15.2:34010) 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 -- 172.21.15.2:0/690583889 learned_addr learned my addr 172.21.15.2:0/690583889 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44b08a5640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b22d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44b08a5640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b29e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 -- 172.21.15.2:0/690583889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 msgr2=0x55e73b29e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b29e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 -- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 msgr2=0x55e73b22d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b22d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 -- 172.21.15.2:0/690583889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73b29e890 con 0x55e73b21cdf0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44ab7fe640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 0x55e73b22daa0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f44a0004590 tx=0x7f44a000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af63f491d90e294d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f448b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f448b7fe640 1 -- 172.21.15.2:0/690583889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a0003cd0 con 0x55e73b21cdf0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44a4036040 con 0x55e73b21cdf0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.172+0000 7f448b7fe640 1 -- 172.21.15.2:0/690583889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f44a0003e70 con 0x55e73b21cdf0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f448b7fe640 1 -- 172.21.15.2:0/690583889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44a001d470 con 0x55e73b21cdf0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 10 client.18462 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e73b2a5c70 con 0x55e73b21cdf0 2024-09-10T23:33:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f448b7fe640 1 -- 172.21.15.2:0/690583889 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44a4036040 con 0x55e73b21cdf0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f448b7fe640 1 -- 172.21.15.2:0/690583889 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f44a0011820 con 0x55e73b21cdf0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 10 client.18462 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 10 client.18462 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 20 client.18462 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b2a63d0 0x55e73b2a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 4 client.18462 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e73b1908a0 con 0x55e73b2a63d0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.173+0000 7f44b08a5640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b2a63d0 0x55e73b2a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b08a5640 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b2a63d0 0x55e73b2a87f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c869c65e0f32f76 server_cookie=3781000e8e522bec in_seq=0 out_seq=0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f448b7fe640 10 client.18462 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f448b7fe640 1 -- 172.21.15.2:0/690583889 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e73b1908a0 con 0x55e73b2a63d0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f448b7fe640 10 client.18462 handle_command_reply: tid=0 2024-09-10T23:33:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 client.18462 shutdown 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 msgr2=0x55e73b22daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 0x55e73b22daa0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f44a0004590 tx=0x7f44a000bde0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 shutdown_connections 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e73b228d80 0x55e73b29e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55e73b2a63d0 0x55e73b2a87f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e73b21cdf0 0x55e73b22daa0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 --2- 172.21.15.2:0/690583889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e73b21c4d0 0x55e73b22d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 >> 172.21.15.2:0/690583889 conn(0x55e73b21a300 msgr2=0x55e73b2278b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f448b7fe640 0 client.18462 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 shutdown_connections 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.174+0000 7f44b46dd740 1 -- 172.21.15.2:0/690583889 wait complete. 2024-09-10T23:33:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b46dd740 20 client.18462 trim_cache size 0 max 16384 2024-09-10T23:33:02.182 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f44940b5360 msgr2=0x7f44940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f44940b5360 0x7f44940b7820 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9c0 tx=0x7f449c004a90 comp rx=0 tx=0).stop 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 msgr2=0x7f44ac101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 0x7f44ac101950 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9f0 tx=0x7f449c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 shutdown_connections 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f44940b5360 0x7f44940b7820 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac10d100 0x7f44ac1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac1045c0 0x7f44ac101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 --2- 172.21.15.2:0/3263697944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44ac103ca0 0x7f44ac101950 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 >> 172.21.15.2:0/3263697944 conn(0x7f44ac0fd700 msgr2=0x7f44ac10f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 shutdown_connections 2024-09-10T23:33:02.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:02.175+0000 7f44b2308640 1 -- 172.21.15.2:0/3263697944 wait complete. 2024-09-10T23:33:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:02 smithi154 ceph-mon[35136]: pgmap v612: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:33:02.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:02 smithi177 ceph-mon[35760]: pgmap v612: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:33:02.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:02 smithi002 ceph-mon[31150]: pgmap v612: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:33:03.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:33:03.268 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 -- 172.21.15.2:0/716882568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075e60 msgr2=0x7f8cf81135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/716882568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075e60 0x7f8cf81135b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009900 tx=0x7f8ce802a410 comp rx=0 tx=0).stop 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 -- 172.21.15.2:0/716882568 shutdown_connections 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/716882568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cf8113af0 0x7f8cf8115ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/716882568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075e60 0x7f8cf81135b0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/716882568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf8075540 0x7f8cf8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 -- 172.21.15.2:0/716882568 >> 172.21.15.2:0/716882568 conn(0x7f8cf80fe820 msgr2=0x7f8cf8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 -- 172.21.15.2:0/716882568 shutdown_connections 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.895+0000 7f8cff5bd640 1 -- 172.21.15.2:0/716882568 wait complete. 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 Processor -- start 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 -- start start 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 0x7f8cf819f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf8075e60 0x7f8cf819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cf8113af0 0x7f8cf81a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8119380 con 0x7f8cf8075540 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8119200 con 0x7f8cf8075e60 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cff5bd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8119500 con 0x7f8cf8113af0 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 0x7f8cf819f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 0x7f8cf819f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34034/0 (socket says 172.21.15.2:34034) 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 -- 172.21.15.2:0/3891173997 learned_addr learned my addr 172.21.15.2:0/3891173997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cf8113af0 0x7f8cf81a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf8075e60 0x7f8cf819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 -- 172.21.15.2:0/3891173997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cf8113af0 msgr2=0x7f8cf81a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cf8113af0 0x7f8cf81a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 -- 172.21.15.2:0/3891173997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf8075e60 msgr2=0x7f8cf819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf8075e60 0x7f8cf819fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.896+0000 7f8cfd359640 1 -- 172.21.15.2:0/3891173997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf81a5900 con 0x7f8cf8075540 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.897+0000 7f8cfd359640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 0x7f8cf819f850 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c920 tx=0x7f8cf400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.897+0000 7f8cee7fc640 1 -- 172.21.15.2:0/3891173997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4007c70 con 0x7f8cf8075540 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.897+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf81a5bf0 con 0x7f8cf8075540 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.897+0000 7f8cee7fc640 1 -- 172.21.15.2:0/3891173997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf4007e10 con 0x7f8cf8075540 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.897+0000 7f8cee7fc640 1 -- 172.21.15.2:0/3891173997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4018820 con 0x7f8cf8075540 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.897+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81ac480 con 0x7f8cf8075540 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 Processor -- start 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 -- start start 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8088ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088eda10 0x55d8088f9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d808863ea0 con 0x55d8088ed0f0 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d8088532d0 con 0x55d8088f99a0 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8d01992740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d8088570e0 con 0x55d8088eda10 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.900+0000 7f8cee7fc640 1 -- 172.21.15.2:0/3891173997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8cf400f450 con 0x7f8cf8075540 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8088ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8088ed4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34048/0 (socket says 172.21.15.2:34048) 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1011173172 learned_addr learned my addr 172.21.15.2:0/1011173172 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfd359640 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088eda10 0x55d8088f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1011173172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088eda10 msgr2=0x55d8088f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088eda10 0x55d8088f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1011173172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 msgr2=0x55d8088fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1011173172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8085b1650 con 0x55d8088ed0f0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfd359640 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088eda10 0x55d8088f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8088ed4d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0008d90 tx=0x7f8cf000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8de9ec81b9dacc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8ce37fe640 1 -- 172.21.15.2:0/1011173172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0014070 con 0x55d8088ed0f0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8ce37fe640 1 -- 172.21.15.2:0/1011173172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf0003b70 con 0x55d8088ed0f0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8ce37fe640 1 -- 172.21.15.2:0/1011173172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0010720 con 0x55d8088ed0f0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.901+0000 7f8cee7fc640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8ce40b52e0 0x7f8ce40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8cfd359640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8ce40b52e0 0x7f8ce40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8cee7fc640 1 -- 172.21.15.2:0/3891173997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8cf40e5df0 con 0x7f8cf8075540 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8cfd359640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8ce40b52e0 0x7f8ce40b77a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40e3c70 tx=0x7f8cf400fc70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 -- 172.21.15.2:0/1011173172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 msgr2=0x55d8088ed4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8088ed4d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0008d90 tx=0x7f8cf000e720 comp rx=0 tx=0).stop 2024-09-10T23:33:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 -- 172.21.15.2:0/1011173172 shutdown_connections 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088eda10 0x55d8088f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 --2- 172.21.15.2:0/1011173172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8088ed4d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 -- 172.21.15.2:0/1011173172 >> 172.21.15.2:0/1011173172 conn(0x55d8088eaf20 msgr2=0x55d8088ec0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 -- 172.21.15.2:0/1011173172 shutdown_connections 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 -- 172.21.15.2:0/1011173172 wait complete. 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.902+0000 7f8d01992740 1 -- start start 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 Processor -- start 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d8088f9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 0x55d8088f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d8086b4700 con 0x55d8088f99a0 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d8087ee160 con 0x55d8088eda10 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d8088fc620 con 0x55d8088ed0f0 2024-09-10T23:33:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8d01992740 10 client.0 _ll_register_callbacks cb 0x55d8088079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8cfdb5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 0x55d8088f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8cfdb5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 0x55d8088f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34064/0 (socket says 172.21.15.2:34064) 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1863974002 learned_addr learned my addr 172.21.15.2:0/1863974002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d8088f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.903+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 msgr2=0x55d8088f9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d8088f9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1863974002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 msgr2=0x55d8088f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/1863974002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80881bc90 con 0x55d8088f99a0 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 0x55d8088f6d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0004750 tx=0x7f8cf0004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5570f1fffe7d523d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8ce0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/1863974002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf001c030 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf0003b70 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/1863974002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8cf0021070 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/1863974002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8cf0014070 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8d01992740 10 client.18474 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d808907f10 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.904+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/1863974002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf0003b70 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/1863974002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8cf0003fc0 con 0x55d8088f99a0 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8d01992740 10 client.18474 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8d01992740 10 client.18474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8d01992740 20 client.18474 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8d01992740 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089092c0 0x55d80890b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8d01992740 4 client.18474 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d808865df0 con 0x55d8089092c0 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089092c0 0x55d80890b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089092c0 0x55d80890b6b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba3530148afd2f9e server_cookie=2fe98e8b5d754b45 in_seq=0 out_seq=0 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.905+0000 7f8ce0ff9640 10 client.18474 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/1863974002 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d808865df0 con 0x55d8089092c0 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8ce0ff9640 10 client.18474 handle_command_reply: tid=0 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 client.18474 shutdown 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 msgr2=0x55d8088f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 0x55d8088f6d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0004750 tx=0x7f8cf0004910 comp rx=0 tx=0).stop 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 shutdown_connections 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089092c0 0x55d80890b6b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088f99a0 0x55d8088f6d00 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8ce0ff9640 0 client.18474 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 --2- 172.21.15.2:0/1863974002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d8088f9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 >> 172.21.15.2:0/1863974002 conn(0x55d8088eaf20 msgr2=0x55d8088f0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 shutdown_connections 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.906+0000 7f8d01992740 1 -- 172.21.15.2:0/1863974002 wait complete. 2024-09-10T23:33:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.907+0000 7f8d01992740 20 client.18474 trim_cache size 0 max 16384 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 Processor -- start 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 -- start start 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8089058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088fad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088f99a0 0x55d8088fb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b4910 con 0x55d8088ed0f0 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b6450 con 0x55d8088eda10 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8d01992740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b4fe0 con 0x55d8088f99a0 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8cfdb5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8089058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8cfdb5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8089058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34074/0 (socket says 172.21.15.2:34074) 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.920+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/2847504932 learned_addr learned my addr 172.21.15.2:0/2847504932 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/2847504932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088f99a0 msgr2=0x55d8088fb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088f99a0 0x55d8088fb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/2847504932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 msgr2=0x55d8088fad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088fad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfdb5a640 1 -- 172.21.15.2:0/2847504932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8088ed840 con 0x55d8088ed0f0 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8089058b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0005e10 tx=0x7f8cf0005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205cf5516c6800e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8ce2ffd640 1 -- 172.21.15.2:0/2847504932 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf001c030 con 0x55d8088ed0f0 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8ce2ffd640 1 -- 172.21.15.2:0/2847504932 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf001d040 con 0x55d8088ed0f0 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.921+0000 7f8ce2ffd640 1 -- 172.21.15.2:0/2847504932 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0003d90 con 0x55d8088ed0f0 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 -- 172.21.15.2:0/2847504932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 msgr2=0x55d8089058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8089058b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0005e10 tx=0x7f8cf0005a10 comp rx=0 tx=0).stop 2024-09-10T23:33:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 -- 172.21.15.2:0/2847504932 shutdown_connections 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088f99a0 0x55d8088fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088eda10 0x55d8088fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- 172.21.15.2:0/2847504932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088ed0f0 0x55d8089058b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 -- 172.21.15.2:0/2847504932 >> 172.21.15.2:0/2847504932 conn(0x55d8088eaf20 msgr2=0x55d8088f8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 -- 172.21.15.2:0/2847504932 shutdown_connections 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 -- 172.21.15.2:0/2847504932 wait complete. 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 -- start start 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 Processor -- start 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d808901c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 0x55d8089021c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.922+0000 7f8d01992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8d01992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b5d80 con 0x55d8088eda10 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8d01992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b56b0 con 0x55d8088f99a0 2024-09-10T23:33:03.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8d01992740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b28f0 con 0x55d8088ed0f0 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8d01992740 10 client.0 _ll_register_callbacks cb 0x7f8cf0008be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 0x55d8089021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 0x55d8089021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34080/0 (socket says 172.21.15.2:34080) 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 -- 172.21.15.2:0/706501118 learned_addr learned my addr 172.21.15.2:0/706501118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d808901c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 -- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 msgr2=0x55d808901c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d808901c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 -- 172.21.15.2:0/706501118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 msgr2=0x55d8088fc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 -- 172.21.15.2:0/706501118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8088fd1c0 con 0x55d8088eda10 2024-09-10T23:33:03.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8cfcb58640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 0x55d8089021c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009900 tx=0x7f8ce8032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdb0b65e42a51f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8ce0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/706501118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8035040 con 0x55d8088eda10 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/706501118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8ce8004250 con 0x55d8088eda10 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.923+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf001d040 con 0x55d8088eda10 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/706501118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ce8004470 con 0x55d8088eda10 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 10 client.18480 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:03.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d808976bf0 con 0x55d8088eda10 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/706501118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf001d040 con 0x55d8088eda10 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/706501118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8ce8004c60 con 0x55d8088eda10 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 10 client.18480 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 10 client.18480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 20 client.18480 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089773f0 0x55d808979810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 4 client.18480 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8088618a0 con 0x55d8089773f0 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.924+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089773f0 0x55d808979810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8ce0ff9640 10 client.18480 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8cfdb5a640 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089773f0 0x55d808979810 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c4fa524b0897374 server_cookie=3dec02ab2b974ae4 in_seq=0 out_seq=0 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8ce0ff9640 1 -- 172.21.15.2:0/706501118 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8088618a0 con 0x55d8089773f0 2024-09-10T23:33:03.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8ce0ff9640 10 client.18480 handle_command_reply: tid=0 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 client.18480 shutdown 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 msgr2=0x55d8089021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 0x55d8089021c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009900 tx=0x7f8ce8032da0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 shutdown_connections 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d8089773f0 0x55d808979810 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8088f99a0 0x55d8088fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8088eda10 0x55d8089021c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8ce0ff9640 0 client.18480 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 --2- 172.21.15.2:0/706501118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8088ed0f0 0x55d808901c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 >> 172.21.15.2:0/706501118 conn(0x55d8088eaf20 msgr2=0x55d8088e9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.925+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 shutdown_connections 2024-09-10T23:33:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8d01992740 1 -- 172.21.15.2:0/706501118 wait complete. 2024-09-10T23:33:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8d01992740 20 client.18480 trim_cache size 0 max 16384 2024-09-10T23:33:03.938 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8ce40b52e0 msgr2=0x7f8ce40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8ce40b52e0 0x7f8ce40b77a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40e3c70 tx=0x7f8cf400fc70 comp rx=0 tx=0).stop 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 msgr2=0x7f8cf819f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 0x7f8cf819f850 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c920 tx=0x7f8cf400cde0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 shutdown_connections 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8ce40b52e0 0x7f8ce40b77a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cf8113af0 0x7f8cf81a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf8075e60 0x7f8cf819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 --2- 172.21.15.2:0/3891173997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf8075540 0x7f8cf819f850 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 >> 172.21.15.2:0/3891173997 conn(0x7f8cf80fe820 msgr2=0x7f8cf80ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 shutdown_connections 2024-09-10T23:33:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:03.926+0000 7f8cff5bd640 1 -- 172.21.15.2:0/3891173997 wait complete. 2024-09-10T23:33:04.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:04 smithi002 ceph-mon[31150]: pgmap v613: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:04.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:04 smithi154 ceph-mon[35136]: pgmap v613: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:04.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:04 smithi177 ceph-mon[35760]: pgmap v613: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 -- 172.21.15.2:0/2089247970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb238103b00 msgr2=0x7fb238103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2089247970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb238103b00 0x7fb238103f80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009930 tx=0x7fb22c02a420 comp rx=0 tx=0).stop 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 -- 172.21.15.2:0/2089247970 shutdown_connections 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2089247970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2381044c0 0x7fb23810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2089247970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb238103b00 0x7fb238103f80 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2089247970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381029b0 0x7fb238102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 -- 172.21.15.2:0/2089247970 >> 172.21.15.2:0/2089247970 conn(0x7fb2380fe270 msgr2=0x7fb238100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 -- 172.21.15.2:0/2089247970 shutdown_connections 2024-09-10T23:33:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.405+0000 7fb23e89b640 1 -- 172.21.15.2:0/2089247970 wait complete. 2024-09-10T23:33:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.406+0000 7fb23e89b640 1 Processor -- start 2024-09-10T23:33:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.406+0000 7fb23e89b640 1 -- start start 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 0x7fb23819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb238103b00 0x7fb23819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381044c0 0x7fb23819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb23810e670 con 0x7fb2381029b0 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb23810e4f0 con 0x7fb2381044c0 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb23810e7f0 con 0x7fb238103b00 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 0x7fb23819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 0x7fb23819afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34086/0 (socket says 172.21.15.2:34086) 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 -- 172.21.15.2:0/2588814246 learned_addr learned my addr 172.21.15.2:0/2588814246 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb2377fe640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb238103b00 0x7fb23819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23ce38640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381044c0 0x7fb23819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 -- 172.21.15.2:0/2588814246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb238103b00 msgr2=0x7fb23819b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb238103b00 0x7fb23819b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 -- 172.21.15.2:0/2588814246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381044c0 msgr2=0x7fb23819c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381044c0 0x7fb23819c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 -- 172.21.15.2:0/2588814246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23819cb00 con 0x7fb2381029b0 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23ce38640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381044c0 0x7fb23819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb237fff640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 0x7fb23819afc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb22800c890 tx=0x7fb22800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb2357fa640 1 -- 172.21.15.2:0/2588814246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228004220 con 0x7fb2381029b0 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb2357fa640 1 -- 172.21.15.2:0/2588814246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2280043c0 con 0x7fb2381029b0 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23819cdf0 con 0x7fb2381029b0 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.407+0000 7fb2357fa640 1 -- 172.21.15.2:0/2588814246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228004a00 con 0x7fb2381029b0 2024-09-10T23:33:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.408+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381a34c0 con 0x7fb2381029b0 2024-09-10T23:33:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb2357fa640 1 -- 172.21.15.2:0/2588814246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb2280079b0 con 0x7fb2381029b0 2024-09-10T23:33:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb24166c740 1 Processor -- start 2024-09-10T23:33:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb24166c740 1 -- start start 2024-09-10T23:33:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb24166c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 0x559910001c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb24166c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x559910004580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb24166c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910004bd0 0x559910007090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.410+0000 7fb24166c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55990ff716f0 con 0x55990ffff860 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb24166c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55990ff60b20 con 0x559910004bd0 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb24166c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55990ff64930 con 0x559910002190 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 0x559910001c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 0x559910001c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34092/0 (socket says 172.21.15.2:34092) 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 -- 172.21.15.2:0/4073912452 learned_addr learned my addr 172.21.15.2:0/4073912452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb237fff640 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x559910004580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb2377fe640 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910004bd0 0x559910007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 -- 172.21.15.2:0/4073912452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 msgr2=0x559910004580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x559910004580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 -- 172.21.15.2:0/4073912452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910004bd0 msgr2=0x559910007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910004bd0 0x559910007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb2357fa640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb2200b5360 0x7fb2200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 -- 172.21.15.2:0/4073912452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990ff26530 con 0x55990ffff860 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb237fff640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb2200b5360 0x7fb2200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb23ce38640 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 0x559910001c50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb230010480 tx=0x7fb230009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2e4d2caae32647 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb2357fa640 1 -- 172.21.15.2:0/2588814246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb2280e5940 con 0x7fb2381029b0 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.411+0000 7fb21e7fc640 1 -- 172.21.15.2:0/4073912452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230011760 con 0x55990ffff860 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb21e7fc640 1 -- 172.21.15.2:0/4073912452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb230011db0 con 0x55990ffff860 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb21e7fc640 1 -- 172.21.15.2:0/4073912452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23001a380 con 0x55990ffff860 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 -- 172.21.15.2:0/4073912452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 msgr2=0x559910001c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 0x559910001c50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb230010480 tx=0x7fb230009f90 comp rx=0 tx=0).stop 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb237fff640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb2200b5360 0x7fb2200b7820 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb2280058c0 tx=0x7fb2280b5040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 -- 172.21.15.2:0/4073912452 shutdown_connections 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910004bd0 0x559910007090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x559910004580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 --2- 172.21.15.2:0/4073912452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55990ffff860 0x559910001c50 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 -- 172.21.15.2:0/4073912452 >> 172.21.15.2:0/4073912452 conn(0x55990fffa9b0 msgr2=0x55990fffb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 -- 172.21.15.2:0/4073912452 shutdown_connections 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.412+0000 7fb24166c740 1 -- 172.21.15.2:0/4073912452 wait complete. 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 -- start start 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 Processor -- start 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55990ffff860 0x559910008ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910002190 0x559910009590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55991000a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55990fe98ab0 con 0x559910004bd0 2024-09-10T23:33:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55990ff06730 con 0x559910002190 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559910007bb0 con 0x55990ffff860 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb24166c740 10 client.0 _ll_register_callbacks cb 0x55990ff5a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb23ce38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55991000a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb23ce38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55991000a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34096/0 (socket says 172.21.15.2:34096) 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.413+0000 7fb23ce38640 1 -- 172.21.15.2:0/3861460536 learned_addr learned my addr 172.21.15.2:0/3861460536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2377fe640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910002190 0x559910009590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55990ffff860 0x559910008ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 -- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55990ffff860 msgr2=0x559910008ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55990ffff860 0x559910008ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 -- 172.21.15.2:0/3861460536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910002190 msgr2=0x559910009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910002190 0x559910009590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 -- 172.21.15.2:0/3861460536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990fcc2790 con 0x559910004bd0 2024-09-10T23:33:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2377fe640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910002190 0x559910009590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb23ce38640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55991000a160 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb230011fa0 tx=0x7fb230009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5697b927ab9c5cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2177fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2177fe640 1 -- 172.21.15.2:0/3861460536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230011970 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb230011db0 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2177fe640 1 -- 172.21.15.2:0/3861460536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb230011b10 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2177fe640 1 -- 172.21.15.2:0/3861460536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb230004f80 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb24166c740 10 client.18492 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55990fd3b620 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.414+0000 7fb2177fe640 1 -- 172.21.15.2:0/3861460536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb230011db0 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb2177fe640 1 -- 172.21.15.2:0/3861460536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb230029030 con 0x559910004bd0 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb24166c740 10 client.18492 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb24166c740 10 client.18492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb24166c740 20 client.18492 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb24166c740 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5599100144a0 0x559910016890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb24166c740 4 client.18492 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990ff73640 con 0x5599100144a0 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb2377fe640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5599100144a0 0x559910016890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb2177fe640 10 client.18492 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.415+0000 7fb2377fe640 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5599100144a0 0x559910016890 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8077753843b0298 server_cookie=56f38741409cfd39 in_seq=0 out_seq=0 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.416+0000 7fb2177fe640 1 -- 172.21.15.2:0/3861460536 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55990ff73640 con 0x5599100144a0 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.416+0000 7fb2177fe640 10 client.18492 handle_command_reply: tid=0 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.416+0000 7fb24166c740 1 client.18492 shutdown 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.416+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 msgr2=0x55991000a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.416+0000 7fb24166c740 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55991000a160 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb230011fa0 tx=0x7fb230009bd0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 shutdown_connections 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5599100144a0 0x559910016890 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55991000a160 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559910002190 0x559910009590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb2177fe640 0 client.18492 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 --2- 172.21.15.2:0/3861460536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55990ffff860 0x559910008ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 >> 172.21.15.2:0/3861460536 conn(0x55990fffa9b0 msgr2=0x55990fff9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 shutdown_connections 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 1 -- 172.21.15.2:0/3861460536 wait complete. 2024-09-10T23:33:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.417+0000 7fb24166c740 20 client.18492 trim_cache size 0 max 16384 2024-09-10T23:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 Processor -- start 2024-09-10T23:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 -- start start 2024-09-10T23:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x5599100054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55990fffd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381ac160 con 0x559910004bd0 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381adca0 con 0x55990ffff860 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb24166c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381ac830 con 0x559910002190 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55990fffd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55990fffd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34112/0 (socket says 172.21.15.2:34112) 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 -- 172.21.15.2:0/2487749097 learned_addr learned my addr 172.21.15.2:0/2487749097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb2377fe640 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x5599100054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 -- 172.21.15.2:0/2487749097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 msgr2=0x5599100054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x5599100054f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 -- 172.21.15.2:0/2487749097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 msgr2=0x559910004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.432+0000 7fb23ce38640 1 -- 172.21.15.2:0/2487749097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559910001fc0 con 0x559910004bd0 2024-09-10T23:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb23ce38640 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55990fffd7f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb2300049c0 tx=0x7fb23002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79671444d72cefb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb21dffb640 1 -- 172.21.15.2:0/2487749097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23003c020 con 0x559910004bd0 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb21dffb640 1 -- 172.21.15.2:0/2487749097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb230020030 con 0x559910004bd0 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb21dffb640 1 -- 172.21.15.2:0/2487749097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23002ab50 con 0x559910004bd0 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 -- 172.21.15.2:0/2487749097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 msgr2=0x55990fffd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55990fffd7f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb2300049c0 tx=0x7fb23002c040 comp rx=0 tx=0).stop 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 -- 172.21.15.2:0/2487749097 shutdown_connections 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910004bd0 0x55990fffd7f0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910002190 0x5599100054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 --2- 172.21.15.2:0/2487749097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910004fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 -- 172.21.15.2:0/2487749097 >> 172.21.15.2:0/2487749097 conn(0x55990fffa9b0 msgr2=0x55990fffed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 -- 172.21.15.2:0/2487749097 shutdown_connections 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.433+0000 7fb24166c740 1 -- 172.21.15.2:0/2487749097 wait complete. 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 -- start start 2024-09-10T23:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 Processor -- start 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910010ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 0x55991000f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910004bd0 0x55991000fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381ad5d0 con 0x559910002190 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381acf00 con 0x55990ffff860 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381aa140 con 0x559910004bd0 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb24166c740 10 client.0 _ll_register_callbacks cb 0x7fb2280eb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 0x55991000f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 0x55991000f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34126/0 (socket says 172.21.15.2:34126) 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.434+0000 7fb2377fe640 1 -- 172.21.15.2:0/1541408201 learned_addr learned my addr 172.21.15.2:0/1541408201 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb23ce38640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910010ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2377fe640 1 -- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910004bd0 msgr2=0x55991000fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2377fe640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910004bd0 0x55991000fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2377fe640 1 -- 172.21.15.2:0/1541408201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 msgr2=0x559910010ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2377fe640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910010ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2377fe640 1 -- 172.21.15.2:0/1541408201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599100048f0 con 0x559910002190 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb23ce38640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910010ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2377fe640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 0x55991000f7d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb22c02a9e0 tx=0x7fb22c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae3284e434a91e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2177fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2177fe640 1 -- 172.21.15.2:0/1541408201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c035040 con 0x559910002190 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2177fe640 1 -- 172.21.15.2:0/1541408201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb22c003b70 con 0x559910002190 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb230020030 con 0x559910002190 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2177fe640 1 -- 172.21.15.2:0/1541408201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb22c003d70 con 0x559910002190 2024-09-10T23:33:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb24166c740 10 client.18498 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559910081310 con 0x559910002190 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.435+0000 7fb2177fe640 1 -- 172.21.15.2:0/1541408201 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb230020030 con 0x559910002190 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb2177fe640 1 -- 172.21.15.2:0/1541408201 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb22c03b660 con 0x559910002190 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb24166c740 10 client.18498 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb24166c740 10 client.18498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb24166c740 20 client.18498 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb24166c740 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559910081c50 0x559910084070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb24166c740 4 client.18498 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55990ff6f0f0 con 0x559910081c50 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb23ce38640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559910081c50 0x559910084070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb2177fe640 10 client.18498 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.436+0000 7fb23ce38640 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559910081c50 0x559910084070 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d83f1c2ed037f6 server_cookie=9642ed3baec0ad05 in_seq=0 out_seq=0 2024-09-10T23:33:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb2177fe640 1 -- 172.21.15.2:0/1541408201 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55990ff6f0f0 con 0x559910081c50 2024-09-10T23:33:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb2177fe640 10 client.18498 handle_command_reply: tid=0 2024-09-10T23:33:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 client.18498 shutdown 2024-09-10T23:33:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 msgr2=0x55991000f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 0x55991000f7d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb22c02a9e0 tx=0x7fb22c0035f0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 shutdown_connections 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x559910081c50 0x559910084070 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559910004bd0 0x55991000fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.450+0000 7fb24166c740 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559910002190 0x55991000f7d0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb24166c740 1 --2- 172.21.15.2:0/1541408201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55990ffff860 0x559910010ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb2177fe640 0 client.18498 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 >> 172.21.15.2:0/1541408201 conn(0x55990fffa9b0 msgr2=0x55990fffe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 shutdown_connections 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb24166c740 1 -- 172.21.15.2:0/1541408201 wait complete. 2024-09-10T23:33:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb24166c740 20 client.18498 trim_cache size 0 max 16384 2024-09-10T23:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb2200b5360 msgr2=0x7fb2200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb2200b5360 0x7fb2200b7820 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb2280058c0 tx=0x7fb2280b5040 comp rx=0 tx=0).stop 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 msgr2=0x7fb23819afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 0x7fb23819afc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb22800c890 tx=0x7fb22800cd50 comp rx=0 tx=0).stop 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 shutdown_connections 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb2200b5360 0x7fb2200b7820 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2381044c0 0x7fb23819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb238103b00 0x7fb23819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 --2- 172.21.15.2:0/2588814246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2381029b0 0x7fb23819afc0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 >> 172.21.15.2:0/2588814246 conn(0x7fb2380fe270 msgr2=0x7fb238109220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 shutdown_connections 2024-09-10T23:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:05.451+0000 7fb23e89b640 1 -- 172.21.15.2:0/2588814246 wait complete. 2024-09-10T23:33:05.837 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:33:05.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:33:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:06.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:06 smithi002 ceph-mon[31150]: pgmap v614: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:06 smithi154 ceph-mon[35136]: pgmap v614: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:06.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:06 smithi177 ceph-mon[35760]: pgmap v614: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 -- 172.21.15.2:0/2552153195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 msgr2=0x7f9de410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/2552153195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de410e820 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009ca0 tx=0x7f9ddc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 -- 172.21.15.2:0/2552153195 shutdown_connections 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/2552153195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de410e820 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/2552153195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9de41076a0 0x7f9de4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/2552153195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de4101c90 0x7f9de4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 -- 172.21.15.2:0/2552153195 >> 172.21.15.2:0/2552153195 conn(0x7f9de40fd700 msgr2=0x7f9de40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 -- 172.21.15.2:0/2552153195 shutdown_connections 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 -- 172.21.15.2:0/2552153195 wait complete. 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 Processor -- start 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.613+0000 7f9dec2ab640 1 -- start start 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dec2ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9de4101c90 0x7f9de40fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dec2ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de41076a0 0x7f9de40fe320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dec2ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de40fe860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dec2ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9de4111ca0 con 0x7f9de4108020 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dec2ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9de4111b20 con 0x7f9de41076a0 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dec2ab640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9de4111e20 con 0x7f9de4101c90 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de40fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de40fe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34146/0 (socket says 172.21.15.2:34146) 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 -- 172.21.15.2:0/3528326901 learned_addr learned my addr 172.21.15.2:0/3528326901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea047640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9de4101c90 0x7f9de40fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9de9846640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de41076a0 0x7f9de40fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 -- 172.21.15.2:0/3528326901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9de4101c90 msgr2=0x7f9de40fdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9de4101c90 0x7f9de40fdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 -- 172.21.15.2:0/3528326901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de41076a0 msgr2=0x7f9de40fe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de41076a0 0x7f9de40fe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 -- 172.21.15.2:0/3528326901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de41a75e0 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9de9846640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de41076a0 0x7f9de40fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9dea848640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de40fe860 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc005cc0 tx=0x7f9ddc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.614+0000 7f9ddb7fe640 1 -- 172.21.15.2:0/3528326901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc003bf0 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.615+0000 7f9ddb7fe640 1 -- 172.21.15.2:0/3528326901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ddc003d90 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.615+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de41a7870 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.615+0000 7f9ddb7fe640 1 -- 172.21.15.2:0/3528326901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc02fb20 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.615+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de41a7db0 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.617+0000 7f9ddb7fe640 1 -- 172.21.15.2:0/3528326901 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9ddc004580 con 0x7f9de4108020 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.617+0000 7f9dee680740 1 Processor -- start 2024-09-10T23:33:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.617+0000 7f9dee680740 1 -- start start 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dee680740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dee680740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d4e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dee680740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d50b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dee680740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a27cb8e60 con 0x562a27d42800 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dee680740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a27ca8290 con 0x562a27d41ee0 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dee680740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562a27cac0a0 con 0x562a27d4e790 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d4e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d4e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34148/0 (socket says 172.21.15.2:34148) 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 -- 172.21.15.2:0/158001455 learned_addr learned my addr 172.21.15.2:0/158001455 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9de9846640 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9de9846640 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d50b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9ddb7fe640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9dd00b52e0 0x7f9dd00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 -- 172.21.15.2:0/158001455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 msgr2=0x562a27d50b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d50b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 -- 172.21.15.2:0/158001455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 msgr2=0x562a27d422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 -- 172.21.15.2:0/158001455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a27a06930 con 0x562a27d42800 2024-09-10T23:33:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea848640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9dd00b52e0 0x7f9dd00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.618+0000 7f9dea047640 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d4e250 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f9de000ad30 tx=0x7f9de000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41c34f5bf449b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9ddb7fe640 1 -- 172.21.15.2:0/3528326901 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9ddc106f90 con 0x7f9de4108020 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9dd8de6640 1 -- 172.21.15.2:0/158001455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0010630 con 0x562a27d42800 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9dd8de6640 1 -- 172.21.15.2:0/158001455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9de0014070 con 0x562a27d42800 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9dd8de6640 1 -- 172.21.15.2:0/158001455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0018a70 con 0x562a27d42800 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9dee680740 1 -- 172.21.15.2:0/158001455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 msgr2=0x562a27d4e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9dee680740 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d4e250 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f9de000ad30 tx=0x7f9de000f790 comp rx=0 tx=0).stop 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.619+0000 7f9dea848640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9dd00b52e0 0x7f9dd00b77a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0a73b0 tx=0x7f9ddc0c7cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- 172.21.15.2:0/158001455 shutdown_connections 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d50b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d4e250 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 --2- 172.21.15.2:0/158001455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- 172.21.15.2:0/158001455 >> 172.21.15.2:0/158001455 conn(0x562a27d3fd10 msgr2=0x562a27d40eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- 172.21.15.2:0/158001455 shutdown_connections 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- 172.21.15.2:0/158001455 wait complete. 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- start start 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 Processor -- start 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d42800 0x562a27d4bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 0x562a27d4c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a27b09890 con 0x562a27d4e790 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a27c42d40 con 0x562a27d41ee0 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562a27d51440 con 0x562a27d42800 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9dee680740 10 client.0 _ll_register_callbacks cb 0x562a27ca6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9de9846640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 0x562a27d4c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9de9846640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 0x562a27d4c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34160/0 (socket says 172.21.15.2:34160) 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.620+0000 7f9de9846640 1 -- 172.21.15.2:0/3868366237 learned_addr learned my addr 172.21.15.2:0/3868366237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dea047640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d42800 0x562a27d4bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 -- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d42800 msgr2=0x562a27d4bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d42800 0x562a27d4bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 -- 172.21.15.2:0/3868366237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 msgr2=0x562a27d4b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 -- 172.21.15.2:0/3868366237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a27d5a820 con 0x562a27d4e790 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9de9846640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 0x562a27d4c1c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400bf70 tx=0x7f9dd4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3226a9f24824ee57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dcdffb640 1 -- 172.21.15.2:0/3868366237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4005020 con 0x562a27d4e790 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dcdffb640 1 -- 172.21.15.2:0/3868366237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9dd40051c0 con 0x562a27d4e790 2024-09-10T23:33:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9de0014070 con 0x562a27d4e790 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dcdffb640 1 -- 172.21.15.2:0/3868366237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9dd40053c0 con 0x562a27d4e790 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dee680740 10 client.18510 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.621+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a27d5d210 con 0x562a27d4e790 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dcdffb640 1 -- 172.21.15.2:0/3868366237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9de0014070 con 0x562a27d4e790 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dcdffb640 1 -- 172.21.15.2:0/3868366237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9dd400f040 con 0x562a27d4e790 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dee680740 10 client.18510 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dee680740 10 client.18510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dee680740 20 client.18510 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dee680740 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27d60aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dee680740 4 client.18510 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a27cbadb0 con 0x562a27d5e670 2024-09-10T23:33:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.622+0000 7f9dea047640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27d60aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dcdffb640 10 client.18510 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dea047640 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27d60aa0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b7aa988363845fc server_cookie=fcca49cc964111b2 in_seq=0 out_seq=0 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dcdffb640 1 -- 172.21.15.2:0/3868366237 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a27cbadb0 con 0x562a27d5e670 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dcdffb640 10 client.18510 handle_command_reply: tid=0 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dee680740 1 client.18510 shutdown 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 msgr2=0x562a27d4c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.623+0000 7f9dee680740 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 0x562a27d4c1c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400bf70 tx=0x7f9dd4015040 comp rx=0 tx=0).stop 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 shutdown_connections 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27d60aa0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d4e790 0x562a27d4c1c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dcdffb640 0 client.18510 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d42800 0x562a27d4bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 --2- 172.21.15.2:0/3868366237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 >> 172.21.15.2:0/3868366237 conn(0x562a27d3fd10 msgr2=0x562a27d3ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 shutdown_connections 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 1 -- 172.21.15.2:0/3868366237 wait complete. 2024-09-10T23:33:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.624+0000 7f9dee680740 20 client.18510 trim_cache size 0 max 16384 2024-09-10T23:33:06.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.641+0000 7f9dee680740 1 Processor -- start 2024-09-10T23:33:06.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.641+0000 7f9dee680740 1 -- start start 2024-09-10T23:33:06.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dee680740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dee680740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d48950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dee680740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d48e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dee680740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41b0500 con 0x562a27d42800 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dee680740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41b2040 con 0x562a27d41ee0 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dee680740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41b0bd0 con 0x562a27d4e790 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d48950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d48950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34162/0 (socket says 172.21.15.2:34162) 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 -- 172.21.15.2:0/3555434066 learned_addr learned my addr 172.21.15.2:0/3555434066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9de9846640 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d48e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9de9846640 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 -- 172.21.15.2:0/3555434066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 msgr2=0x562a27d48e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d48e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 -- 172.21.15.2:0/3555434066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 msgr2=0x562a27d4aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 -- 172.21.15.2:0/3555434066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a27d3fb40 con 0x562a27d42800 2024-09-10T23:33:06.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.642+0000 7f9dea047640 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d48950 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f9de0000be0 tx=0x7f9de00186d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f72c465f1aeb20c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:06.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dcffff640 1 -- 172.21.15.2:0/3555434066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0030070 con 0x562a27d42800 2024-09-10T23:33:06.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dcffff640 1 -- 172.21.15.2:0/3555434066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9de0014070 con 0x562a27d42800 2024-09-10T23:33:06.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dcffff640 1 -- 172.21.15.2:0/3555434066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de00048c0 con 0x562a27d42800 2024-09-10T23:33:06.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 -- 172.21.15.2:0/3555434066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 msgr2=0x562a27d48950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d48950 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f9de0000be0 tx=0x7f9de00186d0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 -- 172.21.15.2:0/3555434066 shutdown_connections 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d48e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d42800 0x562a27d48950 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 --2- 172.21.15.2:0/3555434066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d41ee0 0x562a27d4aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 -- 172.21.15.2:0/3555434066 >> 172.21.15.2:0/3555434066 conn(0x562a27d3fd10 msgr2=0x562a27d4bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 -- 172.21.15.2:0/3555434066 shutdown_connections 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.643+0000 7f9dee680740 1 -- 172.21.15.2:0/3555434066 wait complete. 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 -- start start 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 Processor -- start 2024-09-10T23:33:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 0x562a27d56f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d42800 0x562a27d534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d53ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41b1970 con 0x562a27d41ee0 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41b12a0 con 0x562a27d42800 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41ae4e0 con 0x562a27d4e790 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9dee680740 10 client.0 _ll_register_callbacks cb 0x7f9dd400b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 0x562a27d56f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 0x562a27d56f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34176/0 (socket says 172.21.15.2:34176) 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 -- 172.21.15.2:0/1013432740 learned_addr learned my addr 172.21.15.2:0/1013432740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 -- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 msgr2=0x562a27d53ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d53ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 -- 172.21.15.2:0/1013432740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d42800 msgr2=0x562a27d534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d42800 0x562a27d534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.644+0000 7f9de9846640 1 -- 172.21.15.2:0/1013432740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a27d4c5e0 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9de9846640 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 0x562a27d56f30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b690 tx=0x7f9dd400b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a85f151f5367da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dcdffb640 1 -- 172.21.15.2:0/1013432740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4005e50 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dcdffb640 1 -- 172.21.15.2:0/1013432740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9dd4005560 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9de0014070 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dcdffb640 1 -- 172.21.15.2:0/1013432740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9dd401e760 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 10 client.18516 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a27dcc470 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dcdffb640 1 -- 172.21.15.2:0/1013432740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9de0014070 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dcdffb640 1 -- 172.21.15.2:0/1013432740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9dd40035f0 con 0x562a27d41ee0 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 10 client.18516 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 10 client.18516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 20 client.18516 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27dcea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 4 client.18516 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.645+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562a27cb6860 con 0x562a27d5e670 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.646+0000 7f9dea047640 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27dcea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.646+0000 7f9dea047640 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27dcea20 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff28326fd371bc3d server_cookie=658df75c809f86a7 in_seq=0 out_seq=0 2024-09-10T23:33:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.646+0000 7f9dcdffb640 10 client.18516 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dcdffb640 1 -- 172.21.15.2:0/1013432740 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562a27cb6860 con 0x562a27d5e670 2024-09-10T23:33:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dcdffb640 10 client.18516 handle_command_reply: tid=0 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 client.18516 shutdown 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 msgr2=0x562a27d56f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 0x562a27d56f30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b690 tx=0x7f9dd400b380 comp rx=0 tx=0).stop 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 shutdown_connections 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x562a27d5e670 0x562a27dcea20 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a27d4e790 0x562a27d53ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a27d42800 0x562a27d534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 --2- 172.21.15.2:0/1013432740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a27d41ee0 0x562a27d56f30 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 >> 172.21.15.2:0/1013432740 conn(0x562a27d3fd10 msgr2=0x562a27d3e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.648+0000 7f9dcdffb640 0 client.18516 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 shutdown_connections 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dee680740 1 -- 172.21.15.2:0/1013432740 wait complete. 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dee680740 20 client.18516 trim_cache size 0 max 16384 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd", 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:33:06.655 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9dd00b52e0 msgr2=0x7f9dd00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9dd00b52e0 0x7f9dd00b77a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0a73b0 tx=0x7f9ddc0c7cb0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 msgr2=0x7f9de40fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de40fe860 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc005cc0 tx=0x7f9ddc02f380 comp rx=0 tx=0).stop 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 shutdown_connections 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9dd00b52e0 0x7f9dd00b77a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9de4108020 0x7f9de40fe860 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de41076a0 0x7f9de40fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 --2- 172.21.15.2:0/3528326901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9de4101c90 0x7f9de40fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:06.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 >> 172.21.15.2:0/3528326901 conn(0x7f9de40fd700 msgr2=0x7f9de406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:06.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 shutdown_connections 2024-09-10T23:33:06.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:06.649+0000 7f9dec2ab640 1 -- 172.21.15.2:0/3528326901 wait complete. 2024-09-10T23:33:07.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:33:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:08.177 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:08 smithi002 ceph-mon[31150]: pgmap v615: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:33:08.177 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:08 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:33:08.177 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:08 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:08.177 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:08 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:33:08.178 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:08 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 -- 172.21.15.2:0/2076791406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0101cd0 msgr2=0x7f53e01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 --2- 172.21.15.2:0/2076791406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0101cd0 0x7f53e01020b0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d002a410 comp rx=0 tx=0).stop 2024-09-10T23:33:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 -- 172.21.15.2:0/2076791406 shutdown_connections 2024-09-10T23:33:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 --2- 172.21.15.2:0/2076791406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e0108060 0x7f53e010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 --2- 172.21.15.2:0/2076791406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e01076e0 0x7f53e0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 --2- 172.21.15.2:0/2076791406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0101cd0 0x7f53e01020b0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 -- 172.21.15.2:0/2076791406 >> 172.21.15.2:0/2076791406 conn(0x7f53e00fd700 msgr2=0x7f53e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 -- 172.21.15.2:0/2076791406 shutdown_connections 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.260+0000 7f53e6857640 1 -- 172.21.15.2:0/2076791406 wait complete. 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 Processor -- start 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 -- start start 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e0101cd0 0x7f53e019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e01076e0 0x7f53e019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 0x7f53e019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e0111ce0 con 0x7f53e0108060 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e0111b60 con 0x7f53e0101cd0 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e6857640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53e0111e60 con 0x7f53e01076e0 2024-09-10T23:33:08.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e4df4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 0x7f53e019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e4df4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 0x7f53e019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34204/0 (socket says 172.21.15.2:34204) 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53e4df4640 1 -- 172.21.15.2:0/1946592662 learned_addr learned my addr 172.21.15.2:0/1946592662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53dffff640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e0101cd0 0x7f53e019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.261+0000 7f53d7fff640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e01076e0 0x7f53e019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e4df4640 1 -- 172.21.15.2:0/1946592662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e01076e0 msgr2=0x7f53e019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e4df4640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e01076e0 0x7f53e019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e4df4640 1 -- 172.21.15.2:0/1946592662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e0101cd0 msgr2=0x7f53e019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e4df4640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e0101cd0 0x7f53e019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e4df4640 1 -- 172.21.15.2:0/1946592662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e01a5490 con 0x7f53e0108060 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e4df4640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 0x7f53e019ab50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f53d800eaa0 tx=0x7f53d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53ddffb640 1 -- 172.21.15.2:0/1946592662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d800cdb0 con 0x7f53e0108060 2024-09-10T23:33:08.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53ddffb640 1 -- 172.21.15.2:0/1946592662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d8005020 con 0x7f53e0108060 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e01a5780 con 0x7f53e0108060 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53ddffb640 1 -- 172.21.15.2:0/1946592662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d80116d0 con 0x7f53e0108060 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.262+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e01a5cc0 con 0x7f53e0108060 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 Processor -- start 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53ddffb640 1 -- 172.21.15.2:0/1946592662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f53d800f040 con 0x7f53e0108060 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 -- start start 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557181ff6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x5571820027f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557181f6ce50 con 0x557181ff6480 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557181f5c280 con 0x557181ff6da0 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557181f60090 con 0x557182002d30 2024-09-10T23:33:08.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557181ff6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557181ff6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34214/0 (socket says 172.21.15.2:34214) 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53d7fff640 1 -- 172.21.15.2:0/2255380977 learned_addr learned my addr 172.21.15.2:0/2255380977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.265+0000 7f53d7fff640 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53dffff640 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x5571820027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d7fff640 1 -- 172.21.15.2:0/2255380977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 msgr2=0x557182005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d7fff640 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d7fff640 1 -- 172.21.15.2:0/2255380977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 msgr2=0x5571820027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d7fff640 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x5571820027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d7fff640 1 -- 172.21.15.2:0/2255380977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557181cba650 con 0x557181ff6480 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53dffff640 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x5571820027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53ddffb640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53cc0b5360 0x7f53cc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d7fff640 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557181ff6860 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f53c80125b0 tx=0x7f53c800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccbf36df0897d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53dffff640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53cc0b5360 0x7f53cc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d67fc640 1 -- 172.21.15.2:0/2255380977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8005020 con 0x557181ff6480 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53ddffb640 1 -- 172.21.15.2:0/1946592662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53d80e58e0 con 0x7f53e0108060 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d67fc640 1 -- 172.21.15.2:0/2255380977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c8005670 con 0x557181ff6480 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.266+0000 7f53d67fc640 1 -- 172.21.15.2:0/2255380977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c800e770 con 0x557181ff6480 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 -- 172.21.15.2:0/2255380977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 msgr2=0x557181ff6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557181ff6860 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f53c80125b0 tx=0x7f53c800b8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53dffff640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53cc0b5360 0x7f53cc0b7820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f53d0031440 tx=0x7f53d0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 -- 172.21.15.2:0/2255380977 shutdown_connections 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182005120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x5571820027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/2255380977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557181ff6860 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 -- 172.21.15.2:0/2255380977 >> 172.21.15.2:0/2255380977 conn(0x557181ff42b0 msgr2=0x557181ff5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 -- 172.21.15.2:0/2255380977 shutdown_connections 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 -- 172.21.15.2:0/2255380977 wait complete. 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 -- start start 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.267+0000 7f53e8c2c740 1 Processor -- start 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557182002680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x557181fffad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182000130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557181dbd700 con 0x557181ff6480 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557181ef7110 con 0x557181ff6da0 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571820059b0 con 0x557182002d30 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e8c2c740 10 client.0 _ll_register_callbacks cb 0x557181f10990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557182002680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557182002680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34222/0 (socket says 172.21.15.2:34222) 2024-09-10T23:33:08.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 -- 172.21.15.2:0/3241404464 learned_addr learned my addr 172.21.15.2:0/3241404464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e4df4640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182000130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53d7fff640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x557181fffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 -- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 msgr2=0x557182000130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182000130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 -- 172.21.15.2:0/3241404464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 msgr2=0x557181fffad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x557181fffad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 -- 172.21.15.2:0/3241404464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557181f24c40 con 0x557181ff6480 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53e4df4640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182000130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53dffff640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557182002680 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca55a73451555110 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.268+0000 7f53bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53bf7fe640 1 -- 172.21.15.2:0/3241404464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d004c020 con 0x557181ff6480 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53bf7fe640 1 -- 172.21.15.2:0/3241404464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53d0004250 con 0x557181ff6480 2024-09-10T23:33:08.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c8005670 con 0x557181ff6480 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53bf7fe640 1 -- 172.21.15.2:0/3241404464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53d0035040 con 0x557181ff6480 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 10 client.18528 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571820112b0 con 0x557181ff6480 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53bf7fe640 1 -- 172.21.15.2:0/3241404464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c8005670 con 0x557181ff6480 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53bf7fe640 1 -- 172.21.15.2:0/3241404464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53d00049c0 con 0x557181ff6480 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 10 client.18528 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 10 client.18528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 20 client.18528 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557182012810 0x557182014c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 4 client.18528 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.269+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557181f6eda0 con 0x557182012810 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.270+0000 7f53d7fff640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557182012810 0x557182014c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.270+0000 7f53bf7fe640 10 client.18528 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.270+0000 7f53d7fff640 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557182012810 0x557182014c00 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67072e70f4d8f197 server_cookie=392fb727f2852785 in_seq=0 out_seq=0 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53bf7fe640 1 -- 172.21.15.2:0/3241404464 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557181f6eda0 con 0x557182012810 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53bf7fe640 10 client.18528 handle_command_reply: tid=0 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 client.18528 shutdown 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 msgr2=0x557182002680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557182002680 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d002a410 comp rx=0 tx=0).stop 2024-09-10T23:33:08.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 shutdown_connections 2024-09-10T23:33:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557182012810 0x557182014c00 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557182002d30 0x557182000130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x557181fffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/3241404464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x557182002680 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 >> 172.21.15.2:0/3241404464 conn(0x557181ff42b0 msgr2=0x557181ff9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53bf7fe640 0 client.18528 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:08.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 shutdown_connections 2024-09-10T23:33:08.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 1 -- 172.21.15.2:0/3241404464 wait complete. 2024-09-10T23:33:08.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.271+0000 7f53e8c2c740 20 client.18528 trim_cache size 0 max 16384 2024-09-10T23:33:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 Processor -- start 2024-09-10T23:33:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 -- start start 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x55718200ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6da0 0x557182004120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557182002d30 0x557182004660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e01ae380 con 0x557181ff6480 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e01afec0 con 0x557182002d30 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53e01aea50 con 0x557181ff6da0 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x55718200ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x55718200ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34238/0 (socket says 172.21.15.2:34238) 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 -- 172.21.15.2:0/109648691 learned_addr learned my addr 172.21.15.2:0/109648691 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53d7fff640 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6da0 0x557182004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 -- 172.21.15.2:0/109648691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6da0 msgr2=0x557182004120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6da0 0x557182004120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 -- 172.21.15.2:0/109648691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557182002d30 msgr2=0x557182004660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557182002d30 0x557182004660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.289+0000 7f53dffff640 1 -- 172.21.15.2:0/109648691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557181fff880 con 0x557181ff6480 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.290+0000 7f53d7fff640 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6da0 0x557182004120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.290+0000 7f53dffff640 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x55718200ebe0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f53d0006010 tx=0x7f53d0005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f4c0f5e17e024f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.290+0000 7f53d5ffb640 1 -- 172.21.15.2:0/109648691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0060020 con 0x557181ff6480 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.290+0000 7f53d5ffb640 1 -- 172.21.15.2:0/109648691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d0004450 con 0x557181ff6480 2024-09-10T23:33:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.290+0000 7f53d5ffb640 1 -- 172.21.15.2:0/109648691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d004c040 con 0x557181ff6480 2024-09-10T23:33:08.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- 172.21.15.2:0/109648691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 msgr2=0x55718200ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x55718200ebe0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f53d0006010 tx=0x7f53d0005db0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- 172.21.15.2:0/109648691 shutdown_connections 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557182002d30 0x557182004660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6da0 0x557182004120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/109648691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557181ff6480 0x55718200ebe0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- 172.21.15.2:0/109648691 >> 172.21.15.2:0/109648691 conn(0x557181ff42b0 msgr2=0x557181fface0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- 172.21.15.2:0/109648691 shutdown_connections 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- 172.21.15.2:0/109648691 wait complete. 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- start start 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 Processor -- start 2024-09-10T23:33:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6480 0x55718200ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x55718200b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 0x557182005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e01af7f0 con 0x557182002d30 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e01af120 con 0x557181ff6da0 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.291+0000 7f53e8c2c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53e01ac360 con 0x557181ff6480 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e8c2c740 10 client.0 _ll_register_callbacks cb 0x7f53d0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 0x557182005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 0x557182005c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34242/0 (socket says 172.21.15.2:34242) 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 -- 172.21.15.2:0/1531782981 learned_addr learned my addr 172.21.15.2:0/1531782981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53d7fff640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x55718200b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53dffff640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6480 0x55718200ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 -- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6480 msgr2=0x55718200ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6480 0x55718200ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 -- 172.21.15.2:0/1531782981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 msgr2=0x55718200b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x55718200b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 -- 172.21.15.2:0/1531782981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557182006190 con 0x557182002d30 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53d7fff640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x55718200b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e4df4640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 0x557182005c00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f53d80e3390 tx=0x7f53d80ab930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fe193d585f42f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53bf7fe640 1 -- 172.21.15.2:0/1531782981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d801f040 con 0x557182002d30 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53bf7fe640 1 -- 172.21.15.2:0/1531782981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f53d80ab360 con 0x557182002d30 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53d0004450 con 0x557182002d30 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53bf7fe640 1 -- 172.21.15.2:0/1531782981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53d80b0b30 con 0x557182002d30 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e8c2c740 10 client.18534 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.292+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55718207fed0 con 0x557182002d30 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53bf7fe640 1 -- 172.21.15.2:0/1531782981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d0004450 con 0x557182002d30 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53bf7fe640 1 -- 172.21.15.2:0/1531782981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53d80a7b70 con 0x557182002d30 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53e8c2c740 10 client.18534 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53e8c2c740 10 client.18534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53e8c2c740 20 client.18534 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5571820805f0 0x5571820829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53e8c2c740 4 client.18534 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557181f6a850 con 0x5571820805f0 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.293+0000 7f53dffff640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5571820805f0 0x5571820829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53dffff640 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5571820805f0 0x5571820829e0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c566e7ceb874c72 server_cookie=4206a68e7d285b04 in_seq=0 out_seq=0 2024-09-10T23:33:08.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53bf7fe640 10 client.18534 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53bf7fe640 1 -- 172.21.15.2:0/1531782981 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x557181f6a850 con 0x5571820805f0 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53bf7fe640 10 client.18534 handle_command_reply: tid=0 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 client.18534 shutdown 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 msgr2=0x557182005c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 0x557182005c00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f53d80e3390 tx=0x7f53d80ab930 comp rx=0 tx=0).stop 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 shutdown_connections 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5571820805f0 0x5571820829e0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557182002d30 0x557182005c00 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557181ff6da0 0x55718200b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 --2- 172.21.15.2:0/1531782981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557181ff6480 0x55718200ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53bf7fe640 0 client.18534 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 >> 172.21.15.2:0/1531782981 conn(0x557181ff42b0 msgr2=0x557182001100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 shutdown_connections 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 1 -- 172.21.15.2:0/1531782981 wait complete. 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.294+0000 7f53e8c2c740 20 client.18534 trim_cache size 0 max 16384 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:33:08.302 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:33:08.304 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.305 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.306 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:33:08.307 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.308 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:33:08.309 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.310 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:33:08.311 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.312 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:08.313 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:33:08.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53cc0b5360 msgr2=0x7f53cc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53cc0b5360 0x7f53cc0b7820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f53d0031440 tx=0x7f53d0005b50 comp rx=0 tx=0).stop 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 msgr2=0x7f53e019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 0x7f53e019ab50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f53d800eaa0 tx=0x7f53d800ef60 comp rx=0 tx=0).stop 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 shutdown_connections 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f53cc0b5360 0x7f53cc0b7820 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e0108060 0x7f53e019ab50 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53e01076e0 0x7f53e019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 --2- 172.21.15.2:0/1946592662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e0101cd0 0x7f53e019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 >> 172.21.15.2:0/1946592662 conn(0x7f53e00fd700 msgr2=0x7f53e00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 shutdown_connections 2024-09-10T23:33:08.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:08.295+0000 7f53e6857640 1 -- 172.21.15.2:0/1946592662 wait complete. 2024-09-10T23:33:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:08 smithi177 ceph-mon[35760]: pgmap v615: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:33:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:08 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:33:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:08 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:08 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:33:08.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:08 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:08.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:08 smithi154 ceph-mon[35136]: pgmap v615: 97 pgs: 97 active+clean; 2.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:33:08.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:08 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:33:08.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:08 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:08.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:08 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:33:08.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:08 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:09.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:09 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:33:09.295 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:33:09.295 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:33:09.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:09 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:33:09.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:09 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:33:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 -- 172.21.15.2:0/2661059873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 msgr2=0x7f738c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 --2- 172.21.15.2:0/2661059873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c108c10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7380009ca0 tx=0x7f738002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 -- 172.21.15.2:0/2661059873 shutdown_connections 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 --2- 172.21.15.2:0/2661059873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f738c109150 0x7f738c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 --2- 172.21.15.2:0/2661059873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c108c10 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 --2- 172.21.15.2:0/2661059873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f738c102dc0 0x7f738c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 -- 172.21.15.2:0/2661059873 >> 172.21.15.2:0/2661059873 conn(0x7f738c0fe830 msgr2=0x7f738c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 -- 172.21.15.2:0/2661059873 shutdown_connections 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.170+0000 7f73936ba640 1 -- 172.21.15.2:0/2661059873 wait complete. 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 Processor -- start 2024-09-10T23:33:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 -- start start 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f738c102dc0 0x7f738c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f738c109150 0x7f738c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112e10 con 0x7f738c1087d0 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112c90 con 0x7f738c102dc0 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f73936ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112f90 con 0x7f738c109150 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f7390c55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f7390c55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34256/0 (socket says 172.21.15.2:34256) 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.171+0000 7f7390c55640 1 -- 172.21.15.2:0/661253903 learned_addr learned my addr 172.21.15.2:0/661253903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7391456640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f738c102dc0 0x7f738c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7391c57640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f738c109150 0x7f738c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7390c55640 1 -- 172.21.15.2:0/661253903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f738c109150 msgr2=0x7f738c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7390c55640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f738c109150 0x7f738c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7390c55640 1 -- 172.21.15.2:0/661253903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f738c102dc0 msgr2=0x7f738c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7390c55640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f738c102dc0 0x7f738c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7390c55640 1 -- 172.21.15.2:0/661253903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c19f3b0 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f7390c55640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c199840 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7380006010 tx=0x7f73800319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380003bf0 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7380003d90 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c19f640 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738002fc20 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.172+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1a5d60 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.173+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c1031a0 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.175+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f73800046a0 con 0x7f738c1087d0 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.176+0000 7f737e7fc640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5360 0x7f73780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.176+0000 7f7391456640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5360 0x7f73780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.176+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7380106fb0 con 0x7f738c1087d0 2024-09-10T23:33:10.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.176+0000 7f7391456640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5360 0x7f73780b7820 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f73880058c0 tx=0x7f738800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.179+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f73800cdf20 con 0x7f738c1087d0 2024-09-10T23:33:10.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.401+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f738c19a430 con 0x7f738c1087d0 2024-09-10T23:33:10.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:10 smithi002 ceph-mon[31150]: pgmap v616: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:10.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.402+0000 7f737e7fc640 1 -- 172.21.15.2:0/661253903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f73800cd820 con 0x7f738c1087d0 2024-09-10T23:33:10.404 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:33:10.404 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:33:10.405 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:33:10.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5360 msgr2=0x7f73780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5360 0x7f73780b7820 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f73880058c0 tx=0x7f738800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 msgr2=0x7f738c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c199840 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7380006010 tx=0x7f73800319f0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 shutdown_connections 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f73780b5360 0x7f73780b7820 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f738c109150 0x7f738c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738c1087d0 0x7f738c199840 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.404+0000 7f73936ba640 1 --2- 172.21.15.2:0/661253903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f738c102dc0 0x7f738c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.405+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 >> 172.21.15.2:0/661253903 conn(0x7f738c0fe830 msgr2=0x7f738c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.405+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 shutdown_connections 2024-09-10T23:33:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:10.405+0000 7f73936ba640 1 -- 172.21.15.2:0/661253903 wait complete. 2024-09-10T23:33:10.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:10 smithi177 ceph-mon[35760]: pgmap v616: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:10.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:10 smithi154 ceph-mon[35136]: pgmap v616: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:11.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:33:11.424 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:11.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:11 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/661253903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:33:11.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:11 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/661253903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:33:11.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:11 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/661253903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:33:12.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 -- 172.21.15.2:0/2146032253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc108020 msgr2=0x7f98cc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/2146032253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc108020 0x7f98cc10e820 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009ca0 tx=0x7f98c402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 -- 172.21.15.2:0/2146032253 shutdown_connections 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/2146032253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc108020 0x7f98cc10e820 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/2146032253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98cc1076a0 0x7f98cc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/2146032253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98cc101c90 0x7f98cc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 -- 172.21.15.2:0/2146032253 >> 172.21.15.2:0/2146032253 conn(0x7f98cc0fd700 msgr2=0x7f98cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.057+0000 7f98d2ca3640 1 -- 172.21.15.2:0/2146032253 shutdown_connections 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 -- 172.21.15.2:0/2146032253 wait complete. 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 Processor -- start 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 -- start start 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98cc101c90 0x7f98cc197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 0x7f98cc198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98cc108020 0x7f98cc1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111ce0 con 0x7f98cc1076a0 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111b60 con 0x7f98cc101c90 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98d2ca3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111e60 con 0x7f98cc108020 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.058+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 0x7f98cc198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 0x7f98cc198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37218/0 (socket says 172.21.15.2:37218) 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 -- 172.21.15.2:0/838642941 learned_addr learned my addr 172.21.15.2:0/838642941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98cc101c90 0x7f98cc197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98d1240640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98cc108020 0x7f98cc1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 -- 172.21.15.2:0/838642941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98cc108020 msgr2=0x7f98cc1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98cc108020 0x7f98cc1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 -- 172.21.15.2:0/838642941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98cc101c90 msgr2=0x7f98cc197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98cc101c90 0x7f98cc197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 -- 172.21.15.2:0/838642941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc1a7630 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98cbfff640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 0x7f98cc198390 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f98b800d950 tx=0x7f98b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98c9ffb640 1 -- 172.21.15.2:0/838642941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b8017030 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98c9ffb640 1 -- 172.21.15.2:0/838642941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98b8004020 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc1a7920 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98c9ffb640 1 -- 172.21.15.2:0/838642941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b80047a0 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.059+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc1a7e60 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98c9ffb640 1 -- 172.21.15.2:0/838642941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f98b8009a30 con 0x7f98cc1076a0 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 Processor -- start 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 -- start start 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 0x557ab1f9d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557ab1f07ea0 con 0x557ab1f91a10 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ab1ef72d0 con 0x557ab1f9d9a0 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.062+0000 7f98d5078740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557ab1efb0e0 con 0x557ab1f910f0 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 0x557ab1f9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 0x557ab1f9d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37224/0 (socket says 172.21.15.2:37224) 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 -- 172.21.15.2:0/857744160 learned_addr learned my addr 172.21.15.2:0/857744160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98cbfff640 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d1240640 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 -- 172.21.15.2:0/857744160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 msgr2=0x557ab1f914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 -- 172.21.15.2:0/857744160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 msgr2=0x557ab1f9fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 -- 172.21.15.2:0/857744160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab1c55650 con 0x557ab1f91a10 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98c9ffb640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98bc0b52e0 0x7f98bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 0x557ab1f9d460 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f98c000bd10 tx=0x7f98c00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45786ae4b3aae0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98d1240640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98bc0b52e0 0x7f98bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.063+0000 7f98b6ffd640 1 -- 172.21.15.2:0/857744160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0004030 con 0x557ab1f91a10 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98c9ffb640 1 -- 172.21.15.2:0/838642941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f98b80e5550 con 0x7f98cc1076a0 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98b6ffd640 1 -- 172.21.15.2:0/857744160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98c00035f0 con 0x557ab1f91a10 2024-09-10T23:33:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98b6ffd640 1 -- 172.21.15.2:0/857744160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c00117b0 con 0x557ab1f91a10 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d1240640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98bc0b52e0 0x7f98bc0b77a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f98c402f500 tx=0x7f98c402f370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 -- 172.21.15.2:0/857744160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 msgr2=0x557ab1f9d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 0x557ab1f9d460 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f98c000bd10 tx=0x7f98c00107a0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 -- 172.21.15.2:0/857744160 shutdown_connections 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f91a10 0x557ab1f9d460 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 --2- 172.21.15.2:0/857744160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 -- 172.21.15.2:0/857744160 >> 172.21.15.2:0/857744160 conn(0x557ab1f8ef20 msgr2=0x557ab1f900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.064+0000 7f98d5078740 1 -- 172.21.15.2:0/857744160 shutdown_connections 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 -- 172.21.15.2:0/857744160 wait complete. 2024-09-10T23:33:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 -- start start 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 Processor -- start 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f910f0 0x557ab1f9d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1f9a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557ab1d58700 con 0x557ab1f9d9a0 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ab1e92160 con 0x557ab1f910f0 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557ab1fa0620 con 0x557ab1f91a10 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.065+0000 7f98d5078740 10 client.0 _ll_register_callbacks cb 0x557ab1eab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37240/0 (socket says 172.21.15.2:37240) 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 -- 172.21.15.2:0/3435289914 learned_addr learned my addr 172.21.15.2:0/3435289914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f910f0 0x557ab1f9d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98cbfff640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1f9a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 -- 172.21.15.2:0/3435289914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 msgr2=0x557ab1f9a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1f9a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 -- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f910f0 msgr2=0x557ab1f9d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f910f0 0x557ab1f9d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 -- 172.21.15.2:0/3435289914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab1ebfc90 con 0x557ab1f9d9a0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d1240640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ad30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f98c4035000 tx=0x7f98c402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b8ffbc90592610 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98abfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98abfff640 1 -- 172.21.15.2:0/3435289914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4003e00 con 0x557ab1f9d9a0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98abfff640 1 -- 172.21.15.2:0/3435289914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f98c4004040 con 0x557ab1f9d9a0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98c00035f0 con 0x557ab1f9d9a0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98abfff640 1 -- 172.21.15.2:0/3435289914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98c4004240 con 0x557ab1f9d9a0 2024-09-10T23:33:12.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.066+0000 7f98d5078740 10 client.18552 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ab1fabfb0 con 0x557ab1f9d9a0 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98abfff640 1 -- 172.21.15.2:0/3435289914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98c00035f0 con 0x557ab1f9d9a0 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98abfff640 1 -- 172.21.15.2:0/3435289914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98c4051070 con 0x557ab1f9d9a0 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 10 client.18552 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 10 client.18552 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 20 client.18552 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab1fad410 0x557ab1faf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 4 client.18552 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ab1f09df0 con 0x557ab1fad410 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.067+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab1fad410 0x557ab1faf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.068+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab1fad410 0x557ab1faf850 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=621c3cf44f5c2769 server_cookie=671525d89e7c6c10 in_seq=0 out_seq=0 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.068+0000 7f98abfff640 10 client.18552 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.068+0000 7f98abfff640 1 -- 172.21.15.2:0/3435289914 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ab1f09df0 con 0x557ab1fad410 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.068+0000 7f98abfff640 10 client.18552 handle_command_reply: tid=0 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 client.18552 shutdown 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 msgr2=0x557ab1f9ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ad30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f98c4035000 tx=0x7f98c402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 shutdown_connections 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab1fad410 0x557ab1faf850 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ad30 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1f9a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 --2- 172.21.15.2:0/3435289914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f910f0 0x557ab1f9d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98abfff640 0 client.18552 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 >> 172.21.15.2:0/3435289914 conn(0x557ab1f8ef20 msgr2=0x557ab1f94ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 shutdown_connections 2024-09-10T23:33:12.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 1 -- 172.21.15.2:0/3435289914 wait complete. 2024-09-10T23:33:12.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.069+0000 7f98d5078740 20 client.18552 trim_cache size 0 max 16384 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.082+0000 7f98d5078740 1 Processor -- start 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.082+0000 7f98d5078740 1 -- start start 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d5078740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d5078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f91a10 0x557ab1f9c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d5078740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d5078740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1b04f0 con 0x557ab1f9d9a0 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d5078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1b2030 con 0x557ab1f91a10 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d5078740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1b0bc0 con 0x557ab1f910f0 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37254/0 (socket says 172.21.15.2:37254) 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f91a10 0x557ab1f9c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 -- 172.21.15.2:0/550776749 learned_addr learned my addr 172.21.15.2:0/550776749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 -- 172.21.15.2:0/550776749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 msgr2=0x557ab1f8e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f8e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 -- 172.21.15.2:0/550776749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f91a10 msgr2=0x557ab1f9c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f91a10 0x557ab1f9c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 -- 172.21.15.2:0/550776749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab1f8fc00 con 0x557ab1f9d9a0 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f8e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98d1240640 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ed90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006010 tx=0x7f98c40041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d6974b6b7468dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98b67fc640 1 -- 172.21.15.2:0/550776749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4062070 con 0x557ab1f9d9a0 2024-09-10T23:33:12.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98b67fc640 1 -- 172.21.15.2:0/550776749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98c4059030 con 0x557ab1f9d9a0 2024-09-10T23:33:12.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.083+0000 7f98b67fc640 1 -- 172.21.15.2:0/550776749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4030ea0 con 0x557ab1f9d9a0 2024-09-10T23:33:12.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 -- 172.21.15.2:0/550776749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 msgr2=0x557ab1f9ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ed90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006010 tx=0x7f98c40041d0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 -- 172.21.15.2:0/550776749 shutdown_connections 2024-09-10T23:33:12.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f9d9a0 0x557ab1f9ed90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f91a10 0x557ab1f9c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 --2- 172.21.15.2:0/550776749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f910f0 0x557ab1f8e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 -- 172.21.15.2:0/550776749 >> 172.21.15.2:0/550776749 conn(0x557ab1f8ef20 msgr2=0x557ab1f9bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 -- 172.21.15.2:0/550776749 shutdown_connections 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.084+0000 7f98d5078740 1 -- 172.21.15.2:0/550776749 wait complete. 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 -- start start 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 Processor -- start 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 0x557ab1fa58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1fa5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1fa08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1b1960 con 0x557ab1f910f0 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1b1290 con 0x557ab1f9d9a0 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1ae4d0 con 0x557ab1f91a10 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d5078740 10 client.0 _ll_register_callbacks cb 0x7f98c4031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:12.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d0a3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 0x557ab1fa58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d0a3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 0x557ab1fa58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37256/0 (socket says 172.21.15.2:37256) 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d0a3f640 1 -- 172.21.15.2:0/1328995992 learned_addr learned my addr 172.21.15.2:0/1328995992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98cbfff640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1fa5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.085+0000 7f98d1240640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1fa08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d0a3f640 1 -- 172.21.15.2:0/1328995992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 msgr2=0x557ab1fa5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1fa5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d0a3f640 1 -- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 msgr2=0x557ab1fa08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1fa08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d0a3f640 1 -- 172.21.15.2:0/1328995992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab1fa0de0 con 0x557ab1f910f0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d0a3f640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 0x557ab1fa58f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f98c000baa0 tx=0x7f98c00058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3bf7e92f34a12f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98abfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98abfff640 1 -- 172.21.15.2:0/1328995992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0033060 con 0x557ab1f910f0 2024-09-10T23:33:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98abfff640 1 -- 172.21.15.2:0/1328995992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f98c00037f0 con 0x557ab1f910f0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98c4059030 con 0x557ab1f910f0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98abfff640 1 -- 172.21.15.2:0/1328995992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98c00039f0 con 0x557ab1f910f0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d5078740 10 client.18558 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ab201a9e0 con 0x557ab1f910f0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.086+0000 7f98abfff640 1 -- 172.21.15.2:0/1328995992 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98c4059030 con 0x557ab1f910f0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98abfff640 1 -- 172.21.15.2:0/1328995992 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98c0011600 con 0x557ab1f910f0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98d5078740 10 client.18558 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98d5078740 10 client.18558 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98d5078740 20 client.18558 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98d5078740 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab201afd0 0x557ab201d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98d5078740 4 client.18558 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ab1f058a0 con 0x557ab201afd0 2024-09-10T23:33:12.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98cbfff640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab201afd0 0x557ab201d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98cbfff640 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab201afd0 0x557ab201d3f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=49b836e41357dc1f server_cookie=1662cd0b877c8070 in_seq=0 out_seq=0 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.087+0000 7f98abfff640 10 client.18558 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98abfff640 1 -- 172.21.15.2:0/1328995992 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ab1f058a0 con 0x557ab201afd0 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98abfff640 10 client.18558 handle_command_reply: tid=0 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 client.18558 shutdown 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 msgr2=0x557ab1fa58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 0x557ab1fa58f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f98c000baa0 tx=0x7f98c00058e0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 shutdown_connections 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557ab201afd0 0x557ab201d3f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ab1f9d9a0 0x557ab1fa08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ab1f91a10 0x557ab1fa5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98abfff640 0 client.18558 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 --2- 172.21.15.2:0/1328995992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ab1f910f0 0x557ab1fa58f0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 >> 172.21.15.2:0/1328995992 conn(0x557ab1f8ef20 msgr2=0x557ab1f9c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 shutdown_connections 2024-09-10T23:33:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 1 -- 172.21.15.2:0/1328995992 wait complete. 2024-09-10T23:33:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.088+0000 7f98d5078740 20 client.18558 trim_cache size 0 max 16384 2024-09-10T23:33:12.095 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98bc0b52e0 msgr2=0x7f98bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98bc0b52e0 0x7f98bc0b77a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f98c402f500 tx=0x7f98c402f370 comp rx=0 tx=0).stop 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 msgr2=0x7f98cc198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 0x7f98cc198390 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f98b800d950 tx=0x7f98b800de10 comp rx=0 tx=0).stop 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 shutdown_connections 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f98bc0b52e0 0x7f98bc0b77a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98cc108020 0x7f98cc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc1076a0 0x7f98cc198390 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 --2- 172.21.15.2:0/838642941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98cc101c90 0x7f98cc197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 >> 172.21.15.2:0/838642941 conn(0x7f98cc0fd700 msgr2=0x7f98cc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 shutdown_connections 2024-09-10T23:33:12.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:12.089+0000 7f98d2ca3640 1 -- 172.21.15.2:0/838642941 wait complete. 2024-09-10T23:33:12.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:12 smithi002 ceph-mon[31150]: pgmap v617: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:12.430 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:12 smithi154 ceph-mon[35136]: pgmap v617: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:12.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:12 smithi177 ceph-mon[35760]: pgmap v617: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:12.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:33:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 -- 172.21.15.2:0/1477520575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec041087d0 msgr2=0x7fec04108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/1477520575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec041087d0 0x7fec04108c10 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7febec009900 tx=0x7febec02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 -- 172.21.15.2:0/1477520575 shutdown_connections 2024-09-10T23:33:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/1477520575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 0x7fec0410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/1477520575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec041087d0 0x7fec04108c10 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/1477520575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec04102dc0 0x7fec041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 -- 172.21.15.2:0/1477520575 >> 172.21.15.2:0/1477520575 conn(0x7fec040fe830 msgr2=0x7fec04100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 -- 172.21.15.2:0/1477520575 shutdown_connections 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.614+0000 7fec0ad9a640 1 -- 172.21.15.2:0/1477520575 wait complete. 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 Processor -- start 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 -- start start 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 0x7fec04199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec041087d0 0x7fec04199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 0x7fec0419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec04112e10 con 0x7fec04102dc0 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec04112c90 con 0x7fec04109150 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec0ad9a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec04112f90 con 0x7fec041087d0 2024-09-10T23:33:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 0x7fec04199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 0x7fec04199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37284/0 (socket says 172.21.15.2:37284) 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 -- 172.21.15.2:0/2839441227 learned_addr learned my addr 172.21.15.2:0/2839441227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec09337640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 0x7fec0419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec03fff640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec041087d0 0x7fec04199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 -- 172.21.15.2:0/2839441227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec041087d0 msgr2=0x7fec04199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec041087d0 0x7fec04199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 -- 172.21.15.2:0/2839441227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 msgr2=0x7fec0419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 0x7fec0419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec08b36640 1 -- 172.21.15.2:0/2839441227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0419f3f0 con 0x7fec04102dc0 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.615+0000 7fec09337640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 0x7fec0419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.616+0000 7fec08b36640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 0x7fec04199340 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7febf400c970 tx=0x7febf400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.616+0000 7fec01ffb640 1 -- 172.21.15.2:0/2839441227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4007bb0 con 0x7fec04102dc0 2024-09-10T23:33:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.616+0000 7fec01ffb640 1 -- 172.21.15.2:0/2839441227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf4007d50 con 0x7fec04102dc0 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.616+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0419f6e0 con 0x7fec04102dc0 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.616+0000 7fec01ffb640 1 -- 172.21.15.2:0/2839441227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf400f450 con 0x7fec04102dc0 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.616+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041a5da0 con 0x7fec04102dc0 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.618+0000 7fec01ffb640 1 -- 172.21.15.2:0/2839441227 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7febf4004f20 con 0x7fec04102dc0 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.618+0000 7fec0d16f740 1 Processor -- start 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.618+0000 7fec0d16f740 1 -- start start 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929dd68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929de7190 0x564929de9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec0d16f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564929d4cea0 con 0x564929dd64d0 2024-09-10T23:33:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec0d16f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564929d3c2d0 con 0x564929dd6df0 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec0d16f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564929d400e0 con 0x564929de7190 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929dd68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929dd68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37288/0 (socket says 172.21.15.2:37288) 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 -- 172.21.15.2:0/3744016903 learned_addr learned my addr 172.21.15.2:0/3744016903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec03fff640 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929de7190 0x564929de9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec08b36640 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 -- 172.21.15.2:0/3744016903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929de7190 msgr2=0x564929de9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929de7190 0x564929de9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 -- 172.21.15.2:0/3744016903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 msgr2=0x564929de6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 -- 172.21.15.2:0/3744016903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564929a9a650 con 0x564929dd64d0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec08b36640 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec01ffb640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febf00b52e0 0x7febf00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec09337640 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929dd68b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7febfc009f60 tx=0x7febfc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c743d502cf9f371b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.619+0000 7fec08b36640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febf00b52e0 0x7febf00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec01ffb640 1 -- 172.21.15.2:0/2839441227 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febf40e59c0 con 0x7fec04102dc0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7febfaffd640 1 -- 172.21.15.2:0/3744016903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc016070 con 0x564929dd64d0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7febfaffd640 1 -- 172.21.15.2:0/3744016903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc01bb10 con 0x564929dd64d0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7febfaffd640 1 -- 172.21.15.2:0/3744016903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc012c10 con 0x564929dd64d0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec08b36640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febf00b52e0 0x7febf00b77a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7febf40e3840 tx=0x7febf4004980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 -- 172.21.15.2:0/3744016903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 msgr2=0x564929dd68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929dd68b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7febfc009f60 tx=0x7febfc009f90 comp rx=0 tx=0).stop 2024-09-10T23:33:13.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 -- 172.21.15.2:0/3744016903 shutdown_connections 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929de7190 0x564929de9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3744016903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929dd68b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 -- 172.21.15.2:0/3744016903 >> 172.21.15.2:0/3744016903 conn(0x564929dd4300 msgr2=0x564929dd54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 -- 172.21.15.2:0/3744016903 shutdown_connections 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.620+0000 7fec0d16f740 1 -- 172.21.15.2:0/3744016903 wait complete. 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 -- start start 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 Processor -- start 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929de6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 0x564929de4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564929b9d700 con 0x564929de7190 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564929cd7160 con 0x564929dd6df0 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564929de9e40 con 0x564929dd64d0 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec0d16f740 10 client.0 _ll_register_callbacks cb 0x564929cf09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec09337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 0x564929de4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec09337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 0x564929de4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37304/0 (socket says 172.21.15.2:37304) 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.621+0000 7fec09337640 1 -- 172.21.15.2:0/3234979848 learned_addr learned my addr 172.21.15.2:0/3234979848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec03fff640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929de6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 -- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 msgr2=0x564929de6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929de6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 -- 172.21.15.2:0/3234979848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 msgr2=0x564929de3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 -- 172.21.15.2:0/3234979848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564929d04c90 con 0x564929de7190 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec03fff640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec09337640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 0x564929de4590 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7febfc005f40 tx=0x7febfc0127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac35533591012bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7febe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7febe3fff640 1 -- 172.21.15.2:0/3234979848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc016070 con 0x564929de7190 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7febe3fff640 1 -- 172.21.15.2:0/3234979848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febfc004d10 con 0x564929de7190 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febfc01bb10 con 0x564929de7190 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7febe3fff640 1 -- 172.21.15.2:0/3234979848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7febfc012990 con 0x564929de7190 2024-09-10T23:33:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec0d16f740 10 client.18570 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564929df5740 con 0x564929de7190 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.622+0000 7febe3fff640 1 -- 172.21.15.2:0/3234979848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc01bb10 con 0x564929de7190 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7febe3fff640 1 -- 172.21.15.2:0/3234979848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7febfc00f040 con 0x564929de7190 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec0d16f740 10 client.18570 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec0d16f740 10 client.18570 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec0d16f740 20 client.18570 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929df6a90 0x564929df8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec0d16f740 4 client.18570 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564929d4edf0 con 0x564929df6a90 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.623+0000 7fec03fff640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929df6a90 0x564929df8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.624+0000 7fec03fff640 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929df6a90 0x564929df8e80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1cf35b7a66288042 server_cookie=454e30b90b8a0e2a in_seq=0 out_seq=0 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.624+0000 7febe3fff640 10 client.18570 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.624+0000 7febe3fff640 1 -- 172.21.15.2:0/3234979848 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564929d4edf0 con 0x564929df6a90 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.624+0000 7febe3fff640 10 client.18570 handle_command_reply: tid=0 2024-09-10T23:33:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.624+0000 7fec0d16f740 1 client.18570 shutdown 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 msgr2=0x564929de4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 0x564929de4590 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7febfc005f40 tx=0x7febfc0127f0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 shutdown_connections 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929df6a90 0x564929df8e80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929de7190 0x564929de4590 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929dd6df0 0x564929de3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 --2- 172.21.15.2:0/3234979848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929de6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 >> 172.21.15.2:0/3234979848 conn(0x564929dd4300 msgr2=0x564929dd3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7febe3fff640 0 client.18570 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 shutdown_connections 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 1 -- 172.21.15.2:0/3234979848 wait complete. 2024-09-10T23:33:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.625+0000 7fec0d16f740 20 client.18570 trim_cache size 0 max 16384 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 Processor -- start 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 -- start start 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929dd3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 0x564929df3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dd5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec041ac240 con 0x564929dd6df0 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec041add80 con 0x564929de7190 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec0d16f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec041ac910 con 0x564929dd64d0 2024-09-10T23:33:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 0x564929df3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 0x564929df3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37316/0 (socket says 172.21.15.2:37316) 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 -- 172.21.15.2:0/2090851157 learned_addr learned my addr 172.21.15.2:0/2090851157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec09337640 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929dd3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec09337640 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dd5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 -- 172.21.15.2:0/2090851157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 msgr2=0x564929dd3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929dd3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 -- 172.21.15.2:0/2090851157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 msgr2=0x564929dd5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dd5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 -- 172.21.15.2:0/2090851157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564929de2430 con 0x564929dd6df0 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7fec03fff640 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 0x564929df3070 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7febec02a450 tx=0x7febec009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93efef748b22bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7febfa7fc640 1 -- 172.21.15.2:0/2090851157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec035030 con 0x564929dd6df0 2024-09-10T23:33:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7febfa7fc640 1 -- 172.21.15.2:0/2090851157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec0054f0 con 0x564929dd6df0 2024-09-10T23:33:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.639+0000 7febfa7fc640 1 -- 172.21.15.2:0/2090851157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec0035f0 con 0x564929dd6df0 2024-09-10T23:33:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 -- 172.21.15.2:0/2090851157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 msgr2=0x564929df3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 0x564929df3070 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7febec02a450 tx=0x7febec009640 comp rx=0 tx=0).stop 2024-09-10T23:33:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 -- 172.21.15.2:0/2090851157 shutdown_connections 2024-09-10T23:33:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dd5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd6df0 0x564929df3070 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 --2- 172.21.15.2:0/2090851157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd64d0 0x564929dd3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 -- 172.21.15.2:0/2090851157 >> 172.21.15.2:0/2090851157 conn(0x564929dd4300 msgr2=0x564929dd5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 -- 172.21.15.2:0/2090851157 shutdown_connections 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 -- 172.21.15.2:0/2090851157 wait complete. 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 -- start start 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.640+0000 7fec0d16f740 1 Processor -- start 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929def0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd6df0 0x564929def610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec041ad6b0 con 0x564929dd64d0 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec041acfe0 con 0x564929de7190 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec041aa220 con 0x564929dd6df0 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec0d16f740 10 client.0 _ll_register_callbacks cb 0x7febfc009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929def0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929def0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37318/0 (socket says 172.21.15.2:37318) 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 -- 172.21.15.2:0/1920898550 learned_addr learned my addr 172.21.15.2:0/1920898550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec03fff640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd6df0 0x564929def610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 -- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd6df0 msgr2=0x564929def610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd6df0 0x564929def610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 -- 172.21.15.2:0/1920898550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 msgr2=0x564929dec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec09337640 1 -- 172.21.15.2:0/1920898550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564929defe40 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.641+0000 7fec03fff640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd6df0 0x564929def610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec09337640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929def0d0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7febfc012720 tx=0x7febfc0128f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538f5e7404c805d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7febe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7febe3fff640 1 -- 172.21.15.2:0/1920898550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc038020 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7febe3fff640 1 -- 172.21.15.2:0/1920898550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7febfc0059a0 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febec0054f0 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7febe3fff640 1 -- 172.21.15.2:0/1920898550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7febfc016040 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 10 client.18576 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564929e63d60 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7febe3fff640 1 -- 172.21.15.2:0/1920898550 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec0054f0 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7febe3fff640 1 -- 172.21.15.2:0/1920898550 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7febfc01b5f0 con 0x564929dd64d0 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 10 client.18576 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 10 client.18576 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 20 client.18576 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929e64460 0x564929e66880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 4 client.18576 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.642+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564929d4a8a0 con 0x564929e64460 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.643+0000 7fec03fff640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929e64460 0x564929e66880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.643+0000 7fec03fff640 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929e64460 0x564929e66880 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3ce8085657576e47 server_cookie=f2100a68adfa4623 in_seq=0 out_seq=0 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.643+0000 7febe3fff640 10 client.18576 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.643+0000 7febe3fff640 1 -- 172.21.15.2:0/1920898550 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564929d4a8a0 con 0x564929e64460 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.643+0000 7febe3fff640 10 client.18576 handle_command_reply: tid=0 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.643+0000 7fec0d16f740 1 client.18576 shutdown 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 msgr2=0x564929def0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929def0d0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7febfc012720 tx=0x7febfc0128f0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 shutdown_connections 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x564929e64460 0x564929e66880 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564929de7190 0x564929dec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564929dd6df0 0x564929def610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 --2- 172.21.15.2:0/1920898550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564929dd64d0 0x564929def0d0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 >> 172.21.15.2:0/1920898550 conn(0x564929dd4300 msgr2=0x564929dd5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7febe3fff640 0 client.18576 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 shutdown_connections 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 1 -- 172.21.15.2:0/1920898550 wait complete. 2024-09-10T23:33:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0d16f740 20 client.18576 trim_cache size 0 max 16384 2024-09-10T23:33:13.658 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febf00b52e0 msgr2=0x7febf00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.644+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febf00b52e0 0x7febf00b77a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7febf40e3840 tx=0x7febf4004980 comp rx=0 tx=0).stop 2024-09-10T23:33:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 msgr2=0x7fec04199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 0x7fec04199340 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7febf400c970 tx=0x7febf400ce30 comp rx=0 tx=0).stop 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 shutdown_connections 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7febf00b52e0 0x7febf00b77a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec04109150 0x7fec0419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec041087d0 0x7fec04199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 --2- 172.21.15.2:0/2839441227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04102dc0 0x7fec04199340 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 >> 172.21.15.2:0/2839441227 conn(0x7fec040fe830 msgr2=0x7fec04100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 shutdown_connections 2024-09-10T23:33:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:13.645+0000 7fec0ad9a640 1 -- 172.21.15.2:0/2839441227 wait complete. 2024-09-10T23:33:14.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:14 smithi177 ceph-mon[35760]: pgmap v618: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:33:14.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:14 smithi002 ceph-mon[31150]: pgmap v618: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:33:14.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:14 smithi154 ceph-mon[35136]: pgmap v618: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 22 op/s 2024-09-10T23:33:14.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:33:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 -- 172.21.15.2:0/4113338396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 msgr2=0x7fd92c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4113338396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10e860 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fd924009900 tx=0x7fd92402a410 comp rx=0 tx=0).stop 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 -- 172.21.15.2:0/4113338396 shutdown_connections 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4113338396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10e860 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4113338396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92c1076e0 0x7fd92c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4113338396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 0x7fd92c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 -- 172.21.15.2:0/4113338396 >> 172.21.15.2:0/4113338396 conn(0x7fd92c0fd700 msgr2=0x7fd92c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 -- 172.21.15.2:0/4113338396 shutdown_connections 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 -- 172.21.15.2:0/4113338396 wait complete. 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 Processor -- start 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.277+0000 7fd9335cd640 1 -- start start 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 0x7fd92c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92c1076e0 0x7fd92c10f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c112e40 con 0x7fd92c108060 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c112cc0 con 0x7fd92c1076e0 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c112fc0 con 0x7fd92c101cd0 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37334/0 (socket says 172.21.15.2:37334) 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 -- 172.21.15.2:0/4213231068 learned_addr learned my addr 172.21.15.2:0/4213231068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931369640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 0x7fd92c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 -- 172.21.15.2:0/4213231068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 msgr2=0x7fd92c10f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 0x7fd92c10f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 -- 172.21.15.2:0/4213231068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92c1076e0 msgr2=0x7fd92c10f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92c1076e0 0x7fd92c10f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 -- 172.21.15.2:0/4213231068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c1a75d0 con 0x7fd92c108060 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931369640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 0x7fd92c10f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd931b6a640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10fdf0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd924004770 tx=0x7fd924004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd92a7fc640 1 -- 172.21.15.2:0/4213231068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92403f030 con 0x7fd92c108060 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd92a7fc640 1 -- 172.21.15.2:0/4213231068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd924003aa0 con 0x7fd92c108060 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd92a7fc640 1 -- 172.21.15.2:0/4213231068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924035070 con 0x7fd92c108060 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.278+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c1a7860 con 0x7fd92c108060 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.279+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c1a7d90 con 0x7fd92c108060 2024-09-10T23:33:15.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.281+0000 7fd9359a2740 1 Processor -- start 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.281+0000 7fd92a7fc640 1 -- 172.21.15.2:0/4213231068 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd9240035f0 con 0x7fd92c108060 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.281+0000 7fd9359a2740 1 -- start start 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1bb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd9359a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d5bb131ea0 con 0x55d5bb1c7d80 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd9359a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d5bb1212d0 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd9359a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d5bb1250e0 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37336/0 (socket says 172.21.15.2:37336) 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 -- 172.21.15.2:0/4064573602 learned_addr learned my addr 172.21.15.2:0/4064573602 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1bb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd931369640 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 -- 172.21.15.2:0/4064573602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bb4d0 msgr2=0x55d5bb1bb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1bb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 -- 172.21.15.2:0/4064573602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 msgr2=0x55d5bb1c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd92a7fc640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd9140b5360 0x7fd9140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.282+0000 7fd930b68640 1 -- 172.21.15.2:0/4064573602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5bae7f650 con 0x55d5bb1c7d80 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.283+0000 7fd92a7fc640 1 -- 172.21.15.2:0/4213231068 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd924106640 con 0x7fd92c108060 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.283+0000 7fd930b68640 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ca170 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fd920013b10 tx=0x7fd920009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3188931934c10655 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.283+0000 7fd930b68640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd9140b5360 0x7fd9140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.283+0000 7fd9137fe640 1 -- 172.21.15.2:0/4064573602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92000cbc0 con 0x55d5bb1c7d80 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.283+0000 7fd9137fe640 1 -- 172.21.15.2:0/4064573602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd920021cd0 con 0x55d5bb1c7d80 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.283+0000 7fd9137fe640 1 -- 172.21.15.2:0/4064573602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920010e50 con 0x55d5bb1c7d80 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 -- 172.21.15.2:0/4064573602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 msgr2=0x55d5bb1ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd930b68640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd9140b5360 0x7fd9140b7820 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd920009e90 tx=0x7fd92001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ca170 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fd920013b10 tx=0x7fd920009600 comp rx=0 tx=0).stop 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 -- 172.21.15.2:0/4064573602 shutdown_connections 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ca170 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 --2- 172.21.15.2:0/4064573602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1bb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 -- 172.21.15.2:0/4064573602 >> 172.21.15.2:0/4064573602 conn(0x55d5bb1b9300 msgr2=0x55d5bb1ba4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 -- 172.21.15.2:0/4064573602 shutdown_connections 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 -- 172.21.15.2:0/4064573602 wait complete. 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 -- start start 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.284+0000 7fd9359a2740 1 Processor -- start 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d5baf82700 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d5bb0bc160 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d5bb1caa00 con 0x55d5bb1c7d80 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd9359a2740 10 client.0 _ll_register_callbacks cb 0x55d5bb0d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37344/0 (socket says 172.21.15.2:37344) 2024-09-10T23:33:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 -- 172.21.15.2:0/2318840344 learned_addr learned my addr 172.21.15.2:0/2318840344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd931b6a640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd931369640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 -- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 msgr2=0x55d5bb1c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 -- 172.21.15.2:0/2318840344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 msgr2=0x55d5bb1c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 -- 172.21.15.2:0/2318840344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5bb0e9c90 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd930b68640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c4af0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd920009ce0 tx=0x7fd9200092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56b9787bfa7d0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd910ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd910ff9640 1 -- 172.21.15.2:0/2318840344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920013220 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.285+0000 7fd910ff9640 1 -- 172.21.15.2:0/2318840344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd92000c8e0 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd920021cd0 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd910ff9640 1 -- 172.21.15.2:0/2318840344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd92000cae0 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 10 client.18588 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5bb1d6360 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd910ff9640 1 -- 172.21.15.2:0/2318840344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd920021cd0 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd910ff9640 1 -- 172.21.15.2:0/2318840344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd92000f040 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 10 client.18588 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 10 client.18588 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 20 client.18588 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb1d7710 0x55d5bb1d9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 4 client.18588 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5bb133df0 con 0x55d5bb1d7710 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.286+0000 7fd931369640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb1d7710 0x55d5bb1d9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.287+0000 7fd931369640 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb1d7710 0x55d5bb1d9b00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4d178551523a1f2 server_cookie=56e23dd5630b7fef in_seq=0 out_seq=0 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.287+0000 7fd910ff9640 10 client.18588 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.287+0000 7fd910ff9640 1 -- 172.21.15.2:0/2318840344 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5bb133df0 con 0x55d5bb1d7710 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.287+0000 7fd910ff9640 10 client.18588 handle_command_reply: tid=0 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 client.18588 shutdown 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 msgr2=0x55d5bb1c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c4af0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd920009ce0 tx=0x7fd9200092b0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 shutdown_connections 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb1d7710 0x55d5bb1d9b00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1c4af0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 --2- 172.21.15.2:0/2318840344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd910ff9640 0 client.18588 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 >> 172.21.15.2:0/2318840344 conn(0x55d5bb1b9300 msgr2=0x55d5bb1beea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 shutdown_connections 2024-09-10T23:33:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 1 -- 172.21.15.2:0/2318840344 wait complete. 2024-09-10T23:33:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.288+0000 7fd9359a2740 20 client.18588 trim_cache size 0 max 16384 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.301+0000 7fd9359a2740 1 Processor -- start 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.301+0000 7fd9359a2740 1 -- start start 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd9359a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1b0480 con 0x55d5bb1c7d80 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd9359a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1b1fc0 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd9359a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1b0b50 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ba970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37348/0 (socket says 172.21.15.2:37348) 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 -- 172.21.15.2:0/1960398857 learned_addr learned my addr 172.21.15.2:0/1960398857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd930b68640 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931369640 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 -- 172.21.15.2:0/1960398857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bbdf0 msgr2=0x55d5bb1ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 -- 172.21.15.2:0/1960398857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 msgr2=0x55d5bb1c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 -- 172.21.15.2:0/1960398857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5bb1bbc20 con 0x55d5bb1c7d80 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931369640 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd931b6a640 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ba970 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd9241044c0 tx=0x7fd924003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1bd5425c2f6d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.302+0000 7fd912ffd640 1 -- 172.21.15.2:0/1960398857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924049070 con 0x55d5bb1c7d80 2024-09-10T23:33:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd912ffd640 1 -- 172.21.15.2:0/1960398857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9240cc920 con 0x55d5bb1c7d80 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd912ffd640 1 -- 172.21.15.2:0/1960398857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9240c9080 con 0x55d5bb1c7d80 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 -- 172.21.15.2:0/1960398857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 msgr2=0x55d5bb1ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ba970 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd9241044c0 tx=0x7fd924003f50 comp rx=0 tx=0).stop 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 -- 172.21.15.2:0/1960398857 shutdown_connections 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1ba970 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1960398857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 -- 172.21.15.2:0/1960398857 >> 172.21.15.2:0/1960398857 conn(0x55d5bb1b9300 msgr2=0x55d5bb1c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 -- 172.21.15.2:0/1960398857 shutdown_connections 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 -- 172.21.15.2:0/1960398857 wait complete. 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.303+0000 7fd9359a2740 1 -- start start 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 Processor -- start 2024-09-10T23:33:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1b18f0 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1b1220 con 0x55d5bb1bbdf0 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1ae460 con 0x55d5bb1c7d80 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd9359a2740 10 client.0 _ll_register_callbacks cb 0x7fd91c00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37360/0 (socket says 172.21.15.2:37360) 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 -- 172.21.15.2:0/1422925517 learned_addr learned my addr 172.21.15.2:0/1422925517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931b6a640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 -- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 msgr2=0x55d5bb1cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd930b68640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 -- 172.21.15.2:0/1422925517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 msgr2=0x55d5bb1d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.304+0000 7fd931369640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd931369640 1 -- 172.21.15.2:0/1422925517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5bb1cb240 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd930b68640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd931369640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1cfe80 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00b370 tx=0x7fd91c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395706dc1bab8f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd910ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd910ff9640 1 -- 172.21.15.2:0/1422925517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0035f0 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd910ff9640 1 -- 172.21.15.2:0/1422925517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd91c003790 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9240cc920 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd910ff9640 1 -- 172.21.15.2:0/1422925517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd91c003990 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd9359a2740 10 client.18594 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:15.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5bb244bb0 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.305+0000 7fd910ff9640 1 -- 172.21.15.2:0/1422925517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9240cc920 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd910ff9640 1 -- 172.21.15.2:0/1422925517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd91c01daf0 con 0x55d5bb1bb4d0 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd9359a2740 10 client.18594 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd9359a2740 10 client.18594 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd9359a2740 20 client.18594 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb245360 0x55d5bb247780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd9359a2740 4 client.18594 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d5bb12f8a0 con 0x55d5bb245360 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd930b68640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb245360 0x55d5bb247780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd910ff9640 10 client.18594 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.306+0000 7fd930b68640 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb245360 0x55d5bb247780 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c914242e6e599fb0 server_cookie=2e0610d3e85e0bca in_seq=0 out_seq=0 2024-09-10T23:33:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd910ff9640 1 -- 172.21.15.2:0/1422925517 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d5bb12f8a0 con 0x55d5bb245360 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd910ff9640 10 client.18594 handle_command_reply: tid=0 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 client.18594 shutdown 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 msgr2=0x55d5bb1cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1cfe80 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00b370 tx=0x7fd91c0118d0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 shutdown_connections 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55d5bb245360 0x55d5bb247780 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd910ff9640 0 client.18594 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d5bb1c7d80 0x55d5bb1cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5bb1bbdf0 0x55d5bb1d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 --2- 172.21.15.2:0/1422925517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5bb1bb4d0 0x55d5bb1cfe80 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 >> 172.21.15.2:0/1422925517 conn(0x55d5bb1b9300 msgr2=0x55d5bb1ba430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 shutdown_connections 2024-09-10T23:33:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 1 -- 172.21.15.2:0/1422925517 wait complete. 2024-09-10T23:33:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.307+0000 7fd9359a2740 20 client.18594 trim_cache size 0 max 16384 2024-09-10T23:33:15.316 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd9140b5360 msgr2=0x7fd9140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd9140b5360 0x7fd9140b7820 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd920009e90 tx=0x7fd92001d000 comp rx=0 tx=0).stop 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 msgr2=0x7fd92c10fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10fdf0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd924004770 tx=0x7fd924004270 comp rx=0 tx=0).stop 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 shutdown_connections 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd9140b5360 0x7fd9140b7820 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92c108060 0x7fd92c10fdf0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92c1076e0 0x7fd92c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 --2- 172.21.15.2:0/4213231068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd92c101cd0 0x7fd92c10f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 >> 172.21.15.2:0/4213231068 conn(0x7fd92c0fd700 msgr2=0x7fd92c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 shutdown_connections 2024-09-10T23:33:15.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:15.308+0000 7fd9335cd640 1 -- 172.21.15.2:0/4213231068 wait complete. 2024-09-10T23:33:15.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:33:16.171 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:16.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:16 smithi002 ceph-mon[31150]: pgmap v619: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:16.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:16 smithi177 ceph-mon[35760]: pgmap v619: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:16.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:16 smithi154 ceph-mon[35136]: pgmap v619: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 -- 172.21.15.2:0/3672420739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 msgr2=0x7f268c101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 --2- 172.21.15.2:0/3672420739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c101bf0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f267c009900 tx=0x7f267c02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 -- 172.21.15.2:0/3672420739 shutdown_connections 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 --2- 172.21.15.2:0/3672420739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f268c10d250 0x7f268c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 --2- 172.21.15.2:0/3672420739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10a920 0x7f268c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 --2- 172.21.15.2:0/3672420739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c101bf0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 -- 172.21.15.2:0/3672420739 >> 172.21.15.2:0/3672420739 conn(0x7f268c076f50 msgr2=0x7f268c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 -- 172.21.15.2:0/3672420739 shutdown_connections 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 -- 172.21.15.2:0/3672420739 wait complete. 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.662+0000 7f2691727640 1 Processor -- start 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 -- start start 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c1027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f268c10a920 0x7f268c102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10d250 0x7f268c103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f268c112d90 con 0x7f268c101810 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f268c112c10 con 0x7f268c10d250 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f2691727640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f268c112f10 con 0x7f268c10a920 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c1027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c1027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37380/0 (socket says 172.21.15.2:37380) 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 -- 172.21.15.2:0/1514825821 learned_addr learned my addr 172.21.15.2:0/1514825821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268a7fc640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f268c10a920 0x7f268c102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10d250 0x7f268c103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 -- 172.21.15.2:0/1514825821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f268c10a920 msgr2=0x7f268c102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f268c10a920 0x7f268c102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 -- 172.21.15.2:0/1514825821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10d250 msgr2=0x7f268c103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10d250 0x7f268c103260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 -- 172.21.15.2:0/1514825821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c1a7680 con 0x7f268c101810 2024-09-10T23:33:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10d250 0x7f268c103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.663+0000 7f268affd640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c1027e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f267c005940 tx=0x7f267c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.664+0000 7f2673fff640 1 -- 172.21.15.2:0/1514825821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c03f030 con 0x7f268c101810 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.664+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c1a7910 con 0x7f268c101810 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.664+0000 7f2673fff640 1 -- 172.21.15.2:0/1514825821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f267c003aa0 con 0x7f268c101810 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.664+0000 7f2673fff640 1 -- 172.21.15.2:0/1514825821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c035070 con 0x7f268c101810 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.664+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c1a7df0 con 0x7f268c101810 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.666+0000 7f2693afc740 1 Processor -- start 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.666+0000 7f2673fff640 1 -- 172.21.15.2:0/1514825821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f267c03bce0 con 0x7f268c101810 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.666+0000 7f2693afc740 1 -- start start 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2693afc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd94d0 0x558feecd98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2693afc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 0x558feece5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2693afc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2693afc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558feec4fea0 con 0x558feecd9df0 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2693afc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558feec3f2d0 con 0x558feece5d80 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2693afc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558feec430e0 con 0x558feecd94d0 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 0x558feece5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 0x558feece5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37392/0 (socket says 172.21.15.2:37392) 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 -- 172.21.15.2:0/384346559 learned_addr learned my addr 172.21.15.2:0/384346559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268b7fe640 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd94d0 0x558feecd98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268a7fc640 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 -- 172.21.15.2:0/384346559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd94d0 msgr2=0x558feecd98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd94d0 0x558feecd98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 -- 172.21.15.2:0/384346559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 msgr2=0x558feece8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.700 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 -- 172.21.15.2:0/384346559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fee99d650 con 0x558feecd9df0 2024-09-10T23:33:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f268affd640 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 0x558feece5840 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f267c10c750 tx=0x7f267c10c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f10b45ee7221829 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.667+0000 7f2673fff640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26740b52e0 0x7f26740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26740b52e0 0x7f26740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f26717fa640 1 -- 172.21.15.2:0/384346559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0c9400 con 0x558feecd9df0 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f26717fa640 1 -- 172.21.15.2:0/384346559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f267c113030 con 0x558feecd9df0 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f26717fa640 1 -- 172.21.15.2:0/384346559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0cc520 con 0x558feecd9df0 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2673fff640 1 -- 172.21.15.2:0/1514825821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f267c1065e0 con 0x7f268c101810 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 -- 172.21.15.2:0/384346559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 msgr2=0x558feece5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26740b52e0 0x7f26740b77a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2684005fd0 tx=0x7f2684009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 0x558feece5840 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f267c10c750 tx=0x7f267c10c840 comp rx=0 tx=0).stop 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 -- 172.21.15.2:0/384346559 shutdown_connections 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd9df0 0x558feece5840 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 --2- 172.21.15.2:0/384346559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd94d0 0x558feecd98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.668+0000 7f2693afc740 1 -- 172.21.15.2:0/384346559 >> 172.21.15.2:0/384346559 conn(0x558feecd7300 msgr2=0x558feecd84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 -- 172.21.15.2:0/384346559 shutdown_connections 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 -- 172.21.15.2:0/384346559 wait complete. 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 -- start start 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 Processor -- start 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 0x558feece5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feece2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558feeaa0700 con 0x558feecd94d0 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558feebda160 con 0x558feece5d80 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558feece87c0 con 0x558feecd9df0 2024-09-10T23:33:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f2693afc740 10 client.0 _ll_register_callbacks cb 0x558feebf39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f268affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 0x558feece5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f268affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 0x558feece5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37404/0 (socket says 172.21.15.2:37404) 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.669+0000 7f268affd640 1 -- 172.21.15.2:0/3267029626 learned_addr learned my addr 172.21.15.2:0/3267029626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f268affd640 1 -- 172.21.15.2:0/3267029626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 msgr2=0x558feece2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f268affd640 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feece2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f268affd640 1 -- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 msgr2=0x558feece2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f268affd640 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f268affd640 1 -- 172.21.15.2:0/3267029626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558feec07c90 con 0x558feecd94d0 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f268affd640 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 0x558feece5600 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f267c006010 tx=0x7f267c03b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263d69287a90c9bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f266eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f266eff5640 1 -- 172.21.15.2:0/3267029626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c049070 con 0x558feecd94d0 2024-09-10T23:33:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f266eff5640 1 -- 172.21.15.2:0/3267029626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f267c003c50 con 0x558feecd94d0 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f267c113030 con 0x558feecd94d0 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f266eff5640 1 -- 172.21.15.2:0/3267029626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f267c0cc700 con 0x558feecd94d0 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f2693afc740 10 client.18606 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558feecf3fd0 con 0x558feecd94d0 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f266eff5640 1 -- 172.21.15.2:0/3267029626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f267c113030 con 0x558feecd94d0 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.670+0000 7f266eff5640 1 -- 172.21.15.2:0/3267029626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f267c0c9020 con 0x558feecd94d0 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f2693afc740 10 client.18606 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f2693afc740 10 client.18606 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f2693afc740 20 client.18606 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f2693afc740 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feecf5320 0x558feecf7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f2693afc740 4 client.18606 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558feec51df0 con 0x558feecf5320 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f268a7fc640 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feecf5320 0x558feecf7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f268a7fc640 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feecf5320 0x558feecf7710 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5fca0c7e14f99ad server_cookie=3d685c8f2788f245 in_seq=0 out_seq=0 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.671+0000 7f266eff5640 10 client.18606 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f266eff5640 1 -- 172.21.15.2:0/3267029626 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558feec51df0 con 0x558feecf5320 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f266eff5640 10 client.18606 handle_command_reply: tid=0 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 client.18606 shutdown 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 msgr2=0x558feece5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 0x558feece5600 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f267c006010 tx=0x7f267c03b540 comp rx=0 tx=0).stop 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 shutdown_connections 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feece5d80 0x558feece2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feece2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feecf5320 0x558feecf7710 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 --2- 172.21.15.2:0/3267029626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feecd94d0 0x558feece5600 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 >> 172.21.15.2:0/3267029626 conn(0x558feecd7300 msgr2=0x558feecdcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f266eff5640 0 client.18606 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 shutdown_connections 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 1 -- 172.21.15.2:0/3267029626 wait complete. 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.672+0000 7f2693afc740 20 client.18606 trim_cache size 0 max 16384 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 Processor -- start 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 -- start start 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd9df0 0x558feecd6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feece19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd8b70 0x558feecdfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1b0590 con 0x558feece5d80 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1b20d0 con 0x558feecd9df0 2024-09-10T23:33:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f2693afc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1b0c60 con 0x558feecd8b70 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feece19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feece19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37410/0 (socket says 172.21.15.2:37410) 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 -- 172.21.15.2:0/269712186 learned_addr learned my addr 172.21.15.2:0/269712186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268affd640 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd9df0 0x558feecd6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 -- 172.21.15.2:0/269712186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd8b70 msgr2=0x558feecdfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd8b70 0x558feecdfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 -- 172.21.15.2:0/269712186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd9df0 msgr2=0x558feecd6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd9df0 0x558feecd6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 -- 172.21.15.2:0/269712186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558feece2800 con 0x558feece5d80 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.686+0000 7f268a7fc640 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feece19e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f268c1042d0 tx=0x7f26800108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aec59709a17bf78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2670ff9640 1 -- 172.21.15.2:0/269712186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268001c720 con 0x558feece5d80 2024-09-10T23:33:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2670ff9640 1 -- 172.21.15.2:0/269712186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f268001cd70 con 0x558feece5d80 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2670ff9640 1 -- 172.21.15.2:0/269712186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268001bde0 con 0x558feece5d80 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 -- 172.21.15.2:0/269712186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 msgr2=0x558feece19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feece19e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f268c1042d0 tx=0x7f26800108c0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 -- 172.21.15.2:0/269712186 shutdown_connections 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd8b70 0x558feecdfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feece19e0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 --2- 172.21.15.2:0/269712186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd9df0 0x558feecd6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 -- 172.21.15.2:0/269712186 >> 172.21.15.2:0/269712186 conn(0x558feecd7300 msgr2=0x558feece12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 -- 172.21.15.2:0/269712186 shutdown_connections 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.687+0000 7f2693afc740 1 -- 172.21.15.2:0/269712186 wait complete. 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 -- start start 2024-09-10T23:33:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 Processor -- start 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd8b70 0x558feecede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feecee410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feecea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1b1a00 con 0x558feece5d80 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1b1330 con 0x558feecd8b70 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1ae570 con 0x558feecd9df0 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f2693afc740 10 client.0 _ll_register_callbacks cb 0x7f26840092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feecea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feecea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37418/0 (socket says 172.21.15.2:37418) 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 -- 172.21.15.2:0/1339991617 learned_addr learned my addr 172.21.15.2:0/1339991617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268a7fc640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feecee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268affd640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd8b70 0x558feecede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 -- 172.21.15.2:0/1339991617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 msgr2=0x558feecee410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feecee410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 -- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd8b70 msgr2=0x558feecede90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd8b70 0x558feecede90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268b7fe640 1 -- 172.21.15.2:0/1339991617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558feeceae40 con 0x558feece5d80 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268affd640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd8b70 0x558feecede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.688+0000 7f268a7fc640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feecee410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f268b7fe640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feecea610 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2684009790 tx=0x7f2684012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1147975ca127f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f266eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f266eff5640 1 -- 172.21.15.2:0/1339991617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268401f8f0 con 0x558feece5d80 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f266eff5640 1 -- 172.21.15.2:0/1339991617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f268401fa90 con 0x558feece5d80 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f268001cd70 con 0x558feece5d80 2024-09-10T23:33:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f266eff5640 1 -- 172.21.15.2:0/1339991617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f268401fc90 con 0x558feece5d80 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 10 client.18612 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558feed62ec0 con 0x558feece5d80 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f266eff5640 1 -- 172.21.15.2:0/1339991617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f268001cd70 con 0x558feece5d80 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f266eff5640 1 -- 172.21.15.2:0/1339991617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f268400f040 con 0x558feece5d80 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 10 client.18612 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 10 client.18612 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 20 client.18612 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feed63610 0x558feed65a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 4 client.18612 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.689+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558feec4d8a0 con 0x558feed63610 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f268affd640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feed63610 0x558feed65a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f266eff5640 10 client.18612 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f268affd640 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feed63610 0x558feed65a30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c64574765aaf67f9 server_cookie=b5597004302f7603 in_seq=0 out_seq=0 2024-09-10T23:33:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f266eff5640 1 -- 172.21.15.2:0/1339991617 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558feec4d8a0 con 0x558feed63610 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f266eff5640 10 client.18612 handle_command_reply: tid=0 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 client.18612 shutdown 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 msgr2=0x558feecea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feecea610 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2684009790 tx=0x7f2684012aa0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 shutdown_connections 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558feed63610 0x558feed65a30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558feece5d80 0x558feecea610 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558feecd9df0 0x558feecee410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 --2- 172.21.15.2:0/1339991617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558feecd8b70 0x558feecede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 >> 172.21.15.2:0/1339991617 conn(0x558feecd7300 msgr2=0x558feece1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.690+0000 7f266eff5640 0 client.18612 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:33:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 shutdown_connections 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2693afc740 1 -- 172.21.15.2:0/1339991617 wait complete. 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2693afc740 20 client.18612 trim_cache size 0 max 16384 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26740b52e0 msgr2=0x7f26740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26740b52e0 0x7f26740b77a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2684005fd0 tx=0x7f2684009440 comp rx=0 tx=0).stop 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 msgr2=0x7f268c1027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c1027e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f267c005940 tx=0x7f267c004270 comp rx=0 tx=0).stop 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 shutdown_connections 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26740b52e0 0x7f26740b77a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f268c10d250 0x7f268c103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f268c10a920 0x7f268c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 --2- 172.21.15.2:0/1514825821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c101810 0x7f268c1027e0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 >> 172.21.15.2:0/1514825821 conn(0x7f268c076f50 msgr2=0x7f268c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 shutdown_connections 2024-09-10T23:33:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:16.691+0000 7f2691727640 1 -- 172.21.15.2:0/1514825821 wait complete. 2024-09-10T23:33:17.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:33:17.769 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:18.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:18 smithi002 ceph-mon[31150]: pgmap v620: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3338287468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac104600 msgr2=0x7ff4ac10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3338287468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac104600 0x7ff4ac10caf0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009900 tx=0x7ff49c02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3338287468 shutdown_connections 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3338287468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac10d140 0x7ff4ac10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3338287468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac104600 0x7ff4ac10caf0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3338287468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 0x7ff4ac1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3338287468 >> 172.21.15.2:0/3338287468 conn(0x7ff4ac0fd700 msgr2=0x7ff4ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3338287468 shutdown_connections 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.357+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3338287468 wait complete. 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 Processor -- start 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 -- start start 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 0x7ff4ac101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac104600 0x7ff4ac101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 0x7ff4ac102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac112db0 con 0x7ff4ac10d140 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac112c30 con 0x7ff4ac104600 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b35d6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac112f30 con 0x7ff4ac103ce0 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b1b73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 0x7ff4ac102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b1b73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 0x7ff4ac102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37440/0 (socket says 172.21.15.2:37440) 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b1b73640 1 -- 172.21.15.2:0/3898456757 learned_addr learned my addr 172.21.15.2:0/3898456757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b1372640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 0x7ff4ac101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.358+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac104600 0x7ff4ac101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1b73640 1 -- 172.21.15.2:0/3898456757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 msgr2=0x7ff4ac101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 0x7ff4ac101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1b73640 1 -- 172.21.15.2:0/3898456757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac104600 msgr2=0x7ff4ac101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac104600 0x7ff4ac101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1b73640 1 -- 172.21.15.2:0/3898456757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac1a7720 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac104600 0x7ff4ac101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1372640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 0x7ff4ac101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 0x7ff4ac102410 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400eaa0 tx=0x7ff4a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4a27fc640 1 -- 172.21.15.2:0/3898456757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400cdb0 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4a27fc640 1 -- 172.21.15.2:0/3898456757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4a4005020 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ac1a7a10 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4a27fc640 1 -- 172.21.15.2:0/3898456757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40116d0 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.359+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ac1a7f00 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 Processor -- start 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4a27fc640 1 -- 172.21.15.2:0/3898456757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff4a400f040 con 0x7ff4ac10d140 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 -- start start 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x5566560f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f7df0 0x556656103840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556656103d80 0x556656106170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55665606dea0 con 0x5566560f74d0 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55665605d2d0 con 0x556656103d80 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5566560610e0 con 0x5566560f7df0 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b0b71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x5566560f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b0b71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x5566560f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37454/0 (socket says 172.21.15.2:37454) 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.362+0000 7ff4b0b71640 1 -- 172.21.15.2:0/3955214132 learned_addr learned my addr 172.21.15.2:0/3955214132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556656103d80 0x556656106170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b1372640 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f7df0 0x556656103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 -- 172.21.15.2:0/3955214132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f7df0 msgr2=0x556656103840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f7df0 0x556656103840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 -- 172.21.15.2:0/3955214132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556656103d80 msgr2=0x556656106170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556656103d80 0x556656106170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 -- 172.21.15.2:0/3955214132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556655dbb650 con 0x5566560f74d0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b1372640 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f7df0 0x556656103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4a27fc640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff4980b52e0 0x7ff4980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x5566560f78b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff49c006010 tx=0x7ff49c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92b864d6c51d9be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4b1372640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff4980b52e0 0x7ff4980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4977fe640 1 -- 172.21.15.2:0/3955214132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c045070 con 0x5566560f74d0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4977fe640 1 -- 172.21.15.2:0/3955214132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff49c031820 con 0x5566560f74d0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4a27fc640 1 -- 172.21.15.2:0/3898456757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff4a40e5b20 con 0x7ff4ac10d140 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.363+0000 7ff4977fe640 1 -- 172.21.15.2:0/3955214132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c035050 con 0x5566560f74d0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 -- 172.21.15.2:0/3955214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 msgr2=0x5566560f78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b1372640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff4980b52e0 0x7ff4980b77a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x5566560f61e0 tx=0x7ff4a800b7d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x5566560f78b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff49c006010 tx=0x7ff49c009560 comp rx=0 tx=0).stop 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 -- 172.21.15.2:0/3955214132 shutdown_connections 2024-09-10T23:33:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556656103d80 0x556656106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f7df0 0x556656103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/3955214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x5566560f78b0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 -- 172.21.15.2:0/3955214132 >> 172.21.15.2:0/3955214132 conn(0x5566560f5300 msgr2=0x5566560f64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 -- 172.21.15.2:0/3955214132 shutdown_connections 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 -- 172.21.15.2:0/3955214132 wait complete. 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.364+0000 7ff4b59ab740 1 -- start start 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 Processor -- start 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x5566561036b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656100b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656101180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556655ebe700 con 0x556656103d80 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556655ff8160 con 0x5566560f7df0 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5566561069a0 con 0x5566560f74d0 2024-09-10T23:33:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b59ab740 10 client.0 _ll_register_callbacks cb 0x5566560119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656101180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37470/0 (socket says 172.21.15.2:37470) 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 -- 172.21.15.2:0/485608012 learned_addr learned my addr 172.21.15.2:0/485608012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1372640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x5566561036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 -- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 msgr2=0x5566561036b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x5566561036b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 -- 172.21.15.2:0/485608012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 msgr2=0x556656100b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656100b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b1b73640 1 -- 172.21.15.2:0/485608012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556656025c90 con 0x556656103d80 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.365+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656101180 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40a9560 tx=0x7ff4a40ac1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb671e347062182 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff494ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff494ff9640 1 -- 172.21.15.2:0/485608012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401f030 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff494ff9640 1 -- 172.21.15.2:0/485608012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff4a40cf070 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff49c031820 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff494ff9640 1 -- 172.21.15.2:0/485608012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4a40b0dd0 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 10 client.18624 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556656112370 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff494ff9640 1 -- 172.21.15.2:0/485608012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff49c031820 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff494ff9640 1 -- 172.21.15.2:0/485608012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4a40e3af0 con 0x556656103d80 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 10 client.18624 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 10 client.18624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 20 client.18624 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5566561138d0 0x556656115d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 4 client.18624 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.366+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55665606fdf0 con 0x5566561138d0 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.367+0000 7ff4b1372640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5566561138d0 0x556656115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.367+0000 7ff494ff9640 10 client.18624 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.367+0000 7ff4b1372640 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5566561138d0 0x556656115d20 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c9933eaa9fdc3d server_cookie=2f478e90c8a41cb6 in_seq=0 out_seq=0 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff494ff9640 1 -- 172.21.15.2:0/485608012 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55665606fdf0 con 0x5566561138d0 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff494ff9640 10 client.18624 handle_command_reply: tid=0 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 client.18624 shutdown 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 msgr2=0x556656101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656101180 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40a9560 tx=0x7ff4a40ac1d0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 shutdown_connections 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5566561138d0 0x556656115d20 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656101180 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff494ff9640 0 client.18624 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/485608012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x5566561036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 >> 172.21.15.2:0/485608012 conn(0x5566560f5300 msgr2=0x5566560fae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 shutdown_connections 2024-09-10T23:33:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 1 -- 172.21.15.2:0/485608012 wait complete. 2024-09-10T23:33:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.368+0000 7ff4b59ab740 20 client.18624 trim_cache size 0 max 16384 2024-09-10T23:33:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 Processor -- start 2024-09-10T23:33:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 -- start start 2024-09-10T23:33:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x55665610fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656105170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556656103d80 0x5566561056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac1b04c0 con 0x5566560f74d0 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac1b2000 con 0x5566560f7df0 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac1b0b90 con 0x556656103d80 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x55665610fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x55665610fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37480/0 (socket says 172.21.15.2:37480) 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 -- 172.21.15.2:0/1743104631 learned_addr learned my addr 172.21.15.2:0/1743104631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b0b71640 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656105170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556656103d80 0x5566561056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 -- 172.21.15.2:0/1743104631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556656103d80 msgr2=0x5566561056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556656103d80 0x5566561056b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 -- 172.21.15.2:0/1743104631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 msgr2=0x556656105170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656105170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1372640 1 -- 172.21.15.2:0/1743104631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566560f5d80 con 0x5566560f74d0 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.382+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556656103d80 0x5566561056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.383+0000 7ff4b1372640 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x55665610fc30 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8005f00 tx=0x7ff4a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a53192f21e8f2e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.383+0000 7ff496ffd640 1 -- 172.21.15.2:0/1743104631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8020880 con 0x5566560f74d0 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.383+0000 7ff496ffd640 1 -- 172.21.15.2:0/1743104631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4a8031440 con 0x5566560f74d0 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.383+0000 7ff496ffd640 1 -- 172.21.15.2:0/1743104631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a801f6b0 con 0x5566560f74d0 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 -- 172.21.15.2:0/1743104631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 msgr2=0x55665610fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x55665610fc30 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8005f00 tx=0x7ff4a8014000 comp rx=0 tx=0).stop 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 -- 172.21.15.2:0/1743104631 shutdown_connections 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556656103d80 0x5566561056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x556656105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/1743104631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566560f74d0 0x55665610fc30 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 -- 172.21.15.2:0/1743104631 >> 172.21.15.2:0/1743104631 conn(0x5566560f5300 msgr2=0x5566560f63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 -- 172.21.15.2:0/1743104631 shutdown_connections 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 -- 172.21.15.2:0/1743104631 wait complete. 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 -- start start 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.384+0000 7ff4b59ab740 1 Processor -- start 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x55665610bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x55665610c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656106c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac1b1930 con 0x556656103d80 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac1b1260 con 0x5566560f7df0 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac1ae4a0 con 0x5566560f74d0 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 10 client.0 _ll_register_callbacks cb 0x7ff4a40a8940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656106c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656106c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37484/0 (socket says 172.21.15.2:37484) 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b0b71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x55665610c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 -- 172.21.15.2:0/4278495402 learned_addr learned my addr 172.21.15.2:0/4278495402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1372640 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x55665610bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 -- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 msgr2=0x55665610bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x55665610bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 -- 172.21.15.2:0/4278495402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 msgr2=0x55665610c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x55665610c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 -- 172.21.15.2:0/4278495402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665610c920 con 0x556656103d80 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b1b73640 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656106c50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400efd0 tx=0x7ff4a40a8210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7733184d9bb614 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff494ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff494ff9640 1 -- 172.21.15.2:0/4278495402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401f070 con 0x556656103d80 2024-09-10T23:33:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff494ff9640 1 -- 172.21.15.2:0/4278495402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff4a40cf0c0 con 0x556656103d80 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.385+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4a8031440 con 0x556656103d80 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff494ff9640 1 -- 172.21.15.2:0/4278495402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4a40aba60 con 0x556656103d80 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 10 client.18630 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556656180ca0 con 0x556656103d80 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff494ff9640 1 -- 172.21.15.2:0/4278495402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4a8031440 con 0x556656103d80 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff494ff9640 1 -- 172.21.15.2:0/4278495402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4a40ab1c0 con 0x556656103d80 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 10 client.18630 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 10 client.18630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 20 client.18630 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556656181390 0x5566561837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 4 client.18630 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55665606b8a0 con 0x556656181390 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.386+0000 7ff4b1372640 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556656181390 0x5566561837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b1372640 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556656181390 0x5566561837b0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa90b2e6f963beed server_cookie=758974d250853d28 in_seq=0 out_seq=0 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff494ff9640 10 client.18630 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff494ff9640 1 -- 172.21.15.2:0/4278495402 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55665606b8a0 con 0x556656181390 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff494ff9640 10 client.18630 handle_command_reply: tid=0 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 client.18630 shutdown 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 msgr2=0x556656106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656106c50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400efd0 tx=0x7ff4a40a8210 comp rx=0 tx=0).stop 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 shutdown_connections 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556656181390 0x5566561837b0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556656103d80 0x556656106c50 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566560f7df0 0x55665610c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 --2- 172.21.15.2:0/4278495402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5566560f74d0 0x55665610bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 >> 172.21.15.2:0/4278495402 conn(0x5566560f5300 msgr2=0x5566560f3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff494ff9640 0 client.18630 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 shutdown_connections 2024-09-10T23:33:18.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 1 -- 172.21.15.2:0/4278495402 wait complete. 2024-09-10T23:33:18.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.387+0000 7ff4b59ab740 20 client.18630 trim_cache size 0 max 16384 2024-09-10T23:33:18.402 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:18.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff4980b52e0 msgr2=0x7ff4980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff4980b52e0 0x7ff4980b77a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x5566560f61e0 tx=0x7ff4a800b7d0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 msgr2=0x7ff4ac102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 0x7ff4ac102410 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400eaa0 tx=0x7ff4a400ef60 comp rx=0 tx=0).stop 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 shutdown_connections 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff4980b52e0 0x7ff4980b77a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4ac10d140 0x7ff4ac102410 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac104600 0x7ff4ac101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 --2- 172.21.15.2:0/3898456757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4ac103ce0 0x7ff4ac101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 >> 172.21.15.2:0/3898456757 conn(0x7ff4ac0fd700 msgr2=0x7ff4ac0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 shutdown_connections 2024-09-10T23:33:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:18.388+0000 7ff4b35d6640 1 -- 172.21.15.2:0/3898456757 wait complete. 2024-09-10T23:33:18.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:18 smithi177 ceph-mon[35760]: pgmap v620: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:18.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:18 smithi154 ceph-mon[35136]: pgmap v620: 97 pgs: 97 active+clean; 2.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.542+0000 7f8bfc271640 1 -- 172.21.15.2:0/3138966960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 msgr2=0x7f8bf410ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.542+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3138966960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf410ab80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009860 tx=0x7f8bec02a340 comp rx=0 tx=0).stop 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- 172.21.15.2:0/3138966960 shutdown_connections 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3138966960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf410ab80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3138966960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf4107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3138966960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bf406bfb0 0x7f8bf4105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- 172.21.15.2:0/3138966960 >> 172.21.15.2:0/3138966960 conn(0x7f8bf40fd150 msgr2=0x7f8bf40ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- 172.21.15.2:0/3138966960 shutdown_connections 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- 172.21.15.2:0/3138966960 wait complete. 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 Processor -- start 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- start start 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bf406bfb0 0x7f8bf4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410e5f0 con 0x7f8bf4105b10 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410e470 con 0x7f8bf41086c0 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.543+0000 7f8bfc271640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410e770 con 0x7f8bf406bfb0 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37504/0 (socket says 172.21.15.2:37504) 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 -- 172.21.15.2:0/3943390171 learned_addr learned my addr 172.21.15.2:0/3943390171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bf406bfb0 0x7f8bf4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 -- 172.21.15.2:0/3943390171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bf406bfb0 msgr2=0x7f8bf4198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bf406bfb0 0x7f8bf4198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 -- 172.21.15.2:0/3943390171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 msgr2=0x7f8bf4199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf4199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 -- 172.21.15.2:0/3943390171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf419a8b0 con 0x7f8bf4105b10 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bf980c640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf41993c0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e9c0 tx=0x7f8be400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8beb7fe640 1 -- 172.21.15.2:0/3943390171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400ccc0 con 0x7f8bf4105b10 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf419aba0 con 0x7f8bf4105b10 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8beb7fe640 1 -- 172.21.15.2:0/3943390171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be40054d0 con 0x7f8bf4105b10 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8beb7fe640 1 -- 172.21.15.2:0/3943390171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4010430 con 0x7f8bf4105b10 2024-09-10T23:33:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.544+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf41a1270 con 0x7f8bf4105b10 2024-09-10T23:33:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.547+0000 7f8bff046740 1 Processor -- start 2024-09-10T23:33:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 -- start start 2024-09-10T23:33:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 0x5622ed367c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed36d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5622ed2d76f0 con 0x5622ed365860 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5622ed2c6b20 con 0x5622ed368190 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bff046740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5622ed2ca930 con 0x5622ed36abd0 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 0x5622ed367c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8beb7fe640 1 -- 172.21.15.2:0/3943390171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8be4004f80 con 0x7f8bf4105b10 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 0x5622ed367c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37514/0 (socket says 172.21.15.2:37514) 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 -- 172.21.15.2:0/271534799 learned_addr learned my addr 172.21.15.2:0/271534799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 -- 172.21.15.2:0/271534799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 msgr2=0x5622ed36d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed36d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 -- 172.21.15.2:0/271534799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 msgr2=0x5622ed36a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa80e640 1 -- 172.21.15.2:0/271534799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ed28c530 con 0x5622ed365860 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.548+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 0x5622ed367c50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009860 tx=0x7f8bec005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1f3f2a1c5e878e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8be8bfe640 1 -- 172.21.15.2:0/271534799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec037040 con 0x5622ed365860 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8be8bfe640 1 -- 172.21.15.2:0/271534799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bec004030 con 0x5622ed365860 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8be8bfe640 1 -- 172.21.15.2:0/271534799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec005550 con 0x5622ed365860 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8beb7fe640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8be00b52e0 0x7f8be00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8be00b52e0 0x7f8be00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.549+0000 7f8beb7fe640 1 -- 172.21.15.2:0/3943390171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8be40e60f0 con 0x7f8bf4105b10 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- 172.21.15.2:0/271534799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 msgr2=0x5622ed367c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8be00b52e0 0x7f8be00b77a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005fd0 tx=0x7f8bf0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 0x5622ed367c50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009860 tx=0x7f8bec005d90 comp rx=0 tx=0).stop 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- 172.21.15.2:0/271534799 shutdown_connections 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed36d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- 172.21.15.2:0/271534799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed365860 0x5622ed367c50 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- 172.21.15.2:0/271534799 >> 172.21.15.2:0/271534799 conn(0x5622ed3609b0 msgr2=0x5622ed361740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- 172.21.15.2:0/271534799 shutdown_connections 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- 172.21.15.2:0/271534799 wait complete. 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- start start 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 Processor -- start 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed36eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 0x5622ed36f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed370140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5622ed1feab0 con 0x5622ed368190 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5622ed26c730 con 0x5622ed365860 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5622ed36db50 con 0x5622ed36abd0 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bff046740 10 client.0 _ll_register_callbacks cb 0x5622ed2c06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bf980c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 0x5622ed36f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bf980c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 0x5622ed36f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37516/0 (socket says 172.21.15.2:37516) 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.550+0000 7f8bf980c640 1 -- 172.21.15.2:0/1714818448 learned_addr learned my addr 172.21.15.2:0/1714818448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed36eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed370140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bf980c640 1 -- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 msgr2=0x5622ed370140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bf980c640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed370140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bf980c640 1 -- 172.21.15.2:0/1714818448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 msgr2=0x5622ed36eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bf980c640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed36eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bf980c640 1 -- 172.21.15.2:0/1714818448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ed028790 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bf980c640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 0x5622ed36f570 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f8be40ac5c0 tx=0x7f8be40ac690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fed238413bb8164 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bddffb640 1 -- 172.21.15.2:0/1714818448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40b1070 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bddffb640 1 -- 172.21.15.2:0/1714818448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8be40e80f0 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bec004030 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bddffb640 1 -- 172.21.15.2:0/1714818448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8be40c7050 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bff046740 10 client.18642 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5622ed0a1620 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bddffb640 1 -- 172.21.15.2:0/1714818448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bec004030 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.551+0000 7f8bddffb640 1 -- 172.21.15.2:0/1714818448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8be40a8210 con 0x5622ed368190 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bff046740 10 client.18642 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bff046740 10 client.18642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bff046740 20 client.18642 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bff046740 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed37cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bff046740 4 client.18642 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622ed2d9640 con 0x5622ed37a800 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed37cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bddffb640 10 client.18642 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.552+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed37cbf0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7837bf43472698c server_cookie=7915e566b4b9c939 in_seq=0 out_seq=0 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bddffb640 1 -- 172.21.15.2:0/1714818448 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622ed2d9640 con 0x5622ed37a800 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bddffb640 10 client.18642 handle_command_reply: tid=0 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 client.18642 shutdown 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 msgr2=0x5622ed36f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 0x5622ed36f570 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f8be40ac5c0 tx=0x7f8be40ac690 comp rx=0 tx=0).stop 2024-09-10T23:33:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 shutdown_connections 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed37cbf0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed36abd0 0x5622ed370140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed368190 0x5622ed36f570 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bddffb640 0 client.18642 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 --2- 172.21.15.2:0/1714818448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed36eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 >> 172.21.15.2:0/1714818448 conn(0x5622ed3609b0 msgr2=0x5622ed35fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 shutdown_connections 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 1 -- 172.21.15.2:0/1714818448 wait complete. 2024-09-10T23:33:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.553+0000 7f8bff046740 20 client.18642 trim_cache size 0 max 16384 2024-09-10T23:33:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 Processor -- start 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 -- start start 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed365860 0x5622ed36df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41a9e70 con 0x5622ed36abd0 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41ab9b0 con 0x5622ed368190 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bff046740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41aa540 con 0x5622ed365860 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37518/0 (socket says 172.21.15.2:37518) 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 -- 172.21.15.2:0/1020082431 learned_addr learned my addr 172.21.15.2:0/1020082431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed365860 0x5622ed36df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 -- 172.21.15.2:0/1020082431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed365860 msgr2=0x5622ed36df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed365860 0x5622ed36df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 -- 172.21.15.2:0/1020082431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 msgr2=0x5622ed36e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bf980c640 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.568+0000 7f8bfa80e640 1 -- 172.21.15.2:0/1020082431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ed36a8f0 con 0x5622ed36abd0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bf980c640 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3627e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f8bec005e00 tx=0x7f8bec005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d23416736cf947 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bdffff640 1 -- 172.21.15.2:0/1020082431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec049070 con 0x5622ed36abd0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bdffff640 1 -- 172.21.15.2:0/1020082431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bec030750 con 0x5622ed36abd0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bdffff640 1 -- 172.21.15.2:0/1020082431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec037070 con 0x5622ed36abd0 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 -- 172.21.15.2:0/1020082431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 msgr2=0x5622ed3627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3627e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f8bec005e00 tx=0x7f8bec005ad0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 -- 172.21.15.2:0/1020082431 shutdown_connections 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3627e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed368190 0x5622ed36e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 --2- 172.21.15.2:0/1020082431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed365860 0x5622ed36df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 -- 172.21.15.2:0/1020082431 >> 172.21.15.2:0/1020082431 conn(0x5622ed3609b0 msgr2=0x5622ed36b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 -- 172.21.15.2:0/1020082431 shutdown_connections 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.569+0000 7f8bff046740 1 -- 172.21.15.2:0/1020082431 wait complete. 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 -- start start 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 Processor -- start 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed376610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed368190 0x5622ed376cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41ab2e0 con 0x5622ed36abd0 2024-09-10T23:33:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41aac10 con 0x5622ed365860 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41a7e50 con 0x5622ed368190 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bff046740 10 client.0 _ll_register_callbacks cb 0x7f8be4004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37526/0 (socket says 172.21.15.2:37526) 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 -- 172.21.15.2:0/923497663 learned_addr learned my addr 172.21.15.2:0/923497663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bf980c640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed368190 0x5622ed376cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed376610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 -- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed368190 msgr2=0x5622ed376cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed368190 0x5622ed376cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 -- 172.21.15.2:0/923497663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 msgr2=0x5622ed376610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed376610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bfa80e640 1 -- 172.21.15.2:0/923497663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ed375cd0 con 0x5622ed36abd0 2024-09-10T23:33:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.570+0000 7f8bf980c640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed368190 0x5622ed376cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bfa80e640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3754a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0304b0 tx=0x7f8bec004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e70f50cfa0dd3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bddffb640 1 -- 172.21.15.2:0/923497663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec049070 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bddffb640 1 -- 172.21.15.2:0/923497663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8bec0046c0 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bec030750 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bddffb640 1 -- 172.21.15.2:0/923497663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8bec037040 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 10 client.18648 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5622ed374a60 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bddffb640 1 -- 172.21.15.2:0/923497663 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bec030750 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bddffb640 1 -- 172.21.15.2:0/923497663 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8bec003970 con 0x5622ed36abd0 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 10 client.18648 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 10 client.18648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 20 client.18648 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed3e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 4 client.18648 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.571+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5622ed2d50f0 con 0x5622ed37a800 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.572+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed3e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.572+0000 7f8bfa00d640 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed3e97b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21a26497d26f18e server_cookie=839b0549de867648 in_seq=0 out_seq=0 2024-09-10T23:33:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.572+0000 7f8bddffb640 10 client.18648 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bddffb640 1 -- 172.21.15.2:0/923497663 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622ed2d50f0 con 0x5622ed37a800 2024-09-10T23:33:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bddffb640 10 client.18648 handle_command_reply: tid=0 2024-09-10T23:33:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 client.18648 shutdown 2024-09-10T23:33:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 msgr2=0x5622ed3754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3754a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0304b0 tx=0x7f8bec004550 comp rx=0 tx=0).stop 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 shutdown_connections 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5622ed37a800 0x5622ed3e97b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622ed36abd0 0x5622ed3754a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5622ed368190 0x5622ed376cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bddffb640 0 client.18648 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 --2- 172.21.15.2:0/923497663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622ed365860 0x5622ed376610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 >> 172.21.15.2:0/923497663 conn(0x5622ed3609b0 msgr2=0x5622ed36df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 shutdown_connections 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 1 -- 172.21.15.2:0/923497663 wait complete. 2024-09-10T23:33:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.587+0000 7f8bff046740 20 client.18648 trim_cache size 0 max 16384 2024-09-10T23:33:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:33:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:33:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:33:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8be00b52e0 msgr2=0x7f8be00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8be00b52e0 0x7f8be00b77a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005fd0 tx=0x7f8bf0009500 comp rx=0 tx=0).stop 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 msgr2=0x7f8bf41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf41993c0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e9c0 tx=0x7f8be400ee80 comp rx=0 tx=0).stop 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 shutdown_connections 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8be00b52e0 0x7f8be00b77a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf41086c0 0x7f8bf4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf4105b10 0x7f8bf41993c0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 --2- 172.21.15.2:0/3943390171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bf406bfb0 0x7f8bf4198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 >> 172.21.15.2:0/3943390171 conn(0x7f8bf40fd150 msgr2=0x7f8bf4103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 shutdown_connections 2024-09-10T23:33:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:18.588+0000 7f8bfc271640 1 -- 172.21.15.2:0/3943390171 wait complete. 2024-09-10T23:33:20.309 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:33:20.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:33:20.339 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:20 smithi002 ceph-mon[31150]: pgmap v621: 97 pgs: 97 active+clean; 2.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:33:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:20 smithi177 ceph-mon[35760]: pgmap v621: 97 pgs: 97 active+clean; 2.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:33:20.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:20 smithi154 ceph-mon[35136]: pgmap v621: 97 pgs: 97 active+clean; 2.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:33:20.584 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 -- 172.21.15.2:0/1607330840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c1045c0 msgr2=0x7f079c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1607330840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c1045c0 0x7f079c10cab0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0784009900 tx=0x7f078402a410 comp rx=0 tx=0).stop 2024-09-10T23:33:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 -- 172.21.15.2:0/1607330840 shutdown_connections 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1607330840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c10d100 0x7f079c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1607330840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c1045c0 0x7f079c10cab0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1607330840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079c103ca0 0x7f079c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 -- 172.21.15.2:0/1607330840 >> 172.21.15.2:0/1607330840 conn(0x7f079c0fd700 msgr2=0x7f079c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 -- 172.21.15.2:0/1607330840 shutdown_connections 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 -- 172.21.15.2:0/1607330840 wait complete. 2024-09-10T23:33:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.097+0000 7f07a0bca640 1 Processor -- start 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 -- start start 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 0x7f079c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c1045c0 0x7f079c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079c10d100 0x7f079c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f079c112dc0 con 0x7f079c103ca0 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f079c112c40 con 0x7f079c10d100 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07a0bca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f079c112f40 con 0x7f079c1045c0 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 0x7f079c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 0x7f079c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50354/0 (socket says 172.21.15.2:50354) 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 -- 172.21.15.2:0/1548341636 learned_addr learned my addr 172.21.15.2:0/1548341636 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f0799d9b640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c1045c0 0x7f079c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 -- 172.21.15.2:0/1548341636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c1045c0 msgr2=0x7f079c199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c1045c0 0x7f079c199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 -- 172.21.15.2:0/1548341636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079c10d100 msgr2=0x7f079c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079c10d100 0x7f079c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 -- 172.21.15.2:0/1548341636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c19f2e0 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f0799d9b640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c1045c0 0x7f079c199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f079a59c640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 0x7f079c199230 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f078c00d950 tx=0x7f078c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.098+0000 7f07937fe640 1 -- 172.21.15.2:0/1548341636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c017070 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.099+0000 7f07937fe640 1 -- 172.21.15.2:0/1548341636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f078c009c30 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.099+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079c19f5d0 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.099+0000 7f07937fe640 1 -- 172.21.15.2:0/1548341636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c00f620 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.099+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079c1a5e60 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.101+0000 7f07937fe640 1 -- 172.21.15.2:0/1548341636 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f078c010460 con 0x7f079c103ca0 2024-09-10T23:33:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.101+0000 7f07a2f9f740 1 Processor -- start 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.101+0000 7f07a2f9f740 1 -- start start 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.101+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df4062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.101+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 0x5568df416660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df416ba0 0x5568df418f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5568df37ce60 con 0x5568df406800 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568df36c290 con 0x5568df416ba0 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5568df3700a0 con 0x5568df405ee0 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 0x5568df416660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 0x5568df416660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50364/0 (socket says 172.21.15.2:50364) 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 -- 172.21.15.2:0/218702908 learned_addr learned my addr 172.21.15.2:0/218702908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079ad9d640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df4062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f0799d9b640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df416ba0 0x5568df418f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 -- 172.21.15.2:0/218702908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 msgr2=0x5568df4062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df4062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 -- 172.21.15.2:0/218702908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df416ba0 msgr2=0x5568df418f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df416ba0 0x5568df418f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 -- 172.21.15.2:0/218702908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568df0ca930 con 0x5568df406800 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079ad9d640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df4062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f0799d9b640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df416ba0 0x5568df418f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f07937fe640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07880b5360 0x7f07880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079ad9d640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07880b5360 0x7f07880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f07937fe640 1 -- 172.21.15.2:0/1548341636 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f078c0e5870 con 0x7f079c103ca0 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.102+0000 7f079a59c640 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 0x5568df416660 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ebc40 tx=0x7f078c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4684f85d6d88f276 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f0790ff9640 1 -- 172.21.15.2:0/218702908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c020020 con 0x5568df406800 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f0790ff9640 1 -- 172.21.15.2:0/218702908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f078c0abb50 con 0x5568df406800 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f0790ff9640 1 -- 172.21.15.2:0/218702908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c091e60 con 0x5568df406800 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 -- 172.21.15.2:0/218702908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 msgr2=0x5568df416660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f079ad9d640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07880b5360 0x7f07880b7820 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0794005fd0 tx=0x7f07940073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 0x5568df416660 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ebc40 tx=0x7f078c0ed690 comp rx=0 tx=0).stop 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 -- 172.21.15.2:0/218702908 shutdown_connections 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df416ba0 0x5568df418f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df406800 0x5568df416660 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/218702908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df4062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.103+0000 7f07a2f9f740 1 -- 172.21.15.2:0/218702908 >> 172.21.15.2:0/218702908 conn(0x5568df403d10 msgr2=0x5568df404eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 -- 172.21.15.2:0/218702908 shutdown_connections 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 -- 172.21.15.2:0/218702908 wait complete. 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 -- start start 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 Processor -- start 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 0x5568df413ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df414010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df416ba0 0x5568df414550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5568df1cd890 con 0x5568df405ee0 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568df306d40 con 0x5568df406800 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5568df419850 con 0x5568df416ba0 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f07a2f9f740 10 client.0 _ll_register_callbacks cb 0x5568df36ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 0x5568df413ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 0x5568df413ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50380/0 (socket says 172.21.15.2:50380) 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.104+0000 7f079a59c640 1 -- 172.21.15.2:0/1237810800 learned_addr learned my addr 172.21.15.2:0/1237810800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079ad9d640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df416ba0 0x5568df414550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0799d9b640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df414010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079a59c640 1 -- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df416ba0 msgr2=0x5568df414550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079a59c640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df416ba0 0x5568df414550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079a59c640 1 -- 172.21.15.2:0/1237810800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 msgr2=0x5568df414010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079a59c640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df414010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079a59c640 1 -- 172.21.15.2:0/1237810800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568df422be0 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0799d9b640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df414010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f079a59c640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 0x5568df413ad0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f078c0e33d0 tx=0x7f078c0edfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7113aae1c05bf73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0781ffb640 1 -- 172.21.15.2:0/1237810800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c020030 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0781ffb640 1 -- 172.21.15.2:0/1237810800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f078c0ebd30 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f078c0abb50 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0781ffb640 1 -- 172.21.15.2:0/1237810800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f078c091e60 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f07a2f9f740 10 client.18660 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5568df425570 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0781ffb640 1 -- 172.21.15.2:0/1237810800 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f078c0abb50 con 0x5568df405ee0 2024-09-10T23:33:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.105+0000 7f0781ffb640 1 -- 172.21.15.2:0/1237810800 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f078c0a82b0 con 0x5568df405ee0 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f07a2f9f740 10 client.18660 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f07a2f9f740 10 client.18660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f07a2f9f740 20 client.18660 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df4268c0 0x5568df428cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f07a2f9f740 4 client.18660 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568df37edb0 con 0x5568df4268c0 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f0799d9b640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df4268c0 0x5568df428cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f0799d9b640 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df4268c0 0x5568df428cb0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c40ee6264c4c27 server_cookie=43735796052a5f25 in_seq=0 out_seq=0 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.106+0000 7f0781ffb640 10 client.18660 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f0781ffb640 1 -- 172.21.15.2:0/1237810800 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568df37edb0 con 0x5568df4268c0 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f0781ffb640 10 client.18660 handle_command_reply: tid=0 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 client.18660 shutdown 2024-09-10T23:33:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 msgr2=0x5568df413ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 0x5568df413ad0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f078c0e33d0 tx=0x7f078c0edfd0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 shutdown_connections 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df4268c0 0x5568df428cb0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f0781ffb640 0 client.18660 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df416ba0 0x5568df414550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df414010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/1237810800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df405ee0 0x5568df413ad0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 >> 172.21.15.2:0/1237810800 conn(0x5568df403d10 msgr2=0x5568df402f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.107+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 shutdown_connections 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.108+0000 7f07a2f9f740 1 -- 172.21.15.2:0/1237810800 wait complete. 2024-09-10T23:33:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.108+0000 7f07a2f9f740 20 client.18660 trim_cache size 0 max 16384 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.125+0000 7f07a2f9f740 1 Processor -- start 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.125+0000 7f07a2f9f740 1 -- start start 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.125+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df405ee0 0x5568df403760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.125+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df406800 0x5568df411630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.125+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df407f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1ac0a0 con 0x5568df416ba0 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1adbe0 con 0x5568df405ee0 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1ac770 con 0x5568df406800 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df407f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df407f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50392/0 (socket says 172.21.15.2:50392) 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 -- 172.21.15.2:0/2230877515 learned_addr learned my addr 172.21.15.2:0/2230877515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079a59c640 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df405ee0 0x5568df403760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f0799d9b640 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df406800 0x5568df411630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 -- 172.21.15.2:0/2230877515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df406800 msgr2=0x5568df411630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df406800 0x5568df411630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 -- 172.21.15.2:0/2230877515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df405ee0 msgr2=0x5568df403760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df405ee0 0x5568df403760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 -- 172.21.15.2:0/2230877515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568df4057b0 con 0x5568df416ba0 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f0799d9b640 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df406800 0x5568df411630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f079ad9d640 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df407f40 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f07940105c0 tx=0x7f0794011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15a2e4d49c6828c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f0783fff640 1 -- 172.21.15.2:0/2230877515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794003b70 con 0x5568df416ba0 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f0783fff640 1 -- 172.21.15.2:0/2230877515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0794003d10 con 0x5568df416ba0 2024-09-10T23:33:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.126+0000 7f0783fff640 1 -- 172.21.15.2:0/2230877515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794004620 con 0x5568df416ba0 2024-09-10T23:33:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 -- 172.21.15.2:0/2230877515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 msgr2=0x5568df407f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df407f40 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f07940105c0 tx=0x7f0794011000 comp rx=0 tx=0).stop 2024-09-10T23:33:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 -- 172.21.15.2:0/2230877515 shutdown_connections 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df407f40 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df406800 0x5568df411630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/2230877515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df405ee0 0x5568df403760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 -- 172.21.15.2:0/2230877515 >> 172.21.15.2:0/2230877515 conn(0x5568df403d10 msgr2=0x5568df412350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 -- 172.21.15.2:0/2230877515 shutdown_connections 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 -- 172.21.15.2:0/2230877515 wait complete. 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.127+0000 7f07a2f9f740 1 -- start start 2024-09-10T23:33:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 Processor -- start 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df42c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df428cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df429380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1ad510 con 0x5568df416ba0 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1ace40 con 0x5568df406800 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1aa0a0 con 0x5568df405ee0 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f07a2f9f740 10 client.0 _ll_register_callbacks cb 0x7f078c0eba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df429380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df429380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50406/0 (socket says 172.21.15.2:50406) 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 -- 172.21.15.2:0/402806802 learned_addr learned my addr 172.21.15.2:0/402806802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f0799d9b640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df428cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079a59c640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df42c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 -- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 msgr2=0x5568df42c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df42c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 -- 172.21.15.2:0/402806802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 msgr2=0x5568df428cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df428cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079ad9d640 1 -- 172.21.15.2:0/402806802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568df493430 con 0x5568df416ba0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.128+0000 7f079a59c640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df42c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f079ad9d640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df429380 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0794007c10 tx=0x7f07940044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72d3cf6f949c3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f0781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f0781ffb640 1 -- 172.21.15.2:0/402806802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794036060 con 0x5568df416ba0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f0781ffb640 1 -- 172.21.15.2:0/402806802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0794004800 con 0x5568df416ba0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0794003d10 con 0x5568df416ba0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f0781ffb640 1 -- 172.21.15.2:0/402806802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f079401e700 con 0x5568df416ba0 2024-09-10T23:33:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 10 client.18666 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5568df4945e0 con 0x5568df416ba0 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f0781ffb640 1 -- 172.21.15.2:0/402806802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0794003d10 con 0x5568df416ba0 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f0781ffb640 1 -- 172.21.15.2:0/402806802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0794031a50 con 0x5568df416ba0 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 10 client.18666 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 10 client.18666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 20 client.18666 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df494d00 0x5568df497120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 4 client.18666 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.129+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5568df37a860 con 0x5568df494d00 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.130+0000 7f079a59c640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df494d00 0x5568df497120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.130+0000 7f079a59c640 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df494d00 0x5568df497120 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f45ad5031ef165 server_cookie=bc3eab817be3a637 in_seq=0 out_seq=0 2024-09-10T23:33:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.130+0000 7f0781ffb640 10 client.18666 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f0781ffb640 1 -- 172.21.15.2:0/402806802 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5568df37a860 con 0x5568df494d00 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f0781ffb640 10 client.18666 handle_command_reply: tid=0 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 client.18666 shutdown 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 msgr2=0x5568df429380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df429380 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0794007c10 tx=0x7f07940044d0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 shutdown_connections 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5568df494d00 0x5568df497120 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568df416ba0 0x5568df429380 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568df406800 0x5568df428cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 --2- 172.21.15.2:0/402806802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568df405ee0 0x5568df42c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f0781ffb640 0 client.18666 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 >> 172.21.15.2:0/402806802 conn(0x5568df403d10 msgr2=0x5568df415100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 shutdown_connections 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 1 -- 172.21.15.2:0/402806802 wait complete. 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.132+0000 7f07a2f9f740 20 client.18666 trim_cache size 0 max 16384 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "307b0b48-8904-48ca-a507-77002ebac5a2", 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:33:21.138 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07880b5360 msgr2=0x7f07880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07880b5360 0x7f07880b7820 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0794005fd0 tx=0x7f07940073c0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 msgr2=0x7f079c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 0x7f079c199230 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f078c00d950 tx=0x7f078c00de10 comp rx=0 tx=0).stop 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 shutdown_connections 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f07880b5360 0x7f07880b7820 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079c10d100 0x7f079c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f079c1045c0 0x7f079c199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 --2- 172.21.15.2:0/1548341636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c103ca0 0x7f079c199230 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 >> 172.21.15.2:0/1548341636 conn(0x7f079c0fd700 msgr2=0x7f079c10f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 shutdown_connections 2024-09-10T23:33:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:21.133+0000 7f07a0bca640 1 -- 172.21.15.2:0/1548341636 wait complete. 2024-09-10T23:33:22.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:33:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:22 smithi002 ceph-mon[31150]: pgmap v622: 97 pgs: 97 active+clean; 2.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:33:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:22 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:33:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:22 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:22.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:22 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:33:22.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:22 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:22.318 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:22 smithi177 ceph-mon[35760]: pgmap v622: 97 pgs: 97 active+clean; 2.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:33:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:22 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:33:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:22 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:22 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:33:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:22 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:22.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:22 smithi154 ceph-mon[35136]: pgmap v622: 97 pgs: 97 active+clean; 2.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:33:22.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:22 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:33:22.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:22 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:22.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:22 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:33:22.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:22 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/2841585305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c109150 msgr2=0x7fb99c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/2841585305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c109150 0x7fb99c10f950 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fb994009900 tx=0x7fb99402a410 comp rx=0 tx=0).stop 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/2841585305 shutdown_connections 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/2841585305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c109150 0x7fb99c10f950 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/2841585305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c1087d0 0x7fb99c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/2841585305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb99c102dc0 0x7fb99c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/2841585305 >> 172.21.15.2:0/2841585305 conn(0x7fb99c0fe830 msgr2=0x7fb99c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/2841585305 shutdown_connections 2024-09-10T23:33:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.911+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/2841585305 wait complete. 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.912+0000 7fb9a1e3e640 1 Processor -- start 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.912+0000 7fb9a1e3e640 1 -- start start 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.912+0000 7fb9a1e3e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb99c102dc0 0x7fb99c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.912+0000 7fb9a1e3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 0x7fb99c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb9a1e3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c109150 0x7fb99c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb9a1e3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c112e10 con 0x7fb99c1087d0 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb9a1e3e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c112c90 con 0x7fb99c109150 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb9a1e3e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c112f90 con 0x7fb99c102dc0 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 0x7fb99c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 0x7fb99c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50414/0 (socket says 172.21.15.2:50414) 2024-09-10T23:33:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 -- 172.21.15.2:0/3833550780 learned_addr learned my addr 172.21.15.2:0/3833550780 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99bfff640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c109150 0x7fb99c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb99c102dc0 0x7fb99c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 -- 172.21.15.2:0/3833550780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb99c102dc0 msgr2=0x7fb99c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb99c102dc0 0x7fb99c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 -- 172.21.15.2:0/3833550780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c109150 msgr2=0x7fb99c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c109150 0x7fb99c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 -- 172.21.15.2:0/3833550780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c19f3b0 con 0x7fb99c1087d0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb99affd640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 0x7fb99c199840 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d950 tx=0x7fb99000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb998ff9640 1 -- 172.21.15.2:0/3833550780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990017070 con 0x7fb99c1087d0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb998ff9640 1 -- 172.21.15.2:0/3833550780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb990009c30 con 0x7fb99c1087d0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c19f6a0 con 0x7fb99c1087d0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.913+0000 7fb998ff9640 1 -- 172.21.15.2:0/3833550780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99000f620 con 0x7fb99c1087d0 2024-09-10T23:33:22.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.914+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1a5f30 con 0x7fb99c1087d0 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 Processor -- start 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 -- start start 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb998ff9640 1 -- 172.21.15.2:0/3833550780 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb990010460 con 0x7fb99c1087d0 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677480 0x55ce98677860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 0x55ce986837f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce98686120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ce985ede50 con 0x55ce98677da0 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce985dd280 con 0x55ce98677480 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb9a4213740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ce985e1090 con 0x55ce98683d30 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb99b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 0x55ce986837f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb99b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 0x55ce986837f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50424/0 (socket says 172.21.15.2:50424) 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb99b7fe640 1 -- 172.21.15.2:0/4147683395 learned_addr learned my addr 172.21.15.2:0/4147683395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb99bfff640 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677480 0x55ce98677860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb99affd640 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce98686120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.917+0000 7fb99b7fe640 1 -- 172.21.15.2:0/4147683395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 msgr2=0x55ce98686120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce98686120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb99b7fe640 1 -- 172.21.15.2:0/4147683395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677480 msgr2=0x55ce98677860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677480 0x55ce98677860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb99b7fe640 1 -- 172.21.15.2:0/4147683395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9833b650 con 0x55ce98677da0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb998ff9640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb9840b5360 0x7fb9840b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 0x55ce986837f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0103f0 tx=0x7fb98c0108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f431cbc711af8924 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb99bfff640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb9840b5360 0x7fb9840b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb981ffb640 1 -- 172.21.15.2:0/4147683395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c016070 con 0x55ce98677da0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb998ff9640 1 -- 172.21.15.2:0/3833550780 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb9900e56a0 con 0x7fb99c1087d0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb981ffb640 1 -- 172.21.15.2:0/4147683395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c004d20 con 0x55ce98677da0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.918+0000 7fb981ffb640 1 -- 172.21.15.2:0/4147683395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0053e0 con 0x55ce98677da0 2024-09-10T23:33:22.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 -- 172.21.15.2:0/4147683395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 msgr2=0x55ce986837f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb99bfff640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb9840b5360 0x7fb9840b7820 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb994006010 tx=0x7fb9940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 0x55ce986837f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0103f0 tx=0x7fb98c0108b0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 -- 172.21.15.2:0/4147683395 shutdown_connections 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce98686120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677da0 0x55ce986837f0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 --2- 172.21.15.2:0/4147683395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677480 0x55ce98677860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 -- 172.21.15.2:0/4147683395 >> 172.21.15.2:0/4147683395 conn(0x55ce986752b0 msgr2=0x55ce98676450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 -- 172.21.15.2:0/4147683395 shutdown_connections 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 -- 172.21.15.2:0/4147683395 wait complete. 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 -- start start 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.919+0000 7fb9a4213740 1 Processor -- start 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce986835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98680a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98680fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ce9843e700 con 0x55ce98683d30 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce98578110 con 0x55ce98677da0 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ce9868adc0 con 0x55ce98677480 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb9a4213740 10 client.0 _ll_register_callbacks cb 0x55ce98591990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98680fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98680fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50426/0 (socket says 172.21.15.2:50426) 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 -- 172.21.15.2:0/41968237 learned_addr learned my addr 172.21.15.2:0/41968237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce986835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99affd640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98680a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 -- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 msgr2=0x55ce986835d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce986835d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 -- 172.21.15.2:0/41968237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 msgr2=0x55ce98680a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98680a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 -- 172.21.15.2:0/41968237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce985a5c40 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb99bfff640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98680fe0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb9940096c0 tx=0x7fb994009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868b1a0692892eee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.920+0000 7fb97affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb97affd640 1 -- 172.21.15.2:0/41968237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99404d070 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb97affd640 1 -- 172.21.15.2:0/41968237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb994004450 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb98c004d20 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb97affd640 1 -- 172.21.15.2:0/41968237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb994059050 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 10 client.18678 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce986966a0 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb97affd640 1 -- 172.21.15.2:0/41968237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c004d20 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb97affd640 1 -- 172.21.15.2:0/41968237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb994004cd0 con 0x55ce98683d30 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 10 client.18678 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 10 client.18678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 20 client.18678 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98697b20 0x55ce98699fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 4 client.18678 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.921+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce985efda0 con 0x55ce98697b20 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.922+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98697b20 0x55ce98699fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.922+0000 7fb97affd640 10 client.18678 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.922+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98697b20 0x55ce98699fa0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b6550ad23c52e7 server_cookie=d3477142a19f2dee in_seq=0 out_seq=0 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb97affd640 1 -- 172.21.15.2:0/41968237 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce985efda0 con 0x55ce98697b20 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb97affd640 10 client.18678 handle_command_reply: tid=0 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 client.18678 shutdown 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 msgr2=0x55ce98680fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98680fe0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb9940096c0 tx=0x7fb994009260 comp rx=0 tx=0).stop 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 shutdown_connections 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98697b20 0x55ce98699fa0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98680fe0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98680a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb97affd640 0 client.18678 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 --2- 172.21.15.2:0/41968237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce986835d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 >> 172.21.15.2:0/41968237 conn(0x55ce986752b0 msgr2=0x55ce9867ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 shutdown_connections 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 1 -- 172.21.15.2:0/41968237 wait complete. 2024-09-10T23:33:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.923+0000 7fb9a4213740 20 client.18678 trim_cache size 0 max 16384 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 Processor -- start 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 -- start start 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 0x55ce98674bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98682760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce9867dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1ac1a0 con 0x55ce98677480 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1adce0 con 0x55ce98677da0 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb9a4213740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1ac870 con 0x55ce98683d30 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb99b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 0x55ce98674bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb99b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 0x55ce98674bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50442/0 (socket says 172.21.15.2:50442) 2024-09-10T23:33:22.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb99b7fe640 1 -- 172.21.15.2:0/3092150151 learned_addr learned my addr 172.21.15.2:0/3092150151 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb99b7fe640 1 -- 172.21.15.2:0/3092150151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 msgr2=0x55ce9867dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.941+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce9867dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb99b7fe640 1 -- 172.21.15.2:0/3092150151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 msgr2=0x55ce98682760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98682760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb99b7fe640 1 -- 172.21.15.2:0/3092150151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9867b4f0 con 0x55ce98677480 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 0x55ce98674bc0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009930 tx=0x7fb98c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3149505cc51d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb9817fa640 1 -- 172.21.15.2:0/3092150151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c016040 con 0x55ce98677480 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb9817fa640 1 -- 172.21.15.2:0/3092150151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c032070 con 0x55ce98677480 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb9817fa640 1 -- 172.21.15.2:0/3092150151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c005250 con 0x55ce98677480 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb9a4213740 1 -- 172.21.15.2:0/3092150151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 msgr2=0x55ce98674bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.942+0000 7fb9a4213740 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 0x55ce98674bc0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009930 tx=0x7fb98c005bd0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 -- 172.21.15.2:0/3092150151 shutdown_connections 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98683d30 0x55ce9867dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce98682760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 --2- 172.21.15.2:0/3092150151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98677480 0x55ce98674bc0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 -- 172.21.15.2:0/3092150151 >> 172.21.15.2:0/3092150151 conn(0x55ce986752b0 msgr2=0x55ce98682050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 -- 172.21.15.2:0/3092150151 shutdown_connections 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 -- 172.21.15.2:0/3092150151 wait complete. 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 -- start start 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 Processor -- start 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce9868c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce9868cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.943+0000 7fb9a4213740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98703ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb9a4213740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1ad610 con 0x55ce98683d30 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb9a4213740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1acf40 con 0x55ce98677da0 2024-09-10T23:33:22.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb9a4213740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1aa180 con 0x55ce98677480 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb9a4213740 10 client.0 _ll_register_callbacks cb 0x7fb994032f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98703ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98703ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50454/0 (socket says 172.21.15.2:50454) 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99bfff640 1 -- 172.21.15.2:0/2264546814 learned_addr learned my addr 172.21.15.2:0/2264546814 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce9868cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce9868c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 -- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 msgr2=0x55ce9868c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce9868c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 -- 172.21.15.2:0/2264546814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 msgr2=0x55ce98703ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98703ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 -- 172.21.15.2:0/2264546814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce98704160 con 0x55ce98677da0 2024-09-10T23:33:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99bfff640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98703ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce9868c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb99affd640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce9868cce0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9900e3200 tx=0x7fb9900a7ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98e8b1ddc64a6c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.944+0000 7fb97affd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb97affd640 1 -- 172.21.15.2:0/2264546814 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990020040 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb97affd640 1 -- 172.21.15.2:0/2264546814 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb9900930c0 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb98c032070 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb97affd640 1 -- 172.21.15.2:0/2264546814 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9900aba30 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 10 client.27338 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce98705430 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb97affd640 1 -- 172.21.15.2:0/2264546814 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c032070 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb97affd640 1 -- 172.21.15.2:0/2264546814 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb990010780 con 0x55ce98677da0 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 10 client.27338 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:22.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 10 client.27338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 20 client.27338 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98705bb0 0x55ce98707fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 4 client.27338 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.945+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ce985eb850 con 0x55ce98705bb0 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.946+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98705bb0 0x55ce98707fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.946+0000 7fb99b7fe640 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98705bb0 0x55ce98707fd0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6470f1dad74a63 server_cookie=816c52005748044c in_seq=0 out_seq=0 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.946+0000 7fb97affd640 10 client.27338 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.946+0000 7fb97affd640 1 -- 172.21.15.2:0/2264546814 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x55ce985eb850 con 0x55ce98705bb0 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.946+0000 7fb97affd640 10 client.27338 handle_command_reply: tid=0 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.946+0000 7fb9a4213740 1 client.27338 shutdown 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 msgr2=0x55ce9868cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce9868cce0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9900e3200 tx=0x7fb9900a7ee0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 shutdown_connections 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55ce98705bb0 0x55ce98707fd0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ce98683d30 0x55ce98703ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce98677da0 0x55ce9868cce0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb97affd640 0 client.27338 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 --2- 172.21.15.2:0/2264546814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ce98677480 0x55ce9868c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 >> 172.21.15.2:0/2264546814 conn(0x55ce986752b0 msgr2=0x55ce98682870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 shutdown_connections 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 1 -- 172.21.15.2:0/2264546814 wait complete. 2024-09-10T23:33:22.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a4213740 20 client.27338 trim_cache size 0 max 16384 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "307b0b48-8904-48ca-a507-77002ebac5a2", 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:33:22.958 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.959 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.960 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:33:22.964 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.965 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.965 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.969 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.970 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.970 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:33:22.970 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:33:22.970 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.970 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.971 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.971 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.971 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.971 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:33:22.971 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.972 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:22.974 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb9840b5360 msgr2=0x7fb9840b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb9840b5360 0x7fb9840b7820 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb994006010 tx=0x7fb9940058d0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 msgr2=0x7fb99c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.947+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 0x7fb99c199840 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d950 tx=0x7fb99000de10 comp rx=0 tx=0).stop 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 shutdown_connections 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb9840b5360 0x7fb9840b7820 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c109150 0x7fb99c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1087d0 0x7fb99c199840 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 --2- 172.21.15.2:0/3833550780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb99c102dc0 0x7fb99c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 >> 172.21.15.2:0/3833550780 conn(0x7fb99c0fe830 msgr2=0x7fb99c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 shutdown_connections 2024-09-10T23:33:22.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:22.948+0000 7fb9a1e3e640 1 -- 172.21.15.2:0/3833550780 wait complete. 2024-09-10T23:33:23.880 INFO:tasks.cephfs.filesystem:scrub status for tag:307b0b48-8904-48ca-a507-77002ebac5a2 - {'path': '/', 'tag': '307b0b48-8904-48ca-a507-77002ebac5a2', 'options': 'recursive,force'} 2024-09-10T23:33:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:24 smithi002 ceph-mon[31150]: pgmap v623: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:24.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:24 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:33:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:24 smithi177 ceph-mon[35760]: pgmap v623: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:24 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:33:24.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:24 smithi154 ceph-mon[35136]: pgmap v623: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:24.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:24 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:33:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:26 smithi177 ceph-mon[35760]: pgmap v624: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:26.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:26 smithi002 ceph-mon[31150]: pgmap v624: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:26.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:26 smithi154 ceph-mon[35136]: pgmap v624: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:28 smithi177 ceph-mon[35760]: pgmap v625: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:28.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:28 smithi002 ceph-mon[31150]: pgmap v625: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:28.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:28 smithi154 ceph-mon[35136]: pgmap v625: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:30 smithi177 ceph-mon[35760]: pgmap v626: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:30.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:30 smithi002 ceph-mon[31150]: pgmap v626: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:30.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:30 smithi154 ceph-mon[35136]: pgmap v626: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 -- 172.21.15.2:0/2663636819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 msgr2=0x7f2ca0101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/2663636819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0101c70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009cd0 tx=0x7f2c9002a8e0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 -- 172.21.15.2:0/2663636819 shutdown_connections 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/2663636819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 0x7f2ca0109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/2663636819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca01029c0 0x7f2ca0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/2663636819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0101c70 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.689+0000 7f2ca4e47640 1 -- 172.21.15.2:0/2663636819 >> 172.21.15.2:0/2663636819 conn(0x7f2ca00fd150 msgr2=0x7f2ca00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.690+0000 7f2ca4e47640 1 -- 172.21.15.2:0/2663636819 shutdown_connections 2024-09-10T23:33:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.690+0000 7f2ca4e47640 1 -- 172.21.15.2:0/2663636819 wait complete. 2024-09-10T23:33:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.690+0000 7f2ca4e47640 1 Processor -- start 2024-09-10T23:33:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.690+0000 7f2ca4e47640 1 -- start start 2024-09-10T23:33:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2ca4e47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2ca4e47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca01029c0 0x7f2ca01993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2ca4e47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 0x7f2ca0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2ca4e47640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca010d4e0 con 0x7f2ca0101870 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2ca4e47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca010d360 con 0x7f2ca01029c0 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2ca4e47640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca010d660 con 0x7f2ca0103380 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33872/0 (socket says 172.21.15.2:33872) 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 -- 172.21.15.2:0/1714975192 learned_addr learned my addr 172.21.15.2:0/1714975192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 0x7f2ca0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca01029c0 0x7f2ca01993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 -- 172.21.15.2:0/1714975192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 msgr2=0x7f2ca0199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 0x7f2ca0199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 -- 172.21.15.2:0/1714975192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca01029c0 msgr2=0x7f2ca01993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca01029c0 0x7f2ca01993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 -- 172.21.15.2:0/1714975192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca019a890 con 0x7f2ca0101870 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 0x7f2ca0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.691+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0198d50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097b0 tx=0x7f2c90004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.692+0000 7f2c977fe640 1 -- 172.21.15.2:0/1714975192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90004040 con 0x7f2ca0101870 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.692+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca019ab20 con 0x7f2ca0101870 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.692+0000 7f2c977fe640 1 -- 172.21.15.2:0/1714975192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c90004690 con 0x7f2ca0101870 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.692+0000 7f2c977fe640 1 -- 172.21.15.2:0/1714975192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90030e40 con 0x7f2ca0101870 2024-09-10T23:33:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.692+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca01a1250 con 0x7f2ca0101870 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.694+0000 7f2c977fe640 1 -- 172.21.15.2:0/1714975192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2c90030070 con 0x7f2ca0101870 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.695+0000 7f2c977fe640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2c8c0b52e0 0x7f2c8c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.695+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2c8c0b52e0 0x7f2c8c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.695+0000 7f2c977fe640 1 -- 172.21.15.2:0/1714975192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2c9002e030 con 0x7f2ca0101870 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.695+0000 7f2ca7c15740 1 Processor -- start 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2c8c0b52e0 0x7f2c8c0b77a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009bd0 tx=0x7f2c88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 -- start start 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3ed860 0x55957a3efc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55957a35f6f0 con 0x55957a3f0190 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55957a34eb20 con 0x55957a3ed860 2024-09-10T23:33:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55957a352930 con 0x55957a3f2bd0 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2c9dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2c9dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33880/0 (socket says 172.21.15.2:33880) 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/213803135 learned_addr learned my addr 172.21.15.2:0/213803135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.696+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3ed860 0x55957a3efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/213803135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 msgr2=0x55957a3f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/213803135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3ed860 msgr2=0x55957a3efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3ed860 0x55957a3efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/213803135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957a314530 con 0x55957a3f0190 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3ed860 0x55957a3efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f2580 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e630 tx=0x7f2c88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf9979bb8be2aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c94ff9640 1 -- 172.21.15.2:0/213803135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88004020 con 0x55957a3f0190 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c94ff9640 1 -- 172.21.15.2:0/213803135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c880041c0 con 0x55957a3f0190 2024-09-10T23:33:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.697+0000 7f2c94ff9640 1 -- 172.21.15.2:0/213803135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8801c6b0 con 0x55957a3f0190 2024-09-10T23:33:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 -- 172.21.15.2:0/213803135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 msgr2=0x55957a3f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f2580 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e630 tx=0x7f2c88014000 comp rx=0 tx=0).stop 2024-09-10T23:33:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 -- 172.21.15.2:0/213803135 shutdown_connections 2024-09-10T23:33:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f2580 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/213803135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3ed860 0x55957a3efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 -- 172.21.15.2:0/213803135 >> 172.21.15.2:0/213803135 conn(0x55957a3e89b0 msgr2=0x55957a3e9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 -- 172.21.15.2:0/213803135 shutdown_connections 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 -- 172.21.15.2:0/213803135 wait complete. 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 -- start start 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.698+0000 7f2ca7c15740 1 Processor -- start 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f2bd0 0x55957a3f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55957a286ab0 con 0x55957a3f0190 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55957a2f4730 con 0x55957a3f2bd0 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55957a3f5bb0 con 0x55957a3ed860 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2ca7c15740 10 client.0 _ll_register_callbacks cb 0x55957a3486b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33884/0 (socket says 172.21.15.2:33884) 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/2045215897 learned_addr learned my addr 172.21.15.2:0/2045215897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f2bd0 0x55957a3f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 msgr2=0x55957a3f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/2045215897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f2bd0 msgr2=0x55957a3f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f2bd0 0x55957a3f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 -- 172.21.15.2:0/2045215897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957a0b0790 con 0x55957a3f0190 2024-09-10T23:33:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f7560 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e600 tx=0x7f2c88003fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6d9b1a8e10f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.699+0000 7f2c85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2c85ffb640 1 -- 172.21.15.2:0/2045215897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88034060 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2c85ffb640 1 -- 172.21.15.2:0/2045215897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2c8800ed60 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c880041c0 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2c85ffb640 1 -- 172.21.15.2:0/2045215897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c8801c410 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 10 client.18696 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55957a129620 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2c85ffb640 1 -- 172.21.15.2:0/2045215897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c880041c0 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2c85ffb640 1 -- 172.21.15.2:0/2045215897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2c8802e030 con 0x55957a3f0190 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 10 client.18696 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 10 client.18696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 20 client.18696 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a402470 0x55957a404860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 4 client.18696 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.700+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55957a361640 con 0x55957a402470 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.701+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a402470 0x55957a404860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.701+0000 7f2c85ffb640 10 client.18696 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.701+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a402470 0x55957a404860 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14919b3874c019c server_cookie=4d4176da54bf8081 in_seq=0 out_seq=0 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2c85ffb640 1 -- 172.21.15.2:0/2045215897 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55957a361640 con 0x55957a402470 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2c85ffb640 10 client.18696 handle_command_reply: tid=0 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 client.18696 shutdown 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 msgr2=0x55957a3f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f7560 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e600 tx=0x7f2c88003fa0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 shutdown_connections 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a402470 0x55957a404860 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f2bd0 0x55957a3f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2c85ffb640 0 client.18696 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f0190 0x55957a3f7560 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/2045215897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 >> 172.21.15.2:0/2045215897 conn(0x55957a3e89b0 msgr2=0x55957a3e7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 shutdown_connections 2024-09-10T23:33:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 1 -- 172.21.15.2:0/2045215897 wait complete. 2024-09-10T23:33:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.702+0000 7f2ca7c15740 20 client.18696 trim_cache size 0 max 16384 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 Processor -- start 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 -- start start 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 0x55957a3f8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01a9ed0 con 0x55957a3ed860 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01aba10 con 0x55957a3f0190 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01aa5a0 con 0x55957a3f2bd0 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2c9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 0x55957a3f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2c9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 0x55957a3f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33888/0 (socket says 172.21.15.2:33888) 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2c9e59c640 1 -- 172.21.15.2:0/547684929 learned_addr learned my addr 172.21.15.2:0/547684929 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.734+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9e59c640 1 -- 172.21.15.2:0/547684929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 msgr2=0x55957a3eccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3eccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9e59c640 1 -- 172.21.15.2:0/547684929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 msgr2=0x55957a3e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9e59c640 1 -- 172.21.15.2:0/547684929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957a3f6c90 con 0x55957a3ed860 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 0x55957a3f8110 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2c90006010 tx=0x7f2c900b4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8adb09fe39a4c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c87fff640 1 -- 172.21.15.2:0/547684929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900cca80 con 0x55957a3ed860 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c87fff640 1 -- 172.21.15.2:0/547684929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c90036040 con 0x55957a3ed860 2024-09-10T23:33:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.735+0000 7f2c87fff640 1 -- 172.21.15.2:0/547684929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900c91e0 con 0x55957a3ed860 2024-09-10T23:33:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 -- 172.21.15.2:0/547684929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 msgr2=0x55957a3f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 0x55957a3f8110 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2c90006010 tx=0x7f2c900b4040 comp rx=0 tx=0).stop 2024-09-10T23:33:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 -- 172.21.15.2:0/547684929 shutdown_connections 2024-09-10T23:33:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3f2bd0 0x55957a3eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/547684929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3ed860 0x55957a3f8110 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 -- 172.21.15.2:0/547684929 >> 172.21.15.2:0/547684929 conn(0x55957a3e89b0 msgr2=0x55957a3e3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 -- 172.21.15.2:0/547684929 shutdown_connections 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 -- 172.21.15.2:0/547684929 wait complete. 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 -- start start 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.736+0000 7f2ca7c15740 1 Processor -- start 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3fe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3fd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 0x55957a3fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01ab340 con 0x55957a3f2bd0 2024-09-10T23:33:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01aac70 con 0x55957a3f0190 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01a7eb0 con 0x55957a3ed860 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 10 client.0 _ll_register_callbacks cb 0x7f2c90009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 0x55957a3fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3fe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 0x55957a3fdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33896/0 (socket says 172.21.15.2:33896) 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 -- 172.21.15.2:0/3184296431 learned_addr learned my addr 172.21.15.2:0/3184296431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9dd9b640 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 -- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 msgr2=0x55957a3fe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3fe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 -- 172.21.15.2:0/3184296431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 msgr2=0x55957a3fd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3fd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 -- 172.21.15.2:0/3184296431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957a3fe350 con 0x55957a3f2bd0 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c9ed9d640 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 0x55957a3fdb20 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f2c98012cb0 tx=0x7f2c9800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5522f64f8052960 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c85ffb640 1 -- 172.21.15.2:0/3184296431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98023060 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2c85ffb640 1 -- 172.21.15.2:0/3184296431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2c98004250 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.737+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c90036040 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2c85ffb640 1 -- 172.21.15.2:0/3184296431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c98004450 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 10 client.18702 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55957a46f3e0 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2c85ffb640 1 -- 172.21.15.2:0/3184296431 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c90036040 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2c85ffb640 1 -- 172.21.15.2:0/3184296431 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2c980105f0 con 0x55957a3f2bd0 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 10 client.18702 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 10 client.18702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 20 client.18702 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a46fdf0 0x55957a472210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 4 client.18702 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:33:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55957a35d0f0 con 0x55957a46fdf0 2024-09-10T23:33:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.738+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a46fdf0 0x55957a472210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.739+0000 7f2c9e59c640 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a46fdf0 0x55957a472210 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bed40ad5aafd5ba server_cookie=8293446b9a971b0e in_seq=0 out_seq=0 2024-09-10T23:33:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.739+0000 7f2c85ffb640 10 client.18702 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2c85ffb640 1 -- 172.21.15.2:0/3184296431 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55957a35d0f0 con 0x55957a46fdf0 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2c85ffb640 10 client.18702 handle_command_reply: tid=0 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 client.18702 shutdown 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 msgr2=0x55957a3fdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 0x55957a3fdb20 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f2c98012cb0 tx=0x7f2c9800f790 comp rx=0 tx=0).stop 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 shutdown_connections 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55957a46fdf0 0x55957a472210 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55957a3f2bd0 0x55957a3fdb20 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55957a3f0190 0x55957a3fd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2c85ffb640 0 client.18702 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 --2- 172.21.15.2:0/3184296431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55957a3ed860 0x55957a3fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 >> 172.21.15.2:0/3184296431 conn(0x55957a3e89b0 msgr2=0x55957a3f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 shutdown_connections 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 1 -- 172.21.15.2:0/3184296431 wait complete. 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.753+0000 7f2ca7c15740 20 client.18702 trim_cache size 0 max 16384 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:33:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:33:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:33:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:33:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2c8c0b52e0 msgr2=0x7f2c8c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2c8c0b52e0 0x7f2c8c0b77a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009bd0 tx=0x7f2c88005f90 comp rx=0 tx=0).stop 2024-09-10T23:33:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 msgr2=0x7f2ca0198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0198d50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097b0 tx=0x7f2c90004ab0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 shutdown_connections 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2c8c0b52e0 0x7f2c8c0b77a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ca0103380 0x7f2ca0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca01029c0 0x7f2ca01993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 --2- 172.21.15.2:0/1714975192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca0101870 0x7f2ca0198d50 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 >> 172.21.15.2:0/1714975192 conn(0x7f2ca00fd150 msgr2=0x7f2ca00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 shutdown_connections 2024-09-10T23:33:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:31.754+0000 7f2ca4e47640 1 -- 172.21.15.2:0/1714975192 wait complete. 2024-09-10T23:33:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:32 smithi177 ceph-mon[35760]: pgmap v627: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:32 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:33:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:32 smithi002 ceph-mon[31150]: pgmap v627: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:32.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:32.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:32 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:33:32.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:32 smithi154 ceph-mon[35136]: pgmap v627: 97 pgs: 97 active+clean; 2.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:32.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:32 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:33:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:34 smithi177 ceph-mon[35760]: pgmap v628: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:33:34.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:34 smithi002 ceph-mon[31150]: pgmap v628: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:33:34.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:34 smithi154 ceph-mon[35136]: pgmap v628: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:33:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:36 smithi177 ceph-mon[35760]: pgmap v629: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:36.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:36 smithi002 ceph-mon[31150]: pgmap v629: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:36.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:36 smithi154 ceph-mon[35136]: pgmap v629: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:33:37.232 INFO:tasks.workunit.client.0.smithi002.stdout:437/600: open fd = 3 2024-09-10T23:33:37.232 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.232 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.232 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:438/600: open fd = 3 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:439/600: open fd = 3 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:440/600: open fd = 3 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:441/600: open fd = 3 2024-09-10T23:33:37.233 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:442/600: open fd = 3 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:443/600: open fd = 3 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:444/600: open fd = 3 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:445/600: open fd = 3 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:446/600: open fd = 3 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:447/600: open fd = 3 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:448/600: open fd = 3 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:449/600: open fd = 3 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:450/600: open fd = 3 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:451/600: open fd = 3 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:452/600: open fd = 3 2024-09-10T23:33:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:453/600: open fd = 3 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:454/600: open fd = 3 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:455/600: open fd = 3 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.237 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:456/600: open fd = 3 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:457/600: open fd = 3 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:458/600: open fd = 3 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:459/600: open fd = 3 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.238 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:460/600: open fd = 3 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:461/600: open fd = 3 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:462/600: open fd = 3 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:463/600: open fd = 3 2024-09-10T23:33:37.239 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:464/600: open fd = 3 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:465/600: open fd = 3 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:466/600: open fd = 3 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.240 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:467/600: open fd = 3 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:468/600: open fd = 3 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:469/600: open fd = 3 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:470/600: open fd = 3 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.241 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:471/600: open fd = 3 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:472/600: open fd = 3 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:473/600: open fd = 3 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:474/600: open fd = 3 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.242 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:475/600: open fd = 3 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:476/600: open fd = 3 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:477/600: open fd = 3 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:478/600: open fd = 3 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:479/600: open fd = 3 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:480/600: open fd = 3 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:481/600: open fd = 3 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:482/600: open fd = 3 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:483/600: open fd = 3 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:484/600: open fd = 3 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.245 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:485/600: open fd = 3 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:486/600: open fd = 3 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:487/600: open fd = 3 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.246 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:488/600: open fd = 3 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:489/600: open fd = 3 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:490/600: open fd = 3 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.247 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:491/600: open fd = 3 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:492/600: open fd = 3 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:493/600: open fd = 3 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:494/600: open fd = 3 2024-09-10T23:33:37.248 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:495/600: open fd = 3 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:496/600: open fd = 3 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:497/600: open fd = 3 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:498/600: open fd = 3 2024-09-10T23:33:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:33:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:33:38.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:38 smithi177 ceph-mon[35760]: pgmap v630: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:33:38.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:38 smithi002 ceph-mon[31150]: pgmap v630: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:33:38.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:38 smithi154 ceph-mon[35136]: pgmap v630: 97 pgs: 97 active+clean; 3.0 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:33:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:40 smithi177 ceph-mon[35760]: pgmap v631: 97 pgs: 97 active+clean; 3.1 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:40.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:40 smithi002 ceph-mon[31150]: pgmap v631: 97 pgs: 97 active+clean; 3.1 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:40.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:40 smithi154 ceph-mon[35136]: pgmap v631: 97 pgs: 97 active+clean; 3.1 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:33:42.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:42 smithi177 ceph-mon[35760]: pgmap v632: 97 pgs: 97 active+clean; 3.1 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:33:42.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:42 smithi002 ceph-mon[31150]: pgmap v632: 97 pgs: 97 active+clean; 3.1 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:33:42.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:42 smithi154 ceph-mon[35136]: pgmap v632: 97 pgs: 97 active+clean; 3.1 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:33:44.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:44 smithi177 ceph-mon[35760]: pgmap v633: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:44.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:44 smithi002 ceph-mon[31150]: pgmap v633: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:44.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:44 smithi154 ceph-mon[35136]: pgmap v633: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:33:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.855+0000 7f1ebc52c640 1 -- 172.21.15.2:0/158684008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb41029c0 msgr2=0x7f1eb4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.855+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/158684008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb41029c0 0x7f1eb4102e40 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009930 tx=0x7f1ea402a420 comp rx=0 tx=0).stop 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 -- 172.21.15.2:0/158684008 shutdown_connections 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/158684008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb4103380 0x7f1eb4109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/158684008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb41029c0 0x7f1eb4102e40 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/158684008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1eb4101870 0x7f1eb4101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 -- 172.21.15.2:0/158684008 >> 172.21.15.2:0/158684008 conn(0x7f1eb40fd150 msgr2=0x7f1eb40ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 -- 172.21.15.2:0/158684008 shutdown_connections 2024-09-10T23:33:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 -- 172.21.15.2:0/158684008 wait complete. 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 Processor -- start 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.856+0000 7f1ebc52c640 1 -- start start 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 0x7f1eb419af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb41029c0 0x7f1eb419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1eb4103380 0x7f1eb419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb410d4e0 con 0x7f1eb4101870 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb410d360 con 0x7f1eb4103380 2024-09-10T23:33:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb410d660 con 0x7f1eb41029c0 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 0x7f1eb419af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 0x7f1eb419af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40884/0 (socket says 172.21.15.2:40884) 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 -- 172.21.15.2:0/3704888748 learned_addr learned my addr 172.21.15.2:0/3704888748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1eb4103380 0x7f1eb419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb41029c0 0x7f1eb419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 -- 172.21.15.2:0/3704888748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb41029c0 msgr2=0x7f1eb419b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb41029c0 0x7f1eb419b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 -- 172.21.15.2:0/3704888748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1eb4103380 msgr2=0x7f1eb419c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1eb4103380 0x7f1eb419c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 -- 172.21.15.2:0/3704888748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb419cad0 con 0x7f1eb4101870 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb41029c0 0x7f1eb419b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eba2c8640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 0x7f1eb419af90 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000c890 tx=0x7f1eb000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eab7fe640 1 -- 172.21.15.2:0/3704888748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0004220 con 0x7f1eb4101870 2024-09-10T23:33:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1eab7fe640 1 -- 172.21.15.2:0/3704888748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb00043c0 con 0x7f1eb4101870 2024-09-10T23:33:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.857+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb419cdc0 con 0x7f1eb4101870 2024-09-10T23:33:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.858+0000 7f1eab7fe640 1 -- 172.21.15.2:0/3704888748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0004a00 con 0x7f1eb4101870 2024-09-10T23:33:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.858+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb41a3490 con 0x7f1eb4101870 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.860+0000 7f1ebf3ce740 1 Processor -- start 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 -- start start 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd200ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20102580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd20105090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1eab7fe640 1 -- 172.21.15.2:0/3704888748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1eb00079b0 con 0x7f1eb4101870 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd2006f6f0 con 0x55fd200fd860 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd2005eb20 con 0x55fd20102bd0 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd20062930 con 0x55fd20100190 2024-09-10T23:33:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd200ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd200ffc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40892/0 (socket says 172.21.15.2:40892) 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 -- 172.21.15.2:0/429252663 learned_addr learned my addr 172.21.15.2:0/429252663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1eba2c8640 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20102580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd20105090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 -- 172.21.15.2:0/429252663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 msgr2=0x55fd20102580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20102580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 -- 172.21.15.2:0/429252663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 msgr2=0x55fd20105090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd20105090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.861+0000 7f1ebaac9640 1 -- 172.21.15.2:0/429252663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd20024530 con 0x55fd200fd860 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd200ffc50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009f90 tx=0x7f1eac0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fd39d0b7c91623 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1ea8bfe640 1 -- 172.21.15.2:0/429252663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac004d20 con 0x55fd200fd860 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1ea8bfe640 1 -- 172.21.15.2:0/429252663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eac004050 con 0x55fd200fd860 2024-09-10T23:33:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1ea8bfe640 1 -- 172.21.15.2:0/429252663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac005280 con 0x55fd200fd860 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1eab7fe640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ea00b52e0 0x7f1ea00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1eba2c8640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ea00b52e0 0x7f1ea00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.862+0000 7f1eab7fe640 1 -- 172.21.15.2:0/3704888748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1eb00e5960 con 0x7f1eb4101870 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/429252663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 msgr2=0x55fd200ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd200ffc50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009f90 tx=0x7f1eac0118d0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/429252663 shutdown_connections 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd20105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/429252663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd200ffc50 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/429252663 >> 172.21.15.2:0/429252663 conn(0x55fd200f89b0 msgr2=0x55fd200f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1eba2c8640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ea00b52e0 0x7f1ea00b77a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00058c0 tx=0x7f1eb0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/429252663 shutdown_connections 2024-09-10T23:33:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/429252663 wait complete. 2024-09-10T23:33:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 -- start start 2024-09-10T23:33:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.863+0000 7f1ebf3ce740 1 Processor -- start 2024-09-10T23:33:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd20106e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd20107500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd1ff96ab0 con 0x55fd20100190 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd20004730 con 0x55fd20102bd0 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd20105bb0 con 0x55fd200fd860 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebf3ce740 10 client.0 _ll_register_callbacks cb 0x55fd200586b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd20107500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd20107500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40906/0 (socket says 172.21.15.2:40906) 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/371810599 learned_addr learned my addr 172.21.15.2:0/371810599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd20106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 msgr2=0x55fd20106e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd20106e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/371810599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 msgr2=0x55fd201080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/371810599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd1fdc0790 con 0x55fd20100190 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd20107500 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009340 tx=0x7f1ea4031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf1a5a1319f58ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1e9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.864+0000 7f1e9dffb640 1 -- 172.21.15.2:0/371810599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4035070 con 0x55fd20100190 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1e9dffb640 1 -- 172.21.15.2:0/371810599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1ea4004240 con 0x55fd20100190 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eac004050 con 0x55fd20100190 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1e9dffb640 1 -- 172.21.15.2:0/371810599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ea4004440 con 0x55fd20100190 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 10 client.18714 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd1fe39620 con 0x55fd20100190 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1e9dffb640 1 -- 172.21.15.2:0/371810599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eac004050 con 0x55fd20100190 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1e9dffb640 1 -- 172.21.15.2:0/371810599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ea4004ce0 con 0x55fd20100190 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 10 client.18714 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 10 client.18714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 20 client.18714 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd20112760 0x55fd20114b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 4 client.18714 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.865+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd20071640 con 0x55fd20112760 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.866+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd20112760 0x55fd20114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.866+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd20112760 0x55fd20114b50 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efb70ab5f581e92 server_cookie=ed268497430129a in_seq=0 out_seq=0 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.866+0000 7f1e9dffb640 10 client.18714 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1e9dffb640 1 -- 172.21.15.2:0/371810599 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd20071640 con 0x55fd20112760 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1e9dffb640 10 client.18714 handle_command_reply: tid=0 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 client.18714 shutdown 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 msgr2=0x55fd20107500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd20107500 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009340 tx=0x7f1ea4031830 comp rx=0 tx=0).stop 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 shutdown_connections 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd20112760 0x55fd20114b50 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1e9dffb640 0 client.18714 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd20107500 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/371810599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd20106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 >> 172.21.15.2:0/371810599 conn(0x55fd200f89b0 msgr2=0x55fd200f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 shutdown_connections 2024-09-10T23:33:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/371810599 wait complete. 2024-09-10T23:33:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.867+0000 7f1ebf3ce740 20 client.18714 trim_cache size 0 max 16384 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 Processor -- start 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 -- start start 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd20107570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41ac0d0 con 0x55fd200fd860 2024-09-10T23:33:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41adc10 con 0x55fd20102bd0 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41ac7a0 con 0x55fd20100190 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebaac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd20107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebaac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd20107570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40912/0 (socket says 172.21.15.2:40912) 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1ebaac9640 1 -- 172.21.15.2:0/3500514561 learned_addr learned my addr 172.21.15.2:0/3500514561 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.882+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebaac9640 1 -- 172.21.15.2:0/3500514561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 msgr2=0x55fd20105fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20105fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebaac9640 1 -- 172.21.15.2:0/3500514561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 msgr2=0x55fd201064f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebaac9640 1 -- 172.21.15.2:0/3500514561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd20114ec0 con 0x55fd200fd860 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd20107570 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0042a0 tx=0x7f1eac009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4601696af5c199 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1e9ffff640 1 -- 172.21.15.2:0/3500514561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac009b30 con 0x55fd200fd860 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1e9ffff640 1 -- 172.21.15.2:0/3500514561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eac003cb0 con 0x55fd200fd860 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1e9ffff640 1 -- 172.21.15.2:0/3500514561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0053b0 con 0x55fd200fd860 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.883+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/3500514561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 msgr2=0x55fd20107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd20107570 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0042a0 tx=0x7f1eac009ce0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/3500514561 shutdown_connections 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd201064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd20100190 0x55fd20105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/3500514561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd200fd860 0x55fd20107570 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/3500514561 >> 172.21.15.2:0/3500514561 conn(0x55fd200f89b0 msgr2=0x55fd20106e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/3500514561 shutdown_connections 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/3500514561 wait complete. 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- start start 2024-09-10T23:33:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 Processor -- start 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd2010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd2010ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd2010d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41ad540 con 0x55fd20100190 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41ace70 con 0x55fd20102bd0 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41aa0b0 con 0x55fd200fd860 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebf3ce740 10 client.0 _ll_register_callbacks cb 0x7f1eac0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1eb9ac7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd2010ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1eb9ac7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd2010ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40928/0 (socket says 172.21.15.2:40928) 2024-09-10T23:33:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/2960801122 learned_addr learned my addr 172.21.15.2:0/2960801122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.884+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd2010d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd2010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 msgr2=0x55fd2010e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd2010e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/2960801122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 msgr2=0x55fd2010d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd2010d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1eb9ac7640 1 -- 172.21.15.2:0/2960801122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd20108440 con 0x55fd20100190 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1eb9ac7640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd2010ec50 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40037e0 tx=0x7f1ea4032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b5ecf32cd78c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1e9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1e9dffb640 1 -- 172.21.15.2:0/2960801122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4035040 con 0x55fd20100190 2024-09-10T23:33:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1e9dffb640 1 -- 172.21.15.2:0/2960801122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1ea4004110 con 0x55fd20100190 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd2006d0f0 con 0x55fd20100190 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1e9dffb640 1 -- 172.21.15.2:0/2960801122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ea4044470 con 0x55fd20100190 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1ebf3ce740 10 client.18720 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd2010c990 con 0x55fd20100190 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.885+0000 7f1e9dffb640 1 -- 172.21.15.2:0/2960801122 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fd2006d0f0 con 0x55fd20100190 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1e9dffb640 1 -- 172.21.15.2:0/2960801122 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ea403b5c0 con 0x55fd20100190 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebf3ce740 10 client.18720 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebf3ce740 10 client.18720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebf3ce740 20 client.18720 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd2017fae0 0x55fd20181f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebf3ce740 4 client.18720 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:33:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd2006a520 con 0x55fd2017fae0 2024-09-10T23:33:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd2017fae0 0x55fd20181f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1ebaac9640 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd2017fae0 0x55fd20181f00 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a22174adfc875ea server_cookie=c68531c00af8fd9f in_seq=0 out_seq=0 2024-09-10T23:33:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.886+0000 7f1e9dffb640 10 client.18720 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1e9dffb640 1 -- 172.21.15.2:0/2960801122 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd2006a520 con 0x55fd2017fae0 2024-09-10T23:33:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1e9dffb640 10 client.18720 handle_command_reply: tid=0 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 client.18720 shutdown 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 msgr2=0x55fd2010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd2010ec50 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40037e0 tx=0x7f1ea4032ec0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 shutdown_connections 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fd2017fae0 0x55fd20181f00 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd20102bd0 0x55fd2010d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd20100190 0x55fd2010ec50 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1e9dffb640 0 client.18720 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 --2- 172.21.15.2:0/2960801122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd200fd860 0x55fd2010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 >> 172.21.15.2:0/2960801122 conn(0x55fd200f89b0 msgr2=0x55fd20105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 shutdown_connections 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.902+0000 7f1ebf3ce740 1 -- 172.21.15.2:0/2960801122 wait complete. 2024-09-10T23:33:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebf3ce740 20 client.18720 trim_cache size 0 max 16384 2024-09-10T23:33:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:33:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:33:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:33:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ea00b52e0 msgr2=0x7f1ea00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ea00b52e0 0x7f1ea00b77a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00058c0 tx=0x7f1eb0000bc0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 msgr2=0x7f1eb419af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 0x7f1eb419af90 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000c890 tx=0x7f1eb000cd50 comp rx=0 tx=0).stop 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 shutdown_connections 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ea00b52e0 0x7f1ea00b77a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1eb4103380 0x7f1eb419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1eb41029c0 0x7f1eb419b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 --2- 172.21.15.2:0/3704888748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eb4101870 0x7f1eb419af90 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 >> 172.21.15.2:0/3704888748 conn(0x7f1eb40fd150 msgr2=0x7f1eb40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 shutdown_connections 2024-09-10T23:33:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:44.903+0000 7f1ebc52c640 1 -- 172.21.15.2:0/3704888748 wait complete. 2024-09-10T23:33:46.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:46 smithi177 ceph-mon[35760]: pgmap v634: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:33:46.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:46 smithi002 ceph-mon[31150]: pgmap v634: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:33:46.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:46 smithi154 ceph-mon[35136]: pgmap v634: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:33:47.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:47 smithi177 ceph-mon[35760]: pgmap v635: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:33:47.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:47 smithi002 ceph-mon[31150]: pgmap v635: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:33:47.528 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:47 smithi154 ceph-mon[35136]: pgmap v635: 97 pgs: 97 active+clean; 3.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:33:49.714 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:49 smithi177 ceph-mon[35760]: pgmap v636: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:33:49.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:49 smithi002 ceph-mon[31150]: pgmap v636: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:33:49.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:49 smithi154 ceph-mon[35136]: pgmap v636: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:33:51.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:51 smithi177 ceph-mon[35760]: pgmap v637: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:33:51.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:51 smithi002 ceph-mon[31150]: pgmap v637: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:33:51.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:51 smithi154 ceph-mon[35136]: pgmap v637: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T23:33:53.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:53 smithi002 ceph-mon[31150]: pgmap v638: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:33:53.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:53 smithi154 ceph-mon[35136]: pgmap v638: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:33:53.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:33:53.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:53 smithi177 ceph-mon[35760]: pgmap v638: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:33:54.155 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 -- 172.21.15.2:0/400577785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 msgr2=0x7ff18410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 --2- 172.21.15.2:0/400577785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18410f950 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009900 tx=0x7ff17c02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 -- 172.21.15.2:0/400577785 shutdown_connections 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 --2- 172.21.15.2:0/400577785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18410f950 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 --2- 172.21.15.2:0/400577785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 0x7ff184108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 --2- 172.21.15.2:0/400577785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff184102dc0 0x7ff1841031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 -- 172.21.15.2:0/400577785 >> 172.21.15.2:0/400577785 conn(0x7ff1840fe830 msgr2=0x7ff184100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 -- 172.21.15.2:0/400577785 shutdown_connections 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.645+0000 7ff18ab42640 1 -- 172.21.15.2:0/400577785 wait complete. 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 Processor -- start 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 -- start start 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff184102dc0 0x7ff184199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 0x7ff184199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff184112e10 con 0x7ff184109150 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff184112c90 con 0x7ff1841087d0 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff18ab42640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff184112f90 con 0x7ff184102dc0 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.646+0000 7ff1890df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35720/0 (socket says 172.21.15.2:35720) 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 -- 172.21.15.2:0/4267993194 learned_addr learned my addr 172.21.15.2:0/4267993194 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1888de640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff184102dc0 0x7ff184199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff183fff640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 0x7ff184199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 -- 172.21.15.2:0/4267993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff184102dc0 msgr2=0x7ff184199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff184102dc0 0x7ff184199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 -- 172.21.15.2:0/4267993194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 msgr2=0x7ff184199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 0x7ff184199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 -- 172.21.15.2:0/4267993194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18419f3b0 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff183fff640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 0x7ff184199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff1890df640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18419ebe0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7ff17c004770 tx=0x7ff17c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff181ffb640 1 -- 172.21.15.2:0/4267993194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c03f030 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18419f640 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff181ffb640 1 -- 172.21.15.2:0/4267993194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff17c003aa0 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.647+0000 7ff181ffb640 1 -- 172.21.15.2:0/4267993194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c035070 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.648+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1841a5d60 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 Processor -- start 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff181ffb640 1 -- 172.21.15.2:0/4267993194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff17c0035f0 con 0x7ff184109150 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 -- start start 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85493480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fe85409e50 con 0x55fe8549f950 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe853f9280 con 0x55fe854939c0 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff18cf17740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fe853fd090 con 0x55fe854930a0 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.650+0000 7ff183fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35724/0 (socket says 172.21.15.2:35724) 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 -- 172.21.15.2:0/1284326730 learned_addr learned my addr 172.21.15.2:0/1284326730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff1888de640 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85493480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 -- 172.21.15.2:0/1284326730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 msgr2=0x55fe85493480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85493480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 -- 172.21.15.2:0/1284326730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 msgr2=0x55fe8549f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 -- 172.21.15.2:0/1284326730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe85157650 con 0x55fe8549f950 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff181ffb640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff1700b52e0 0x7ff1700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff183fff640 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1d40 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7ff17400af30 tx=0x7ff17400a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784463a342c33b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff1888de640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff1700b52e0 0x7ff1700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff181ffb640 1 -- 172.21.15.2:0/4267993194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff17c106610 con 0x7ff184109150 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff17affd640 1 -- 172.21.15.2:0/1284326730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17400fae0 con 0x55fe8549f950 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff17affd640 1 -- 172.21.15.2:0/1284326730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff174014e50 con 0x55fe8549f950 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.651+0000 7ff17affd640 1 -- 172.21.15.2:0/1284326730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174012d50 con 0x55fe8549f950 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 -- 172.21.15.2:0/1284326730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 msgr2=0x55fe854a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1d40 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7ff17400af30 tx=0x7ff17400a820 comp rx=0 tx=0).stop 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff1888de640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff1700b52e0 0x7ff1700b77a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55fe85491db0 tx=0x7ff16c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 -- 172.21.15.2:0/1284326730 shutdown_connections 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1d40 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 --2- 172.21.15.2:0/1284326730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85493480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 -- 172.21.15.2:0/1284326730 >> 172.21.15.2:0/1284326730 conn(0x55fe85490ed0 msgr2=0x55fe85492070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 -- 172.21.15.2:0/1284326730 shutdown_connections 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.652+0000 7ff18cf17740 1 -- 172.21.15.2:0/1284326730 wait complete. 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 -- start start 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 Processor -- start 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 0x55fe8549f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe8549f950 0x55fe8549cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fe8525a700 con 0x55fe854930a0 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe85394110 con 0x55fe854939c0 2024-09-10T23:33:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fe854a25d0 con 0x55fe8549f950 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff18cf17740 10 client.0 _ll_register_callbacks cb 0x55fe853ad990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff1888de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 0x55fe8549f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff1888de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 0x55fe8549f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35736/0 (socket says 172.21.15.2:35736) 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff1888de640 1 -- 172.21.15.2:0/625483850 learned_addr learned my addr 172.21.15.2:0/625483850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff183fff640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.653+0000 7ff1890df640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe8549f950 0x55fe8549cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1888de640 1 -- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe8549f950 msgr2=0x55fe8549cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1888de640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe8549f950 0x55fe8549cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1888de640 1 -- 172.21.15.2:0/625483850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 msgr2=0x55fe8549c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1888de640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1888de640 1 -- 172.21.15.2:0/625483850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe853c1c40 con 0x55fe854930a0 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1890df640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe8549f950 0x55fe8549cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff1888de640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 0x55fe8549f2c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7ff16c003e60 tx=0x7ff16c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a29c2f96ee1e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff163fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff163fff640 1 -- 172.21.15.2:0/625483850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c02c060 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff163fff640 1 -- 172.21.15.2:0/625483850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff16c017030 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff174014e50 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff163fff640 1 -- 172.21.15.2:0/625483850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff16c027410 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff18cf17740 10 client.18732 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe854ae010 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.654+0000 7ff163fff640 1 -- 172.21.15.2:0/625483850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff174014e50 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff163fff640 1 -- 172.21.15.2:0/625483850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff16c0116e0 con 0x55fe854930a0 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff18cf17740 10 client.18732 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff18cf17740 10 client.18732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff18cf17740 20 client.18732 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff18cf17740 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe854af520 0x55fe854b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff18cf17740 4 client.18732 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe8540bda0 con 0x55fe854af520 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff183fff640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe854af520 0x55fe854b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff183fff640 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe854af520 0x55fe854b1960 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e0959e557b6053 server_cookie=4e2b4fd0425dd8e7 in_seq=0 out_seq=0 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.655+0000 7ff163fff640 10 client.18732 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff163fff640 1 -- 172.21.15.2:0/625483850 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe8540bda0 con 0x55fe854af520 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff163fff640 10 client.18732 handle_command_reply: tid=0 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 client.18732 shutdown 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 msgr2=0x55fe8549f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 0x55fe8549f2c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7ff16c003e60 tx=0x7ff16c004730 comp rx=0 tx=0).stop 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 shutdown_connections 2024-09-10T23:33:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe854af520 0x55fe854b1960 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe8549f950 0x55fe8549cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe8549c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff163fff640 0 client.18732 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 --2- 172.21.15.2:0/625483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe854930a0 0x55fe8549f2c0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 >> 172.21.15.2:0/625483850 conn(0x55fe85490ed0 msgr2=0x55fe85496a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 shutdown_connections 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 1 -- 172.21.15.2:0/625483850 wait complete. 2024-09-10T23:33:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.656+0000 7ff18cf17740 20 client.18732 trim_cache size 0 max 16384 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 Processor -- start 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 -- start start 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85490710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe854a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841ae3d0 con 0x55fe8549f950 2024-09-10T23:33:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841aff10 con 0x55fe854939c0 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff18cf17740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841aeaa0 con 0x55fe854930a0 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35744/0 (socket says 172.21.15.2:35744) 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 -- 172.21.15.2:0/3212268725 learned_addr learned my addr 172.21.15.2:0/3212268725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1888de640 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85490710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff183fff640 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe854a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 -- 172.21.15.2:0/3212268725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 msgr2=0x55fe85490710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85490710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 -- 172.21.15.2:0/3212268725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 msgr2=0x55fe854a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe854a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff1890df640 1 -- 172.21.15.2:0/3212268725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe854937f0 con 0x55fe8549f950 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.675+0000 7ff183fff640 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe854a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff1890df640 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1280 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7ff17c032fd0 tx=0x7ff17c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a024121e3fb54820 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff17a7fc640 1 -- 172.21.15.2:0/3212268725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c049040 con 0x55fe8549f950 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff17a7fc640 1 -- 172.21.15.2:0/3212268725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff17c0cc8f0 con 0x55fe8549f950 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff17a7fc640 1 -- 172.21.15.2:0/3212268725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0c9050 con 0x55fe8549f950 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff18cf17740 1 -- 172.21.15.2:0/3212268725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 msgr2=0x55fe854a1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff18cf17740 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1280 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7ff17c032fd0 tx=0x7ff17c003f50 comp rx=0 tx=0).stop 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff18cf17740 1 -- 172.21.15.2:0/3212268725 shutdown_connections 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.676+0000 7ff18cf17740 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a1280 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854939c0 0x55fe854a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 --2- 172.21.15.2:0/3212268725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854930a0 0x55fe85490710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- 172.21.15.2:0/3212268725 >> 172.21.15.2:0/3212268725 conn(0x55fe85490ed0 msgr2=0x55fe8549e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- 172.21.15.2:0/3212268725 shutdown_connections 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- 172.21.15.2:0/3212268725 wait complete. 2024-09-10T23:33:54.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- start start 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 Processor -- start 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854930a0 0x55fe854a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854939c0 0x55fe854a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841af840 con 0x55fe8549f950 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841af170 con 0x55fe854930a0 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841ac3b0 con 0x55fe854939c0 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.677+0000 7ff18cf17740 10 client.0 _ll_register_callbacks cb 0x7ff16c00bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff1890df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff1890df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35748/0 (socket says 172.21.15.2:35748) 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854939c0 0x55fe854a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff1890df640 1 -- 172.21.15.2:0/812235542 learned_addr learned my addr 172.21.15.2:0/812235542 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff1888de640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854930a0 0x55fe854a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 -- 172.21.15.2:0/812235542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854930a0 msgr2=0x55fe854a78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854930a0 0x55fe854a78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 -- 172.21.15.2:0/812235542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 msgr2=0x55fe854a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 -- 172.21.15.2:0/812235542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe854a2e40 con 0x55fe854939c0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff1890df640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff183fff640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854939c0 0x55fe854a7e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff174012970 tx=0x7ff1740049e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=552f2473bf494382 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff163fff640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff163fff640 1 -- 172.21.15.2:0/812235542 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174015e60 con 0x55fe854939c0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff17c0cc8f0 con 0x55fe854939c0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.678+0000 7ff163fff640 1 -- 172.21.15.2:0/812235542 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff174014300 con 0x55fe854939c0 2024-09-10T23:33:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff163fff640 1 -- 172.21.15.2:0/812235542 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff174012450 con 0x55fe854939c0 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 10 client.27757 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe8551cd00 con 0x55fe854939c0 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff163fff640 1 -- 172.21.15.2:0/812235542 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff17c0cc8f0 con 0x55fe854939c0 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff163fff640 1 -- 172.21.15.2:0/812235542 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff174038030 con 0x55fe854939c0 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 10 client.27757 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 10 client.27757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 20 client.27757 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe8551d140 0x55fe8551f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 4 client.27757 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fe85407850 con 0x55fe8551d140 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.679+0000 7ff1888de640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe8551d140 0x55fe8551f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:54.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff1888de640 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe8551d140 0x55fe8551f530 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac3c5660a9cfdd6 server_cookie=268668596a40a130 in_seq=0 out_seq=0 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff163fff640 10 client.27757 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff163fff640 1 -- 172.21.15.2:0/812235542 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x55fe85407850 con 0x55fe8551d140 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff163fff640 10 client.27757 handle_command_reply: tid=0 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 client.27757 shutdown 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854939c0 msgr2=0x55fe854a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854939c0 0x55fe854a7e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff174012970 tx=0x7ff1740049e0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 shutdown_connections 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55fe8551d140 0x55fe8551f530 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fe8549f950 0x55fe854a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fe854939c0 0x55fe854a7e20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff163fff640 0 client.27757 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 --2- 172.21.15.2:0/812235542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe854930a0 0x55fe854a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 >> 172.21.15.2:0/812235542 conn(0x55fe85490ed0 msgr2=0x55fe85496130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.680+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 shutdown_connections 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18cf17740 1 -- 172.21.15.2:0/812235542 wait complete. 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18cf17740 20 client.27757 trim_cache size 0 max 16384 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:33:54.693 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.694 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.696 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:33:54.697 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.698 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.699 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.700 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:33:54.701 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:33:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff1700b52e0 msgr2=0x7ff1700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff1700b52e0 0x7ff1700b77a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55fe85491db0 tx=0x7ff16c00b390 comp rx=0 tx=0).stop 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 msgr2=0x7ff18419ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:54.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18419ebe0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7ff17c004770 tx=0x7ff17c004270 comp rx=0 tx=0).stop 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 shutdown_connections 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff1700b52e0 0x7ff1700b77a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff184109150 0x7ff18419ebe0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1841087d0 0x7ff184199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 --2- 172.21.15.2:0/4267993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff184102dc0 0x7ff184199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 >> 172.21.15.2:0/4267993194 conn(0x7ff1840fe830 msgr2=0x7ff184100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 shutdown_connections 2024-09-10T23:33:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:54.681+0000 7ff18ab42640 1 -- 172.21.15.2:0/4267993194 wait complete. 2024-09-10T23:33:55.685 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:33:55.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:33:55.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:55 smithi002 ceph-mon[31150]: pgmap v639: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:55.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:55 smithi154 ceph-mon[35136]: pgmap v639: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:55 smithi177 ceph-mon[35760]: pgmap v639: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 -- 172.21.15.2:0/1511267371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64108060 msgr2=0x7f9a6410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/1511267371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64108060 0x7f9a6410e860 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009900 tx=0x7f9a5c02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 -- 172.21.15.2:0/1511267371 shutdown_connections 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/1511267371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64108060 0x7f9a6410e860 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/1511267371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a641076e0 0x7f9a64107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/1511267371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64101cd0 0x7f9a641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 -- 172.21.15.2:0/1511267371 >> 172.21.15.2:0/1511267371 conn(0x7f9a640fd700 msgr2=0x7f9a640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 -- 172.21.15.2:0/1511267371 shutdown_connections 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.430+0000 7f9a6bb81640 1 -- 172.21.15.2:0/1511267371 wait complete. 2024-09-10T23:33:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 Processor -- start 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 -- start start 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 0x7f9a640fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a641076e0 0x7f9a640fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64108060 0x7f9a640fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111d70 con 0x7f9a64101cd0 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111bf0 con 0x7f9a64108060 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6bb81640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111ef0 con 0x7f9a641076e0 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 0x7f9a640fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 0x7f9a640fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35776/0 (socket says 172.21.15.2:35776) 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 -- 172.21.15.2:0/3217056266 learned_addr learned my addr 172.21.15.2:0/3217056266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6911c640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a641076e0 0x7f9a640fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6a11e640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64108060 0x7f9a640fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 -- 172.21.15.2:0/3217056266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a641076e0 msgr2=0x7f9a640fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a641076e0 0x7f9a640fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 -- 172.21.15.2:0/3217056266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64108060 msgr2=0x7f9a640fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64108060 0x7f9a640fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.431+0000 7f9a6991d640 1 -- 172.21.15.2:0/3217056266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a641a7690 con 0x7f9a64101cd0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.432+0000 7f9a6991d640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 0x7f9a640fdc00 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000cce0 tx=0x7f9a6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.432+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000f650 con 0x7f9a64101cd0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.432+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a641a7980 con 0x7f9a64101cd0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.432+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a6000fca0 con 0x7f9a64101cd0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.432+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60018b40 con 0x7f9a64101cd0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.432+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a641a7f90 con 0x7f9a64101cd0 2024-09-10T23:33:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.433+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a641020b0 con 0x7f9a64101cd0 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.434+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9a6000f7f0 con 0x7f9a64101cd0 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.435+0000 7f9a56ffd640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a500b52e0 0x7f9a500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.435+0000 7f9a6911c640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a500b52e0 0x7f9a500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.435+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f9a600e6390 con 0x7f9a64101cd0 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.436+0000 7f9a6911c640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a500b52e0 0x7f9a500b77a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9a640ff6f0 tx=0x7f9a58008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.438+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a60014030 con 0x7f9a64101cd0 2024-09-10T23:33:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.663+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a640fef00 con 0x7f9a64101cd0 2024-09-10T23:33:56.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.663+0000 7f9a56ffd640 1 -- 172.21.15.2:0/3217056266 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f9a600ad2f0 con 0x7f9a64101cd0 2024-09-10T23:33:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:33:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:33:56.665 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a500b52e0 msgr2=0x7f9a500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a500b52e0 0x7f9a500b77a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9a640ff6f0 tx=0x7f9a58008040 comp rx=0 tx=0).stop 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 msgr2=0x7f9a640fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 0x7f9a640fdc00 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000cce0 tx=0x7f9a6000a620 comp rx=0 tx=0).stop 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 shutdown_connections 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f9a500b52e0 0x7f9a500b77a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64108060 0x7f9a640fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a641076e0 0x7f9a640fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 --2- 172.21.15.2:0/3217056266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a64101cd0 0x7f9a640fdc00 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 >> 172.21.15.2:0/3217056266 conn(0x7f9a640fd700 msgr2=0x7f9a6406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:56.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 shutdown_connections 2024-09-10T23:33:56.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:56.666+0000 7f9a6bb81640 1 -- 172.21.15.2:0/3217056266 wait complete. 2024-09-10T23:33:57.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:33:57.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:57 smithi002 ceph-mon[31150]: pgmap v640: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:33:57.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:57 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3217056266' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:33:57.747 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:57.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:57 smithi154 ceph-mon[35136]: pgmap v640: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:33:57.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:57 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3217056266' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:33:57.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:57 smithi177 ceph-mon[35760]: pgmap v640: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:33:57.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:57 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3217056266' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:33:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 -- 172.21.15.2:0/491446508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b006b470 msgr2=0x7f59b0105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 --2- 172.21.15.2:0/491446508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b006b470 0x7f59b0105530 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009900 tx=0x7f59ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 -- 172.21.15.2:0/491446508 shutdown_connections 2024-09-10T23:33:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 --2- 172.21.15.2:0/491446508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 0x7f59b010ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 --2- 172.21.15.2:0/491446508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59b0105ac0 0x7f59b0107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 --2- 172.21.15.2:0/491446508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b006b470 0x7f59b0105530 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 -- 172.21.15.2:0/491446508 >> 172.21.15.2:0/491446508 conn(0x7f59b00fd140 msgr2=0x7f59b00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 -- 172.21.15.2:0/491446508 shutdown_connections 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.995+0000 7f59b7317640 1 -- 172.21.15.2:0/491446508 wait complete. 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 Processor -- start 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 -- start start 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59b006b470 0x7f59b0198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 0x7f59b0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 0x7f59b0199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010e5a0 con 0x7f59b0105ac0 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010e420 con 0x7f59b006b470 2024-09-10T23:33:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b7317640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010e720 con 0x7f59b0108670 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b48b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 0x7f59b0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b48b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 0x7f59b0199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35806/0 (socket says 172.21.15.2:35806) 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b48b2640 1 -- 172.21.15.2:0/1024442983 learned_addr learned my addr 172.21.15.2:0/1024442983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b58b4640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 0x7f59b0199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b48b2640 1 -- 172.21.15.2:0/1024442983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 msgr2=0x7f59b0199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b50b3640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59b006b470 0x7f59b0198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b48b2640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 0x7f59b0199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.996+0000 7f59b48b2640 1 -- 172.21.15.2:0/1024442983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59b006b470 msgr2=0x7f59b0198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59b48b2640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59b006b470 0x7f59b0198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59b48b2640 1 -- 172.21.15.2:0/1024442983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b019a840 con 0x7f59b0105ac0 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59b58b4640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 0x7f59b0199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59b48b2640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 0x7f59b0199350 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f59a000d950 tx=0x7f59a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59a67fc640 1 -- 172.21.15.2:0/1024442983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0017030 con 0x7f59b0105ac0 2024-09-10T23:33:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59a67fc640 1 -- 172.21.15.2:0/1024442983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59a0004020 con 0x7f59b0105ac0 2024-09-10T23:33:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b019ab30 con 0x7f59b0105ac0 2024-09-10T23:33:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59a67fc640 1 -- 172.21.15.2:0/1024442983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00047a0 con 0x7f59b0105ac0 2024-09-10T23:33:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:57.997+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b01a1200 con 0x7f59b0105ac0 2024-09-10T23:33:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 Processor -- start 2024-09-10T23:33:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 -- start start 2024-09-10T23:33:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377cfd860 0x557377cffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 0x557377d02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d02bd0 0x557377d05090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557377c6f6f0 con 0x557377d00190 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557377c5eb20 con 0x557377cfd860 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557377c62930 con 0x557377d02bd0 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59a67fc640 1 -- 172.21.15.2:0/1024442983 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f59a0009a30 con 0x7f59b0105ac0 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 0x557377d02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 0x557377d02580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35810/0 (socket says 172.21.15.2:35810) 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 -- 172.21.15.2:0/2284750594 learned_addr learned my addr 172.21.15.2:0/2284750594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b58b4640 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377cfd860 0x557377cffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b48b2640 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d02bd0 0x557377d05090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 -- 172.21.15.2:0/2284750594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d02bd0 msgr2=0x557377d05090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d02bd0 0x557377d05090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 -- 172.21.15.2:0/2284750594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377cfd860 msgr2=0x557377cffc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377cfd860 0x557377cffc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.000+0000 7f59b50b3640 1 -- 172.21.15.2:0/2284750594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557377c24530 con 0x557377d00190 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f59b50b3640 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 0x557377d02580 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f59ac006010 tx=0x7f59ac032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758dfa85223e3a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f599b7fe640 1 -- 172.21.15.2:0/2284750594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac03f030 con 0x557377d00190 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f599b7fe640 1 -- 172.21.15.2:0/2284750594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59ac032dc0 con 0x557377d00190 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f599b7fe640 1 -- 172.21.15.2:0/2284750594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac035070 con 0x557377d00190 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f59a67fc640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f599c0b52e0 0x7f599c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f59b58b4640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f599c0b52e0 0x7f599c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.001+0000 7f59a67fc640 1 -- 172.21.15.2:0/1024442983 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f59a00e57a0 con 0x7f59b0105ac0 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 -- 172.21.15.2:0/2284750594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 msgr2=0x557377d02580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59b58b4640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f599c0b52e0 0x7f599c0b77a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005cc0 tx=0x7f59a80083f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 0x557377d02580 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f59ac006010 tx=0x7f59ac032ba0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 -- 172.21.15.2:0/2284750594 shutdown_connections 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d02bd0 0x557377d05090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d00190 0x557377d02580 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/2284750594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377cfd860 0x557377cffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 -- 172.21.15.2:0/2284750594 >> 172.21.15.2:0/2284750594 conn(0x557377cf89b0 msgr2=0x557377cf9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 -- 172.21.15.2:0/2284750594 shutdown_connections 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 -- 172.21.15.2:0/2284750594 wait complete. 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 -- start start 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.002+0000 7f59ba1c3740 1 Processor -- start 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 0x557377d06e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d00190 0x557377d07500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d02bd0 0x557377d080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557377b96ab0 con 0x557377cfd860 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557377c04730 con 0x557377d02bd0 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557377d05b50 con 0x557377d00190 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 0x557377d06e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 10 client.0 _ll_register_callbacks cb 0x557377c586b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 0x557377d06e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35822/0 (socket says 172.21.15.2:35822) 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 -- 172.21.15.2:0/913596023 learned_addr learned my addr 172.21.15.2:0/913596023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b48b2640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d00190 0x557377d07500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b58b4640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d02bd0 0x557377d080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 -- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d00190 msgr2=0x557377d07500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d00190 0x557377d07500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 -- 172.21.15.2:0/913596023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d02bd0 msgr2=0x557377d080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d02bd0 0x557377d080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 -- 172.21.15.2:0/913596023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573779c0790 con 0x557377cfd860 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b48b2640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d00190 0x557377d07500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59b50b3640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 0x557377d06e60 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f59ac02a450 tx=0x7f59ac031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892d773a6b29beaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f5998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f5998ff9640 1 -- 172.21.15.2:0/913596023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac035050 con 0x557377cfd860 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f5998ff9640 1 -- 172.21.15.2:0/913596023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f59ac0053e0 con 0x557377cfd860 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.003+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59ac032dc0 con 0x557377cfd860 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f5998ff9640 1 -- 172.21.15.2:0/913596023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f59ac03f040 con 0x557377cfd860 2024-09-10T23:33:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 10 client.18756 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557377a39620 con 0x557377cfd860 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f5998ff9640 1 -- 172.21.15.2:0/913596023 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59ac032dc0 con 0x557377cfd860 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f5998ff9640 1 -- 172.21.15.2:0/913596023 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f59ac03b730 con 0x557377cfd860 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 10 client.18756 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 10 client.18756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 20 client.18756 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d12350 0x557377d14760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 4 client.18756 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557377c71640 con 0x557377d12350 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.004+0000 7f59b48b2640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d12350 0x557377d14760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.005+0000 7f5998ff9640 10 client.18756 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.005+0000 7f59b48b2640 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d12350 0x557377d14760 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2aa78bc41430af server_cookie=9bd8d92503cf1f19 in_seq=0 out_seq=0 2024-09-10T23:33:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f5998ff9640 1 -- 172.21.15.2:0/913596023 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557377c71640 con 0x557377d12350 2024-09-10T23:33:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f5998ff9640 10 client.18756 handle_command_reply: tid=0 2024-09-10T23:33:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 client.18756 shutdown 2024-09-10T23:33:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 msgr2=0x557377d06e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 0x557377d06e60 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f59ac02a450 tx=0x7f59ac031850 comp rx=0 tx=0).stop 2024-09-10T23:33:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 shutdown_connections 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d12350 0x557377d14760 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d02bd0 0x557377d080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377d00190 0x557377d07500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/913596023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377cfd860 0x557377d06e60 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 >> 172.21.15.2:0/913596023 conn(0x557377cf89b0 msgr2=0x557377cf7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f5998ff9640 0 client.18756 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 shutdown_connections 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 1 -- 172.21.15.2:0/913596023 wait complete. 2024-09-10T23:33:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.006+0000 7f59ba1c3740 20 client.18756 trim_cache size 0 max 16384 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 Processor -- start 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 -- start start 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377cf7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377cfa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01a9e90 con 0x557377d02bd0 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01ab9d0 con 0x557377d00190 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01aa560 con 0x557377cfd860 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59b58b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377cfa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59b58b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377cfa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35830/0 (socket says 172.21.15.2:35830) 2024-09-10T23:33:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.021+0000 7f59b58b4640 1 -- 172.21.15.2:0/3204360856 learned_addr learned my addr 172.21.15.2:0/3204360856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b50b3640 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377cf7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b48b2640 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b58b4640 1 -- 172.21.15.2:0/3204360856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 msgr2=0x557377cf7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b58b4640 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377cf7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b58b4640 1 -- 172.21.15.2:0/3204360856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 msgr2=0x557377d0f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b58b4640 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b58b4640 1 -- 172.21.15.2:0/3204360856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557377d07960 con 0x557377d02bd0 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f59b58b4640 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377cfa7e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f59a8010530 tx=0x7f59a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af7e6de06d8b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f599affd640 1 -- 172.21.15.2:0/3204360856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a801d8f0 con 0x557377d02bd0 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f599affd640 1 -- 172.21.15.2:0/3204360856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59a8021070 con 0x557377d02bd0 2024-09-10T23:33:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.022+0000 7f599affd640 1 -- 172.21.15.2:0/3204360856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a801a410 con 0x557377d02bd0 2024-09-10T23:33:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 -- 172.21.15.2:0/3204360856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 msgr2=0x557377cfa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377cfa7e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f59a8010530 tx=0x7f59a8012000 comp rx=0 tx=0).stop 2024-09-10T23:33:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 -- 172.21.15.2:0/3204360856 shutdown_connections 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377cfa7e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/3204360856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377cf7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 -- 172.21.15.2:0/3204360856 >> 172.21.15.2:0/3204360856 conn(0x557377cf89b0 msgr2=0x557377cf73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 -- 172.21.15.2:0/3204360856 shutdown_connections 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 -- 172.21.15.2:0/3204360856 wait complete. 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 -- start start 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.023+0000 7f59ba1c3740 1 Processor -- start 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377d0f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377d0e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01ab300 con 0x557377d02bd0 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01aac30 con 0x557377d00190 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59b01a7e70 con 0x557377cfd860 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 10 client.0 _ll_register_callbacks cb 0x7f59ac005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377d0e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377d0e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35846/0 (socket says 172.21.15.2:35846) 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 -- 172.21.15.2:0/4256720385 learned_addr learned my addr 172.21.15.2:0/4256720385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b50b3640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377d0f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b48b2640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 -- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 msgr2=0x557377d0f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377d0f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 -- 172.21.15.2:0/4256720385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 msgr2=0x557377d0dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 -- 172.21.15.2:0/4256720385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557377d0c8d0 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b48b2640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59b58b4640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377d0e550 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f59a80085f0 tx=0x7f59a801d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de95fd8518240e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f5998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f5998ff9640 1 -- 172.21.15.2:0/4256720385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8034060 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f5998ff9640 1 -- 172.21.15.2:0/4256720385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f59a801dd50 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.024+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59a8021070 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f5998ff9640 1 -- 172.21.15.2:0/4256720385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f59a802f410 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 10 client.18762 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557377d7f530 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f5998ff9640 1 -- 172.21.15.2:0/4256720385 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59a8021070 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f5998ff9640 1 -- 172.21.15.2:0/4256720385 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f59a803a3d0 con 0x557377d02bd0 2024-09-10T23:33:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 10 client.18762 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 10 client.18762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 20 client.18762 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d7fe30 0x557377d82250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 4 client.18762 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557377c6d0f0 con 0x557377d7fe30 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.025+0000 7f59b50b3640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d7fe30 0x557377d82250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.026+0000 7f5998ff9640 10 client.18762 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.026+0000 7f59b50b3640 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d7fe30 0x557377d82250 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe37fae821985e4 server_cookie=7f8b1fba0f75667c in_seq=0 out_seq=0 2024-09-10T23:33:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f5998ff9640 1 -- 172.21.15.2:0/4256720385 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557377c6d0f0 con 0x557377d7fe30 2024-09-10T23:33:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f5998ff9640 10 client.18762 handle_command_reply: tid=0 2024-09-10T23:33:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 client.18762 shutdown 2024-09-10T23:33:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 msgr2=0x557377d0e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377d0e550 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f59a80085f0 tx=0x7f59a801d920 comp rx=0 tx=0).stop 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 shutdown_connections 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557377d7fe30 0x557377d82250 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557377d02bd0 0x557377d0e550 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557377d00190 0x557377d0dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f5998ff9640 0 client.18762 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 --2- 172.21.15.2:0/4256720385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557377cfd860 0x557377d0f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 >> 172.21.15.2:0/4256720385 conn(0x557377cf89b0 msgr2=0x557377cf7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 shutdown_connections 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 1 -- 172.21.15.2:0/4256720385 wait complete. 2024-09-10T23:33:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.042+0000 7f59ba1c3740 20 client.18762 trim_cache size 0 max 16384 2024-09-10T23:33:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:33:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:33:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:33:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f599c0b52e0 msgr2=0x7f599c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f599c0b52e0 0x7f599c0b77a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005cc0 tx=0x7f59a80083f0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 msgr2=0x7f59b0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 0x7f59b0199350 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f59a000d950 tx=0x7f59a000de10 comp rx=0 tx=0).stop 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 shutdown_connections 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f599c0b52e0 0x7f599c0b77a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b0108670 0x7f59b0199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b0105ac0 0x7f59b0199350 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 --2- 172.21.15.2:0/1024442983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59b006b470 0x7f59b0198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 >> 172.21.15.2:0/1024442983 conn(0x7f59b00fd140 msgr2=0x7f59b0103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 shutdown_connections 2024-09-10T23:33:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:33:58.043+0000 7f59b7317640 1 -- 172.21.15.2:0/1024442983 wait complete. 2024-09-10T23:33:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 -- 172.21.15.2:0/630845196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22301076e0 msgr2=0x7f2230107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 --2- 172.21.15.2:0/630845196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22301076e0 0x7f2230107b20 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f222402a410 comp rx=0 tx=0).stop 2024-09-10T23:33:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 -- 172.21.15.2:0/630845196 shutdown_connections 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 --2- 172.21.15.2:0/630845196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2230108060 0x7f223010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 --2- 172.21.15.2:0/630845196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22301076e0 0x7f2230107b20 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 --2- 172.21.15.2:0/630845196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2230101cd0 0x7f22301020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 -- 172.21.15.2:0/630845196 >> 172.21.15.2:0/630845196 conn(0x7f22300fd700 msgr2=0x7f22300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 -- 172.21.15.2:0/630845196 shutdown_connections 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.251+0000 7f2234fcb640 1 -- 172.21.15.2:0/630845196 wait complete. 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.252+0000 7f2234fcb640 1 Processor -- start 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.252+0000 7f2234fcb640 1 -- start start 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f2234fcb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 0x7f223019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f2234fcb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22301076e0 0x7f223019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f2234fcb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2230108060 0x7f223019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f2234fcb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2230111d20 con 0x7f2230101cd0 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f2234fcb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2230111ba0 con 0x7f2230108060 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f2234fcb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2230111ea0 con 0x7f22301076e0 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 0x7f223019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 0x7f223019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35874/0 (socket says 172.21.15.2:35874) 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 -- 172.21.15.2:0/2292563877 learned_addr learned my addr 172.21.15.2:0/2292563877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222ed9d640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2230108060 0x7f223019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222dd9b640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22301076e0 0x7f223019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 -- 172.21.15.2:0/2292563877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22301076e0 msgr2=0x7f223019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22301076e0 0x7f223019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 -- 172.21.15.2:0/2292563877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2230108060 msgr2=0x7f223019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2230108060 0x7f223019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 -- 172.21.15.2:0/2292563877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22301a5450 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222dd9b640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22301076e0 0x7f223019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f222e59c640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 0x7f223019a070 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f222000d950 tx=0x7f222000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.253+0000 7f221f7fe640 1 -- 172.21.15.2:0/2292563877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220017070 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.254+0000 7f221f7fe640 1 -- 172.21.15.2:0/2292563877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2220009c30 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.254+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22301a5740 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.254+0000 7f221f7fe640 1 -- 172.21.15.2:0/2292563877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222000f620 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.254+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22301a5c50 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 Processor -- start 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 -- start start 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f221f7fe640 1 -- 172.21.15.2:0/2292563877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2220010460 con 0x7f2230101cd0 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe5068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe516c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe519580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641fe47cea0 con 0x5641fe5064d0 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5641fe46c2d0 con 0x5641fe517190 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.256+0000 7f22373a0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5641fe4700e0 con 0x5641fe506df0 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe5068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe5068b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35880/0 (socket says 172.21.15.2:35880) 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 -- 172.21.15.2:0/4130688910 learned_addr learned my addr 172.21.15.2:0/4130688910 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222dd9b640 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe519580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222e59c640 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe516c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 -- 172.21.15.2:0/4130688910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 msgr2=0x5641fe516c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe516c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 -- 172.21.15.2:0/4130688910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 msgr2=0x5641fe519580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe519580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 -- 172.21.15.2:0/4130688910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641fe1ca650 con 0x5641fe5064d0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222e59c640 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe516c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f222ed9d640 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe5068b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2228010370 tx=0x7f2228010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2130d9d39adcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f221cff9640 1 -- 172.21.15.2:0/4130688910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228016070 con 0x5641fe5064d0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f221cff9640 1 -- 172.21.15.2:0/4130688910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2228012bc0 con 0x5641fe5064d0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f221cff9640 1 -- 172.21.15.2:0/4130688910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228011b90 con 0x5641fe5064d0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.257+0000 7f221f7fe640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22180b52e0 0x7f22180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f222e59c640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22180b52e0 0x7f22180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f221f7fe640 1 -- 172.21.15.2:0/2292563877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f22200e5860 con 0x7f2230101cd0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 -- 172.21.15.2:0/4130688910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 msgr2=0x5641fe5068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f222e59c640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22180b52e0 0x7f22180b77a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f22200e36e0 tx=0x7f2220010cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe5068b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2228010370 tx=0x7f2228010830 comp rx=0 tx=0).stop 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 -- 172.21.15.2:0/4130688910 shutdown_connections 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe519580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe516c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 --2- 172.21.15.2:0/4130688910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe5068b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 -- 172.21.15.2:0/4130688910 >> 172.21.15.2:0/4130688910 conn(0x5641fe504300 msgr2=0x5641fe5054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 -- 172.21.15.2:0/4130688910 shutdown_connections 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.258+0000 7f22373a0740 1 -- 172.21.15.2:0/4130688910 wait complete. 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 -- start start 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 Processor -- start 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe516af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe513f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe5145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641fe2cd700 con 0x5641fe506df0 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5641fe407160 con 0x5641fe5064d0 2024-09-10T23:33:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5641fe519e40 con 0x5641fe517190 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f22373a0740 10 client.0 _ll_register_callbacks cb 0x5641fe4209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe513f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe513f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35892/0 (socket says 172.21.15.2:35892) 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222dd9b640 1 -- 172.21.15.2:0/3662703706 learned_addr learned my addr 172.21.15.2:0/3662703706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222ed9d640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe516af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222ed9d640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe5145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222dd9b640 1 -- 172.21.15.2:0/3662703706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 msgr2=0x5641fe5145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.259+0000 7f222dd9b640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe5145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f222dd9b640 1 -- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 msgr2=0x5641fe516af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f222dd9b640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe516af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f222dd9b640 1 -- 172.21.15.2:0/3662703706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641fe434c90 con 0x5641fe506df0 2024-09-10T23:33:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f222dd9b640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe513f40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f2224031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea44dc7cf4c247c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f2215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f2215ffb640 1 -- 172.21.15.2:0/3662703706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224035040 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2228012bc0 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f2215ffb640 1 -- 172.21.15.2:0/3662703706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2224004240 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f2215ffb640 1 -- 172.21.15.2:0/3662703706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2224004440 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f22373a0740 10 client.18774 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641fe525840 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f2215ffb640 1 -- 172.21.15.2:0/3662703706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2228012bc0 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f2215ffb640 1 -- 172.21.15.2:0/3662703706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2224004b00 con 0x5641fe506df0 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f22373a0740 10 client.18774 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.260+0000 7f22373a0740 10 client.18774 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f22373a0740 20 client.18774 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f22373a0740 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe526c50 0x5641fe529060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f22373a0740 4 client.18774 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641fe47edf0 con 0x5641fe526c50 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f222ed9d640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe526c50 0x5641fe529060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f222ed9d640 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe526c50 0x5641fe529060 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f207136214fa8ab9 server_cookie=8002186c931ce3b6 in_seq=0 out_seq=0 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.261+0000 7f2215ffb640 10 client.18774 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f2215ffb640 1 -- 172.21.15.2:0/3662703706 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641fe47edf0 con 0x5641fe526c50 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f2215ffb640 10 client.18774 handle_command_reply: tid=0 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 client.18774 shutdown 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 msgr2=0x5641fe513f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe513f40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f2224031730 comp rx=0 tx=0).stop 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 shutdown_connections 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe526c50 0x5641fe529060 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe5145c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe513f40 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f2215ffb640 0 client.18774 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 --2- 172.21.15.2:0/3662703706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe516af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 >> 172.21.15.2:0/3662703706 conn(0x5641fe504300 msgr2=0x5641fe503420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 shutdown_connections 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 1 -- 172.21.15.2:0/3662703706 wait complete. 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.262+0000 7f22373a0740 20 client.18774 trim_cache size 0 max 16384 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.275+0000 7f22373a0740 1 Processor -- start 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 -- start start 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe523070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe509d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe52e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22301ac0f0 con 0x5641fe506df0 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22301adc30 con 0x5641fe5064d0 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f22373a0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22301ac7c0 con 0x5641fe517190 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe509d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe509d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35894/0 (socket says 172.21.15.2:35894) 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 -- 172.21.15.2:0/1787199639 learned_addr learned my addr 172.21.15.2:0/1787199639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222ed9d640 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe52e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222ed9d640 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe523070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 -- 172.21.15.2:0/1787199639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 msgr2=0x5641fe52e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe52e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 -- 172.21.15.2:0/1787199639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 msgr2=0x5641fe523070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe523070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 -- 172.21.15.2:0/1787199639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641fe514930 con 0x5641fe506df0 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.276+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe509d20 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2224033000 tx=0x7f22240038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e813b5f72be6fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f2217fff640 1 -- 172.21.15.2:0/1787199639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224035070 con 0x5641fe506df0 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f2217fff640 1 -- 172.21.15.2:0/1787199639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2224004b70 con 0x5641fe506df0 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f2217fff640 1 -- 172.21.15.2:0/1787199639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224005230 con 0x5641fe506df0 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 -- 172.21.15.2:0/1787199639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 msgr2=0x5641fe509d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe509d20 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2224033000 tx=0x7f22240038c0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 -- 172.21.15.2:0/1787199639 shutdown_connections 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe517190 0x5641fe52e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe506df0 0x5641fe509d20 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 --2- 172.21.15.2:0/1787199639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe5064d0 0x5641fe523070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 -- 172.21.15.2:0/1787199639 >> 172.21.15.2:0/1787199639 conn(0x5641fe504300 msgr2=0x5641fe509610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 -- 172.21.15.2:0/1787199639 shutdown_connections 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.277+0000 7f22373a0740 1 -- 172.21.15.2:0/1787199639 wait complete. 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 -- start start 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 Processor -- start 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe51f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe51c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe51c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22301ad560 con 0x5641fe5064d0 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22301ace90 con 0x5641fe517190 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22301aa0d0 con 0x5641fe506df0 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f22373a0740 10 client.0 _ll_register_callbacks cb 0x7f2224009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe51f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe51f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35908/0 (socket says 172.21.15.2:35908) 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 -- 172.21.15.2:0/1019985070 learned_addr learned my addr 172.21.15.2:0/1019985070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe51c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 -- 172.21.15.2:0/1019985070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 msgr2=0x5641fe51c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe51c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 -- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 msgr2=0x5641fe51c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe51c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222ed9d640 1 -- 172.21.15.2:0/1019985070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641fe593b40 con 0x5641fe5064d0 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.278+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe51c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f222ed9d640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe51f9e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2228011010 tx=0x7f2228010fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d778ce179a6506cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f2215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f2215ffb640 1 -- 172.21.15.2:0/1019985070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228016040 con 0x5641fe5064d0 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f2215ffb640 1 -- 172.21.15.2:0/1019985070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f222802bf90 con 0x5641fe5064d0 2024-09-10T23:33:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2224004b70 con 0x5641fe5064d0 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f2215ffb640 1 -- 172.21.15.2:0/1019985070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2228003b80 con 0x5641fe5064d0 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 10 client.18780 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641fe594d00 con 0x5641fe5064d0 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f2215ffb640 1 -- 172.21.15.2:0/1019985070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2224004b70 con 0x5641fe5064d0 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f2215ffb640 1 -- 172.21.15.2:0/1019985070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f222800f040 con 0x5641fe5064d0 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 10 client.18780 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 10 client.18780 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 20 client.18780 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe5952b0 0x5641fe5976d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.279+0000 7f22373a0740 4 client.18780 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641fe47a8a0 con 0x5641fe5952b0 2024-09-10T23:33:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe5952b0 0x5641fe5976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f222dd9b640 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe5952b0 0x5641fe5976d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=398be08e36589305 server_cookie=cc4d90f3bf9be2f0 in_seq=0 out_seq=0 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f2215ffb640 10 client.18780 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f2215ffb640 1 -- 172.21.15.2:0/1019985070 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641fe47a8a0 con 0x5641fe5952b0 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f2215ffb640 10 client.18780 handle_command_reply: tid=0 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f22373a0740 1 client.18780 shutdown 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 msgr2=0x5641fe51f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.280+0000 7f22373a0740 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe51f9e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2228011010 tx=0x7f2228010fa0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 shutdown_connections 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5641fe5952b0 0x5641fe5976d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641fe517190 0x5641fe51c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5641fe506df0 0x5641fe51c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 --2- 172.21.15.2:0/1019985070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641fe5064d0 0x5641fe51f9e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 >> 172.21.15.2:0/1019985070 conn(0x5641fe504300 msgr2=0x5641fe515d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2215ffb640 0 client.18780 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:33:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 shutdown_connections 2024-09-10T23:33:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 1 -- 172.21.15.2:0/1019985070 wait complete. 2024-09-10T23:33:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f22373a0740 20 client.18780 trim_cache size 0 max 16384 2024-09-10T23:33:58.298 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22180b52e0 msgr2=0x7f22180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22180b52e0 0x7f22180b77a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f22200e36e0 tx=0x7f2220010cb0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 msgr2=0x7f223019a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 0x7f223019a070 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f222000d950 tx=0x7f222000de10 comp rx=0 tx=0).stop 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 shutdown_connections 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f22180b52e0 0x7f22180b77a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2230108060 0x7f223019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22301076e0 0x7f223019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 --2- 172.21.15.2:0/2292563877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2230101cd0 0x7f223019a070 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.281+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 >> 172.21.15.2:0/2292563877 conn(0x7f22300fd700 msgr2=0x7f22300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.282+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 shutdown_connections 2024-09-10T23:33:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:58.282+0000 7f2234fcb640 1 -- 172.21.15.2:0/2292563877 wait complete. 2024-09-10T23:33:58.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:33:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:59.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:33:59 smithi002 ceph-mon[31150]: pgmap v641: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:33:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 -- 172.21.15.2:0/2986982532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd4104530 msgr2=0x7fccd410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2986982532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd4104530 0x7fccd410cb10 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009900 tx=0x7fccc402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 -- 172.21.15.2:0/2986982532 shutdown_connections 2024-09-10T23:33:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2986982532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd410d0e0 0x7fccd410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2986982532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd4104530 0x7fccd410cb10 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2986982532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 0x7fccd4103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 -- 172.21.15.2:0/2986982532 >> 172.21.15.2:0/2986982532 conn(0x7fccd40fd700 msgr2=0x7fccd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 -- 172.21.15.2:0/2986982532 shutdown_connections 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.753+0000 7fccdbe10640 1 -- 172.21.15.2:0/2986982532 wait complete. 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 Processor -- start 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 -- start start 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 0x7fccd4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd4104530 0x7fccd41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 0x7fccd419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4112d60 con 0x7fccd410d0e0 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4112be0 con 0x7fccd4103b30 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccdbe10640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4112ee0 con 0x7fccd4104530 2024-09-10T23:33:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.754+0000 7fccda3ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 0x7fccd419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 0x7fccd419eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35922/0 (socket says 172.21.15.2:35922) 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 -- 172.21.15.2:0/2563148211 learned_addr learned my addr 172.21.15.2:0/2563148211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd4104530 0x7fccd41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccd9bac640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 0x7fccd4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 -- 172.21.15.2:0/2563148211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd4104530 msgr2=0x7fccd41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd4104530 0x7fccd41997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 -- 172.21.15.2:0/2563148211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 msgr2=0x7fccd4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 0x7fccd4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 -- 172.21.15.2:0/2563148211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd419f320 con 0x7fccd410d0e0 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccd9bac640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 0x7fccd4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd4104530 0x7fccd41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccda3ad640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 0x7fccd419eb50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00cce0 tx=0x7fcccc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fcccaffd640 1 -- 172.21.15.2:0/2563148211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00f450 con 0x7fccd410d0e0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fcccaffd640 1 -- 172.21.15.2:0/2563148211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcccc00faa0 con 0x7fccd410d0e0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd419f610 con 0x7fccd410d0e0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fcccaffd640 1 -- 172.21.15.2:0/2563148211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc018b70 con 0x7fccd410d0e0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.755+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd41a5cd0 con 0x7fccd410d0e0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 Processor -- start 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fcccaffd640 1 -- 172.21.15.2:0/2563148211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcccc00f5f0 con 0x7fccd410d0e0 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 -- start start 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b4931044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b493110460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931109a0 0x55b493112d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b49307aea0 con 0x55b493104a10 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b49306a2d0 con 0x55b4931109a0 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.758+0000 7fccde1e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b49306e0e0 con 0x55b4931040f0 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b493110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b493110460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35924/0 (socket says 172.21.15.2:35924) 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 -- 172.21.15.2:0/1170668014 learned_addr learned my addr 172.21.15.2:0/1170668014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd93ab640 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b4931044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd93ab640 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931109a0 0x55b493112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 -- 172.21.15.2:0/1170668014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 msgr2=0x55b4931044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b4931044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 -- 172.21.15.2:0/1170668014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931109a0 msgr2=0x55b493112d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931109a0 0x55b493112d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 -- 172.21.15.2:0/1170668014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b492dc8650 con 0x55b493104a10 2024-09-10T23:33:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fcccaffd640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccc00b5360 0x7fccc00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd9bac640 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b493110460 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009c50 tx=0x7fccd000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965b05f80a600775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccc00b5360 0x7fccc00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fccbffff640 1 -- 172.21.15.2:0/1170668014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0016070 con 0x55b493104a10 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.759+0000 7fcccaffd640 1 -- 172.21.15.2:0/2563148211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcccc0e6310 con 0x7fccd410d0e0 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccbffff640 1 -- 172.21.15.2:0/1170668014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd000ee70 con 0x55b493104a10 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccbffff640 1 -- 172.21.15.2:0/1170668014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0011470 con 0x55b493104a10 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 -- 172.21.15.2:0/1170668014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 msgr2=0x55b493110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b493110460 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009c50 tx=0x7fccd000e6c0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccc00b5360 0x7fccc00b7820 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fccc4031440 tx=0x7fccc4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 -- 172.21.15.2:0/1170668014 shutdown_connections 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931109a0 0x55b493112d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b493110460 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1170668014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b4931044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 -- 172.21.15.2:0/1170668014 >> 172.21.15.2:0/1170668014 conn(0x55b493101f20 msgr2=0x55b4931030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 -- 172.21.15.2:0/1170668014 shutdown_connections 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.760+0000 7fccde1e5740 1 -- 172.21.15.2:0/1170668014 wait complete. 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 -- start start 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 Processor -- start 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493110200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b49310d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931109a0 0x55b49310dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b492ecb700 con 0x55b493104a10 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b493005160 con 0x55b4931040f0 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b493113620 con 0x55b4931109a0 2024-09-10T23:33:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccde1e5740 10 client.0 _ll_register_callbacks cb 0x55b49301e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccd93ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b49310d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccd93ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b49310d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35930/0 (socket says 172.21.15.2:35930) 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.761+0000 7fccd93ab640 1 -- 172.21.15.2:0/2842012420 learned_addr learned my addr 172.21.15.2:0/2842012420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd9bac640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccda3ad640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931109a0 0x55b49310dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd93ab640 1 -- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931109a0 msgr2=0x55b49310dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931109a0 0x55b49310dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd93ab640 1 -- 172.21.15.2:0/2842012420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 msgr2=0x55b493110200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493110200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd93ab640 1 -- 172.21.15.2:0/2842012420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b493032c90 con 0x55b493104a10 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd9bac640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccd93ab640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b49310d650 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fccc4033000 tx=0x7fccc40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49af0631dcf7fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccbd7fa640 1 -- 172.21.15.2:0/2842012420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc404d030 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccbd7fa640 1 -- 172.21.15.2:0/2842012420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fccc40035f0 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd000ee70 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccbd7fa640 1 -- 172.21.15.2:0/2842012420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccc4041070 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccde1e5740 10 client.18792 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.762+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b49311ef30 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccbd7fa640 1 -- 172.21.15.2:0/2842012420 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd000ee70 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccbd7fa640 1 -- 172.21.15.2:0/2842012420 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fccc4046050 con 0x55b493104a10 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccde1e5740 10 client.18792 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccde1e5740 10 client.18792 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccde1e5740 20 client.18792 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccde1e5740 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b4931204e0 0x55b493122980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccde1e5740 4 client.18792 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b49307cdf0 con 0x55b4931204e0 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.763+0000 7fccd9bac640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b4931204e0 0x55b493122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccd9bac640 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b4931204e0 0x55b493122980 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eebe13c4c7134cf9 server_cookie=db9e788d1382b32b in_seq=0 out_seq=0 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccbd7fa640 10 client.18792 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccbd7fa640 1 -- 172.21.15.2:0/2842012420 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b49307cdf0 con 0x55b4931204e0 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccbd7fa640 10 client.18792 handle_command_reply: tid=0 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccde1e5740 1 client.18792 shutdown 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 msgr2=0x55b49310d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.764+0000 7fccde1e5740 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b49310d650 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fccc4033000 tx=0x7fccc40056d0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 shutdown_connections 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b4931204e0 0x55b493122980 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931109a0 0x55b49310dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b493104a10 0x55b49310d650 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 --2- 172.21.15.2:0/2842012420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccbd7fa640 0 client.18792 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 >> 172.21.15.2:0/2842012420 conn(0x55b493101f20 msgr2=0x55b493107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 shutdown_connections 2024-09-10T23:33:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 1 -- 172.21.15.2:0/2842012420 wait complete. 2024-09-10T23:33:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.765+0000 7fccde1e5740 20 client.18792 trim_cache size 0 max 16384 2024-09-10T23:33:59.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:33:59 smithi154 ceph-mon[35136]: pgmap v641: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 Processor -- start 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 -- start start 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b49311c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b493104a10 0x55b49310f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493118cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41ae2f0 con 0x55b4931109a0 2024-09-10T23:33:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41afe30 con 0x55b493104a10 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.778+0000 7fccde1e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41ae9c0 con 0x55b4931040f0 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493118cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493118cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35936/0 (socket says 172.21.15.2:35936) 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 -- 172.21.15.2:0/1589852738 learned_addr learned my addr 172.21.15.2:0/1589852738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccd93ab640 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b493104a10 0x55b49310f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccd9bac640 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b49311c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 -- 172.21.15.2:0/1589852738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 msgr2=0x55b49311c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b49311c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 -- 172.21.15.2:0/1589852738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b493104a10 msgr2=0x55b49310f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b493104a10 0x55b49310f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 -- 172.21.15.2:0/1589852738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b493102c00 con 0x55b4931109a0 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccd9bac640 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b49311c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccda3ad640 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493118cf0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0a90b0 tx=0x7fcccc018610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62b24ef1c62b851 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccbf7fe640 1 -- 172.21.15.2:0/1589852738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0b1070 con 0x55b4931109a0 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccbf7fe640 1 -- 172.21.15.2:0/1589852738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcccc0ac5f0 con 0x55b4931109a0 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.779+0000 7fccbf7fe640 1 -- 172.21.15.2:0/1589852738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a8d50 con 0x55b4931109a0 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 -- 172.21.15.2:0/1589852738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 msgr2=0x55b493118cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493118cf0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0a90b0 tx=0x7fcccc018610 comp rx=0 tx=0).stop 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 -- 172.21.15.2:0/1589852738 shutdown_connections 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493118cf0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b493104a10 0x55b49310f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 --2- 172.21.15.2:0/1589852738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4931040f0 0x55b49311c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 -- 172.21.15.2:0/1589852738 >> 172.21.15.2:0/1589852738 conn(0x55b493101f20 msgr2=0x55b49310ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 -- 172.21.15.2:0/1589852738 shutdown_connections 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 -- 172.21.15.2:0/1589852738 wait complete. 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 -- start start 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.780+0000 7fccde1e5740 1 Processor -- start 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b493104a10 0x55b493127240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493127780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41af760 con 0x55b4931109a0 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41af090 con 0x55b4931040f0 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41ac2d0 con 0x55b493104a10 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccde1e5740 10 client.0 _ll_register_callbacks cb 0x7fccc4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35946/0 (socket says 172.21.15.2:35946) 2024-09-10T23:33:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 -- 172.21.15.2:0/3925460750 learned_addr learned my addr 172.21.15.2:0/3925460750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccd93ab640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b493104a10 0x55b493127240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccd9bac640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 -- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b493104a10 msgr2=0x55b493127240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b493104a10 0x55b493127240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 -- 172.21.15.2:0/3925460750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 msgr2=0x55b493128780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493128780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 -- 172.21.15.2:0/3925460750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b493127d70 con 0x55b4931109a0 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccd9bac640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493128780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccda3ad640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493127780 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00afb0 tx=0x7fcccc0a8370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff83882e2ad19f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.781+0000 7fccbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccbd7fa640 1 -- 172.21.15.2:0/3925460750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0d3070 con 0x55b4931109a0 2024-09-10T23:33:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccbd7fa640 1 -- 172.21.15.2:0/3925460750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcccc0b1210 con 0x55b4931109a0 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcccc0ac5f0 con 0x55b4931109a0 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccbd7fa640 1 -- 172.21.15.2:0/3925460750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcccc0b1070 con 0x55b4931109a0 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 10 client.18798 fetch_fsmap learned FSMap version 28 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b493192200 con 0x55b4931109a0 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccbd7fa640 1 -- 172.21.15.2:0/3925460750 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcccc0ac5f0 con 0x55b4931109a0 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccbd7fa640 1 -- 172.21.15.2:0/3925460750 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcccc0b5be0 con 0x55b4931109a0 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 10 client.18798 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 10 client.18798 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 20 client.18798 populate_metadata read hostname 'smithi002' 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b493192810 0x55b493194c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 4 client.18798 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.782+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b4930788a0 con 0x55b493192810 2024-09-10T23:33:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccd9bac640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b493192810 0x55b493194c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccd9bac640 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b493192810 0x55b493194c00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e91799f474c34cd server_cookie=1b5f1791928fb62 in_seq=0 out_seq=0 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccbd7fa640 10 client.18798 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccbd7fa640 1 -- 172.21.15.2:0/3925460750 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b4930788a0 con 0x55b493192810 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccbd7fa640 10 client.18798 handle_command_reply: tid=0 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccde1e5740 1 client.18798 shutdown 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 msgr2=0x55b493127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccde1e5740 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493127780 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00afb0 tx=0x7fcccc0a8370 comp rx=0 tx=0).stop 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 shutdown_connections 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.783+0000 7fccde1e5740 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55b493192810 0x55b493194c00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4931109a0 0x55b493127780 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b493104a10 0x55b493127240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccbd7fa640 0 client.18798 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:33:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 1 --2- 172.21.15.2:0/3925460750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4931040f0 0x55b493128780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 >> 172.21.15.2:0/3925460750 conn(0x55b493101f20 msgr2=0x55b49310f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 shutdown_connections 2024-09-10T23:33:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 1 -- 172.21.15.2:0/3925460750 wait complete. 2024-09-10T23:33:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccde1e5740 20 client.18798 trim_cache size 0 max 16384 2024-09-10T23:33:59.800 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccc00b5360 msgr2=0x7fccc00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccc00b5360 0x7fccc00b7820 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fccc4031440 tx=0x7fccc4009260 comp rx=0 tx=0).stop 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 msgr2=0x7fccd419eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 0x7fccd419eb50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00cce0 tx=0x7fcccc00a620 comp rx=0 tx=0).stop 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 shutdown_connections 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fccc00b5360 0x7fccc00b7820 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccd410d0e0 0x7fccd419eb50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccd4104530 0x7fccd41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 --2- 172.21.15.2:0/2563148211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccd4103b30 0x7fccd4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 >> 172.21.15.2:0/2563148211 conn(0x7fccd40fd700 msgr2=0x7fccd40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 shutdown_connections 2024-09-10T23:33:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:33:59.784+0000 7fccdbe10640 1 -- 172.21.15.2:0/2563148211 wait complete. 2024-09-10T23:33:59.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:33:59 smithi177 ceph-mon[35760]: pgmap v641: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-10T23:34:00.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:34:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 -- 172.21.15.2:0/1661432801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f41087d0 msgr2=0x7f43f4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 --2- 172.21.15.2:0/1661432801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f41087d0 0x7f43f4108c10 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009ca0 tx=0x7f43e802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 -- 172.21.15.2:0/1661432801 shutdown_connections 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 --2- 172.21.15.2:0/1661432801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43f4109150 0x7f43f410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 --2- 172.21.15.2:0/1661432801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f41087d0 0x7f43f4108c10 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 --2- 172.21.15.2:0/1661432801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43f4102dc0 0x7f43f41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 -- 172.21.15.2:0/1661432801 >> 172.21.15.2:0/1661432801 conn(0x7f43f40fe830 msgr2=0x7f43f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 -- 172.21.15.2:0/1661432801 shutdown_connections 2024-09-10T23:34:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 -- 172.21.15.2:0/1661432801 wait complete. 2024-09-10T23:34:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.355+0000 7f43f96c3640 1 Processor -- start 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 -- start start 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 0x7f43f40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43f41087d0 0x7f43f40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43f4109150 0x7f43f4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4112da0 con 0x7f43f4102dc0 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4112c20 con 0x7f43f41087d0 2024-09-10T23:34:01.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f96c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4112f20 con 0x7f43f4109150 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 0x7f43f40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 0x7f43f40754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57380/0 (socket says 172.21.15.2:57380) 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 -- 172.21.15.2:0/3469827346 learned_addr learned my addr 172.21.15.2:0/3469827346 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f37fe640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43f4109150 0x7f43f4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f27fc640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43f41087d0 0x7f43f40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 -- 172.21.15.2:0/3469827346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43f4109150 msgr2=0x7f43f4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43f4109150 0x7f43f4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 -- 172.21.15.2:0/3469827346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43f41087d0 msgr2=0x7f43f40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43f41087d0 0x7f43f40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.356+0000 7f43f2ffd640 1 -- 172.21.15.2:0/3469827346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f41a7690 con 0x7f43f4102dc0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.357+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 0x7f43f40754a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f43e400d950 tx=0x7f43e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.357+0000 7f43dbfff640 1 -- 172.21.15.2:0/3469827346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4017030 con 0x7f43f4102dc0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.357+0000 7f43dbfff640 1 -- 172.21.15.2:0/3469827346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e4004020 con 0x7f43f4102dc0 2024-09-10T23:34:01.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.357+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f41a7980 con 0x7f43f4102dc0 2024-09-10T23:34:01.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.357+0000 7f43dbfff640 1 -- 172.21.15.2:0/3469827346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40047a0 con 0x7f43f4102dc0 2024-09-10T23:34:01.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.357+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f41a7ec0 con 0x7f43f4102dc0 2024-09-10T23:34:01.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.359+0000 7f43fba98740 1 Processor -- start 2024-09-10T23:34:01.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.359+0000 7f43dbfff640 1 -- 172.21.15.2:0/3469827346 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f43e4009a30 con 0x7f43f4102dc0 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.359+0000 7f43fba98740 1 -- start start 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43fba98740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd083f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43fba98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd084b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43fba98740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd084e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43fba98740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558cd07b5ea0 con 0x558cd083f4d0 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43fba98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558cd07a52d0 con 0x558cd083fdf0 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43fba98740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558cd07a90e0 con 0x558cd084bd80 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd083f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd083f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57384/0 (socket says 172.21.15.2:57384) 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 -- 172.21.15.2:0/2725407357 learned_addr learned my addr 172.21.15.2:0/2725407357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd084b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f27fc640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd084e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 -- 172.21.15.2:0/2725407357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 msgr2=0x558cd084e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd084e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 -- 172.21.15.2:0/2725407357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 msgr2=0x558cd084b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd084b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 -- 172.21.15.2:0/2725407357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cd0503650 con 0x558cd083f4d0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f27fc640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd084e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd084b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43dbfff640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43dc0b52e0 0x7f43dc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.360+0000 7f43f37fe640 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd083f8b0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00db80 tx=0x7f43ec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ed4017c662e650 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43dc0b52e0 0x7f43dc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43d97fa640 1 -- 172.21.15.2:0/2725407357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00de70 con 0x558cd083f4d0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43d97fa640 1 -- 172.21.15.2:0/2725407357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ec017070 con 0x558cd083f4d0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43d97fa640 1 -- 172.21.15.2:0/2725407357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0107f0 con 0x558cd083f4d0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43dbfff640 1 -- 172.21.15.2:0/3469827346 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f43e40e57a0 con 0x7f43f4102dc0 2024-09-10T23:34:01.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43fba98740 1 -- 172.21.15.2:0/2725407357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 msgr2=0x558cd083f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43f2ffd640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43dc0b52e0 0x7f43dc0b77a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f43e40e3620 tx=0x7f43e40a7e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.361+0000 7f43fba98740 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd083f8b0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00db80 tx=0x7f43ec00f730 comp rx=0 tx=0).stop 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- 172.21.15.2:0/2725407357 shutdown_connections 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd084e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd084b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 --2- 172.21.15.2:0/2725407357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd083f8b0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- 172.21.15.2:0/2725407357 >> 172.21.15.2:0/2725407357 conn(0x558cd083d300 msgr2=0x558cd083e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- 172.21.15.2:0/2725407357 shutdown_connections 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- 172.21.15.2:0/2725407357 wait complete. 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- start start 2024-09-10T23:34:01.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 Processor -- start 2024-09-10T23:34:01.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083f4d0 0x558cd084b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083fdf0 0x558cd0848b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 0x558cd08491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558cd0606700 con 0x558cd084bd80 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558cd0740160 con 0x558cd083f4d0 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558cd084ea00 con 0x558cd083fdf0 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.362+0000 7f43fba98740 10 client.0 _ll_register_callbacks cb 0x558cd07599e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 0x558cd08491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 0x558cd08491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57400/0 (socket says 172.21.15.2:57400) 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 -- 172.21.15.2:0/1786455102 learned_addr learned my addr 172.21.15.2:0/1786455102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083f4d0 0x558cd084b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f27fc640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083fdf0 0x558cd0848b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 -- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083fdf0 msgr2=0x558cd0848b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083fdf0 0x558cd0848b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 -- 172.21.15.2:0/1786455102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083f4d0 msgr2=0x558cd084b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083f4d0 0x558cd084b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 -- 172.21.15.2:0/1786455102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cd076dc90 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f27fc640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083fdf0 0x558cd0848b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43f37fe640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 0x558cd08491c0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f43ec013040 tx=0x7f43ec0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652543c44e7492a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43d6ff5640 1 -- 172.21.15.2:0/1786455102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec025040 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43d6ff5640 1 -- 172.21.15.2:0/1786455102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f43ec004220 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.363+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec017070 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43d6ff5640 1 -- 172.21.15.2:0/1786455102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43ec004420 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 10 client.18810 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558cd085a350 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43d6ff5640 1 -- 172.21.15.2:0/1786455102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ec017070 con 0x558cd084bd80 2024-09-10T23:34:01.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43d6ff5640 1 -- 172.21.15.2:0/1786455102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43ec003ae0 con 0x558cd084bd80 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 10 client.18810 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 10 client.18810 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 20 client.18810 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd085b700 0x558cd085daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 4 client.18810 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cd07b7df0 con 0x558cd085b700 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.364+0000 7f43f27fc640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd085b700 0x558cd085daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.365+0000 7f43f27fc640 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd085b700 0x558cd085daf0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a4b775ac7e41ff83 server_cookie=a17cf7fa21074f1a in_seq=0 out_seq=0 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.365+0000 7f43d6ff5640 10 client.18810 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43d6ff5640 1 -- 172.21.15.2:0/1786455102 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558cd07b7df0 con 0x558cd085b700 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43d6ff5640 10 client.18810 handle_command_reply: tid=0 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 client.18810 shutdown 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 msgr2=0x558cd08491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 0x558cd08491c0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f43ec013040 tx=0x7f43ec0103d0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 shutdown_connections 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd085b700 0x558cd085daf0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd084bd80 0x558cd08491c0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083fdf0 0x558cd0848b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 --2- 172.21.15.2:0/1786455102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083f4d0 0x558cd084b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 >> 172.21.15.2:0/1786455102 conn(0x558cd083d300 msgr2=0x558cd0842e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43d6ff5640 0 client.18810 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 shutdown_connections 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 1 -- 172.21.15.2:0/1786455102 wait complete. 2024-09-10T23:34:01.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.366+0000 7f43fba98740 20 client.18810 trim_cache size 0 max 16384 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.379+0000 7f43fba98740 1 Processor -- start 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.379+0000 7f43fba98740 1 -- start start 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43fba98740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083f4d0 0x558cd0857c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43fba98740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 0x558cd083cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43fba98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd084bd80 0x558cd084d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43fba98740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41b05e0 con 0x558cd083fdf0 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43fba98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41b2120 con 0x558cd084bd80 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43fba98740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41b0cb0 con 0x558cd083f4d0 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 0x558cd083cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 0x558cd083cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57412/0 (socket says 172.21.15.2:57412) 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 -- 172.21.15.2:0/3531394470 learned_addr learned my addr 172.21.15.2:0/3531394470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f37fe640 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083f4d0 0x558cd0857c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f37fe640 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd084bd80 0x558cd084d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 -- 172.21.15.2:0/3531394470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083f4d0 msgr2=0x558cd0857c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083f4d0 0x558cd0857c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 -- 172.21.15.2:0/3531394470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd084bd80 msgr2=0x558cd084d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd084bd80 0x558cd084d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 -- 172.21.15.2:0/3531394470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cd083dfe0 con 0x558cd083fdf0 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f37fe640 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd084bd80 0x558cd084d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43f27fc640 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 0x558cd083cc10 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f43f4076f90 tx=0x7f43e8005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc032c5738a1dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43d8ff9640 1 -- 172.21.15.2:0/3531394470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8031450 con 0x558cd083fdf0 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43d8ff9640 1 -- 172.21.15.2:0/3531394470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e8048020 con 0x558cd083fdf0 2024-09-10T23:34:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.380+0000 7f43d8ff9640 1 -- 172.21.15.2:0/3531394470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8004030 con 0x558cd083fdf0 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 -- 172.21.15.2:0/3531394470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 msgr2=0x558cd083cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 0x558cd083cc10 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f43f4076f90 tx=0x7f43e8005f80 comp rx=0 tx=0).stop 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 -- 172.21.15.2:0/3531394470 shutdown_connections 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd084bd80 0x558cd084d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083fdf0 0x558cd083cc10 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 --2- 172.21.15.2:0/3531394470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd083f4d0 0x558cd0857c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 -- 172.21.15.2:0/3531394470 >> 172.21.15.2:0/3531394470 conn(0x558cd083d300 msgr2=0x558cd0843d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 -- 172.21.15.2:0/3531394470 shutdown_connections 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 -- 172.21.15.2:0/3531394470 wait complete. 2024-09-10T23:34:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 -- start start 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.381+0000 7f43fba98740 1 Processor -- start 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd0863bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd0853cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd0854460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41b1a50 con 0x558cd083f4d0 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41b1380 con 0x558cd083fdf0 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41ae5c0 con 0x558cd084bd80 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43fba98740 10 client.0 _ll_register_callbacks cb 0x7f43ec015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd0863bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd0863bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57420/0 (socket says 172.21.15.2:57420) 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 -- 172.21.15.2:0/27641015 learned_addr learned my addr 172.21.15.2:0/27641015 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 -- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 msgr2=0x558cd0854460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd0854460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 -- 172.21.15.2:0/27641015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 msgr2=0x558cd0853cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd0853cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 -- 172.21.15.2:0/27641015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cd084ec80 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43f37fe640 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd0863bd0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f43ec013010 tx=0x7f43ec010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a08d80f4d5a5ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.382+0000 7f43d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43d6ff5640 1 -- 172.21.15.2:0/27641015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec020070 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43d6ff5640 1 -- 172.21.15.2:0/27641015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f43ec010470 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43e8048020 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43d6ff5640 1 -- 172.21.15.2:0/27641015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43ec00dd30 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 10 client.18816 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558cd08c8710 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43d6ff5640 1 -- 172.21.15.2:0/27641015 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e8048020 con 0x558cd083f4d0 2024-09-10T23:34:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43d6ff5640 1 -- 172.21.15.2:0/27641015 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43ec005040 con 0x558cd083f4d0 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 10 client.18816 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 10 client.18816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 20 client.18816 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd08c8e90 0x558cd08cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 4 client.18816 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.383+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cd07b38a0 con 0x558cd08c8e90 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43f27fc640 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd08c8e90 0x558cd08cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43f27fc640 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd08c8e90 0x558cd08cb2b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc0ce8da76e5ecbe server_cookie=9a245304a4fdf81a in_seq=0 out_seq=0 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43d6ff5640 10 client.18816 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43d6ff5640 1 -- 172.21.15.2:0/27641015 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cd07b38a0 con 0x558cd08c8e90 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43d6ff5640 10 client.18816 handle_command_reply: tid=0 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43fba98740 1 client.18816 shutdown 2024-09-10T23:34:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 msgr2=0x558cd0863bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43fba98740 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd0863bd0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f43ec013010 tx=0x7f43ec010850 comp rx=0 tx=0).stop 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 shutdown_connections 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.384+0000 7f43fba98740 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x558cd08c8e90 0x558cd08cb2b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558cd084bd80 0x558cd0854460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cd083fdf0 0x558cd0853cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 1 --2- 172.21.15.2:0/27641015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558cd083f4d0 0x558cd0863bd0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43d6ff5640 0 client.18816 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 >> 172.21.15.2:0/27641015 conn(0x558cd083d300 msgr2=0x558cd084a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 shutdown_connections 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 1 -- 172.21.15.2:0/27641015 wait complete. 2024-09-10T23:34:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43fba98740 20 client.18816 trim_cache size 0 max 16384 2024-09-10T23:34:01.391 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43dc0b52e0 msgr2=0x7f43dc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43dc0b52e0 0x7f43dc0b77a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f43e40e3620 tx=0x7f43e40a7e10 comp rx=0 tx=0).stop 2024-09-10T23:34:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 msgr2=0x7f43f40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 0x7f43f40754a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f43e400d950 tx=0x7f43e400de10 comp rx=0 tx=0).stop 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 shutdown_connections 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f43dc0b52e0 0x7f43dc0b77a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43f4109150 0x7f43f4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43f41087d0 0x7f43f40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 --2- 172.21.15.2:0/3469827346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f4102dc0 0x7f43f40754a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 >> 172.21.15.2:0/3469827346 conn(0x7f43f40fe830 msgr2=0x7f43f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 shutdown_connections 2024-09-10T23:34:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:01.385+0000 7f43f96c3640 1 -- 172.21.15.2:0/3469827346 wait complete. 2024-09-10T23:34:01.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:01 smithi002 ceph-mon[31150]: pgmap v642: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:34:01.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:01 smithi154 ceph-mon[35136]: pgmap v642: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:34:01.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:01 smithi177 ceph-mon[35760]: pgmap v642: 97 pgs: 97 active+clean; 3.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:34:02.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:34:02.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:02.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 -- 172.21.15.2:0/1941103108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f797810d250 msgr2=0x7f797810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 --2- 172.21.15.2:0/1941103108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f797810d250 0x7f797810f640 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7970009ca0 tx=0x7f797002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 -- 172.21.15.2:0/1941103108 shutdown_connections 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 --2- 172.21.15.2:0/1941103108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f797810d250 0x7f797810f640 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 --2- 172.21.15.2:0/1941103108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810a920 0x7f797810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 --2- 172.21.15.2:0/1941103108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7978101810 0x7f7978101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 -- 172.21.15.2:0/1941103108 >> 172.21.15.2:0/1941103108 conn(0x7f7978076f50 msgr2=0x7f7978077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 -- 172.21.15.2:0/1941103108 shutdown_connections 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.901+0000 7f797dcc6640 1 -- 172.21.15.2:0/1941103108 wait complete. 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 Processor -- start 2024-09-10T23:34:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 -- start start 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 0x7f7978199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797810a920 0x7f7978199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810d250 0x7f797819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7978112d90 con 0x7f7978101810 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7978112c10 con 0x7f797810a920 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f797dcc6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7978112f10 con 0x7f797810d250 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f79777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 0x7f7978199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f79777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 0x7f7978199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57430/0 (socket says 172.21.15.2:57430) 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.902+0000 7f79777fe640 1 -- 172.21.15.2:0/3389835287 learned_addr learned my addr 172.21.15.2:0/3389835287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f796ffff640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797810a920 0x7f7978199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f7977fff640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810d250 0x7f797819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79777fe640 1 -- 172.21.15.2:0/3389835287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810d250 msgr2=0x7f797819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79777fe640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810d250 0x7f797819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79777fe640 1 -- 172.21.15.2:0/3389835287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797810a920 msgr2=0x7f7978199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79777fe640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797810a920 0x7f7978199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79777fe640 1 -- 172.21.15.2:0/3389835287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797819f2f0 con 0x7f7978101810 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f7977fff640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810d250 0x7f797819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f796ffff640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797810a920 0x7f7978199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79777fe640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 0x7f7978199240 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f796800d950 tx=0x7f796800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79757fa640 1 -- 172.21.15.2:0/3389835287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968017070 con 0x7f7978101810 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79757fa640 1 -- 172.21.15.2:0/3389835287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7968009c30 con 0x7f7978101810 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797819f5e0 con 0x7f7978101810 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f79757fa640 1 -- 172.21.15.2:0/3389835287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796800f620 con 0x7f7978101810 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.903+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79781a5ca0 con 0x7f7978101810 2024-09-10T23:34:02.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 Processor -- start 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f79757fa640 1 -- 172.21.15.2:0/3389835287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7968010460 con 0x7f7978101810 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 -- start start 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 0x5560b3ce28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cf2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3cf3190 0x5560b3cf5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560b3c58ea0 con 0x5560b3ce24d0 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560b3c482d0 con 0x5560b3cf3190 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f798009b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5560b3c4c0e0 con 0x5560b3ce2df0 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 0x5560b3ce28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 0x5560b3ce28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57442/0 (socket says 172.21.15.2:57442) 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 -- 172.21.15.2:0/2742636563 learned_addr learned my addr 172.21.15.2:0/2742636563 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f79777fe640 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cf2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f796ffff640 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3cf3190 0x5560b3cf5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 -- 172.21.15.2:0/2742636563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 msgr2=0x5560b3cf2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cf2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 -- 172.21.15.2:0/2742636563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3cf3190 msgr2=0x5560b3cf5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3cf3190 0x5560b3cf5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f7977fff640 1 -- 172.21.15.2:0/2742636563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560b39a6650 con 0x5560b3ce24d0 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f796ffff640 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3cf3190 0x5560b3cf5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.906+0000 7f79757fa640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f79640b52e0 0x7f79640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.907+0000 7f79777fe640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f79640b52e0 0x7f79640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.907+0000 7f7977fff640 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 0x5560b3ce28b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f7970009830 tx=0x7f7970009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b99bd270673959 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.907+0000 7f79757fa640 1 -- 172.21.15.2:0/3389835287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f79680e5910 con 0x7f7978101810 2024-09-10T23:34:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.907+0000 7f796dffb640 1 -- 172.21.15.2:0/2742636563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970031e30 con 0x5560b3ce24d0 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.907+0000 7f796dffb640 1 -- 172.21.15.2:0/2742636563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7970040070 con 0x5560b3ce24d0 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.907+0000 7f796dffb640 1 -- 172.21.15.2:0/2742636563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970004280 con 0x5560b3ce24d0 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 -- 172.21.15.2:0/2742636563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 msgr2=0x5560b3ce28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 0x5560b3ce28b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f7970009830 tx=0x7f7970009860 comp rx=0 tx=0).stop 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f79777fe640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f79640b52e0 0x7f79640b77a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f79680e3790 tx=0x7f7968093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 -- 172.21.15.2:0/2742636563 shutdown_connections 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3cf3190 0x5560b3cf5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cf2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 --2- 172.21.15.2:0/2742636563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce24d0 0x5560b3ce28b0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 -- 172.21.15.2:0/2742636563 >> 172.21.15.2:0/2742636563 conn(0x5560b3ce0300 msgr2=0x5560b3ce14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 -- 172.21.15.2:0/2742636563 shutdown_connections 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 -- 172.21.15.2:0/2742636563 wait complete. 2024-09-10T23:34:02.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 -- start start 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.908+0000 7f798009b740 1 Processor -- start 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cf2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 0x5560b3ceffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3cf3190 0x5560b3cf0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560b3aa9700 con 0x5560b3ce2df0 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560b3be3160 con 0x5560b3ce24d0 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5560b3cf5de0 con 0x5560b3cf3190 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 10 client.0 _ll_register_callbacks cb 0x5560b3bfc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 0x5560b3ceffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 0x5560b3ceffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57446/0 (socket says 172.21.15.2:57446) 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 -- 172.21.15.2:0/1154991881 learned_addr learned my addr 172.21.15.2:0/1154991881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f7977fff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cf2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f7977fff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3cf3190 0x5560b3cf0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 -- 172.21.15.2:0/1154991881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3cf3190 msgr2=0x5560b3cf0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3cf3190 0x5560b3cf0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 -- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 msgr2=0x5560b3cf2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cf2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 -- 172.21.15.2:0/1154991881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560b3c10c90 con 0x5560b3ce2df0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f796ffff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 0x5560b3ceffa0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f79600106a0 tx=0x7f7960010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5523432da818ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f7956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f7956ffd640 1 -- 172.21.15.2:0/1154991881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960010ea0 con 0x5560b3ce2df0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f7956ffd640 1 -- 172.21.15.2:0/1154991881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f796000ba20 con 0x5560b3ce2df0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.909+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7970040070 con 0x5560b3ce2df0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f7956ffd640 1 -- 172.21.15.2:0/1154991881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f796000bc20 con 0x5560b3ce2df0 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 10 client.18828 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560b3d017f0 con 0x5560b3ce2df0 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f7956ffd640 1 -- 172.21.15.2:0/1154991881 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7970040070 con 0x5560b3ce2df0 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f7956ffd640 1 -- 172.21.15.2:0/1154991881 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f796000f040 con 0x5560b3ce2df0 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 10 client.18828 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 10 client.18828 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 20 client.18828 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d02c00 0x5560b3d05040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 4 client.18828 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560b3c5adf0 con 0x5560b3d02c00 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.910+0000 7f7977fff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d02c00 0x5560b3d05040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.911+0000 7f7956ffd640 10 client.18828 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.911+0000 7f7977fff640 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d02c00 0x5560b3d05040 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=857cfd508bc3bf3d server_cookie=1f307bfcd376afc7 in_seq=0 out_seq=0 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.911+0000 7f7956ffd640 1 -- 172.21.15.2:0/1154991881 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560b3c5adf0 con 0x5560b3d02c00 2024-09-10T23:34:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.911+0000 7f7956ffd640 10 client.18828 handle_command_reply: tid=0 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 client.18828 shutdown 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 msgr2=0x5560b3ceffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 0x5560b3ceffa0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f79600106a0 tx=0x7f7960010b60 comp rx=0 tx=0).stop 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 shutdown_connections 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3cf3190 0x5560b3cf0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d02c00 0x5560b3d05040 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3ce2df0 0x5560b3ceffa0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 --2- 172.21.15.2:0/1154991881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cf2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f7956ffd640 0 client.18828 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 >> 172.21.15.2:0/1154991881 conn(0x5560b3ce0300 msgr2=0x5560b3cdf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 shutdown_connections 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 1 -- 172.21.15.2:0/1154991881 wait complete. 2024-09-10T23:34:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.912+0000 7f798009b740 20 client.18828 trim_cache size 0 max 16384 2024-09-10T23:34:02.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.925+0000 7f798009b740 1 Processor -- start 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.925+0000 7f798009b740 1 -- start start 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f798009b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cdfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f798009b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f798009b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3d0a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f798009b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79781ac1c0 con 0x5560b3cf3190 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f798009b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79781add00 con 0x5560b3ce24d0 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f798009b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79781ac890 con 0x5560b3ce2df0 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3d0a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3d0a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57450/0 (socket says 172.21.15.2:57450) 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 -- 172.21.15.2:0/1760076009 learned_addr learned my addr 172.21.15.2:0/1760076009 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cdfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f796ffff640 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 -- 172.21.15.2:0/1760076009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 msgr2=0x5560b3cff040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cff040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 -- 172.21.15.2:0/1760076009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 msgr2=0x5560b3cdfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cdfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 -- 172.21.15.2:0/1760076009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560b3cee4a0 con 0x5560b3cf3190 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f796ffff640 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f7977fff640 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3d0a910 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7970005cc0 tx=0x7f7970005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c509b372eba4d132 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.926+0000 7f796d7fa640 1 -- 172.21.15.2:0/1760076009 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970003dc0 con 0x5560b3cf3190 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f796d7fa640 1 -- 172.21.15.2:0/1760076009 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7970040070 con 0x5560b3cf3190 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f796d7fa640 1 -- 172.21.15.2:0/1760076009 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970004810 con 0x5560b3cf3190 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 -- 172.21.15.2:0/1760076009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 msgr2=0x5560b3d0a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3d0a910 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7970005cc0 tx=0x7f7970005c30 comp rx=0 tx=0).stop 2024-09-10T23:34:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 -- 172.21.15.2:0/1760076009 shutdown_connections 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3d0a910 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce2df0 0x5560b3cff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 --2- 172.21.15.2:0/1760076009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce24d0 0x5560b3cdfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 -- 172.21.15.2:0/1760076009 >> 172.21.15.2:0/1760076009 conn(0x5560b3ce0300 msgr2=0x5560b3ce1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 -- 172.21.15.2:0/1760076009 shutdown_connections 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.927+0000 7f798009b740 1 -- 172.21.15.2:0/1760076009 wait complete. 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 -- start start 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 Processor -- start 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce24d0 0x5560b3cfb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce2df0 0x5560b3cfb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3cf8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79781ad630 con 0x5560b3cf3190 2024-09-10T23:34:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79781acf60 con 0x5560b3ce2df0 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79781aa1a0 con 0x5560b3ce24d0 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f798009b740 10 client.0 _ll_register_callbacks cb 0x7f796000e390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.928+0000 7f7977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3cf8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3cf8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57452/0 (socket says 172.21.15.2:57452) 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 -- 172.21.15.2:0/622166154 learned_addr learned my addr 172.21.15.2:0/622166154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce24d0 0x5560b3cfb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f796ffff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce2df0 0x5560b3cfb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 -- 172.21.15.2:0/622166154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce24d0 msgr2=0x5560b3cfb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce24d0 0x5560b3cfb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 -- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce2df0 msgr2=0x5560b3cfb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce2df0 0x5560b3cfb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 -- 172.21.15.2:0/622166154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560b3cfbdf0 con 0x5560b3cf3190 2024-09-10T23:34:02.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7977fff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3cf8070 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7970009430 tx=0x7f797003e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41115a91305daa41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7956ffd640 1 -- 172.21.15.2:0/622166154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970004240 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f7956ffd640 1 -- 172.21.15.2:0/622166154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7970031450 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.929+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7970040070 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f7956ffd640 1 -- 172.21.15.2:0/622166154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7970031650 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 10 client.18834 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560b3d70120 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f7956ffd640 1 -- 172.21.15.2:0/622166154 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7970040070 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f7956ffd640 1 -- 172.21.15.2:0/622166154 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7970053040 con 0x5560b3cf3190 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 10 client.18834 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 10 client.18834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 20 client.18834 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d70350 0x5560b3d72740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:02.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 4 client.18834 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:02.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560b3c568a0 con 0x5560b3d70350 2024-09-10T23:34:02.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.930+0000 7f796ffff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d70350 0x5560b3d72740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f796ffff640 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d70350 0x5560b3d72740 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5be77dd4064f4026 server_cookie=8d2f0a4a61df7566 in_seq=0 out_seq=0 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f7956ffd640 10 client.18834 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f7956ffd640 1 -- 172.21.15.2:0/622166154 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560b3c568a0 con 0x5560b3d70350 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f7956ffd640 10 client.18834 handle_command_reply: tid=0 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 client.18834 shutdown 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 msgr2=0x5560b3cf8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3cf8070 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7970009430 tx=0x7f797003e040 comp rx=0 tx=0).stop 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 shutdown_connections 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x5560b3d70350 0x5560b3d72740 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560b3cf3190 0x5560b3cf8070 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5560b3ce2df0 0x5560b3cfb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 --2- 172.21.15.2:0/622166154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560b3ce24d0 0x5560b3cfb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 >> 172.21.15.2:0/622166154 conn(0x5560b3ce0300 msgr2=0x5560b3cf15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f7956ffd640 0 client.18834 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 shutdown_connections 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 1 -- 172.21.15.2:0/622166154 wait complete. 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.931+0000 7f798009b740 20 client.18834 trim_cache size 0 max 16384 2024-09-10T23:34:02.938 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:02.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f79640b52e0 msgr2=0x7f79640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f79640b52e0 0x7f79640b77a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f79680e3790 tx=0x7f7968093040 comp rx=0 tx=0).stop 2024-09-10T23:34:02.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 msgr2=0x7f7978199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:02.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 0x7f7978199240 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f796800d950 tx=0x7f796800de10 comp rx=0 tx=0).stop 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 shutdown_connections 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f79640b52e0 0x7f79640b77a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f797810d250 0x7f797819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797810a920 0x7f7978199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 --2- 172.21.15.2:0/3389835287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978101810 0x7f7978199240 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 >> 172.21.15.2:0/3389835287 conn(0x7f7978076f50 msgr2=0x7f79781005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 shutdown_connections 2024-09-10T23:34:02.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:02.932+0000 7f797dcc6640 1 -- 172.21.15.2:0/3389835287 wait complete. 2024-09-10T23:34:03.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:03 smithi002 ceph-mon[31150]: pgmap v643: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:34:03.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:34:03.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:03 smithi154 ceph-mon[35136]: pgmap v643: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:34:03.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:03 smithi177 ceph-mon[35760]: pgmap v643: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:34:04.038 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:04.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/1212805840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e8108060 msgr2=0x7fa4e810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/1212805840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e8108060 0x7fa4e810e860 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009ca0 tx=0x7fa4e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/1212805840 shutdown_connections 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/1212805840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e8108060 0x7fa4e810e860 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/1212805840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e81076e0 0x7fa4e8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/1212805840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8101cd0 0x7fa4e81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/1212805840 >> 172.21.15.2:0/1212805840 conn(0x7fa4e80fd700 msgr2=0x7fa4e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/1212805840 shutdown_connections 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.537+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/1212805840 wait complete. 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 Processor -- start 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 -- start start 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e8101cd0 0x7fa4e80fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 0x7fa4e80fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8108060 0x7fa4e80fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8111d20 con 0x7fa4e81076e0 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8111ba0 con 0x7fa4e8101cd0 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4ed5e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8111ea0 con 0x7fa4e8108060 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4de7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 0x7fa4e80fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4de7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 0x7fa4e80fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57464/0 (socket says 172.21.15.2:57464) 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4de7fc640 1 -- 172.21.15.2:0/438045145 learned_addr learned my addr 172.21.15.2:0/438045145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8108060 0x7fa4e80fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.538+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e8101cd0 0x7fa4e80fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4de7fc640 1 -- 172.21.15.2:0/438045145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8108060 msgr2=0x7fa4e80fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8108060 0x7fa4e80fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4de7fc640 1 -- 172.21.15.2:0/438045145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e8101cd0 msgr2=0x7fa4e80fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e8101cd0 0x7fa4e80fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4de7fc640 1 -- 172.21.15.2:0/438045145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e81a7680 con 0x7fa4e81076e0 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8108060 0x7fa4e80fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:04.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e8101cd0 0x7fa4e80fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 0x7fa4e80fe140 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c920 tx=0x7fa4d000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4e4ff9640 1 -- 172.21.15.2:0/438045145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0007c70 con 0x7fa4e81076e0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e81a7970 con 0x7fa4e81076e0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4e4ff9640 1 -- 172.21.15.2:0/438045145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d0007e10 con 0x7fa4e81076e0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4e4ff9640 1 -- 172.21.15.2:0/438045145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0018820 con 0x7fa4e81076e0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.539+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e81a7f00 con 0x7fa4e81076e0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.541+0000 7fa4e4ff9640 1 -- 172.21.15.2:0/438045145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa4d000f450 con 0x7fa4e81076e0 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 Processor -- start 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 -- start start 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db3e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db4a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db4ad80 0x55bc8db4d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc8dab4ea0 con 0x55bc8db3edf0 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc8daa42d0 con 0x55bc8db4ad80 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc8daa80e0 con 0x55bc8db3e4d0 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db4a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db4a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57480/0 (socket says 172.21.15.2:57480) 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/1730204516 learned_addr learned my addr 172.21.15.2:0/1730204516 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db3e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.542+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db4ad80 0x55bc8db4d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/1730204516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 msgr2=0x55bc8db3e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db3e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/1730204516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db4ad80 msgr2=0x55bc8db4d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db4ad80 0x55bc8db4d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/1730204516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc8d802650 con 0x55bc8db3edf0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e4ff9640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4d40b52e0 0x7fa4d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db4ad80 0x55bc8db4d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4d40b52e0 0x7fa4d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db4a840 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009c50 tx=0x7fa4d800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b450b1636e12c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4e4ff9640 1 -- 172.21.15.2:0/438045145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa4d00e5da0 con 0x7fa4e81076e0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4dd7fa640 1 -- 172.21.15.2:0/1730204516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8016070 con 0x55bc8db3edf0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4dd7fa640 1 -- 172.21.15.2:0/1730204516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d8011920 con 0x55bc8db3edf0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.543+0000 7fa4dd7fa640 1 -- 172.21.15.2:0/1730204516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8010810 con 0x55bc8db3edf0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1730204516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 msgr2=0x55bc8db4a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4d40b52e0 0x7fa4d40b77a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009a60 tx=0x7fa4e0005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db4a840 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009c50 tx=0x7fa4d800e6c0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1730204516 shutdown_connections 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db4ad80 0x55bc8db4d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db4a840 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1730204516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db3e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1730204516 >> 172.21.15.2:0/1730204516 conn(0x55bc8db3c300 msgr2=0x55bc8db3d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1730204516 shutdown_connections 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1730204516 wait complete. 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 -- start start 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.544+0000 7fa4ef9b6740 1 Processor -- start 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db4a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db47a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 0x55bc8db47ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc8d905700 con 0x55bc8db4ad80 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc8da3f160 con 0x55bc8db3edf0 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc8db4da00 con 0x55bc8db3e4d0 2024-09-10T23:34:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ef9b6740 10 client.0 _ll_register_callbacks cb 0x55bc8da589e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 0x55bc8db47ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 0x55bc8db47ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57482/0 (socket says 172.21.15.2:57482) 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 -- 172.21.15.2:0/423069350 learned_addr learned my addr 172.21.15.2:0/423069350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db47a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db4a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 -- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 msgr2=0x55bc8db4a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db4a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 -- 172.21.15.2:0/423069350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 msgr2=0x55bc8db47a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db47a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 -- 172.21.15.2:0/423069350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc8da6cc90 con 0x55bc8db4ad80 2024-09-10T23:34:04.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db4a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 0x55bc8db47ff0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0035000 tx=0x7fa4e002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39edc2fd6982d47f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.545+0000 7fa4ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/423069350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0004040 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/423069350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa4e00041e0 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4d8011920 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/423069350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4e0004420 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 10 client.18846 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc8db59270 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/423069350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d8011920 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/423069350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4e0051070 con 0x55bc8db4ad80 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 10 client.18846 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 10 client.18846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:04.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 20 client.18846 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8db5a6d0 0x55bc8db5cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 4 client.18846 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.546+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc8dab6df0 con 0x55bc8db5a6d0 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.547+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8db5a6d0 0x55bc8db5cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.547+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8db5a6d0 0x55bc8db5cb10 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc9b45c9799c1dfe server_cookie=c376abed3a4b527e in_seq=0 out_seq=0 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.547+0000 7fa4ce7fc640 10 client.18846 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/423069350 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc8dab6df0 con 0x55bc8db5a6d0 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ce7fc640 10 client.18846 handle_command_reply: tid=0 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 client.18846 shutdown 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 msgr2=0x55bc8db47ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 0x55bc8db47ff0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0035000 tx=0x7fa4e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 shutdown_connections 2024-09-10T23:34:04.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8db5a6d0 0x55bc8db5cb10 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db4ad80 0x55bc8db47ff0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db47a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ce7fc640 0 client.18846 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/423069350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db3e4d0 0x55bc8db4a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 >> 172.21.15.2:0/423069350 conn(0x55bc8db3c300 msgr2=0x55bc8db41ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 shutdown_connections 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/423069350 wait complete. 2024-09-10T23:34:04.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.548+0000 7fa4ef9b6740 20 client.18846 trim_cache size 0 max 16384 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.561+0000 7fa4ef9b6740 1 Processor -- start 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.561+0000 7fa4ef9b6740 1 -- start start 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 0x55bc8db42410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db3da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db44c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e81b0550 con 0x55bc8db3e4d0 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e81b2090 con 0x55bc8db3edf0 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e81b0c20 con 0x55bc8db4ad80 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 0x55bc8db42410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 0x55bc8db42410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57498/0 (socket says 172.21.15.2:57498) 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/2016742212 learned_addr learned my addr 172.21.15.2:0/2016742212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db3da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db44c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/2016742212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 msgr2=0x55bc8db44c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db44c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/2016742212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 msgr2=0x55bc8db3da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db3da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e6ffd640 1 -- 172.21.15.2:0/2016742212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc8db5d190 con 0x55bc8db3e4d0 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.562+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db44c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 0x55bc8db42410 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009de0 tx=0x7fa4d800efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ea4e0349a8b7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4dcff9640 1 -- 172.21.15.2:0/2016742212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8016040 con 0x55bc8db3e4d0 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4dcff9640 1 -- 172.21.15.2:0/2016742212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d8004620 con 0x55bc8db3e4d0 2024-09-10T23:34:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4dcff9640 1 -- 172.21.15.2:0/2016742212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8029690 con 0x55bc8db3e4d0 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/2016742212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 msgr2=0x55bc8db42410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 0x55bc8db42410 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009de0 tx=0x7fa4d800efa0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/2016742212 shutdown_connections 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db44c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3edf0 0x55bc8db3da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/2016742212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3e4d0 0x55bc8db42410 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.563+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/2016742212 >> 172.21.15.2:0/2016742212 conn(0x55bc8db3c300 msgr2=0x55bc8db3d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/2016742212 shutdown_connections 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/2016742212 wait complete. 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 -- start start 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 Processor -- start 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3e4d0 0x55bc8db52ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db53470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db4dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e81b19c0 con 0x55bc8db3edf0 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e81b12f0 con 0x55bc8db3e4d0 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e81ae530 con 0x55bc8db4ad80 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4ef9b6740 10 client.0 _ll_register_callbacks cb 0x7fa4e0009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4de7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db53470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4de7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db53470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57512/0 (socket says 172.21.15.2:57512) 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.564+0000 7fa4de7fc640 1 -- 172.21.15.2:0/1226053100 learned_addr learned my addr 172.21.15.2:0/1226053100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3e4d0 0x55bc8db52ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db4dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4de7fc640 1 -- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 msgr2=0x55bc8db4dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db4dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4de7fc640 1 -- 172.21.15.2:0/1226053100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3e4d0 msgr2=0x55bc8db52ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3e4d0 0x55bc8db52ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4de7fc640 1 -- 172.21.15.2:0/1226053100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc8db4e4b0 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4e77fe640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db4dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4de7fc640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db53470 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa4d001f000 tx=0x7fa4d000fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e40af20f85bb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/1226053100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0097030 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/1226053100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa4d00ac970 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4d8004620 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/1226053100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4d00acc10 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ef9b6740 10 client.18852 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc8dbc8090 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.565+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/1226053100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d8004620 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/1226053100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4d00ab770 con 0x55bc8db3edf0 2024-09-10T23:34:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ef9b6740 10 client.18852 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ef9b6740 10 client.18852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ef9b6740 20 client.18852 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8dbc8840 0x55bc8dbcac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ef9b6740 4 client.18852 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc8dab28a0 con 0x55bc8dbc8840 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8dbc8840 0x55bc8dbcac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4e6ffd640 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8dbc8840 0x55bc8dbcac60 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d4e6375358e5097 server_cookie=a8cdd4b01f584537 in_seq=0 out_seq=0 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.566+0000 7fa4ce7fc640 10 client.18852 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ce7fc640 1 -- 172.21.15.2:0/1226053100 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc8dab28a0 con 0x55bc8dbc8840 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ce7fc640 10 client.18852 handle_command_reply: tid=0 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 client.18852 shutdown 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 msgr2=0x55bc8db53470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db53470 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa4d001f000 tx=0x7fa4d000fcc0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 shutdown_connections 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55bc8dbc8840 0x55bc8dbcac60 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bc8db4ad80 0x55bc8db4dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc8db3edf0 0x55bc8db53470 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 --2- 172.21.15.2:0/1226053100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8db3e4d0 0x55bc8db52ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 >> 172.21.15.2:0/1226053100 conn(0x55bc8db3c300 msgr2=0x55bc8db3ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ce7fc640 0 client.18852 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 shutdown_connections 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 1 -- 172.21.15.2:0/1226053100 wait complete. 2024-09-10T23:34:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.567+0000 7fa4ef9b6740 20 client.18852 trim_cache size 0 max 16384 2024-09-10T23:34:04.583 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4d40b52e0 msgr2=0x7fa4d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4d40b52e0 0x7fa4d40b77a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009a60 tx=0x7fa4e0005c30 comp rx=0 tx=0).stop 2024-09-10T23:34:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 msgr2=0x7fa4e80fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 0x7fa4e80fe140 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c920 tx=0x7fa4d000cde0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 shutdown_connections 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa4d40b52e0 0x7fa4d40b77a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e8108060 0x7fa4e80fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4e81076e0 0x7fa4e80fe140 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 --2- 172.21.15.2:0/438045145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4e8101cd0 0x7fa4e80fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 >> 172.21.15.2:0/438045145 conn(0x7fa4e80fd700 msgr2=0x7fa4e806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 shutdown_connections 2024-09-10T23:34:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:04.568+0000 7fa4ed5e1640 1 -- 172.21.15.2:0/438045145 wait complete. 2024-09-10T23:34:05.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:05 smithi002 ceph-mon[31150]: pgmap v644: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:05.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:05 smithi154 ceph-mon[35136]: pgmap v644: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:05.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:05 smithi177 ceph-mon[35760]: pgmap v644: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:06.432 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:34:06.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:34:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:07.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 -- 172.21.15.2:0/709475391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188103ca0 msgr2=0x7f3188104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 --2- 172.21.15.2:0/709475391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188103ca0 0x7f3188104080 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3180009900 tx=0x7f318002a410 comp rx=0 tx=0).stop 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 -- 172.21.15.2:0/709475391 shutdown_connections 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 --2- 172.21.15.2:0/709475391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f318810d100 0x7f318810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 --2- 172.21.15.2:0/709475391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31881045c0 0x7f318810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 --2- 172.21.15.2:0/709475391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188103ca0 0x7f3188104080 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 -- 172.21.15.2:0/709475391 >> 172.21.15.2:0/709475391 conn(0x7f31880fd700 msgr2=0x7f31880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 -- 172.21.15.2:0/709475391 shutdown_connections 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.156+0000 7f318ca6d640 1 -- 172.21.15.2:0/709475391 wait complete. 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 Processor -- start 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 -- start start 2024-09-10T23:34:07.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188103ca0 0x7f3188101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 0x7f3188101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f318810d100 0x7f31881023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3188112dc0 con 0x7f31881045c0 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3188112c40 con 0x7f3188103ca0 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f318ca6d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3188112f40 con 0x7f318810d100 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 0x7f3188101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 0x7f3188101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57518/0 (socket says 172.21.15.2:57518) 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.157+0000 7f3185d9b640 1 -- 172.21.15.2:0/3399752219 learned_addr learned my addr 172.21.15.2:0/3399752219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f318659c640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188103ca0 0x7f3188101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f318810d100 0x7f31881023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3185d9b640 1 -- 172.21.15.2:0/3399752219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f318810d100 msgr2=0x7f31881023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f318810d100 0x7f31881023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3185d9b640 1 -- 172.21.15.2:0/3399752219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188103ca0 msgr2=0x7f3188101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188103ca0 0x7f3188101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3185d9b640 1 -- 172.21.15.2:0/3399752219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31881a76b0 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f318810d100 0x7f31881023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 0x7f3188101e90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f317000d740 tx=0x7f317000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f317f7fe640 1 -- 172.21.15.2:0/3399752219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170017020 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31881a79a0 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f317f7fe640 1 -- 172.21.15.2:0/3399752219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f317000de50 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f317f7fe640 1 -- 172.21.15.2:0/3399752219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317000f620 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.158+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31881a7ee0 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 Processor -- start 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f317f7fe640 1 -- 172.21.15.2:0/3399752219 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3170010460 con 0x7f31881045c0 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 -- start start 2024-09-10T23:34:07.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f71250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f73b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b4c5edbe60 con 0x55b4c5f65800 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4c5ecb290 con 0x55b4c5f64ee0 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318ee42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b4c5ecf0a0 con 0x55b4c5f71790 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f71250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f71250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57522/0 (socket says 172.21.15.2:57522) 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.161+0000 7f318659c640 1 -- 172.21.15.2:0/1881088505 learned_addr learned my addr 172.21.15.2:0/1881088505 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f3186d9d640 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f3185d9b640 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f73b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f318659c640 1 -- 172.21.15.2:0/1881088505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 msgr2=0x55b4c5f73b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f318659c640 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f73b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f317f7fe640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31740b52e0 0x7f31740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f318659c640 1 -- 172.21.15.2:0/1881088505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 msgr2=0x55b4c5f652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f318659c640 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f318659c640 1 -- 172.21.15.2:0/1881088505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c5c29930 con 0x55b4c5f65800 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31740b52e0 0x7f31740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.162+0000 7f317f7fe640 1 -- 172.21.15.2:0/3399752219 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f31700e5840 con 0x7f31881045c0 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.163+0000 7f318659c640 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f71250 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3180033000 tx=0x7f3180004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95dfe684e5e211a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.163+0000 7f317cff9640 1 -- 172.21.15.2:0/1881088505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318003f070 con 0x55b4c5f65800 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.163+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31740b52e0 0x7f31740b77a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f31780092f0 tx=0x7f3178004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.163+0000 7f317cff9640 1 -- 172.21.15.2:0/1881088505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3180005500 con 0x55b4c5f65800 2024-09-10T23:34:07.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.163+0000 7f317cff9640 1 -- 172.21.15.2:0/1881088505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180035070 con 0x55b4c5f65800 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 -- 172.21.15.2:0/1881088505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 msgr2=0x55b4c5f71250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f71250 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3180033000 tx=0x7f3180004170 comp rx=0 tx=0).stop 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 -- 172.21.15.2:0/1881088505 shutdown_connections 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f73b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f71250 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 --2- 172.21.15.2:0/1881088505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 -- 172.21.15.2:0/1881088505 >> 172.21.15.2:0/1881088505 conn(0x55b4c5f62d10 msgr2=0x55b4c5f63eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 -- 172.21.15.2:0/1881088505 shutdown_connections 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.164+0000 7f318ee42740 1 -- 172.21.15.2:0/1881088505 wait complete. 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 -- start start 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 Processor -- start 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f6e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f65800 0x55b4c5f6ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b4c5d2c890 con 0x55b4c5f64ee0 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4c5e65d40 con 0x55b4c5f65800 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b4c5f743e0 con 0x55b4c5f71790 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318ee42740 10 client.0 _ll_register_callbacks cb 0x55b4c5ec9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f6e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f6e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57536/0 (socket says 172.21.15.2:57536) 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f318659c640 1 -- 172.21.15.2:0/3454573456 learned_addr learned my addr 172.21.15.2:0/3454573456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f65800 0x55b4c5f6ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.165+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318659c640 1 -- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 msgr2=0x55b4c5f6f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318659c640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318659c640 1 -- 172.21.15.2:0/3454573456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f65800 msgr2=0x55b4c5f6ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318659c640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f65800 0x55b4c5f6ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318659c640 1 -- 172.21.15.2:0/3454573456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c5f7d7a0 con 0x55b4c5f64ee0 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318659c640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f6e6c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3180004c20 tx=0x7f31800058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9768bdf4dd7daeac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f316dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:07.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f316dffb640 1 -- 172.21.15.2:0/3454573456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318004d060 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f316dffb640 1 -- 172.21.15.2:0/3454573456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f31800035f0 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3180005500 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f316dffb640 1 -- 172.21.15.2:0/3454573456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f318003f070 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318ee42740 10 client.18864 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.166+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4c5f80130 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f316dffb640 1 -- 172.21.15.2:0/3454573456 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3180005500 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f316dffb640 1 -- 172.21.15.2:0/3454573456 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3180031770 con 0x55b4c5f64ee0 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f318ee42740 10 client.18864 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f318ee42740 10 client.18864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f318ee42740 20 client.18864 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f318ee42740 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5f81480 0x55b4c5f83870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f318ee42740 4 client.18864 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4c5edddb0 con 0x55b4c5f81480 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.167+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5f81480 0x55b4c5f83870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.168+0000 7f316dffb640 10 client.18864 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.168+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5f81480 0x55b4c5f83870 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb88ff19f03859a server_cookie=ed9ad64d6a6f60c3 in_seq=0 out_seq=0 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f316dffb640 1 -- 172.21.15.2:0/3454573456 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4c5edddb0 con 0x55b4c5f81480 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f316dffb640 10 client.18864 handle_command_reply: tid=0 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 client.18864 shutdown 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 msgr2=0x55b4c5f6e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f6e6c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3180004c20 tx=0x7f31800058f0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 shutdown_connections 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5f81480 0x55b4c5f83870 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f65800 0x55b4c5f6ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 --2- 172.21.15.2:0/3454573456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f6e6c0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 >> 172.21.15.2:0/3454573456 conn(0x55b4c5f62d10 msgr2=0x55b4c5f61f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:07.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f316dffb640 0 client.18864 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:07.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 shutdown_connections 2024-09-10T23:34:07.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 1 -- 172.21.15.2:0/3454573456 wait complete. 2024-09-10T23:34:07.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.169+0000 7f318ee42740 20 client.18864 trim_cache size 0 max 16384 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 Processor -- start 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 -- start start 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f70400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f6b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b0580 con 0x55b4c5f65800 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b20c0 con 0x55b4c5f64ee0 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.187+0000 7f318ee42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b0c50 con 0x55b4c5f71790 2024-09-10T23:34:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f6b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f6b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57548/0 (socket says 172.21.15.2:57548) 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 -- 172.21.15.2:0/2004052385 learned_addr learned my addr 172.21.15.2:0/2004052385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3186d9d640 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 -- 172.21.15.2:0/2004052385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 msgr2=0x55b4c5f6be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 -- 172.21.15.2:0/2004052385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 msgr2=0x55b4c5f70400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f70400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 -- 172.21.15.2:0/2004052385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c5f5e3d0 con 0x55b4c5f65800 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3186d9d640 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f3185d9b640 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f6b8f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3170009610 tx=0x7f31700cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d474c8112c2d208 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f316ffff640 1 -- 172.21.15.2:0/2004052385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31700ac710 con 0x55b4c5f65800 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f316ffff640 1 -- 172.21.15.2:0/2004052385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31700ac010 con 0x55b4c5f65800 2024-09-10T23:34:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.188+0000 7f316ffff640 1 -- 172.21.15.2:0/2004052385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170010780 con 0x55b4c5f65800 2024-09-10T23:34:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 -- 172.21.15.2:0/2004052385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 msgr2=0x55b4c5f6b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f6b8f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3170009610 tx=0x7f31700cf040 comp rx=0 tx=0).stop 2024-09-10T23:34:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 -- 172.21.15.2:0/2004052385 shutdown_connections 2024-09-10T23:34:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5f6be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f6b8f0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 --2- 172.21.15.2:0/2004052385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f70400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 -- 172.21.15.2:0/2004052385 >> 172.21.15.2:0/2004052385 conn(0x55b4c5f62d10 msgr2=0x55b4c5f6fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 -- 172.21.15.2:0/2004052385 shutdown_connections 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.189+0000 7f318ee42740 1 -- 172.21.15.2:0/2004052385 wait complete. 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 -- start start 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 Processor -- start 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f77eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5fed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b19f0 con 0x55b4c5f65800 2024-09-10T23:34:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b1320 con 0x55b4c5f64ee0 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31881ae560 con 0x55b4c5f71790 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318ee42740 10 client.0 _ll_register_callbacks cb 0x7f3178009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f783f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57552/0 (socket says 172.21.15.2:57552) 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 -- 172.21.15.2:0/3762372527 learned_addr learned my addr 172.21.15.2:0/3762372527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f318659c640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f77eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3186d9d640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5fed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 -- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 msgr2=0x55b4c5fed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5fed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 -- 172.21.15.2:0/3762372527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 msgr2=0x55b4c5f77eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f77eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.190+0000 7f3185d9b640 1 -- 172.21.15.2:0/3762372527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c5fed770 con 0x55b4c5f65800 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f3185d9b640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f783f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f31700a9280 tx=0x7f31700ac710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697567780fe4051b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f316dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f316dffb640 1 -- 172.21.15.2:0/3762372527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170010780 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f316dffb640 1 -- 172.21.15.2:0/3762372527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f3170010920 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31700ac010 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f316dffb640 1 -- 172.21.15.2:0/3762372527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31700b5110 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 10 client.18870 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4c5feea00 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f316dffb640 1 -- 172.21.15.2:0/3762372527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31700ac010 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f316dffb640 1 -- 172.21.15.2:0/3762372527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f31700aace0 con 0x55b4c5f65800 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 10 client.18870 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 10 client.18870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 20 client.18870 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5feefa0 0x55b4c5ff13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 4 client.18870 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:34:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.191+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b4c5f83c60 con 0x55b4c5feefa0 2024-09-10T23:34:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.192+0000 7f318659c640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5feefa0 0x55b4c5ff13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.192+0000 7f318659c640 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5feefa0 0x55b4c5ff13c0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe940c5ed92407bb server_cookie=284fb6ec71a69283 in_seq=0 out_seq=0 2024-09-10T23:34:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.192+0000 7f316dffb640 10 client.18870 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.193+0000 7f316dffb640 1 -- 172.21.15.2:0/3762372527 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b4c5f83c60 con 0x55b4c5feefa0 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.193+0000 7f316dffb640 10 client.18870 handle_command_reply: tid=0 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.193+0000 7f318ee42740 1 client.18870 shutdown 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 msgr2=0x55b4c5f783f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f783f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f31700a9280 tx=0x7f31700ac710 comp rx=0 tx=0).stop 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 shutdown_connections 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55b4c5feefa0 0x55b4c5ff13c0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c5f71790 0x55b4c5fed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4c5f65800 0x55b4c5f783f0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f316dffb640 0 client.18870 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 --2- 172.21.15.2:0/3762372527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4c5f64ee0 0x55b4c5f77eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 >> 172.21.15.2:0/3762372527 conn(0x55b4c5f62d10 msgr2=0x55b4c5f70510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 shutdown_connections 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 1 -- 172.21.15.2:0/3762372527 wait complete. 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ee42740 20 client.18870 trim_cache size 0 max 16384 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7781c901-0381-483c-8ccc-ce03feed1938", 2024-09-10T23:34:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:34:07.200 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:34:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31740b52e0 msgr2=0x7f31740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ca6d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31740b52e0 0x7f31740b77a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f31780092f0 tx=0x7f3178004a40 comp rx=0 tx=0).stop 2024-09-10T23:34:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 msgr2=0x7f3188101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.194+0000 7f318ca6d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 0x7f3188101e90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f317000d740 tx=0x7f317000dc00 comp rx=0 tx=0).stop 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 shutdown_connections 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f31740b52e0 0x7f31740b77a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f318810d100 0x7f31881023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31881045c0 0x7f3188101e90 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 --2- 172.21.15.2:0/3399752219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188103ca0 0x7f3188101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 >> 172.21.15.2:0/3399752219 conn(0x7f31880fd700 msgr2=0x7f31880fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 shutdown_connections 2024-09-10T23:34:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:07.195+0000 7f318ca6d640 1 -- 172.21.15.2:0/3399752219 wait complete. 2024-09-10T23:34:07.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:07 smithi002 ceph-mon[31150]: pgmap v645: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:07.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:07 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:34:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:07 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:34:07.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:07 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:07.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:07 smithi154 ceph-mon[35136]: pgmap v645: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:07 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:34:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:07 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:34:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:07 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:07 smithi177 ceph-mon[35760]: pgmap v645: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:07 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:34:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:07 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:34:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:07 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:08.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:34:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:08.714 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:08 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:34:08.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:08 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 -- 172.21.15.2:0/1111527121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0107780 msgr2=0x7fe1a0107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1111527121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0107780 0x7fe1a0107be0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe190009900 tx=0x7fe19002a410 comp rx=0 tx=0).stop 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 -- 172.21.15.2:0/1111527121 shutdown_connections 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1111527121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1a0108120 0x7fe1a010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1111527121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0107780 0x7fe1a0107be0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1111527121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a0102920 0x7fe1a0102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 -- 172.21.15.2:0/1111527121 >> 172.21.15.2:0/1111527121 conn(0x7fe1a0076f50 msgr2=0x7fe1a0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:08.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 -- 172.21.15.2:0/1111527121 shutdown_connections 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 -- 172.21.15.2:0/1111527121 wait complete. 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.798+0000 7fe1a854c640 1 Processor -- start 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 -- start start 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 0x7fe1a019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1a0107780 0x7fe1a019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a0108120 0x7fe1a019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0111c60 con 0x7fe1a0102920 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0111ae0 con 0x7fe1a0108120 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a854c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0111de0 con 0x7fe1a0107780 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 0x7fe1a019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 0x7fe1a019a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57578/0 (socket says 172.21.15.2:57578) 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 -- 172.21.15.2:0/1746437154 learned_addr learned my addr 172.21.15.2:0/1746437154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:08.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1a0107780 0x7fe1a019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a0108120 0x7fe1a019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 -- 172.21.15.2:0/1746437154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1a0107780 msgr2=0x7fe1a019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1a0107780 0x7fe1a019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 -- 172.21.15.2:0/1746437154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a0108120 msgr2=0x7fe1a019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a0108120 0x7fe1a019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.799+0000 7fe1a62e8640 1 -- 172.21.15.2:0/1746437154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a01a5430 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.800+0000 7fe1a62e8640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 0x7fe1a019a050 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00c920 tx=0x7fe19c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.800+0000 7fe1977fe640 1 -- 172.21.15.2:0/1746437154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c007c70 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.800+0000 7fe1977fe640 1 -- 172.21.15.2:0/1746437154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe19c007e10 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.800+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a01a5720 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.800+0000 7fe1977fe640 1 -- 172.21.15.2:0/1746437154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c018820 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.800+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a01a5c80 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.802+0000 7fe1aa921740 1 Processor -- start 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.802+0000 7fe1977fe640 1 -- 172.21.15.2:0/1746437154 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe19c00f450 con 0x7fe1a0102920 2024-09-10T23:34:08.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.802+0000 7fe1aa921740 1 -- start start 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741d5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741e5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741e5d60 0x556b741e8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1aa921740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b7414be50 con 0x556b741e5d60 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1aa921740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556b7413b280 con 0x556b741d59c0 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1aa921740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556b7413f090 con 0x556b741d50a0 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741d5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:46176/0 (socket says 172.21.15.2:46176) 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/181544802 learned_addr learned my addr 172.21.15.2:0/181544802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741e5d60 0x556b741e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a62e8640 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/181544802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 msgr2=0x556b741e5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741e5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/181544802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741e5d60 msgr2=0x556b741e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741e5d60 0x556b741e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/181544802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b73e99650 con 0x556b741d50a0 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1977fe640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe18c0b5360 0x7fe18c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741d5480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe198010370 tx=0x7fe198010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8981b41b9eaa7b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.803+0000 7fe1a62e8640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe18c0b5360 0x7fe18c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe1977fe640 1 -- 172.21.15.2:0/1746437154 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe19c0e5bd0 con 0x7fe1a0102920 2024-09-10T23:34:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe194ff9640 1 -- 172.21.15.2:0/181544802 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198016070 con 0x556b741d50a0 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe194ff9640 1 -- 172.21.15.2:0/181544802 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe198012bc0 con 0x556b741d50a0 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe194ff9640 1 -- 172.21.15.2:0/181544802 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19801bc50 con 0x556b741d50a0 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe1aa921740 1 -- 172.21.15.2:0/181544802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 msgr2=0x556b741d5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe1a62e8640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe18c0b5360 0x7fe18c0b7820 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0e3a50 tx=0x7fe19c00fe60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.804+0000 7fe1aa921740 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741d5480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe198010370 tx=0x7fe198010830 comp rx=0 tx=0).stop 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- 172.21.15.2:0/181544802 shutdown_connections 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741e5d60 0x556b741e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 --2- 172.21.15.2:0/181544802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741d5480 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- 172.21.15.2:0/181544802 >> 172.21.15.2:0/181544802 conn(0x556b741d2ed0 msgr2=0x556b741d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- 172.21.15.2:0/181544802 shutdown_connections 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- 172.21.15.2:0/181544802 wait complete. 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- start start 2024-09-10T23:34:08.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 Processor -- start 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 0x556b741e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b73f9c700 con 0x556b741d59c0 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556b740d6110 con 0x556b741e5d60 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556b741e8a10 con 0x556b741d50a0 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1aa921740 10 client.0 _ll_register_callbacks cb 0x556b740ef990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1a5ae7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 0x556b741e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1a5ae7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 0x556b741e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57592/0 (socket says 172.21.15.2:57592) 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.805+0000 7fe1a5ae7640 1 -- 172.21.15.2:0/645118872 learned_addr learned my addr 172.21.15.2:0/645118872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a5ae7640 1 -- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 msgr2=0x556b741e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741e56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a5ae7640 1 -- 172.21.15.2:0/645118872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 msgr2=0x556b741e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a5ae7640 1 -- 172.21.15.2:0/645118872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b74103c40 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 0x556b741e2b10 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fe190009900 tx=0x7fe1900316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404ed1aaec15eef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe189ffb640 1 -- 172.21.15.2:0/645118872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190035040 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe189ffb640 1 -- 172.21.15.2:0/645118872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe190031d10 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe198012bc0 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe189ffb640 1 -- 172.21.15.2:0/645118872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe190004040 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1aa921740 10 client.18882 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.806+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b741f43c0 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe189ffb640 1 -- 172.21.15.2:0/645118872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe198012bc0 con 0x556b741d59c0 2024-09-10T23:34:08.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe189ffb640 1 -- 172.21.15.2:0/645118872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe190004750 con 0x556b741d59c0 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1aa921740 10 client.18882 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1aa921740 10 client.18882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1aa921740 20 client.18882 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1aa921740 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b741f5920 0x556b741f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1aa921740 4 client.18882 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b7414dda0 con 0x556b741f5920 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b741f5920 0x556b741f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe189ffb640 10 client.18882 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.807+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b741f5920 0x556b741f7d10 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8cdaba8aa50752 server_cookie=2cb5c2e96f488528 in_seq=0 out_seq=0 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe189ffb640 1 -- 172.21.15.2:0/645118872 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b7414dda0 con 0x556b741f5920 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe189ffb640 10 client.18882 handle_command_reply: tid=0 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 client.18882 shutdown 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 msgr2=0x556b741e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 0x556b741e2b10 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fe190009900 tx=0x7fe1900316d0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 shutdown_connections 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b741f5920 0x556b741f7d10 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d59c0 0x556b741e2b10 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe189ffb640 0 client.18882 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 --2- 172.21.15.2:0/645118872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d50a0 0x556b741e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 >> 172.21.15.2:0/645118872 conn(0x556b741d2ed0 msgr2=0x556b741d8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 shutdown_connections 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.808+0000 7fe1aa921740 1 -- 172.21.15.2:0/645118872 wait complete. 2024-09-10T23:34:08.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.809+0000 7fe1aa921740 20 client.18882 trim_cache size 0 max 16384 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 Processor -- start 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 -- start start 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741d8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741e5d60 0x556b741fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ac060 con 0x556b741d50a0 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01adba0 con 0x556b741d59c0 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1aa921740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ac730 con 0x556b741e5d60 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1a6ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1a6ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57608/0 (socket says 172.21.15.2:57608) 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.826+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1760931996 learned_addr learned my addr 172.21.15.2:0/1760931996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1760931996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741e5d60 msgr2=0x556b741fd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741e5d60 0x556b741fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1760931996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 msgr2=0x556b741d8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741d8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741d8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1760931996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b741e1010 con 0x556b741d50a0 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741f1c40 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fe19801b980 tx=0x7fe19801b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b869a1475c820a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe18bfff640 1 -- 172.21.15.2:0/1760931996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198016050 con 0x556b741d50a0 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe18bfff640 1 -- 172.21.15.2:0/1760931996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe198003e20 con 0x556b741d50a0 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.827+0000 7fe18bfff640 1 -- 172.21.15.2:0/1760931996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198012890 con 0x556b741d50a0 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 -- 172.21.15.2:0/1760931996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 msgr2=0x556b741f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741f1c40 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fe19801b980 tx=0x7fe19801b750 comp rx=0 tx=0).stop 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 -- 172.21.15.2:0/1760931996 shutdown_connections 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741e5d60 0x556b741fd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741d59c0 0x556b741d8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1760931996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741f1c40 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 -- 172.21.15.2:0/1760931996 >> 172.21.15.2:0/1760931996 conn(0x556b741d2ed0 msgr2=0x556b741d8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 -- 172.21.15.2:0/1760931996 shutdown_connections 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 -- 172.21.15.2:0/1760931996 wait complete. 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 -- start start 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.828+0000 7fe1aa921740 1 Processor -- start 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741edca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d59c0 0x556b741ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741dde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ad4d0 con 0x556b741d50a0 2024-09-10T23:34:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ace00 con 0x556b741e5d60 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01aa040 con 0x556b741d59c0 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 10 client.0 _ll_register_callbacks cb 0x7fe190009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741edca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57620/0 (socket says 172.21.15.2:57620) 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1910110295 learned_addr learned my addr 172.21.15.2:0/1910110295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d59c0 0x556b741ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d59c0 msgr2=0x556b741ee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d59c0 0x556b741ee1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1910110295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 msgr2=0x556b741dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741dde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 -- 172.21.15.2:0/1910110295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b741ee8a0 con 0x556b741d50a0 2024-09-10T23:34:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1a6ae9640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741edca0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fe198009640 tx=0x7fe198009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9febd24ae6c99a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe189ffb640 1 -- 172.21.15.2:0/1910110295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198032070 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe189ffb640 1 -- 172.21.15.2:0/1910110295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe19801b9b0 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.829+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe198003e20 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe189ffb640 1 -- 172.21.15.2:0/1910110295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe198044050 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 10 client.18888 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b74267470 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe189ffb640 1 -- 172.21.15.2:0/1910110295 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe198003e20 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe189ffb640 1 -- 172.21.15.2:0/1910110295 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe19800f040 con 0x556b741d50a0 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 10 client.18888 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 10 client.18888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 20 client.18888 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b74267950 0x556b74269d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 4 client.18888 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b74149850 con 0x556b74267950 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.830+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b74267950 0x556b74269d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe189ffb640 10 client.18888 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1a5ae7640 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b74267950 0x556b74269d40 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18d1962eec6fd1b2 server_cookie=ac71c12e0ebf1f5f in_seq=0 out_seq=0 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe189ffb640 1 -- 172.21.15.2:0/1910110295 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x556b74149850 con 0x556b74267950 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe189ffb640 10 client.18888 handle_command_reply: tid=0 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 client.18888 shutdown 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 msgr2=0x556b741edca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741edca0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fe198009640 tx=0x7fe198009b90 comp rx=0 tx=0).stop 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 shutdown_connections 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x556b74267950 0x556b74269d40 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b741e5d60 0x556b741dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556b741d59c0 0x556b741ee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe189ffb640 0 client.18888 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 --2- 172.21.15.2:0/1910110295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b741d50a0 0x556b741edca0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 >> 172.21.15.2:0/1910110295 conn(0x556b741d2ed0 msgr2=0x556b741e4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 shutdown_connections 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 1 -- 172.21.15.2:0/1910110295 wait complete. 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.831+0000 7fe1aa921740 20 client.18888 trim_cache size 0 max 16384 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:34:08.844 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "7781c901-0381-483c-8ccc-ce03feed1938": { 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:07.192812+0000", 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:34:08.845 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.846 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.849 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:34:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.851 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.853 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.854 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.855 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:08.856 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe18c0b5360 msgr2=0x7fe18c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe18c0b5360 0x7fe18c0b7820 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0e3a50 tx=0x7fe19c00fe60 comp rx=0 tx=0).stop 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 msgr2=0x7fe1a019a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 0x7fe1a019a050 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00c920 tx=0x7fe19c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 shutdown_connections 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe18c0b5360 0x7fe18c0b7820 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a0108120 0x7fe1a019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1a0107780 0x7fe1a019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 --2- 172.21.15.2:0/1746437154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a0102920 0x7fe1a019a050 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:08.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 >> 172.21.15.2:0/1746437154 conn(0x7fe1a0076f50 msgr2=0x7fe1a0100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:08.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 shutdown_connections 2024-09-10T23:34:08.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:08.832+0000 7fe1a854c640 1 -- 172.21.15.2:0/1746437154 wait complete. 2024-09-10T23:34:08.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:08 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:34:09.665 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:34:09.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:34:09.931 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:10.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:09 smithi002 ceph-mon[31150]: pgmap v646: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:34:10.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:09 smithi154 ceph-mon[35136]: pgmap v646: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:34:10.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.439+0000 7fb1aacee640 1 -- 172.21.15.2:0/1351248496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 msgr2=0x7fb1a4104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.439+0000 7fb1aacee640 1 --2- 172.21.15.2:0/1351248496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a4104090 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb194009900 tx=0x7fb19402a410 comp rx=0 tx=0).stop 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 -- 172.21.15.2:0/1351248496 shutdown_connections 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 --2- 172.21.15.2:0/1351248496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a410d110 0x7fb1a410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 --2- 172.21.15.2:0/1351248496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1a41045d0 0x7fb1a410cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 --2- 172.21.15.2:0/1351248496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a4104090 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 -- 172.21.15.2:0/1351248496 >> 172.21.15.2:0/1351248496 conn(0x7fb1a40fd6d0 msgr2=0x7fb1a40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 -- 172.21.15.2:0/1351248496 shutdown_connections 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 -- 172.21.15.2:0/1351248496 wait complete. 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 Processor -- start 2024-09-10T23:34:10.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.440+0000 7fb1aacee640 1 -- start start 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1aacee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a41991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1aacee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a41045d0 0x7fb1a41996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1aacee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1a410d110 0x7fb1a419ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1aacee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4112d80 con 0x7fb1a4103cb0 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1aacee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4112c00 con 0x7fb1a41045d0 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1aacee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4112f00 con 0x7fb1a410d110 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a41991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a41991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57634/0 (socket says 172.21.15.2:57634) 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 -- 172.21.15.2:0/2307825887 learned_addr learned my addr 172.21.15.2:0/2307825887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a3fff640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a41045d0 0x7fb1a41996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a928b640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1a410d110 0x7fb1a419ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 -- 172.21.15.2:0/2307825887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1a410d110 msgr2=0x7fb1a419ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1a410d110 0x7fb1a419ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 -- 172.21.15.2:0/2307825887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a41045d0 msgr2=0x7fb1a41996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a41045d0 0x7fb1a41996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 -- 172.21.15.2:0/2307825887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a419f250 con 0x7fb1a4103cb0 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a3fff640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a41045d0 0x7fb1a41996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.441+0000 7fb1a8a8a640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a41991a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fb194006010 tx=0x7fb1940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.442+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19403f030 con 0x7fb1a4103cb0 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.442+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb194003800 con 0x7fb1a4103cb0 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.442+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a419f4e0 con 0x7fb1a4103cb0 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.442+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194035070 con 0x7fb1a4103cb0 2024-09-10T23:34:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.442+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a41a5c00 con 0x7fb1a4103cb0 2024-09-10T23:34:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.443+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a4104090 con 0x7fb1a4103cb0 2024-09-10T23:34:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.444+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb194031b10 con 0x7fb1a4103cb0 2024-09-10T23:34:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.445+0000 7fb1a1ffb640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb18c0b52e0 0x7fb18c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.445+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb1941068a0 con 0x7fb1a4103cb0 2024-09-10T23:34:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.445+0000 7fb1a3fff640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb18c0b52e0 0x7fb18c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.446+0000 7fb1a3fff640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb18c0b52e0 0x7fb18c0b77a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40fff00 tx=0x7fb19800a680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:10.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.448+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb1940cd710 con 0x7fb1a4103cb0 2024-09-10T23:34:10.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:09 smithi177 ceph-mon[35760]: pgmap v646: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-10T23:34:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.669+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1a41a5e00 con 0x7fb1a4103cb0 2024-09-10T23:34:10.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.670+0000 7fb1a1ffb640 1 -- 172.21.15.2:0/2307825887 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fb1940cd010 con 0x7fb1a4103cb0 2024-09-10T23:34:10.672 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:34:10.672 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb18c0b52e0 msgr2=0x7fb18c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb18c0b52e0 0x7fb18c0b77a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40fff00 tx=0x7fb19800a680 comp rx=0 tx=0).stop 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 msgr2=0x7fb1a41991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a41991a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fb194006010 tx=0x7fb1940042f0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 shutdown_connections 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb18c0b52e0 0x7fb18c0b77a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1a410d110 0x7fb1a419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a41045d0 0x7fb1a41996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 --2- 172.21.15.2:0/2307825887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4103cb0 0x7fb1a41991a0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 >> 172.21.15.2:0/2307825887 conn(0x7fb1a40fd6d0 msgr2=0x7fb1a410f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 shutdown_connections 2024-09-10T23:34:10.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:10.672+0000 7fb1aacee640 1 -- 172.21.15.2:0/2307825887 wait complete. 2024-09-10T23:34:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 -- 172.21.15.2:0/3897979588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd01018b0 msgr2=0x7fedd0101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 --2- 172.21.15.2:0/3897979588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd01018b0 0x7fedd0101cb0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009930 tx=0x7fedc002a420 comp rx=0 tx=0).stop 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 -- 172.21.15.2:0/3897979588 shutdown_connections 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 --2- 172.21.15.2:0/3897979588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd01033c0 0x7fedd0109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 --2- 172.21.15.2:0/3897979588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd0102a00 0x7fedd0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 --2- 172.21.15.2:0/3897979588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd01018b0 0x7fedd0101cb0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 -- 172.21.15.2:0/3897979588 >> 172.21.15.2:0/3897979588 conn(0x7fedd00fd150 msgr2=0x7fedd00ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 -- 172.21.15.2:0/3897979588 shutdown_connections 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 -- 172.21.15.2:0/3897979588 wait complete. 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.133+0000 7fedd4acd640 1 Processor -- start 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 -- start start 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd01018b0 0x7fedd0198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 0x7fedd01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd01033c0 0x7fedd019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010d650 con 0x7fedd0102a00 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010d4d0 con 0x7fedd01033c0 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedd4acd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010d7d0 con 0x7fedd01018b0 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 0x7fedd01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 0x7fedd01995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46752/0 (socket says 172.21.15.2:46752) 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd01018b0 0x7fedd0198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2649107727 learned_addr learned my addr 172.21.15.2:0/2649107727 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedced9d640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd01033c0 0x7fedd019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2649107727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd01018b0 msgr2=0x7fedd0198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd01018b0 0x7fedd0198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2649107727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd01033c0 msgr2=0x7fedd019a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd01033c0 0x7fedd019a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.134+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2649107727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd019aae0 con 0x7fedd0102a00 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.135+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 0x7fedd01995f0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b4a0 tx=0x7fedc400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.135+0000 7fedbf7fe640 1 -- 172.21.15.2:0/2649107727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4014070 con 0x7fedd0102a00 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.135+0000 7fedbf7fe640 1 -- 172.21.15.2:0/2649107727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc4010ac0 con 0x7fedd0102a00 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.135+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd019add0 con 0x7fedd0102a00 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.135+0000 7fedbf7fe640 1 -- 172.21.15.2:0/2649107727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4017c30 con 0x7fedd0102a00 2024-09-10T23:34:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.135+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd01a14a0 con 0x7fedd0102a00 2024-09-10T23:34:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 Processor -- start 2024-09-10T23:34:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 -- start start 2024-09-10T23:34:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d4860 0x557c739d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739d9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d9bd0 0x557c739dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c739466f0 con 0x557c739d7190 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c73935b20 con 0x557c739d9bd0 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedd78a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c73939930 con 0x557c739d4860 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedbf7fe640 1 -- 172.21.15.2:0/2649107727 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fedc4010610 con 0x7fedd0102a00 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739d9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46766/0 (socket says 172.21.15.2:46766) 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedce59c640 1 -- 172.21.15.2:0/4078246962 learned_addr learned my addr 172.21.15.2:0/4078246962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.138+0000 7fedced9d640 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d4860 0x557c739d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d9bd0 0x557c739dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedce59c640 1 -- 172.21.15.2:0/4078246962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d4860 msgr2=0x557c739d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedce59c640 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d4860 0x557c739d6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedce59c640 1 -- 172.21.15.2:0/4078246962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d9bd0 msgr2=0x557c739dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedce59c640 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d9bd0 0x557c739dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedce59c640 1 -- 172.21.15.2:0/4078246962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c738fb530 con 0x557c739d7190 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedce59c640 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739d9580 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fedc002aa10 tx=0x7fedc00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb488904c118fe56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedbcff9640 1 -- 172.21.15.2:0/4078246962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0040070 con 0x557c739d7190 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedbcff9640 1 -- 172.21.15.2:0/4078246962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc00047a0 con 0x557c739d7190 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedbcff9640 1 -- 172.21.15.2:0/4078246962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0035040 con 0x557c739d7190 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedbf7fe640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fedb80b52e0 0x7fedb80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.139+0000 7fedced9d640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fedb80b52e0 0x7fedb80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedbf7fe640 1 -- 172.21.15.2:0/2649107727 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fedc40e50d0 con 0x7fedd0102a00 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 -- 172.21.15.2:0/4078246962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 msgr2=0x557c739d9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739d9580 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fedc002aa10 tx=0x7fedc00043b0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedced9d640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fedb80b52e0 0x7fedb80b77a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fedd0199d20 tx=0x7fedc800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 -- 172.21.15.2:0/4078246962 shutdown_connections 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d9bd0 0x557c739dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739d9580 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 --2- 172.21.15.2:0/4078246962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d4860 0x557c739d6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 -- 172.21.15.2:0/4078246962 >> 172.21.15.2:0/4078246962 conn(0x557c739cf9b0 msgr2=0x557c739d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 -- 172.21.15.2:0/4078246962 shutdown_connections 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 -- 172.21.15.2:0/4078246962 wait complete. 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 -- start start 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.140+0000 7fedd78a2740 1 Processor -- start 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d4860 0x557c739dde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739de530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739df100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c7386dab0 con 0x557c739d7190 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c738db730 con 0x557c739d4860 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c739dcb50 con 0x557c739d9bd0 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 10 client.0 _ll_register_callbacks cb 0x557c7392f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739de530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46778/0 (socket says 172.21.15.2:46778) 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2961048387 learned_addr learned my addr 172.21.15.2:0/2961048387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedce59c640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d4860 0x557c739dde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedced9d640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 msgr2=0x557c739df100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739df100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2961048387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d4860 msgr2=0x557c739dde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d4860 0x557c739dde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 -- 172.21.15.2:0/2961048387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c73697790 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739de530 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fedc40a8bc0 tx=0x7fedc40ab720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deba96eddd48015 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2961048387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc401e070 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2961048387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fedc40aabb0 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.141+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedc00047a0 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2961048387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedc40a70c0 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 10 client.18906 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c73710620 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2961048387 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc00047a0 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2961048387 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedc40acbd0 con 0x557c739d7190 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 10 client.18906 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 10 client.18906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 20 client.18906 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c739e9750 0x557c739ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 4 client.18906 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c73948640 con 0x557c739e9750 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.142+0000 7fedce59c640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c739e9750 0x557c739ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.143+0000 7fedce59c640 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c739e9750 0x557c739ebb80 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0eceeea42e39b3 server_cookie=77451fc4593e7ee3 in_seq=0 out_seq=0 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.143+0000 7fedb5ffb640 10 client.18906 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.143+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2961048387 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c73948640 con 0x557c739e9750 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.143+0000 7fedb5ffb640 10 client.18906 handle_command_reply: tid=0 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.143+0000 7fedd78a2740 1 client.18906 shutdown 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 msgr2=0x557c739de530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739de530 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fedc40a8bc0 tx=0x7fedc40ab720 comp rx=0 tx=0).stop 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 shutdown_connections 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c739e9750 0x557c739ebb80 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739df100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedb5ffb640 0 client.18906 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d7190 0x557c739de530 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2961048387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d4860 0x557c739dde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 >> 172.21.15.2:0/2961048387 conn(0x557c739cf9b0 msgr2=0x557c739cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 shutdown_connections 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 1 -- 172.21.15.2:0/2961048387 wait complete. 2024-09-10T23:34:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.144+0000 7fedd78a2740 20 client.18906 trim_cache size 0 max 16384 2024-09-10T23:34:11.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.158+0000 7fedd78a2740 1 Processor -- start 2024-09-10T23:34:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.158+0000 7fedd78a2740 1 -- start start 2024-09-10T23:34:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.158+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.158+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedd78a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01aa050 con 0x557c739d4860 2024-09-10T23:34:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedd78a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01abb90 con 0x557c739d7190 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedd78a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01aa720 con 0x557c739d9bd0 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46792/0 (socket says 172.21.15.2:46792) 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 -- 172.21.15.2:0/343895047 learned_addr learned my addr 172.21.15.2:0/343895047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedced9d640 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 -- 172.21.15.2:0/343895047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 msgr2=0x557c739d3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739d3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 -- 172.21.15.2:0/343895047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 msgr2=0x557c739da4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739da4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 -- 172.21.15.2:0/343895047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c739d98f0 con 0x557c739d4860 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedce59c640 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739d9fb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fedc0006010 tx=0x7fedc0005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89299cf7f1902b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedb7fff640 1 -- 172.21.15.2:0/343895047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0040040 con 0x557c739d4860 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedb7fff640 1 -- 172.21.15.2:0/343895047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc0004a70 con 0x557c739d4860 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.159+0000 7fedb7fff640 1 -- 172.21.15.2:0/343895047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0035040 con 0x557c739d4860 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- 172.21.15.2:0/343895047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 msgr2=0x557c739d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739d9fb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fedc0006010 tx=0x7fedc0005a20 comp rx=0 tx=0).stop 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- 172.21.15.2:0/343895047 shutdown_connections 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739d3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739da4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- 172.21.15.2:0/343895047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739d9fb0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- 172.21.15.2:0/343895047 >> 172.21.15.2:0/343895047 conn(0x557c739cf9b0 msgr2=0x557c739caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- 172.21.15.2:0/343895047 shutdown_connections 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- 172.21.15.2:0/343895047 wait complete. 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- start start 2024-09-10T23:34:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 Processor -- start 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01ab4c0 con 0x557c739d4860 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01aadf0 con 0x557c739d7190 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01a8030 con 0x557c739d9bd0 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.160+0000 7fedd78a2740 10 client.0 _ll_register_callbacks cb 0x7fedc4017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739e5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46794/0 (socket says 172.21.15.2:46794) 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 -- 172.21.15.2:0/2601110764 learned_addr learned my addr 172.21.15.2:0/2601110764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedced9d640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 -- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 msgr2=0x557c739e4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739e4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 -- 172.21.15.2:0/2601110764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 msgr2=0x557c739e47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739e47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 -- 172.21.15.2:0/2601110764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c739e3300 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedce59c640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739e5ae0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005ab0 tx=0x7fedc0032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1cfe9ef4aeb12e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2601110764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0040050 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2601110764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fedc0004d30 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c739440f0 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2601110764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedc0035040 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedd78a2740 10 client.18912 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c73a56840 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.161+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2601110764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557c739440f0 con 0x557c739d4860 2024-09-10T23:34:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2601110764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedc004f8f0 con 0x557c739d4860 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedd78a2740 10 client.18912 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedd78a2740 10 client.18912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedd78a2740 20 client.18912 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c73a56d70 0x557c73a59160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedd78a2740 4 client.18912 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c73941520 con 0x557c73a56d70 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c73a56d70 0x557c73a59160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedb5ffb640 10 client.18912 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.162+0000 7fedcdd9b640 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c73a56d70 0x557c73a59160 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5cbdd9fff5a4ba1 server_cookie=3c51a165b5309aa8 in_seq=0 out_seq=0 2024-09-10T23:34:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.177+0000 7fedb5ffb640 1 -- 172.21.15.2:0/2601110764 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c73941520 con 0x557c73a56d70 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.177+0000 7fedb5ffb640 10 client.18912 handle_command_reply: tid=0 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.177+0000 7fedd78a2740 1 client.18912 shutdown 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 msgr2=0x557c739e5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739e5ae0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005ab0 tx=0x7fedc0032810 comp rx=0 tx=0).stop 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 shutdown_connections 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557c73a56d70 0x557c73a59160 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c739d9bd0 0x557c739e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c739d7190 0x557c739e47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 --2- 172.21.15.2:0/2601110764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c739d4860 0x557c739e5ae0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedb5ffb640 0 client.18912 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 >> 172.21.15.2:0/2601110764 conn(0x557c739cf9b0 msgr2=0x557c739d9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 shutdown_connections 2024-09-10T23:34:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 1 -- 172.21.15.2:0/2601110764 wait complete. 2024-09-10T23:34:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd78a2740 20 client.18912 trim_cache size 0 max 16384 2024-09-10T23:34:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:34:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:34:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:34:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:34:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fedb80b52e0 msgr2=0x7fedb80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fedb80b52e0 0x7fedb80b77a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fedd0199d20 tx=0x7fedc800d040 comp rx=0 tx=0).stop 2024-09-10T23:34:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 msgr2=0x7fedd01995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 0x7fedd01995f0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b4a0 tx=0x7fedc400b960 comp rx=0 tx=0).stop 2024-09-10T23:34:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 shutdown_connections 2024-09-10T23:34:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fedb80b52e0 0x7fedb80b77a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd01033c0 0x7fedd019a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd0102a00 0x7fedd01995f0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 --2- 172.21.15.2:0/2649107727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd01018b0 0x7fedd0198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 >> 172.21.15.2:0/2649107727 conn(0x7fedd00fd150 msgr2=0x7fedd00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 shutdown_connections 2024-09-10T23:34:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:11.178+0000 7fedd4acd640 1 -- 172.21.15.2:0/2649107727 wait complete. 2024-09-10T23:34:11.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2307825887' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:34:11.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2307825887' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:34:11.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2307825887' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:34:11.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:34:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:12.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:11 smithi002 ceph-mon[31150]: pgmap v647: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:12.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:11 smithi154 ceph-mon[35136]: pgmap v647: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 -- 172.21.15.2:0/3670737708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c1087d0 msgr2=0x7f823c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 --2- 172.21.15.2:0/3670737708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c1087d0 0x7f823c108c10 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f8230009900 tx=0x7f823002a410 comp rx=0 tx=0).stop 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 -- 172.21.15.2:0/3670737708 shutdown_connections 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 --2- 172.21.15.2:0/3670737708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f823c109150 0x7f823c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 --2- 172.21.15.2:0/3670737708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c1087d0 0x7f823c108c10 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 --2- 172.21.15.2:0/3670737708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c102dc0 0x7f823c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 -- 172.21.15.2:0/3670737708 >> 172.21.15.2:0/3670737708 conn(0x7f823c0fe830 msgr2=0x7f823c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 -- 172.21.15.2:0/3670737708 shutdown_connections 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 -- 172.21.15.2:0/3670737708 wait complete. 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.294+0000 7f8244150640 1 Processor -- start 2024-09-10T23:34:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 -- start start 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 0x7f823c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c1087d0 0x7f823c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f823c109150 0x7f823c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f823c112e10 con 0x7f823c102dc0 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f823c112c90 con 0x7f823c1087d0 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8244150640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f823c112f90 con 0x7f823c109150 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 0x7f823c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 0x7f823c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46800/0 (socket says 172.21.15.2:46800) 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 -- 172.21.15.2:0/2700590706 learned_addr learned my addr 172.21.15.2:0/2700590706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f82426ed640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f823c109150 0x7f823c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f82416eb640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c1087d0 0x7f823c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 -- 172.21.15.2:0/2700590706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f823c109150 msgr2=0x7f823c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f823c109150 0x7f823c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 -- 172.21.15.2:0/2700590706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c1087d0 msgr2=0x7f823c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c1087d0 0x7f823c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.295+0000 7f8241eec640 1 -- 172.21.15.2:0/2700590706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c19f390 con 0x7f823c102dc0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.296+0000 7f8241eec640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 0x7f823c1992e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f822c00b4a0 tx=0x7f822c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.296+0000 7f823affd640 1 -- 172.21.15.2:0/2700590706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c014070 con 0x7f823c102dc0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.296+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c19f680 con 0x7f823c102dc0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.296+0000 7f823affd640 1 -- 172.21.15.2:0/2700590706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f822c010ac0 con 0x7f823c102dc0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.296+0000 7f823affd640 1 -- 172.21.15.2:0/2700590706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c017c30 con 0x7f823c102dc0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.296+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c1a5f10 con 0x7f823c102dc0 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.298+0000 7f8246525740 1 Processor -- start 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.298+0000 7f8246525740 1 -- start start 2024-09-10T23:34:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.298+0000 7f823affd640 1 -- 172.21.15.2:0/2700590706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f822c010610 con 0x7f823c102dc0 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8246525740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe29c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8246525740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8246525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8246525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6fe212ea0 con 0x55d6fe2acdb0 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8246525740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d6fe2022d0 con 0x55d6fe29ca10 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8246525740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d6fe2060e0 con 0x55d6fe29c0f0 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46812/0 (socket says 172.21.15.2:46812) 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 -- 172.21.15.2:0/191787873 learned_addr learned my addr 172.21.15.2:0/191787873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82426ed640 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe29c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f8241eec640 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 -- 172.21.15.2:0/191787873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 msgr2=0x55d6fe29c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe29c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 -- 172.21.15.2:0/191787873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 msgr2=0x55d6fe2ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 -- 172.21.15.2:0/191787873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fdf60650 con 0x55d6fe2acdb0 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.299+0000 7f82416eb640 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2af1a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8230009900 tx=0x7f8230032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa2d422a5a1b5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f823affd640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f82240b52e0 0x7f82240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f8223fff640 1 -- 172.21.15.2:0/191787873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230035030 con 0x55d6fe2acdb0 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f8223fff640 1 -- 172.21.15.2:0/191787873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82300316a0 con 0x55d6fe2acdb0 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f8223fff640 1 -- 172.21.15.2:0/191787873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300046c0 con 0x55d6fe2acdb0 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f82426ed640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f82240b52e0 0x7f82240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f823affd640 1 -- 172.21.15.2:0/2700590706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f822c0e5480 con 0x7f823c102dc0 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f8246525740 1 -- 172.21.15.2:0/191787873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 msgr2=0x55d6fe2af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f82426ed640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f82240b52e0 0x7f82240b77a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8234005fd0 tx=0x7f8234009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.300+0000 7f8246525740 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2af1a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8230009900 tx=0x7f8230032ce0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 -- 172.21.15.2:0/191787873 shutdown_connections 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2af1a0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 --2- 172.21.15.2:0/191787873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe29c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 -- 172.21.15.2:0/191787873 >> 172.21.15.2:0/191787873 conn(0x55d6fe299f20 msgr2=0x55d6fe29b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 -- 172.21.15.2:0/191787873 shutdown_connections 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 -- 172.21.15.2:0/191787873 wait complete. 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 -- start start 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.301+0000 7f8246525740 1 Processor -- start 2024-09-10T23:34:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2aa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6fe063700 con 0x55d6fe29c0f0 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d6fe19d160 con 0x55d6fe29ca10 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d6fe2afa00 con 0x55d6fe2acdb0 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 10 client.0 _ll_register_callbacks cb 0x55d6fe1b69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2ac6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46814/0 (socket says 172.21.15.2:46814) 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 -- 172.21.15.2:0/32667294 learned_addr learned my addr 172.21.15.2:0/32667294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f82416eb640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f82426ed640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 -- 172.21.15.2:0/32667294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 msgr2=0x55d6fe2aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 -- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 msgr2=0x55d6fe2a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 -- 172.21.15.2:0/32667294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fe1cac90 con 0x55d6fe29c0f0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8241eec640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2ac6c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f822c0a8ec0 tx=0x7f822c0a8390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d76784e03d10d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f82217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f82217fa640 1 -- 172.21.15.2:0/32667294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c01e030 con 0x55d6fe29c0f0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f82217fa640 1 -- 172.21.15.2:0/32667294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f822c010c70 con 0x55d6fe29c0f0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.302+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82300316a0 con 0x55d6fe29c0f0 2024-09-10T23:34:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f82217fa640 1 -- 172.21.15.2:0/32667294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f822c0ab3c0 con 0x55d6fe29c0f0 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 10 client.18924 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6fe2bb390 con 0x55d6fe29c0f0 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f82217fa640 1 -- 172.21.15.2:0/32667294 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82300316a0 con 0x55d6fe29c0f0 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f82217fa640 1 -- 172.21.15.2:0/32667294 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f822c0a7ec0 con 0x55d6fe29c0f0 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 10 client.18924 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 10 client.18924 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 20 client.18924 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe2bc730 0x55d6fe2beb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 4 client.18924 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6fe214df0 con 0x55d6fe2bc730 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.303+0000 7f82416eb640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe2bc730 0x55d6fe2beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.304+0000 7f82416eb640 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe2bc730 0x55d6fe2beb80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b04b13d9e0df0d0a server_cookie=606e514ad37e4a31 in_seq=0 out_seq=0 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.304+0000 7f82217fa640 10 client.18924 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f82217fa640 1 -- 172.21.15.2:0/32667294 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6fe214df0 con 0x55d6fe2bc730 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f82217fa640 10 client.18924 handle_command_reply: tid=0 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 client.18924 shutdown 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 msgr2=0x55d6fe2ac6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2ac6c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f822c0a8ec0 tx=0x7f822c0a8390 comp rx=0 tx=0).stop 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 shutdown_connections 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe2bc730 0x55d6fe2beb80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f82217fa640 0 client.18924 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 --2- 172.21.15.2:0/32667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2ac6c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 >> 172.21.15.2:0/32667294 conn(0x55d6fe299f20 msgr2=0x55d6fe29fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 shutdown_connections 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 1 -- 172.21.15.2:0/32667294 wait complete. 2024-09-10T23:34:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.305+0000 7f8246525740 20 client.18924 trim_cache size 0 max 16384 2024-09-10T23:34:12.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 Processor -- start 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 -- start start 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ab850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2c4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1ac190 con 0x55d6fe2acdb0 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1adcd0 con 0x55d6fe29ca10 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8246525740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1ac860 con 0x55d6fe29c0f0 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46820/0 (socket says 172.21.15.2:46820) 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 -- 172.21.15.2:0/674900305 learned_addr learned my addr 172.21.15.2:0/674900305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f8241eec640 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82416eb640 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 -- 172.21.15.2:0/674900305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 msgr2=0x55d6fe2b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 -- 172.21.15.2:0/674900305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 msgr2=0x55d6fe2ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.319+0000 7f82426ed640 1 -- 172.21.15.2:0/674900305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fe299d50 con 0x55d6fe2acdb0 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f82426ed640 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2c4420 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8234009e20 tx=0x7f8234016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a95107ef6892539 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f82237fe640 1 -- 172.21.15.2:0/674900305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234011e40 con 0x55d6fe2acdb0 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f82237fe640 1 -- 172.21.15.2:0/674900305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f823401d8e0 con 0x55d6fe2acdb0 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f82237fe640 1 -- 172.21.15.2:0/674900305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234020a00 con 0x55d6fe2acdb0 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f8246525740 1 -- 172.21.15.2:0/674900305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 msgr2=0x55d6fe2c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f8246525740 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2c4420 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8234009e20 tx=0x7f8234016000 comp rx=0 tx=0).stop 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f8246525740 1 -- 172.21.15.2:0/674900305 shutdown_connections 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f8246525740 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2c4420 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f8246525740 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29ca10 0x55d6fe2ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.320+0000 7f8246525740 1 --2- 172.21.15.2:0/674900305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- 172.21.15.2:0/674900305 >> 172.21.15.2:0/674900305 conn(0x55d6fe299f20 msgr2=0x55d6fe2ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- 172.21.15.2:0/674900305 shutdown_connections 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- 172.21.15.2:0/674900305 wait complete. 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- start start 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 Processor -- start 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 0x55d6fe2b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1ad600 con 0x55d6fe29ca10 2024-09-10T23:34:12.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1acf30 con 0x55d6fe29c0f0 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.321+0000 7f8246525740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1aa170 con 0x55d6fe2acdb0 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f8246525740 10 client.0 _ll_register_callbacks cb 0x7f822c017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 0x55d6fe2b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 0x55d6fe2b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46824/0 (socket says 172.21.15.2:46824) 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 -- 172.21.15.2:0/4075581561 learned_addr learned my addr 172.21.15.2:0/4075581561 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f8241eec640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82426ed640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 -- 172.21.15.2:0/4075581561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 msgr2=0x55d6fe2b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 -- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29c0f0 msgr2=0x55d6fe2b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 -- 172.21.15.2:0/4075581561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fe329630 con 0x55d6fe29ca10 2024-09-10T23:34:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82416eb640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 0x55d6fe2b1c90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8230005300 tx=0x7f8230032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f606e9e4a7c6d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82217fa640 1 -- 172.21.15.2:0/4075581561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230052070 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82217fa640 1 -- 172.21.15.2:0/4075581561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8230031520 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f823401d8e0 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f82217fa640 1 -- 172.21.15.2:0/4075581561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8230035040 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f8246525740 10 client.18930 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.322+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6fe32a8a0 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f82217fa640 1 -- 172.21.15.2:0/4075581561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f823401d8e0 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f82217fa640 1 -- 172.21.15.2:0/4075581561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8230055020 con 0x55d6fe29ca10 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8246525740 10 client.18930 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8246525740 10 client.18930 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8246525740 20 client.18930 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8246525740 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe32aca0 0x55d6fe32d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8246525740 4 client.18930 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6fe2108a0 con 0x55d6fe32aca0 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.323+0000 7f8241eec640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe32aca0 0x55d6fe32d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8241eec640 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe32aca0 0x55d6fe32d090 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bc89276f2ed64350 server_cookie=630ac32c22fd9c8e in_seq=0 out_seq=0 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f82217fa640 10 client.18930 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f82217fa640 1 -- 172.21.15.2:0/4075581561 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6fe2108a0 con 0x55d6fe32aca0 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f82217fa640 10 client.18930 handle_command_reply: tid=0 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 client.18930 shutdown 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 msgr2=0x55d6fe2b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 0x55d6fe2b1c90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8230005300 tx=0x7f8230032e50 comp rx=0 tx=0).stop 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 shutdown_connections 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55d6fe32aca0 0x55d6fe32d090 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d6fe2acdb0 0x55d6fe2b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6fe29ca10 0x55d6fe2b1c90 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 --2- 172.21.15.2:0/4075581561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6fe29c0f0 0x55d6fe2b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f82217fa640 0 client.18930 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 >> 172.21.15.2:0/4075581561 conn(0x55d6fe299f20 msgr2=0x55d6fe298f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 shutdown_connections 2024-09-10T23:34:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 1 -- 172.21.15.2:0/4075581561 wait complete. 2024-09-10T23:34:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.324+0000 7f8246525740 20 client.18930 trim_cache size 0 max 16384 2024-09-10T23:34:12.332 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f82240b52e0 msgr2=0x7f82240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f82240b52e0 0x7f82240b77a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8234005fd0 tx=0x7f8234009600 comp rx=0 tx=0).stop 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 msgr2=0x7f823c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 0x7f823c1992e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f822c00b4a0 tx=0x7f822c00b960 comp rx=0 tx=0).stop 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 shutdown_connections 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f82240b52e0 0x7f82240b77a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f823c109150 0x7f823c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c1087d0 0x7f823c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 --2- 172.21.15.2:0/2700590706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f823c102dc0 0x7f823c1992e0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 >> 172.21.15.2:0/2700590706 conn(0x7f823c0fe830 msgr2=0x7f823c105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:12.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 shutdown_connections 2024-09-10T23:34:12.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:12.325+0000 7f8244150640 1 -- 172.21.15.2:0/2700590706 wait complete. 2024-09-10T23:34:12.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:11 smithi177 ceph-mon[35760]: pgmap v647: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:13.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:34:13.285 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 -- 172.21.15.2:0/2012383269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858100bb0 msgr2=0x7fd858100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 --2- 172.21.15.2:0/2012383269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858100bb0 0x7fd858100f90 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd848009900 tx=0x7fd84802a410 comp rx=0 tx=0).stop 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 -- 172.21.15.2:0/2012383269 shutdown_connections 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 --2- 172.21.15.2:0/2012383269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 0x7fd85810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 --2- 172.21.15.2:0/2012383269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd858107530 0x7fd858107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 --2- 172.21.15.2:0/2012383269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858100bb0 0x7fd858100f90 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 -- 172.21.15.2:0/2012383269 >> 172.21.15.2:0/2012383269 conn(0x7fd8580fc8c0 msgr2=0x7fd8580fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 -- 172.21.15.2:0/2012383269 shutdown_connections 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.937+0000 7fd85d79d640 1 -- 172.21.15.2:0/2012383269 wait complete. 2024-09-10T23:34:13.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 Processor -- start 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 -- start start 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd858100bb0 0x7fd858199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 0x7fd858199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 0x7fd85819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd858112c40 con 0x7fd858107530 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd858112ac0 con 0x7fd858107eb0 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85d79d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd858112dc0 con 0x7fd858100bb0 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd8577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 0x7fd858199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd8577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 0x7fd858199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46850/0 (socket says 172.21.15.2:46850) 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd8577fe640 1 -- 172.21.15.2:0/136154699 learned_addr learned my addr 172.21.15.2:0/136154699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd857fff640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd858100bb0 0x7fd858199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 0x7fd85819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd8577fe640 1 -- 172.21.15.2:0/136154699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd858100bb0 msgr2=0x7fd858199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd8577fe640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd858100bb0 0x7fd858199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.938+0000 7fd8577fe640 1 -- 172.21.15.2:0/136154699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 msgr2=0x7fd85819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd8577fe640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 0x7fd85819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd8577fe640 1 -- 172.21.15.2:0/136154699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85819f1e0 con 0x7fd858107530 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 0x7fd85819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd8577fe640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 0x7fd858199670 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00e9f0 tx=0x7fd84c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd8557fa640 1 -- 172.21.15.2:0/136154699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00cd80 con 0x7fd858107530 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd8557fa640 1 -- 172.21.15.2:0/136154699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd84c0054d0 con 0x7fd858107530 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd8557fa640 1 -- 172.21.15.2:0/136154699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c010690 con 0x7fd858107530 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85819f4d0 con 0x7fd858107530 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.939+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8581a5b90 con 0x7fd858107530 2024-09-10T23:34:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.941+0000 7fd860dd4740 1 Processor -- start 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.941+0000 7fd860dd4740 1 -- start start 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd8557fa640 1 -- 172.21.15.2:0/136154699 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd84c004e90 con 0x7fd858107530 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea46a0 0x55d80fea4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feb0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feb3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd860dd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d80fe1aea0 con 0x55d80fea4fc0 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd860dd4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d80fe0a2d0 con 0x55d80fea46a0 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd860dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d80fe0e0e0 con 0x55d80feb0f50 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feb0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feb0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46856/0 (socket says 172.21.15.2:46856) 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 -- 172.21.15.2:0/2796345490 learned_addr learned my addr 172.21.15.2:0/2796345490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd8577fe640 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feb3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea46a0 0x55d80fea4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 -- 172.21.15.2:0/2796345490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 msgr2=0x55d80feb3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feb3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 -- 172.21.15.2:0/2796345490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea46a0 msgr2=0x55d80fea4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea46a0 0x55d80fea4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.942+0000 7fd857fff640 1 -- 172.21.15.2:0/2796345490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fb68650 con 0x55d80fea4fc0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd857fff640 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feb0a10 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd848009900 tx=0x7fd848032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67520d965aad6195 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd8557fa640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8400b5390 0x7fd8400b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8400b5390 0x7fd8400b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd8557fa640 1 -- 172.21.15.2:0/136154699 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd84c0e6130 con 0x7fd858107530 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd83e7fc640 1 -- 172.21.15.2:0/2796345490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84803f070 con 0x55d80fea4fc0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd83e7fc640 1 -- 172.21.15.2:0/2796345490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd848032e40 con 0x55d80fea4fc0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd83e7fc640 1 -- 172.21.15.2:0/2796345490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848035070 con 0x55d80fea4fc0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd860dd4740 1 -- 172.21.15.2:0/2796345490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 msgr2=0x55d80feb0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8400b5390 0x7fd8400b7850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd850009370 tx=0x7fd850009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.943+0000 7fd860dd4740 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feb0a10 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd848009900 tx=0x7fd848032b90 comp rx=0 tx=0).stop 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 -- 172.21.15.2:0/2796345490 shutdown_connections 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feb3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feb0a10 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 --2- 172.21.15.2:0/2796345490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea46a0 0x55d80fea4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 -- 172.21.15.2:0/2796345490 >> 172.21.15.2:0/2796345490 conn(0x55d80fea24d0 msgr2=0x55d80fea3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 -- 172.21.15.2:0/2796345490 shutdown_connections 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 -- 172.21.15.2:0/2796345490 wait complete. 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 -- start start 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.944+0000 7fd860dd4740 1 Processor -- start 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea46a0 0x55d80feb0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feadc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d80fc6b700 con 0x55d80fea4fc0 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d80fda5160 con 0x55d80feb0f50 2024-09-10T23:34:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d80feb3b70 con 0x55d80fea46a0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd860dd4740 10 client.0 _ll_register_callbacks cb 0x55d80fdbe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feadc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feadc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46866/0 (socket says 172.21.15.2:46866) 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 -- 172.21.15.2:0/1301371307 learned_addr learned my addr 172.21.15.2:0/1301371307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd857fff640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea46a0 0x55d80feb0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 -- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea46a0 msgr2=0x55d80feb0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea46a0 0x55d80feb0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 -- 172.21.15.2:0/1301371307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 msgr2=0x55d80feae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 -- 172.21.15.2:0/1301371307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80fdd2c90 con 0x55d80fea4fc0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8577fe640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feadc90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fd84c017040 tx=0x7fd84c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adac8affff03ed56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8377fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.945+0000 7fd8377fe640 1 -- 172.21.15.2:0/1301371307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0ac6d0 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd8377fe640 1 -- 172.21.15.2:0/1301371307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd84c0a8b70 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d80fe1cdf0 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd8377fe640 1 -- 172.21.15.2:0/1301371307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd84c0ac070 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 10 client.18942 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d80febf530 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd8377fe640 1 -- 172.21.15.2:0/1301371307 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d80fe1cdf0 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd8377fe640 1 -- 172.21.15.2:0/1301371307 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd84c0b5a00 con 0x55d80fea4fc0 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 10 client.18942 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 10 client.18942 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 20 client.18942 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80fec09f0 0x55d80fec2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 4 client.18942 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d80fe188a0 con 0x55d80fec09f0 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.946+0000 7fd857fff640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80fec09f0 0x55d80fec2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.947+0000 7fd857fff640 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80fec09f0 0x55d80fec2de0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ede0f787e1b5eb74 server_cookie=209cbb8621446b7c in_seq=0 out_seq=0 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.947+0000 7fd8377fe640 10 client.18942 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd8377fe640 1 -- 172.21.15.2:0/1301371307 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d80fe188a0 con 0x55d80fec09f0 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd8377fe640 10 client.18942 handle_command_reply: tid=0 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 client.18942 shutdown 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 msgr2=0x55d80feadc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feadc90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fd84c017040 tx=0x7fd84c009310 comp rx=0 tx=0).stop 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 shutdown_connections 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80fec09f0 0x55d80fec2de0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea4fc0 0x55d80feadc90 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd8377fe640 0 client.18942 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1301371307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea46a0 0x55d80feb0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 >> 172.21.15.2:0/1301371307 conn(0x55d80fea24d0 msgr2=0x55d80fea8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 shutdown_connections 2024-09-10T23:34:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 1 -- 172.21.15.2:0/1301371307 wait complete. 2024-09-10T23:34:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.948+0000 7fd860dd4740 20 client.18942 trim_cache size 0 max 16384 2024-09-10T23:34:13.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 Processor -- start 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 -- start start 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80febcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea4fc0 0x55d80fea1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feb2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581ae180 con 0x55d80fea46a0 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581afcc0 con 0x55d80feb0f50 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.961+0000 7fd860dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581ae850 con 0x55d80fea4fc0 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80febcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80febcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46878/0 (socket says 172.21.15.2:46878) 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 -- 172.21.15.2:0/1928949943 learned_addr learned my addr 172.21.15.2:0/1928949943 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd8577fe640 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea4fc0 0x55d80fea1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 -- 172.21.15.2:0/1928949943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea4fc0 msgr2=0x55d80fea1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea4fc0 0x55d80fea1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 -- 172.21.15.2:0/1928949943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 msgr2=0x55d80feb2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feb2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 -- 172.21.15.2:0/1928949943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fec3440 con 0x55d80fea46a0 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd8577fe640 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea4fc0 0x55d80fea1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd857fff640 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80febcdd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd8480095d0 tx=0x7fd848000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f6d8d2ca50152e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd83dffb640 1 -- 172.21.15.2:0/1928949943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84803f040 con 0x55d80fea46a0 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd83dffb640 1 -- 172.21.15.2:0/1928949943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd848031d10 con 0x55d80fea46a0 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.962+0000 7fd83dffb640 1 -- 172.21.15.2:0/1928949943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848035040 con 0x55d80fea46a0 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 -- 172.21.15.2:0/1928949943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 msgr2=0x55d80febcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80febcdd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd8480095d0 tx=0x7fd848000bc0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 -- 172.21.15.2:0/1928949943 shutdown_connections 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80feb0f50 0x55d80feb2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80fea4fc0 0x55d80fea1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 --2- 172.21.15.2:0/1928949943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80febcdd0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 -- 172.21.15.2:0/1928949943 >> 172.21.15.2:0/1928949943 conn(0x55d80fea24d0 msgr2=0x55d80fea0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 -- 172.21.15.2:0/1928949943 shutdown_connections 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.963+0000 7fd860dd4740 1 -- 172.21.15.2:0/1928949943 wait complete. 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 -- start start 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 Processor -- start 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80feb9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea4fc0 0x55d80feb9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feaa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581af5f0 con 0x55d80fea46a0 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581aef20 con 0x55d80fea4fc0 2024-09-10T23:34:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581ac160 con 0x55d80feb0f50 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd860dd4740 10 client.0 _ll_register_callbacks cb 0x7fd84c0e9900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd857fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80feb9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd857fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80feb9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46882/0 (socket says 172.21.15.2:46882) 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.964+0000 7fd857fff640 1 -- 172.21.15.2:0/3532554865 learned_addr learned my addr 172.21.15.2:0/3532554865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8577fe640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea4fc0 0x55d80feb9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd857fff640 1 -- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 msgr2=0x55d80feaa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd85cf9c640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feaa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd857fff640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feaa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd857fff640 1 -- 172.21.15.2:0/3532554865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea4fc0 msgr2=0x55d80feb9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd857fff640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea4fc0 0x55d80feb9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd857fff640 1 -- 172.21.15.2:0/3532554865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80feaeb60 con 0x55d80fea46a0 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8577fe640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea4fc0 0x55d80feb9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd857fff640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80feb9290 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd84802ab60 tx=0x7fd848031c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d03db013c33be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:13.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8377fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8377fe640 1 -- 172.21.15.2:0/3532554865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848059020 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8377fe640 1 -- 172.21.15.2:0/3532554865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd8480318b0 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd848031d10 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8377fe640 1 -- 172.21.15.2:0/3532554865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd84803f070 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd860dd4740 10 client.18948 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d80fea2f50 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.965+0000 7fd8377fe640 1 -- 172.21.15.2:0/3532554865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd848031d10 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd8377fe640 1 -- 172.21.15.2:0/3532554865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd84c0051b0 con 0x55d80fea46a0 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd860dd4740 10 client.18948 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd860dd4740 10 client.18948 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd860dd4740 20 client.18948 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:13.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd860dd4740 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80feaba00 0x55d80ff30890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd860dd4740 4 client.18948 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d80fe15cd0 con 0x55d80feaba00 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd8577fe640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80feaba00 0x55d80ff30890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd8577fe640 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80feaba00 0x55d80ff30890 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87bf25d88da110de server_cookie=f8ff022af7d672f9 in_seq=0 out_seq=0 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.966+0000 7fd8377fe640 10 client.18948 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd8377fe640 1 -- 172.21.15.2:0/3532554865 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d80fe15cd0 con 0x55d80feaba00 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd8377fe640 10 client.18948 handle_command_reply: tid=0 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 client.18948 shutdown 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 msgr2=0x55d80feb9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80feb9290 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd84802ab60 tx=0x7fd848031c20 comp rx=0 tx=0).stop 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 shutdown_connections 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55d80feaba00 0x55d80ff30890 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d80feb0f50 0x55d80feaa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d80fea4fc0 0x55d80feb9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 --2- 172.21.15.2:0/3532554865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80fea46a0 0x55d80feb9290 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 >> 172.21.15.2:0/3532554865 conn(0x55d80fea24d0 msgr2=0x55d80fea1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd8377fe640 0 client.18948 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 shutdown_connections 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 1 -- 172.21.15.2:0/3532554865 wait complete. 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.967+0000 7fd860dd4740 20 client.18948 trim_cache size 0 max 16384 2024-09-10T23:34:13.974 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8400b5390 msgr2=0x7fd8400b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8400b5390 0x7fd8400b7850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd850009370 tx=0x7fd850009720 comp rx=0 tx=0).stop 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 msgr2=0x7fd858199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 0x7fd858199670 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00e9f0 tx=0x7fd84c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 shutdown_connections 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd8400b5390 0x7fd8400b7850 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd858107eb0 0x7fd85819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd858107530 0x7fd858199670 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 --2- 172.21.15.2:0/136154699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd858100bb0 0x7fd858199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 >> 172.21.15.2:0/136154699 conn(0x7fd8580fc8c0 msgr2=0x7fd8580fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 shutdown_connections 2024-09-10T23:34:13.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:13.968+0000 7fd85d79d640 1 -- 172.21.15.2:0/136154699 wait complete. 2024-09-10T23:34:14.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:13 smithi002 ceph-mon[31150]: pgmap v648: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:34:14.266 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:13 smithi177 ceph-mon[35760]: pgmap v648: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:34:14.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:13 smithi154 ceph-mon[35136]: pgmap v648: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:34:14.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:34:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.580+0000 7f6250f2c640 1 -- 172.21.15.2:0/1165421840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c109170 msgr2=0x7f624c10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.580+0000 7f6250f2c640 1 --2- 172.21.15.2:0/1165421840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c109170 0x7f624c10f970 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f623c009ca0 tx=0x7f623c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 -- 172.21.15.2:0/1165421840 shutdown_connections 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 --2- 172.21.15.2:0/1165421840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c109170 0x7f624c10f970 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 --2- 172.21.15.2:0/1165421840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c1087f0 0x7f624c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 --2- 172.21.15.2:0/1165421840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c102de0 0x7f624c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 -- 172.21.15.2:0/1165421840 >> 172.21.15.2:0/1165421840 conn(0x7f624c0fe830 msgr2=0x7f624c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 -- 172.21.15.2:0/1165421840 shutdown_connections 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 -- 172.21.15.2:0/1165421840 wait complete. 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 Processor -- start 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.581+0000 7f6250f2c640 1 -- start start 2024-09-10T23:34:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6250f2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c102de0 0x7f624c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6250f2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 0x7f624c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6250f2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c109170 0x7f624c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6250f2c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f624c112e30 con 0x7f624c1087f0 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6250f2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f624c112cb0 con 0x7f624c102de0 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6250f2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f624c112fb0 con 0x7f624c109170 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 0x7f624c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 0x7f624c199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46900/0 (socket says 172.21.15.2:46900) 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 -- 172.21.15.2:0/2947843357 learned_addr learned my addr 172.21.15.2:0/2947843357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f624ad9d640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c109170 0x7f624c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f624a59c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c102de0 0x7f624c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 -- 172.21.15.2:0/2947843357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c109170 msgr2=0x7f624c19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c109170 0x7f624c19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 -- 172.21.15.2:0/2947843357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c102de0 msgr2=0x7f624c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c102de0 0x7f624c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 -- 172.21.15.2:0/2947843357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c19f2f0 con 0x7f624c1087f0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.582+0000 7f6249d9b640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 0x7f624c199780 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f623400d950 tx=0x7f623400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.583+0000 7f62437fe640 1 -- 172.21.15.2:0/2947843357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234017030 con 0x7f624c1087f0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.583+0000 7f62437fe640 1 -- 172.21.15.2:0/2947843357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6234004020 con 0x7f624c1087f0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.583+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c19f5e0 con 0x7f624c1087f0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.583+0000 7f62437fe640 1 -- 172.21.15.2:0/2947843357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340047a0 con 0x7f624c1087f0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.583+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1a5ca0 con 0x7f624c1087f0 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.585+0000 7f6253301740 1 Processor -- start 2024-09-10T23:34:15.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.585+0000 7f6253301740 1 -- start start 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.585+0000 7f62437fe640 1 -- 172.21.15.2:0/2947843357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6234009a30 con 0x7f624c1087f0 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.585+0000 7f6253301740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae2f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.585+0000 7f6253301740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2f0df0 0x55ecae2fc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f6253301740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2fcd80 0x55ecae2ff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f6253301740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ecae266ea0 con 0x55ecae2fcd80 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f6253301740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ecae2562d0 con 0x55ecae2f0df0 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f6253301740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ecae25a0e0 con 0x55ecae2f04d0 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f6249d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2fcd80 0x55ecae2ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae2f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae2f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:39964/0 (socket says 172.21.15.2:39964) 2024-09-10T23:34:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f6249d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2fcd80 0x55ecae2ff170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46902/0 (socket says 172.21.15.2:46902) 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 -- 172.21.15.2:0/1044229162 learned_addr learned my addr 172.21.15.2:0/1044229162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624a59c640 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2f0df0 0x55ecae2fc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 -- 172.21.15.2:0/1044229162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2f0df0 msgr2=0x55ecae2fc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2f0df0 0x55ecae2fc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 -- 172.21.15.2:0/1044229162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2fcd80 msgr2=0x55ecae2ff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2fcd80 0x55ecae2ff170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 -- 172.21.15.2:0/1044229162 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecadfb4650 con 0x55ecae2f04d0 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f624ad9d640 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae2f08b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f623c005fa0 tx=0x7f623c009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1fb13d98dcb6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.586+0000 7f62437fe640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62380b52e0 0x7f62380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.587+0000 7f624a59c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62380b52e0 0x7f62380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.587+0000 7f62437fe640 1 -- 172.21.15.2:0/2947843357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f62340e5550 con 0x7f624c1087f0 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.587+0000 7f6240ff9640 1 -- 172.21.15.2:0/1044229162 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c031cf0 con 0x55ecae2f04d0 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.587+0000 7f6240ff9640 1 -- 172.21.15.2:0/1044229162 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623c036030 con 0x55ecae2f04d0 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.587+0000 7f6240ff9640 1 -- 172.21.15.2:0/1044229162 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0042a0 con 0x55ecae2f04d0 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- 172.21.15.2:0/1044229162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 msgr2=0x55ecae2f08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f624a59c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62380b52e0 0x7f62380b77a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55ecae2ef1e0 tx=0x7f6244005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae2f08b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f623c005fa0 tx=0x7f623c009800 comp rx=0 tx=0).stop 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- 172.21.15.2:0/1044229162 shutdown_connections 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2fcd80 0x55ecae2ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2f0df0 0x55ecae2fc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- 172.21.15.2:0/1044229162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae2f08b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- 172.21.15.2:0/1044229162 >> 172.21.15.2:0/1044229162 conn(0x55ecae2ee300 msgr2=0x55ecae2ef4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:15.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- 172.21.15.2:0/1044229162 shutdown_connections 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- 172.21.15.2:0/1044229162 wait complete. 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- start start 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 Processor -- start 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2fc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ecae0b7700 con 0x55ecae2f04d0 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ecae1f1160 con 0x55ecae2fcd80 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ecae2ff820 con 0x55ecae2f0df0 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f6253301740 10 client.0 _ll_register_callbacks cb 0x55ecae20a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.588+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2fc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46918/0 (socket says 172.21.15.2:46918) 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 -- 172.21.15.2:0/4161802758 learned_addr learned my addr 172.21.15.2:0/4161802758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6249d9b640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624ad9d640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 -- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 msgr2=0x55ecae2f9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2f9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 -- 172.21.15.2:0/4161802758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 msgr2=0x55ecae2fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 -- 172.21.15.2:0/4161802758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecae21ec90 con 0x55ecae2f04d0 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624ad9d640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f624a59c640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2fc610 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f62440058c0 tx=0x7f6244004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe275433977e2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6231ffb640 1 -- 172.21.15.2:0/4161802758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244005020 con 0x55ecae2f04d0 2024-09-10T23:34:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f623c036030 con 0x55ecae2f04d0 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6231ffb640 1 -- 172.21.15.2:0/4161802758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f62440051c0 con 0x55ecae2f04d0 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6231ffb640 1 -- 172.21.15.2:0/4161802758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62440053c0 con 0x55ecae2f04d0 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6253301740 10 client.18960 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.589+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ecae30b1a0 con 0x55ecae2f04d0 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6231ffb640 1 -- 172.21.15.2:0/4161802758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623c036030 con 0x55ecae2f04d0 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6231ffb640 1 -- 172.21.15.2:0/4161802758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6244027070 con 0x55ecae2f04d0 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6253301740 10 client.18960 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6253301740 10 client.18960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6253301740 20 client.18960 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6253301740 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae30e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6253301740 4 client.18960 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecae268df0 con 0x55ecae30c600 2024-09-10T23:34:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6249d9b640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae30e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6231ffb640 10 client.18960 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.590+0000 7f6249d9b640 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae30e9f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3edf376c6639bb server_cookie=9020068c0c9de7d9 in_seq=0 out_seq=0 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6231ffb640 1 -- 172.21.15.2:0/4161802758 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ecae268df0 con 0x55ecae30c600 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6231ffb640 10 client.18960 handle_command_reply: tid=0 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6253301740 1 client.18960 shutdown 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 msgr2=0x55ecae2fc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6253301740 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2fc610 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f62440058c0 tx=0x7f6244004730 comp rx=0 tx=0).stop 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 shutdown_connections 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.591+0000 7f6253301740 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae30e9f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6231ffb640 0 client.18960 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:15.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2f9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 1 --2- 172.21.15.2:0/4161802758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2fc610 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 >> 172.21.15.2:0/4161802758 conn(0x55ecae2ee300 msgr2=0x55ecae2f3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 shutdown_connections 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 1 -- 172.21.15.2:0/4161802758 wait complete. 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.592+0000 7f6253301740 20 client.18960 trim_cache size 0 max 16384 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 Processor -- start 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 -- start start 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2fe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1ae2f0 con 0x55ecae2f04d0 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1afe30 con 0x55ecae2fcd80 2024-09-10T23:34:15.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6253301740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1ae9c0 con 0x55ecae2f0df0 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2edc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46930/0 (socket says 172.21.15.2:46930) 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 -- 172.21.15.2:0/1248827557 learned_addr learned my addr 172.21.15.2:0/1248827557 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6249d9b640 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 -- 172.21.15.2:0/1248827557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 msgr2=0x55ecae2fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 -- 172.21.15.2:0/1248827557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 msgr2=0x55ecae2fe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f624a59c640 1 -- 172.21.15.2:0/1248827557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecae2fc240 con 0x55ecae2f04d0 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.605+0000 7f6249d9b640 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f624a59c640 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2edc10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f624401e7c0 tx=0x7f6244009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adb9f3965f83963 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6233fff640 1 -- 172.21.15.2:0/1248827557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244005560 con 0x55ecae2f04d0 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6233fff640 1 -- 172.21.15.2:0/1248827557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f624402e030 con 0x55ecae2f04d0 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6233fff640 1 -- 172.21.15.2:0/1248827557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624401f8b0 con 0x55ecae2f04d0 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 -- 172.21.15.2:0/1248827557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 msgr2=0x55ecae2edc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2edc10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f624401e7c0 tx=0x7f6244009c20 comp rx=0 tx=0).stop 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 -- 172.21.15.2:0/1248827557 shutdown_connections 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae2fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f0df0 0x55ecae2fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 --2- 172.21.15.2:0/1248827557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f04d0 0x55ecae2edc10 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 -- 172.21.15.2:0/1248827557 >> 172.21.15.2:0/1248827557 conn(0x55ecae2ee300 msgr2=0x55ecae2f4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 -- 172.21.15.2:0/1248827557 shutdown_connections 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.606+0000 7f6253301740 1 -- 172.21.15.2:0/1248827557 wait complete. 2024-09-10T23:34:15.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 -- start start 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 Processor -- start 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae3138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 0x55ecae313e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae37d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1af760 con 0x55ecae2f0df0 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1af090 con 0x55ecae2fcd80 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1ac2d0 con 0x55ecae2f04d0 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6253301740 10 client.0 _ll_register_callbacks cb 0x7f6244009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 0x55ecae313e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 0x55ecae313e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46932/0 (socket says 172.21.15.2:46932) 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 -- 172.21.15.2:0/36438510 learned_addr learned my addr 172.21.15.2:0/36438510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:15.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f624ad9d640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae37d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f624a59c640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae3138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 -- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 msgr2=0x55ecae3138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae3138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 -- 172.21.15.2:0/36438510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 msgr2=0x55ecae37d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae37d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.607+0000 7f6249d9b640 1 -- 172.21.15.2:0/36438510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecae37da30 con 0x55ecae2f0df0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6249d9b640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 0x55ecae313e10 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f62340e3060 tx=0x7f623400df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fa6ebdcf0ff276 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6231ffb640 1 -- 172.21.15.2:0/36438510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340ab490 con 0x55ecae2f0df0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6231ffb640 1 -- 172.21.15.2:0/36438510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f62340930b0 con 0x55ecae2f0df0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f624402e030 con 0x55ecae2f0df0 2024-09-10T23:34:15.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6231ffb640 1 -- 172.21.15.2:0/36438510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62340ab830 con 0x55ecae2f0df0 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 10 client.18966 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ecae37ed00 con 0x55ecae2f0df0 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6231ffb640 1 -- 172.21.15.2:0/36438510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f624402e030 con 0x55ecae2f0df0 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6231ffb640 1 -- 172.21.15.2:0/36438510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6234085ce0 con 0x55ecae2f0df0 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 10 client.18966 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 10 client.18966 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 20 client.18966 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae381480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 4 client.18966 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.608+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ecae2648a0 con 0x55ecae30c600 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f624a59c640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae381480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f624a59c640 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae381480 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63df4d2ba30b3fc3 server_cookie=413467bc2a3c79d3 in_seq=0 out_seq=0 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6231ffb640 10 client.18966 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6231ffb640 1 -- 172.21.15.2:0/36438510 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ecae2648a0 con 0x55ecae30c600 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6231ffb640 10 client.18966 handle_command_reply: tid=0 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 client.18966 shutdown 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 msgr2=0x55ecae313e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 0x55ecae313e10 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f62340e3060 tx=0x7f623400df40 comp rx=0 tx=0).stop 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 shutdown_connections 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55ecae30c600 0x55ecae381480 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.637 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ecae2fcd80 0x55ecae37d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecae2f0df0 0x55ecae313e10 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6231ffb640 0 client.18966 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 --2- 172.21.15.2:0/36438510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ecae2f04d0 0x55ecae3138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.609+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 >> 172.21.15.2:0/36438510 conn(0x55ecae2ee300 msgr2=0x55ecae2fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 shutdown_connections 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6253301740 1 -- 172.21.15.2:0/36438510 wait complete. 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6253301740 20 client.18966 trim_cache size 0 max 16384 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62380b52e0 msgr2=0x7f62380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62380b52e0 0x7f62380b77a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55ecae2ef1e0 tx=0x7f6244005f90 comp rx=0 tx=0).stop 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 msgr2=0x7f624c199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 0x7f624c199780 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f623400d950 tx=0x7f623400de10 comp rx=0 tx=0).stop 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 shutdown_connections 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62380b52e0 0x7f62380b77a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c109170 0x7f624c19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1087f0 0x7f624c199780 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 --2- 172.21.15.2:0/2947843357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c102de0 0x7f624c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 >> 172.21.15.2:0/2947843357 conn(0x7f624c0fe830 msgr2=0x7f624c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 shutdown_connections 2024-09-10T23:34:15.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:15.610+0000 7f6250f2c640 1 -- 172.21.15.2:0/2947843357 wait complete. 2024-09-10T23:34:16.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:15 smithi002 ceph-mon[31150]: pgmap v649: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:16.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:15 smithi154 ceph-mon[35136]: pgmap v649: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:16.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:15 smithi177 ceph-mon[35760]: pgmap v649: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:16.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:34:16.849 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:17.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 -- 172.21.15.2:0/2263882333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd8108040 msgr2=0x7fcfd810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2263882333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd8108040 0x7fcfd810e840 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009ca0 tx=0x7fcfd002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 -- 172.21.15.2:0/2263882333 shutdown_connections 2024-09-10T23:34:17.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2263882333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd8108040 0x7fcfd810e840 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2263882333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd81076c0 0x7fcfd8107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2263882333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd8101cb0 0x7fcfd8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.334+0000 7fcfdf120640 1 -- 172.21.15.2:0/2263882333 >> 172.21.15.2:0/2263882333 conn(0x7fcfd80fd700 msgr2=0x7fcfd80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:17.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 -- 172.21.15.2:0/2263882333 shutdown_connections 2024-09-10T23:34:17.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 -- 172.21.15.2:0/2263882333 wait complete. 2024-09-10T23:34:17.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 Processor -- start 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 -- start start 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd8101cb0 0x7fcfd8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 0x7fcfd81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd8108040 0x7fcfd8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8111d00 con 0x7fcfd81076c0 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8111b80 con 0x7fcfd8108040 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfdf120640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8111e80 con 0x7fcfd8101cb0 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.335+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 0x7fcfd81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 0x7fcfd81983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46946/0 (socket says 172.21.15.2:46946) 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 -- 172.21.15.2:0/2978813173 learned_addr learned my addr 172.21.15.2:0/2978813173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd8108040 0x7fcfd8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd8101cb0 0x7fcfd8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 -- 172.21.15.2:0/2978813173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd8101cb0 msgr2=0x7fcfd8197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd8101cb0 0x7fcfd8197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 -- 172.21.15.2:0/2978813173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd8108040 msgr2=0x7fcfd8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd8108040 0x7fcfd8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 -- 172.21.15.2:0/2978813173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd81a7690 con 0x7fcfd81076c0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd8108040 0x7fcfd8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 0x7fcfd81983f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00b4a0 tx=0x7fcfcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd5ffb640 1 -- 172.21.15.2:0/2978813173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc014070 con 0x7fcfd81076c0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd5ffb640 1 -- 172.21.15.2:0/2978813173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfcc010ac0 con 0x7fcfd81076c0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd81a7980 con 0x7fcfd81076c0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.336+0000 7fcfd5ffb640 1 -- 172.21.15.2:0/2978813173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc017c30 con 0x7fcfd81076c0 2024-09-10T23:34:17.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.337+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd81a7f40 con 0x7fcfd81076c0 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfd5ffb640 1 -- 172.21.15.2:0/2978813173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcfcc010610 con 0x7fcfd81076c0 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 Processor -- start 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 -- start start 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b6f41bea0 con 0x564b6f4a5df0 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b6f40b2d0 con 0x564b6f4a54d0 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.339+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564b6f40f0e0 con 0x564b6f4b1d80 2024-09-10T23:34:17.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46962/0 (socket says 172.21.15.2:46962) 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 -- 172.21.15.2:0/4005671135 learned_addr learned my addr 172.21.15.2:0/4005671135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfd5ffb640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcfc00b52e0 0x7fcfc00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 -- 172.21.15.2:0/4005671135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 msgr2=0x564b6f4b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 -- 172.21.15.2:0/4005671135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 msgr2=0x564b6f4a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 -- 172.21.15.2:0/4005671135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6f169650 con 0x564b6f4a5df0 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcfc00b52e0 0x7fcfc00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfd5ffb640 1 -- 172.21.15.2:0/2978813173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcfcc0e5560 con 0x7fcfd81076c0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.340+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b1840 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800cbe0 tx=0x7fcfc800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c37883512c787d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfbeffd640 1 -- 172.21.15.2:0/4005671135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8010630 con 0x564b6f4a5df0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfbeffd640 1 -- 172.21.15.2:0/4005671135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc8010c80 con 0x564b6f4a5df0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfbeffd640 1 -- 172.21.15.2:0/4005671135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc801ab70 con 0x564b6f4a5df0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 -- 172.21.15.2:0/4005671135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 msgr2=0x564b6f4b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcfc00b52e0 0x7fcfc00b77a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002f500 tx=0x7fcfd00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b1840 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800cbe0 tx=0x7fcfc800e720 comp rx=0 tx=0).stop 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 -- 172.21.15.2:0/4005671135 shutdown_connections 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b1840 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/4005671135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 -- 172.21.15.2:0/4005671135 >> 172.21.15.2:0/4005671135 conn(0x564b6f4a3300 msgr2=0x564b6f4a44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:17.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.341+0000 7fcfe14f5740 1 -- 172.21.15.2:0/4005671135 shutdown_connections 2024-09-10T23:34:17.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 -- 172.21.15.2:0/4005671135 wait complete. 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 -- start start 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 Processor -- start 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a5df0 0x564b6f4aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 0x564b6f4af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b6f26c700 con 0x564b6f4b1d80 2024-09-10T23:34:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b6f3a6160 con 0x564b6f4a54d0 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564b6f4b4a00 con 0x564b6f4a5df0 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfe14f5740 10 client.0 _ll_register_callbacks cb 0x564b6f3bf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.342+0000 7fcfdd6bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 0x564b6f4af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 0x564b6f4af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46968/0 (socket says 172.21.15.2:46968) 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 -- 172.21.15.2:0/2257740928 learned_addr learned my addr 172.21.15.2:0/2257740928 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a5df0 0x564b6f4aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 -- 172.21.15.2:0/2257740928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a5df0 msgr2=0x564b6f4aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a5df0 0x564b6f4aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 -- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 msgr2=0x564b6f4b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 -- 172.21.15.2:0/2257740928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6f3d3c90 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 0x564b6f4af080 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009a60 tx=0x7fcfd002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2335b0b4a71f7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfb7fff640 1 -- 172.21.15.2:0/2257740928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0004450 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfb7fff640 1 -- 172.21.15.2:0/2257740928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcfd00045f0 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.343+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc8010c80 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfb7fff640 1 -- 172.21.15.2:0/2257740928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfd00047f0 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 10 client.18978 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b6f4c0340 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfb7fff640 1 -- 172.21.15.2:0/2257740928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc8010c80 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfb7fff640 1 -- 172.21.15.2:0/2257740928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcfd0030780 con 0x564b6f4b1d80 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 10 client.18978 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 10 client.18978 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:34:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 20 client.18978 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f4c17a0 0x564b6f4c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 4 client.18978 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b6f41ddf0 con 0x564b6f4c17a0 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.344+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f4c17a0 0x564b6f4c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.345+0000 7fcfb7fff640 10 client.18978 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.345+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f4c17a0 0x564b6f4c3bc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be94ece6cc498074 server_cookie=903c03bbe744a7d6 in_seq=0 out_seq=0 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfb7fff640 1 -- 172.21.15.2:0/2257740928 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b6f41ddf0 con 0x564b6f4c17a0 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfb7fff640 10 client.18978 handle_command_reply: tid=0 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 client.18978 shutdown 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 msgr2=0x564b6f4af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 0x564b6f4af080 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009a60 tx=0x7fcfd002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 shutdown_connections 2024-09-10T23:34:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f4c17a0 0x564b6f4c3bc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4b1d80 0x564b6f4af080 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a5df0 0x564b6f4aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/2257740928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfb7fff640 0 client.18978 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 >> 172.21.15.2:0/2257740928 conn(0x564b6f4a3300 msgr2=0x564b6f4a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 shutdown_connections 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 1 -- 172.21.15.2:0/2257740928 wait complete. 2024-09-10T23:34:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.346+0000 7fcfe14f5740 20 client.18978 trim_cache size 0 max 16384 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.359+0000 7fcfe14f5740 1 Processor -- start 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.359+0000 7fcfe14f5740 1 -- start start 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f49e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81b0640 con 0x564b6f4a5df0 2024-09-10T23:34:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81b2180 con 0x564b6f4a54d0 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81b0d10 con 0x564b6f4b1d80 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f49e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f49e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46984/0 (socket says 172.21.15.2:46984) 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfdcebc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 -- 172.21.15.2:0/145035357 learned_addr learned my addr 172.21.15.2:0/145035357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 -- 172.21.15.2:0/145035357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 msgr2=0x564b6f4a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 -- 172.21.15.2:0/145035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 msgr2=0x564b6f4bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 -- 172.21.15.2:0/145035357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6f4a3fe0 con 0x564b6f4a5df0 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.360+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f49e320 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0abcc0 tx=0x7fcfcc010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09fbc5d4b930de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfbe7fc640 1 -- 172.21.15.2:0/145035357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc01e070 con 0x564b6f4a5df0 2024-09-10T23:34:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfbe7fc640 1 -- 172.21.15.2:0/145035357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfcc017360 con 0x564b6f4a5df0 2024-09-10T23:34:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfbe7fc640 1 -- 172.21.15.2:0/145035357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0b0810 con 0x564b6f4a5df0 2024-09-10T23:34:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 -- 172.21.15.2:0/145035357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 msgr2=0x564b6f49e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f49e320 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0abcc0 tx=0x7fcfcc010f90 comp rx=0 tx=0).stop 2024-09-10T23:34:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 -- 172.21.15.2:0/145035357 shutdown_connections 2024-09-10T23:34:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4b1d80 0x564b6f4a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f49e320 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/145035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4a54d0 0x564b6f4bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 -- 172.21.15.2:0/145035357 >> 172.21.15.2:0/145035357 conn(0x564b6f4a3300 msgr2=0x564b6f4ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 -- 172.21.15.2:0/145035357 shutdown_connections 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.361+0000 7fcfe14f5740 1 -- 172.21.15.2:0/145035357 wait complete. 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 -- start start 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 Processor -- start 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a54d0 0x564b6f4b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4b1d80 0x564b6f52d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81b1ab0 con 0x564b6f4a5df0 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81b13e0 con 0x564b6f4b1d80 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81ae620 con 0x564b6f4a54d0 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfe14f5740 10 client.0 _ll_register_callbacks cb 0x7fcfd0009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:17.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46986/0 (socket says 172.21.15.2:46986) 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfd7fff640 1 -- 172.21.15.2:0/1884696201 learned_addr learned my addr 172.21.15.2:0/1884696201 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a54d0 0x564b6f4b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.362+0000 7fcfdd6bd640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4b1d80 0x564b6f52d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfd7fff640 1 -- 172.21.15.2:0/1884696201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a54d0 msgr2=0x564b6f4b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a54d0 0x564b6f4b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfd7fff640 1 -- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4b1d80 msgr2=0x564b6f52d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4b1d80 0x564b6f52d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfd7fff640 1 -- 172.21.15.2:0/1884696201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6f4b6d00 con 0x564b6f4a5df0 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfd7fff640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b6470 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc017600 tx=0x7fcfcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983b345b4cea5ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfb7fff640 1 -- 172.21.15.2:0/1884696201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc01e070 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfb7fff640 1 -- 172.21.15.2:0/1884696201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcfcc0a7fa0 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b6f4198a0 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfb7fff640 1 -- 172.21.15.2:0/1884696201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfcc0ab840 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 10 client.18984 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b6f52eca0 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfb7fff640 1 -- 172.21.15.2:0/1884696201 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564b6f4198a0 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfb7fff640 1 -- 172.21.15.2:0/1884696201 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcfcc093040 con 0x564b6f4a5df0 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 10 client.18984 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 10 client.18984 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 20 client.18984 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f52f3c0 0x564b6f5317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 4 client.18984 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.363+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b6f416cd0 con 0x564b6f52f3c0 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.364+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f52f3c0 0x564b6f5317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.364+0000 7fcfdcebc640 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f52f3c0 0x564b6f5317e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75af68a5c742f2f2 server_cookie=404452b40a134c8d in_seq=0 out_seq=0 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.364+0000 7fcfb7fff640 10 client.18984 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.364+0000 7fcfb7fff640 1 -- 172.21.15.2:0/1884696201 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b6f416cd0 con 0x564b6f52f3c0 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.364+0000 7fcfb7fff640 10 client.18984 handle_command_reply: tid=0 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.364+0000 7fcfe14f5740 1 client.18984 shutdown 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 msgr2=0x564b6f4b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b6470 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc017600 tx=0x7fcfcc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 shutdown_connections 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b6f4b1d80 0x564b6f52d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x564b6f52f3c0 0x564b6f5317e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f4a5df0 0x564b6f4b6470 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 --2- 172.21.15.2:0/1884696201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b6f4a54d0 0x564b6f4b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 >> 172.21.15.2:0/1884696201 conn(0x564b6f4a3300 msgr2=0x564b6f4b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:17.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfb7fff640 0 client.18984 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:17.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 shutdown_connections 2024-09-10T23:34:17.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 1 -- 172.21.15.2:0/1884696201 wait complete. 2024-09-10T23:34:17.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfe14f5740 20 client.18984 trim_cache size 0 max 16384 2024-09-10T23:34:17.371 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcfc00b52e0 msgr2=0x7fcfc00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcfc00b52e0 0x7fcfc00b77a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002f500 tx=0x7fcfd00095c0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 msgr2=0x7fcfd81983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.365+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 0x7fcfd81983f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00b4a0 tx=0x7fcfcc00b960 comp rx=0 tx=0).stop 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 shutdown_connections 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcfc00b52e0 0x7fcfc00b77a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfd8108040 0x7fcfd8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd81076c0 0x7fcfd81983f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 --2- 172.21.15.2:0/2978813173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd8101cb0 0x7fcfd8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:17.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 >> 172.21.15.2:0/2978813173 conn(0x7fcfd80fd700 msgr2=0x7fcfd8104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 shutdown_connections 2024-09-10T23:34:17.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:17.366+0000 7fcfdf120640 1 -- 172.21.15.2:0/2978813173 wait complete. 2024-09-10T23:34:18.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:34:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:17 smithi154 ceph-mon[35136]: pgmap v650: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:18.316 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:18.437 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:17 smithi002 ceph-mon[31150]: pgmap v650: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:18.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:17 smithi177 ceph-mon[35760]: pgmap v650: 97 pgs: 97 active+clean; 3.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3644140311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc109150 msgr2=0x7f70dc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3644140311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc109150 0x7f70dc10f950 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ca0 tx=0x7f70d402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3644140311 shutdown_connections 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3644140311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc109150 0x7f70dc10f950 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3644140311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 0x7f70dc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3644140311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc102dc0 0x7f70dc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3644140311 >> 172.21.15.2:0/3644140311 conn(0x7f70dc0fe830 msgr2=0x7f70dc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3644140311 shutdown_connections 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.986+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3644140311 wait complete. 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 Processor -- start 2024-09-10T23:34:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 -- start start 2024-09-10T23:34:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 0x7f70dc199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 0x7f70dc199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc109150 0x7f70dc19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc112e10 con 0x7f70dc102dc0 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc112c90 con 0x7f70dc1087d0 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.987+0000 7f70e3ee4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc112f90 con 0x7f70dc109150 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 0x7f70dc199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 0x7f70dc199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47010/0 (socket says 172.21.15.2:47010) 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 -- 172.21.15.2:0/3853964992 learned_addr learned my addr 172.21.15.2:0/3853964992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e2481640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc109150 0x7f70dc19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e147f640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 0x7f70dc199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 -- 172.21.15.2:0/3853964992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc109150 msgr2=0x7f70dc19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc109150 0x7f70dc19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 -- 172.21.15.2:0/3853964992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 msgr2=0x7f70dc199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 0x7f70dc199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 -- 172.21.15.2:0/3853964992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc19f2e0 con 0x7f70dc102dc0 2024-09-10T23:34:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e147f640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 0x7f70dc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.988+0000 7f70e1c80640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 0x7f70dc199230 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e9f0 tx=0x7f70d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.991+0000 7f70d2ffd640 1 -- 172.21.15.2:0/3853964992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d800cd80 con 0x7f70dc102dc0 2024-09-10T23:34:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.991+0000 7f70d2ffd640 1 -- 172.21.15.2:0/3853964992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d80054d0 con 0x7f70dc102dc0 2024-09-10T23:34:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.991+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70dc19f5d0 con 0x7f70dc102dc0 2024-09-10T23:34:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.991+0000 7f70d2ffd640 1 -- 172.21.15.2:0/3853964992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8010690 con 0x7f70dc102dc0 2024-09-10T23:34:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.991+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70dc1a5c90 con 0x7f70dc102dc0 2024-09-10T23:34:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.994+0000 7f70e62b9740 1 Processor -- start 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.994+0000 7f70d2ffd640 1 -- 172.21.15.2:0/3853964992 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f70d8004e90 con 0x7f70dc102dc0 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.994+0000 7f70e62b9740 1 -- start start 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.994+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2198b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.994+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da2199bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.994+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da2199e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e62b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55da21901ea0 con 0x55da2198b4d0 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e62b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da218f12d0 con 0x55da2199c190 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e62b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55da218f50e0 con 0x55da2198bdf0 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2198b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e1c80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da2199bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2198b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47022/0 (socket says 172.21.15.2:47022) 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 -- 172.21.15.2:0/1345383490 learned_addr learned my addr 172.21.15.2:0/1345383490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e147f640 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da2199e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 -- 172.21.15.2:0/1345383490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 msgr2=0x55da2199bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da2199bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 -- 172.21.15.2:0/1345383490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 msgr2=0x55da2199e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da2199e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 -- 172.21.15.2:0/1345383490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2164f650 con 0x55da2198b4d0 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e147f640 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da2199e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70e2481640 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2198b8b0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f70d4005f70 tx=0x7f70d4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea78007daef41f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70c7fff640 1 -- 172.21.15.2:0/1345383490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031cf0 con 0x55da2198b4d0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70d2ffd640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70c80b52e0 0x7f70c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.995+0000 7f70c7fff640 1 -- 172.21.15.2:0/1345383490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d4040070 con 0x55da2198b4d0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70c7fff640 1 -- 172.21.15.2:0/1345383490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4004040 con 0x55da2198b4d0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e1c80640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70c80b52e0 0x7f70c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70d2ffd640 1 -- 172.21.15.2:0/3853964992 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f70d80e6130 con 0x7f70dc102dc0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 -- 172.21.15.2:0/1345383490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 msgr2=0x55da2198b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e1c80640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70c80b52e0 0x7f70c80b77a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f70d80e3fb0 tx=0x7f70d80e9c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2198b8b0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f70d4005f70 tx=0x7f70d4009360 comp rx=0 tx=0).stop 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 -- 172.21.15.2:0/1345383490 shutdown_connections 2024-09-10T23:34:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da2199e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da2199bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1345383490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2198b8b0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 -- 172.21.15.2:0/1345383490 >> 172.21.15.2:0/1345383490 conn(0x55da21989300 msgr2=0x55da2198a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.996+0000 7f70e62b9740 1 -- 172.21.15.2:0/1345383490 shutdown_connections 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 -- 172.21.15.2:0/1345383490 wait complete. 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 -- start start 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 Processor -- start 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2199bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da21998f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da21999640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55da21752700 con 0x55da2198b4d0 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da2188c160 con 0x55da2199c190 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55da2199ede0 con 0x55da2198bdf0 2024-09-10T23:34:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e62b9740 10 client.0 _ll_register_callbacks cb 0x55da218a59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e2481640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2199bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e2481640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2199bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47030/0 (socket says 172.21.15.2:47030) 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.997+0000 7f70e2481640 1 -- 172.21.15.2:0/3991858044 learned_addr learned my addr 172.21.15.2:0/3991858044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e147f640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da21998f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da21999640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 -- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 msgr2=0x55da21998f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da21998f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 -- 172.21.15.2:0/3991858044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 msgr2=0x55da21999640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da21999640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 -- 172.21.15.2:0/3991858044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da218b9c90 con 0x55da2198b4d0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e2481640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2199bb20 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009a20 tx=0x7f70d4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31704a50407d62c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70c57fa640 1 -- 172.21.15.2:0/3991858044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d404e040 con 0x55da2198b4d0 2024-09-10T23:34:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70c57fa640 1 -- 172.21.15.2:0/3991858044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f70d402f860 con 0x55da2198b4d0 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d4040070 con 0x55da2198b4d0 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70c57fa640 1 -- 172.21.15.2:0/3991858044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70d402fa60 con 0x55da2198b4d0 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e62b9740 10 client.18996 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.998+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da219aa7b0 con 0x55da2198b4d0 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70c57fa640 1 -- 172.21.15.2:0/3991858044 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d4040070 con 0x55da2198b4d0 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70c57fa640 1 -- 172.21.15.2:0/3991858044 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70d4030c00 con 0x55da2198b4d0 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e62b9740 10 client.18996 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e62b9740 10 client.18996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e62b9740 20 client.18996 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e62b9740 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da219abb00 0x55da219adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e62b9740 4 client.18996 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da21903df0 con 0x55da219abb00 2024-09-10T23:34:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:18.999+0000 7f70e147f640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da219abb00 0x55da219adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.000+0000 7f70e147f640 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da219abb00 0x55da219adef0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2eda80735cb452 server_cookie=e7d7cb7df1860c5f in_seq=0 out_seq=0 2024-09-10T23:34:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.000+0000 7f70c57fa640 10 client.18996 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.000+0000 7f70c57fa640 1 -- 172.21.15.2:0/3991858044 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da21903df0 con 0x55da219abb00 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.000+0000 7f70c57fa640 10 client.18996 handle_command_reply: tid=0 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 client.18996 shutdown 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 msgr2=0x55da2199bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2199bb20 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009a20 tx=0x7f70d4003c00 comp rx=0 tx=0).stop 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 shutdown_connections 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da219abb00 0x55da219adef0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da21999640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198bdf0 0x55da21998f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70c57fa640 0 client.18996 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 --2- 172.21.15.2:0/3991858044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198b4d0 0x55da2199bb20 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 >> 172.21.15.2:0/3991858044 conn(0x55da21989300 msgr2=0x55da21988420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 shutdown_connections 2024-09-10T23:34:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 1 -- 172.21.15.2:0/3991858044 wait complete. 2024-09-10T23:34:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.001+0000 7f70e62b9740 20 client.18996 trim_cache size 0 max 16384 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.014+0000 7f70e62b9740 1 Processor -- start 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.014+0000 7f70e62b9740 1 -- start start 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198b4d0 0x55da21988c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da219b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e62b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc1ac1b0 con 0x55da2198bdf0 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e62b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc1adcf0 con 0x55da2199c190 2024-09-10T23:34:19.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e62b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc1ac880 con 0x55da2198b4d0 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47046/0 (socket says 172.21.15.2:47046) 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 -- 172.21.15.2:0/1103924254 learned_addr learned my addr 172.21.15.2:0/1103924254 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e2481640 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198b4d0 0x55da21988c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e2481640 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da219b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 -- 172.21.15.2:0/1103924254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198b4d0 msgr2=0x55da21988c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198b4d0 0x55da21988c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 -- 172.21.15.2:0/1103924254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 msgr2=0x55da219b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da219b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 -- 172.21.15.2:0/1103924254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2198bc20 con 0x55da2198bdf0 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e2481640 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198b4d0 0x55da21988c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70e147f640 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219a8080 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005fa0 tx=0x7f70cc00e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6703ad7428d43171 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:19.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.015+0000 7f70c77fe640 1 -- 172.21.15.2:0/1103924254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc004e60 con 0x55da2198bdf0 2024-09-10T23:34:19.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70c77fe640 1 -- 172.21.15.2:0/1103924254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70cc01f030 con 0x55da2198bdf0 2024-09-10T23:34:19.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70c77fe640 1 -- 172.21.15.2:0/1103924254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc003e50 con 0x55da2198bdf0 2024-09-10T23:34:19.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 -- 172.21.15.2:0/1103924254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 msgr2=0x55da219a8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219a8080 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005fa0 tx=0x7f70cc00e470 comp rx=0 tx=0).stop 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 -- 172.21.15.2:0/1103924254 shutdown_connections 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2199c190 0x55da219b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219a8080 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1103924254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2198b4d0 0x55da21988c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 -- 172.21.15.2:0/1103924254 >> 172.21.15.2:0/1103924254 conn(0x55da21989300 msgr2=0x55da2199d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 -- 172.21.15.2:0/1103924254 shutdown_connections 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.016+0000 7f70e62b9740 1 -- 172.21.15.2:0/1103924254 wait complete. 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 -- start start 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 Processor -- start 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2198b4d0 0x55da219af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2199c190 0x55da219afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc1ad620 con 0x55da2198bdf0 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc1acf50 con 0x55da2198b4d0 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc1aa190 con 0x55da2199c190 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e62b9740 10 client.0 _ll_register_callbacks cb 0x7f70d80e9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e147f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e147f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47058/0 (socket says 172.21.15.2:47058) 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.017+0000 7f70e147f640 1 -- 172.21.15.2:0/1692641086 learned_addr learned my addr 172.21.15.2:0/1692641086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e2481640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2199c190 0x55da219afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e2481640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2198b4d0 0x55da219af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e147f640 1 -- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2199c190 msgr2=0x55da219afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e147f640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2199c190 0x55da219afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e147f640 1 -- 172.21.15.2:0/1692641086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2198b4d0 msgr2=0x55da219af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e147f640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2198b4d0 0x55da219af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e147f640 1 -- 172.21.15.2:0/1692641086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da21a17870 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e2481640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2198b4d0 0x55da219af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e147f640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219af560 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005d00 tx=0x7f70cc004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ebbfc1e1477962 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70c57fa640 1 -- 172.21.15.2:0/1692641086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0036f0 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70c57fa640 1 -- 172.21.15.2:0/1692641086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f70cc003ab0 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70cc01f030 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70c57fa640 1 -- 172.21.15.2:0/1692641086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70cc003cb0 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e62b9740 10 client.19002 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.018+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da21a18aa0 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70c57fa640 1 -- 172.21.15.2:0/1692641086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70cc01f030 con 0x55da2198bdf0 2024-09-10T23:34:19.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70c57fa640 1 -- 172.21.15.2:0/1692641086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70cc00f040 con 0x55da2198bdf0 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e62b9740 10 client.19002 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e62b9740 10 client.19002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e62b9740 20 client.19002 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da21a19160 0x55da21a1b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e62b9740 4 client.19002 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da218ff8a0 con 0x55da21a19160 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.019+0000 7f70e2481640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da21a19160 0x55da21a1b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70c57fa640 10 client.19002 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e2481640 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da21a19160 0x55da21a1b580 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cdb5f1f7918f9a2 server_cookie=bcd6e4ad8d25f331 in_seq=0 out_seq=0 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70c57fa640 1 -- 172.21.15.2:0/1692641086 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da218ff8a0 con 0x55da21a19160 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70c57fa640 10 client.19002 handle_command_reply: tid=0 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 client.19002 shutdown 2024-09-10T23:34:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 msgr2=0x55da219af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219af560 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005d00 tx=0x7f70cc004f20 comp rx=0 tx=0).stop 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 shutdown_connections 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55da21a19160 0x55da21a1b580 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da2199c190 0x55da219afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55da2198bdf0 0x55da219af560 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 --2- 172.21.15.2:0/1692641086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da2198b4d0 0x55da219af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70c57fa640 0 client.19002 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 >> 172.21.15.2:0/1692641086 conn(0x55da21989300 msgr2=0x55da2199a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 shutdown_connections 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 1 -- 172.21.15.2:0/1692641086 wait complete. 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.020+0000 7f70e62b9740 20 client.19002 trim_cache size 0 max 16384 2024-09-10T23:34:19.026 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70c80b52e0 msgr2=0x7f70c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70c80b52e0 0x7f70c80b77a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f70d80e3fb0 tx=0x7f70d80e9c10 comp rx=0 tx=0).stop 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 msgr2=0x7f70dc199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 0x7f70dc199230 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e9f0 tx=0x7f70d800edf0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 shutdown_connections 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f70c80b52e0 0x7f70c80b77a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc109150 0x7f70dc19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70dc1087d0 0x7f70dc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 --2- 172.21.15.2:0/3853964992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70dc102dc0 0x7f70dc199230 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 >> 172.21.15.2:0/3853964992 conn(0x7f70dc0fe830 msgr2=0x7f70dc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 shutdown_connections 2024-09-10T23:34:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:19.021+0000 7f70e3ee4640 1 -- 172.21.15.2:0/3853964992 wait complete. 2024-09-10T23:34:20.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:19 smithi002 ceph-mon[31150]: pgmap v651: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:34:20.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:19 smithi154 ceph-mon[35136]: pgmap v651: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:34:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:19 smithi177 ceph-mon[35760]: pgmap v651: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-10T23:34:20.867 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:34:20.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:34:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3039968692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 msgr2=0x7f0ef410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3039968692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef410f950 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009ca0 tx=0x7f0eec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3039968692 shutdown_connections 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3039968692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef410f950 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3039968692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef41087d0 0x7f0ef4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3039968692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ef4102dc0 0x7f0ef41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.589+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3039968692 >> 172.21.15.2:0/3039968692 conn(0x7f0ef40fe830 msgr2=0x7f0ef4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.590+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3039968692 shutdown_connections 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.590+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3039968692 wait complete. 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.590+0000 7f0ef9be2640 1 Processor -- start 2024-09-10T23:34:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.590+0000 7f0ef9be2640 1 -- start start 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef9be2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ef4102dc0 0x7f0ef419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef9be2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef41087d0 0x7f0ef419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef9be2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef41a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef9be2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4112e10 con 0x7f0ef4109150 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef9be2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4112c90 con 0x7f0ef4102dc0 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef9be2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4112f90 con 0x7f0ef41087d0 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef41a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef41a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56442/0 (socket says 172.21.15.2:56442) 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3061067232 learned_addr learned my addr 172.21.15.2:0/3061067232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ef4102dc0 0x7f0ef419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3061067232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef41087d0 msgr2=0x7f0ef419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef41087d0 0x7f0ef419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3061067232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ef4102dc0 msgr2=0x7f0ef419b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ef4102dc0 0x7f0ef419b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3061067232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef41a15f0 con 0x7f0ef4109150 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.591+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef41a0e20 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0eec005cc0 tx=0x7f0eec02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.592+0000 7f0ef0ff9640 1 -- 172.21.15.2:0/3061067232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec003bf0 con 0x7f0ef4109150 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.592+0000 7f0ef0ff9640 1 -- 172.21.15.2:0/3061067232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0eec003d90 con 0x7f0ef4109150 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.592+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef41a1880 con 0x7f0ef4109150 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.592+0000 7f0ef0ff9640 1 -- 172.21.15.2:0/3061067232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec02fb20 con 0x7f0ef4109150 2024-09-10T23:34:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.592+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef41a8020 con 0x7f0ef4109150 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 Processor -- start 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0ef0ff9640 1 -- 172.21.15.2:0/3061067232 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0eec004580 con 0x7f0ef4109150 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 -- start start 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cb92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 0x564af7cc5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7cc7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564af7c2fe60 con 0x564af7cb9800 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564af7c1f290 con 0x564af7cb8ee0 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.594+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564af7c230a0 con 0x564af7cc5790 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 0x564af7cc5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 0x564af7cc5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56444/0 (socket says 172.21.15.2:56444) 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 -- 172.21.15.2:0/3276443960 learned_addr learned my addr 172.21.15.2:0/3276443960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cb92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7cc7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 -- 172.21.15.2:0/3276443960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 msgr2=0x564af7cc7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7cc7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 -- 172.21.15.2:0/3276443960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 msgr2=0x564af7cb92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cb92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 -- 172.21.15.2:0/3276443960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af797d930 con 0x564af7cb9800 2024-09-10T23:34:21.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cb92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 0x564af7cc5250 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009aa0 tx=0x7f0ee4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2507f5ab47042db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ed9ffb640 1 -- 172.21.15.2:0/3276443960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4017070 con 0x564af7cb9800 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ef0ff9640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0edc0b5360 0x7f0edc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ed9ffb640 1 -- 172.21.15.2:0/3276443960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee4013470 con 0x564af7cb9800 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.595+0000 7f0ed9ffb640 1 -- 172.21.15.2:0/3276443960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4012610 con 0x564af7cb9800 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0edc0b5360 0x7f0edc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0ef0ff9640 1 -- 172.21.15.2:0/3061067232 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0eec106f10 con 0x7f0ef4109150 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0edc0b5360 0x7f0edc0b7820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80058c0 tx=0x7f0ee8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3276443960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 msgr2=0x564af7cc5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 0x564af7cc5250 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009aa0 tx=0x7f0ee4009f60 comp rx=0 tx=0).stop 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3276443960 shutdown_connections 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7cc7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb9800 0x564af7cc5250 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3276443960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cb92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3276443960 >> 172.21.15.2:0/3276443960 conn(0x564af7cb6d10 msgr2=0x564af7cb7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:21.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3276443960 shutdown_connections 2024-09-10T23:34:21.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.596+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3276443960 wait complete. 2024-09-10T23:34:21.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 -- start start 2024-09-10T23:34:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 Processor -- start 2024-09-10T23:34:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cc2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cc2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 0x564af7cc31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564af7a80890 con 0x564af7cc5790 2024-09-10T23:34:21.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564af7bb9d40 con 0x564af7cb8ee0 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564af7cc8440 con 0x564af7cb9800 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0efbfb7740 10 client.0 _ll_register_callbacks cb 0x564af7c1dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 0x564af7cc31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 0x564af7cc31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56452/0 (socket says 172.21.15.2:56452) 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3684417792 learned_addr learned my addr 172.21.15.2:0/3684417792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.597+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cc2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cc2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 msgr2=0x564af7cc2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cc2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3684417792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 msgr2=0x564af7cc2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cc2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef3fff640 1 -- 172.21.15.2:0/3684417792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af7cd1820 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cc2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 0x564af7cc31a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0cd670 tx=0x7f0eec0cd1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c268f863ec4c0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ed2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/3684417792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec02fec0 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/3684417792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0eec0cd940 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee4013470 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/3684417792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0eec0cd6e0 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0efbfb7740 10 client.19014 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564af7cd4140 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.598+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/3684417792 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee4013470 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/3684417792 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0eec0e5030 con 0x564af7cc5790 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0efbfb7740 10 client.19014 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:21.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0efbfb7740 10 client.19014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0efbfb7740 20 client.19014 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7cd5640 0x564af7cd7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0efbfb7740 4 client.19014 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564af7c31db0 con 0x564af7cd5640 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.599+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7cd5640 0x564af7cd7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.600+0000 7f0ed2ffd640 10 client.19014 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.600+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7cd5640 0x564af7cd7a90 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76bdea6c81dd0ae8 server_cookie=bdbd989eddea4ac7 in_seq=0 out_seq=0 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/3684417792 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564af7c31db0 con 0x564af7cd5640 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0ed2ffd640 10 client.19014 handle_command_reply: tid=0 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 client.19014 shutdown 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 msgr2=0x564af7cc31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 0x564af7cc31a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0cd670 tx=0x7f0eec0cd1f0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 shutdown_connections 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7cd5640 0x564af7cd7a90 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cc5790 0x564af7cc31a0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cc2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/3684417792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb8ee0 0x564af7cc2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 >> 172.21.15.2:0/3684417792 conn(0x564af7cb6d10 msgr2=0x564af7cb5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0ed2ffd640 0 client.19014 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 shutdown_connections 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 1 -- 172.21.15.2:0/3684417792 wait complete. 2024-09-10T23:34:21.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.601+0000 7f0efbfb7740 20 client.19014 trim_cache size 0 max 16384 2024-09-10T23:34:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 Processor -- start 2024-09-10T23:34:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 -- start start 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7cc43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cbf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cc5790 0x564af7cbfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41b0610 con 0x564af7cb8ee0 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41b2150 con 0x564af7cc5790 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41b0ce0 con 0x564af7cb9800 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7cc43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7cc43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56468/0 (socket says 172.21.15.2:56468) 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 -- 172.21.15.2:0/2677479190 learned_addr learned my addr 172.21.15.2:0/2677479190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cbf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cc5790 0x564af7cbfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 -- 172.21.15.2:0/2677479190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 msgr2=0x564af7cbf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cbf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 -- 172.21.15.2:0/2677479190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cc5790 msgr2=0x564af7cbfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cc5790 0x564af7cbfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef37fe640 1 -- 172.21.15.2:0/2677479190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af7cb9630 con 0x564af7cb8ee0 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cc5790 0x564af7cbfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.619+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cbf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7cc43c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40099c0 tx=0x7f0ee4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9b93d50da28dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0ed97fa640 1 -- 172.21.15.2:0/2677479190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4017040 con 0x564af7cb8ee0 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0ed97fa640 1 -- 172.21.15.2:0/2677479190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee4025480 con 0x564af7cb8ee0 2024-09-10T23:34:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0ed97fa640 1 -- 172.21.15.2:0/2677479190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4006b60 con 0x564af7cb8ee0 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 -- 172.21.15.2:0/2677479190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 msgr2=0x564af7cc43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7cc43c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40099c0 tx=0x7f0ee4000bc0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 -- 172.21.15.2:0/2677479190 shutdown_connections 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cc5790 0x564af7cbfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cb9800 0x564af7cbf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/2677479190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7cc43c0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.620+0000 7f0efbfb7740 1 -- 172.21.15.2:0/2677479190 >> 172.21.15.2:0/2677479190 conn(0x564af7cb6d10 msgr2=0x564af7cbc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 -- 172.21.15.2:0/2677479190 shutdown_connections 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 -- 172.21.15.2:0/2677479190 wait complete. 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 -- start start 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 Processor -- start 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7ccdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb9800 0x564af7cca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7ccac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41b1a80 con 0x564af7cb8ee0 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.621+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41b13b0 con 0x564af7cb9800 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0efbfb7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41ae5f0 con 0x564af7cc5790 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0efbfb7740 10 client.0 _ll_register_callbacks cb 0x7f0eec005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7ccdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7ccdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56474/0 (socket says 172.21.15.2:56474) 2024-09-10T23:34:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 -- 172.21.15.2:0/1639884277 learned_addr learned my addr 172.21.15.2:0/1639884277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb9800 0x564af7cca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef3fff640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7ccac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 -- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 msgr2=0x564af7ccac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7ccac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 -- 172.21.15.2:0/1639884277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb9800 msgr2=0x564af7cca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb9800 0x564af7cca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 -- 172.21.15.2:0/1639884277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af7ccb410 con 0x564af7cb8ee0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ef37fe640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7ccdea0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4010010 tx=0x7f0ee400e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597207acb4e5215b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ed2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/1639884277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4025830 con 0x564af7cb8ee0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/1639884277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0ee40259d0 con 0x564af7cb8ee0 2024-09-10T23:34:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.622+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee4025480 con 0x564af7cb8ee0 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/1639884277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0ee40136d0 con 0x564af7cb8ee0 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 10 client.19020 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564af7d43550 con 0x564af7cb8ee0 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/1639884277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee4025480 con 0x564af7cb8ee0 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/1639884277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0ee4038900 con 0x564af7cb8ee0 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 10 client.19020 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 10 client.19020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 20 client.19020 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7d43890 0x564af7d45c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 4 client.19020 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564af7cd7e20 con 0x564af7d43890 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.623+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7d43890 0x564af7d45c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.624+0000 7f0ef2ffd640 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7d43890 0x564af7d45c80 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a28123010ff9ec server_cookie=18bf53d58f34d740 in_seq=0 out_seq=0 2024-09-10T23:34:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.624+0000 7f0ed2ffd640 10 client.19020 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0ed2ffd640 1 -- 172.21.15.2:0/1639884277 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564af7cd7e20 con 0x564af7d43890 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0ed2ffd640 10 client.19020 handle_command_reply: tid=0 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 client.19020 shutdown 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 msgr2=0x564af7ccdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7ccdea0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4010010 tx=0x7f0ee400e6f0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 shutdown_connections 2024-09-10T23:34:21.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x564af7d43890 0x564af7d45c80 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564af7cc5790 0x564af7ccac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564af7cb9800 0x564af7cca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 --2- 172.21.15.2:0/1639884277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564af7cb8ee0 0x564af7ccdea0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0ed2ffd640 0 client.19020 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 >> 172.21.15.2:0/1639884277 conn(0x564af7cb6d10 msgr2=0x564af7cbc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 shutdown_connections 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 1 -- 172.21.15.2:0/1639884277 wait complete. 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.626+0000 7f0efbfb7740 20 client.19020 trim_cache size 0 max 16384 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:34:21.631 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:34:21.632 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "bd71323f-7f21-4089-95dd-059cf2b66179", 2024-09-10T23:34:21.632 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:34:21.632 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0edc0b5360 msgr2=0x7f0edc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0edc0b5360 0x7f0edc0b7820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80058c0 tx=0x7f0ee8005e50 comp rx=0 tx=0).stop 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 msgr2=0x7f0ef41a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef41a0e20 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0eec005cc0 tx=0x7f0eec02f380 comp rx=0 tx=0).stop 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 shutdown_connections 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0edc0b5360 0x7f0edc0b7820 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ef4109150 0x7f0ef41a0e20 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef41087d0 0x7f0ef419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 --2- 172.21.15.2:0/3061067232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ef4102dc0 0x7f0ef419b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:21.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 >> 172.21.15.2:0/3061067232 conn(0x7f0ef40fe830 msgr2=0x7f0ef4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:21.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 shutdown_connections 2024-09-10T23:34:21.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:21.627+0000 7f0ef9be2640 1 -- 172.21.15.2:0/3061067232 wait complete. 2024-09-10T23:34:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:21 smithi154 ceph-mon[35136]: pgmap v652: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:22.303 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:21 smithi002 ceph-mon[31150]: pgmap v652: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:21 smithi177 ceph-mon[35760]: pgmap v652: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:22.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:34:22.735 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:22 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:34:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:22 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:22 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:34:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:22 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:23.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3870792300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf54109150 msgr2=0x7fbf5410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3870792300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf54109150 0x7fbf5410f950 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009ca0 tx=0x7fbf4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3870792300 shutdown_connections 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3870792300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf54109150 0x7fbf5410f950 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3870792300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf541087d0 0x7fbf54108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3870792300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54102dc0 0x7fbf541031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3870792300 >> 172.21.15.2:0/3870792300 conn(0x7fbf540fe830 msgr2=0x7fbf54100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3870792300 shutdown_connections 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.214+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3870792300 wait complete. 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 Processor -- start 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 -- start start 2024-09-10T23:34:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf54102dc0 0x7fbf54199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 0x7fbf541997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54109150 0x7fbf5419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112dd0 con 0x7fbf541087d0 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112c50 con 0x7fbf54109150 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.215+0000 7fbf5ae7d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112f50 con 0x7fbf54102dc0 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 0x7fbf541997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 0x7fbf541997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56496/0 (socket says 172.21.15.2:56496) 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 -- 172.21.15.2:0/3302670687 learned_addr learned my addr 172.21.15.2:0/3302670687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54109150 0x7fbf5419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf54102dc0 0x7fbf54199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 -- 172.21.15.2:0/3302670687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf54102dc0 msgr2=0x7fbf54199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf54102dc0 0x7fbf54199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 -- 172.21.15.2:0/3302670687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54109150 msgr2=0x7fbf5419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54109150 0x7fbf5419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 -- 172.21.15.2:0/3302670687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5419f310 con 0x7fbf541087d0 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54109150 0x7fbf5419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 0x7fbf541997a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000e9f0 tx=0x7fbf4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf51ffb640 1 -- 172.21.15.2:0/3302670687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000cd80 con 0x7fbf541087d0 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5419f600 con 0x7fbf541087d0 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf51ffb640 1 -- 172.21.15.2:0/3302670687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf400054d0 con 0x7fbf541087d0 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf51ffb640 1 -- 172.21.15.2:0/3302670687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40010690 con 0x7fbf541087d0 2024-09-10T23:34:23.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.216+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf541a5cc0 con 0x7fbf541087d0 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.219+0000 7fbf51ffb640 1 -- 172.21.15.2:0/3302670687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fbf40004e90 con 0x7fbf541087d0 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.219+0000 7fbf5d252740 1 Processor -- start 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.219+0000 7fbf5d252740 1 -- start start 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def707860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def7137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def716120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5d252740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557def67de50 con 0x557def713d30 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5d252740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557def66d280 con 0x557def707480 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5d252740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557def671090 con 0x557def707da0 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def716120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def707860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf58c19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def7137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def707860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:47390/0 (socket says 172.21.15.2:47390) 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 -- 172.21.15.2:0/3652480373 learned_addr learned my addr 172.21.15.2:0/3652480373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf51ffb640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf440b52e0 0x7fbf440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 -- 172.21.15.2:0/3652480373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 msgr2=0x557def7137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def7137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 -- 172.21.15.2:0/3652480373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 msgr2=0x557def716120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def716120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 -- 172.21.15.2:0/3652480373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557def3cb650 con 0x557def707480 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def716120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def7137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf51ffb640 1 -- 172.21.15.2:0/3302670687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbf400e6110 con 0x7fbf541087d0 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.220+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf440b52e0 0x7fbf440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.221+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def707860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009390 tx=0x7fbf4c0093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b4096188db034d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.221+0000 7fbf3effd640 1 -- 172.21.15.2:0/3652480373 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c04d070 con 0x557def707480 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.221+0000 7fbf3effd640 1 -- 172.21.15.2:0/3652480373 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c036040 con 0x557def707480 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.221+0000 7fbf3effd640 1 -- 172.21.15.2:0/3652480373 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c004800 con 0x557def707480 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 -- 172.21.15.2:0/3652480373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 msgr2=0x557def707860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def707860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009390 tx=0x7fbf4c0093c0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf440b52e0 0x7fbf440b77a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c04a000 tx=0x7fbf4c04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 -- 172.21.15.2:0/3652480373 shutdown_connections 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def716120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def7137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3652480373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def707860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 -- 172.21.15.2:0/3652480373 >> 172.21.15.2:0/3652480373 conn(0x557def7052b0 msgr2=0x557def706450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 -- 172.21.15.2:0/3652480373 shutdown_connections 2024-09-10T23:34:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 -- 172.21.15.2:0/3652480373 wait complete. 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 -- start start 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 Processor -- start 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.222+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707480 0x557def7135b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707da0 0x557def710a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def710fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557def4ce700 con 0x557def713d30 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557def608110 con 0x557def707da0 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557def7169b0 con 0x557def707480 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 10 client.0 _ll_register_callbacks cb 0x557def621990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:23.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def710fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def710fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56524/0 (socket says 172.21.15.2:56524) 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 -- 172.21.15.2:0/2501689125 learned_addr learned my addr 172.21.15.2:0/2501689125 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf58c19640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707480 0x557def7135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf53fff640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707da0 0x557def710a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 -- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707480 msgr2=0x557def7135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707480 0x557def7135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 -- 172.21.15.2:0/2501689125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707da0 msgr2=0x557def710a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707da0 0x557def710a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 -- 172.21.15.2:0/2501689125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557def635c40 con 0x557def713d30 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf53fff640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707da0 0x557def710a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5941a640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def710fa0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c02a900 tx=0x7fbf4c0319e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9324bb065489163 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf33fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:23.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf33fff640 1 -- 172.21.15.2:0/2501689125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c059070 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf33fff640 1 -- 172.21.15.2:0/2501689125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbf4c003970 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.223+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf4c036040 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf33fff640 1 -- 172.21.15.2:0/2501689125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf4c065050 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 10 client.19032 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557def722280 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf33fff640 1 -- 172.21.15.2:0/2501689125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c036040 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf33fff640 1 -- 172.21.15.2:0/2501689125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf4c043070 con 0x557def713d30 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 10 client.19032 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:23.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 10 client.19032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 20 client.19032 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7235d0 0x557def7259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 4 client.19032 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557def67fda0 con 0x557def7235d0 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.224+0000 7fbf58c19640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7235d0 0x557def7259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.225+0000 7fbf33fff640 10 client.19032 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.225+0000 7fbf58c19640 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7235d0 0x557def7259c0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1bd2a112d3a2ff server_cookie=872eda370d378f1b in_seq=0 out_seq=0 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.225+0000 7fbf33fff640 1 -- 172.21.15.2:0/2501689125 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557def67fda0 con 0x557def7235d0 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.225+0000 7fbf33fff640 10 client.19032 handle_command_reply: tid=0 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.225+0000 7fbf5d252740 1 client.19032 shutdown 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 msgr2=0x557def710fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def710fa0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c02a900 tx=0x7fbf4c0319e0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 shutdown_connections 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7235d0 0x557def7259c0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def710fa0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707da0 0x557def710a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf33fff640 0 client.19032 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 --2- 172.21.15.2:0/2501689125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707480 0x557def7135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 >> 172.21.15.2:0/2501689125 conn(0x557def7052b0 msgr2=0x557def70ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 shutdown_connections 2024-09-10T23:34:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 1 -- 172.21.15.2:0/2501689125 wait complete. 2024-09-10T23:34:23.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.226+0000 7fbf5d252740 20 client.19032 trim_cache size 0 max 16384 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 Processor -- start 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 -- start start 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def70dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def70e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def70a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541ae380 con 0x557def713d30 2024-09-10T23:34:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541afec0 con 0x557def707480 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.243+0000 7fbf5d252740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541aea50 con 0x557def707da0 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def70a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def70a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56538/0 (socket says 172.21.15.2:56538) 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 -- 172.21.15.2:0/3900313728 learned_addr learned my addr 172.21.15.2:0/3900313728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def70dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def70e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 -- 172.21.15.2:0/3900313728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 msgr2=0x557def70e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def70e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 -- 172.21.15.2:0/3900313728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 msgr2=0x557def70dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def70dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 -- 172.21.15.2:0/3900313728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557def70b730 con 0x557def713d30 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def70dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def70a570 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0099e0 tx=0x7fbf4c004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df81ce1d080222c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf3e7fc640 1 -- 172.21.15.2:0/3900313728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c059040 con 0x557def713d30 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf3e7fc640 1 -- 172.21.15.2:0/3900313728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c036070 con 0x557def713d30 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.244+0000 7fbf3e7fc640 1 -- 172.21.15.2:0/3900313728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c04d040 con 0x557def713d30 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 -- 172.21.15.2:0/3900313728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 msgr2=0x557def70a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def70a570 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0099e0 tx=0x7fbf4c004990 comp rx=0 tx=0).stop 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 -- 172.21.15.2:0/3900313728 shutdown_connections 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def713d30 0x557def70a570 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def707da0 0x557def70e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3900313728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def70dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 -- 172.21.15.2:0/3900313728 >> 172.21.15.2:0/3900313728 conn(0x557def7052b0 msgr2=0x557def712850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 -- 172.21.15.2:0/3900313728 shutdown_connections 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 -- 172.21.15.2:0/3900313728 wait complete. 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 -- start start 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.245+0000 7fbf5d252740 1 Processor -- start 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def7274c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 0x557def727a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def713d30 0x557def788170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541af7f0 con 0x557def707da0 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541af120 con 0x557def707480 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541ac360 con 0x557def713d30 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5d252740 10 client.0 _ll_register_callbacks cb 0x7fbf4c04b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 0x557def727a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5941a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def713d30 0x557def788170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 0x557def727a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56548/0 (socket says 172.21.15.2:56548) 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 -- 172.21.15.2:0/3903940448 learned_addr learned my addr 172.21.15.2:0/3903940448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def7274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 -- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def713d30 msgr2=0x557def788170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def713d30 0x557def788170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 -- 172.21.15.2:0/3903940448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 msgr2=0x557def7274c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def7274c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf53fff640 1 -- 172.21.15.2:0/3903940448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557def705d30 con 0x557def707da0 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.246+0000 7fbf5941a640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def713d30 0x557def788170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf53fff640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 0x557def727a40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ac5e0 tx=0x7fbf400a80b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bf1e45cbbdefc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf33fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf33fff640 1 -- 172.21.15.2:0/3903940448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf400ac6b0 con 0x557def707da0 2024-09-10T23:34:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf33fff640 1 -- 172.21.15.2:0/3903940448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fbf400b59e0 con 0x557def707da0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf4c036070 con 0x557def707da0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf33fff640 1 -- 172.21.15.2:0/3903940448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf400ac050 con 0x557def707da0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 10 client.19038 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557def790cb0 con 0x557def707da0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf33fff640 1 -- 172.21.15.2:0/3903940448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c036070 con 0x557def707da0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf33fff640 1 -- 172.21.15.2:0/3903940448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf400e80e0 con 0x557def707da0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 10 client.19038 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 10 client.19038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 20 client.19038 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7913e0 0x557def793800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 4 client.19038 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.247+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557def67b850 con 0x557def7913e0 2024-09-10T23:34:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7913e0 0x557def793800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf58c19640 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7913e0 0x557def793800 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed29edb70301578 server_cookie=274ce8ca375b5400 in_seq=0 out_seq=0 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf33fff640 10 client.19038 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf33fff640 1 -- 172.21.15.2:0/3903940448 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x557def67b850 con 0x557def7913e0 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf33fff640 10 client.19038 handle_command_reply: tid=0 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf5d252740 1 client.19038 shutdown 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 msgr2=0x557def727a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.248+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 0x557def727a40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ac5e0 tx=0x7fbf400a80b0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 shutdown_connections 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557def7913e0 0x557def793800 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557def713d30 0x557def788170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557def707da0 0x557def727a40 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf33fff640 0 client.19038 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 --2- 172.21.15.2:0/3903940448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557def707480 0x557def7274c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 >> 172.21.15.2:0/3903940448 conn(0x557def7052b0 msgr2=0x557def703bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 shutdown_connections 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 1 -- 172.21.15.2:0/3903940448 wait complete. 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5d252740 20 client.19038 trim_cache size 0 max 16384 2024-09-10T23:34:23.265 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "7781c901-0381-483c-8ccc-ce03feed1938": { 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:07.192812+0000", 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.266 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.267 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.269 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.270 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.271 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.272 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:34:23.273 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:34:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "bd71323f-7f21-4089-95dd-059cf2b66179": { 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:21.624379+0000", 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:23.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:23.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:23.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:23.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:23.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:23.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:23.280 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf440b52e0 msgr2=0x7fbf440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf440b52e0 0x7fbf440b77a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c04a000 tx=0x7fbf4c04b000 comp rx=0 tx=0).stop 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 msgr2=0x7fbf541997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 0x7fbf541997a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000e9f0 tx=0x7fbf4000edf0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.249+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 shutdown_connections 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fbf440b52e0 0x7fbf440b77a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf54109150 0x7fbf5419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf541087d0 0x7fbf541997a0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 --2- 172.21.15.2:0/3302670687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf54102dc0 0x7fbf54199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 >> 172.21.15.2:0/3302670687 conn(0x7fbf540fe830 msgr2=0x7fbf54100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 shutdown_connections 2024-09-10T23:34:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:23.250+0000 7fbf5ae7d640 1 -- 172.21.15.2:0/3302670687 wait complete. 2024-09-10T23:34:23.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:22 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:34:23.282 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:22 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:23.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:22 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:34:23.283 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:22 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:22 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:34:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:22 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:23.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:22 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:34:23.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:22 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:23.958 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:34:23.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:34:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:24 smithi002 ceph-mon[31150]: pgmap v653: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:24.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:24 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.271+0000 7f1f23660640 1 -- 172.21.15.2:0/3367723279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c103ad0 msgr2=0x7f1f1c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.271+0000 7f1f23660640 1 --2- 172.21.15.2:0/3367723279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c103ad0 0x7f1f1c103f50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009930 tx=0x7f1f0c02a420 comp rx=0 tx=0).stop 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 -- 172.21.15.2:0/3367723279 shutdown_connections 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 --2- 172.21.15.2:0/3367723279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c104490 0x7f1f1c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 --2- 172.21.15.2:0/3367723279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c103ad0 0x7f1f1c103f50 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 --2- 172.21.15.2:0/3367723279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c102980 0x7f1f1c102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 -- 172.21.15.2:0/3367723279 >> 172.21.15.2:0/3367723279 conn(0x7f1f1c0fe240 msgr2=0x7f1f1c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 -- 172.21.15.2:0/3367723279 shutdown_connections 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 -- 172.21.15.2:0/3367723279 wait complete. 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 Processor -- start 2024-09-10T23:34:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.272+0000 7f1f23660640 1 -- start start 2024-09-10T23:34:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 0x7f1f1c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c103ad0 0x7f1f1c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c104490 0x7f1f1c19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10e5d0 con 0x7f1f1c102980 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10e450 con 0x7f1f1c104490 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10e750 con 0x7f1f1c103ad0 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 0x7f1f1c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 0x7f1f1c198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56562/0 (socket says 172.21.15.2:56562) 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 -- 172.21.15.2:0/7025545 learned_addr learned my addr 172.21.15.2:0/7025545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c103ad0 0x7f1f1c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c104490 0x7f1f1c19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 -- 172.21.15.2:0/7025545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c103ad0 msgr2=0x7f1f1c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c103ad0 0x7f1f1c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 -- 172.21.15.2:0/7025545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c104490 msgr2=0x7f1f1c19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c104490 0x7f1f1c19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 -- 172.21.15.2:0/7025545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c19a8d0 con 0x7f1f1c102980 2024-09-10T23:34:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c104490 0x7f1f1c19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f213fc640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 0x7f1f1c198d90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800e9f0 tx=0x7f1f1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f127fc640 1 -- 172.21.15.2:0/7025545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800cd80 con 0x7f1f1c102980 2024-09-10T23:34:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f127fc640 1 -- 172.21.15.2:0/7025545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f180108e0 con 0x7f1f1c102980 2024-09-10T23:34:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f127fc640 1 -- 172.21.15.2:0/7025545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18018980 con 0x7f1f1c102980 2024-09-10T23:34:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.273+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c19abc0 con 0x7f1f1c102980 2024-09-10T23:34:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.274+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1a1290 con 0x7f1f1c102980 2024-09-10T23:34:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.276+0000 7f1f127fc640 1 -- 172.21.15.2:0/7025545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1f18010430 con 0x7f1f1c102980 2024-09-10T23:34:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.276+0000 7f1f2642d740 1 Processor -- start 2024-09-10T23:34:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.276+0000 7f1f2642d740 1 -- start start 2024-09-10T23:34:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.276+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 0x55e0e611d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.276+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e611f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.276+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e61224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f2642d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0e60886f0 con 0x55e0e611ac70 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f2642d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e0e6077b20 con 0x55e0e611d5a0 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f2642d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0e607b930 con 0x55e0e611ffe0 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 0x55e0e611d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 0x55e0e611d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56576/0 (socket says 172.21.15.2:56576) 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 -- 172.21.15.2:0/1089629145 learned_addr learned my addr 172.21.15.2:0/1089629145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f213fc640 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e611f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f127fc640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1f080b5360 0x7f1f080b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e61224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1f080b5360 0x7f1f080b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 -- 172.21.15.2:0/1089629145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 msgr2=0x55e0e61224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e61224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 -- 172.21.15.2:0/1089629145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 msgr2=0x55e0e611f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e611f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 -- 172.21.15.2:0/1089629145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e603d530 con 0x55e0e611ac70 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f127fc640 1 -- 172.21.15.2:0/7025545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1f180e5ed0 con 0x7f1f1c102980 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 0x55e0e611d060 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f1f14013940 tx=0x7f1f14013e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daeca73a620520b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.277+0000 7f1f077fe640 1 -- 172.21.15.2:0/1089629145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14011c40 con 0x55e0e611ac70 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f077fe640 1 -- 172.21.15.2:0/1089629145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14011de0 con 0x55e0e611ac70 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f077fe640 1 -- 172.21.15.2:0/1089629145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140057e0 con 0x55e0e611ac70 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 -- 172.21.15.2:0/1089629145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 msgr2=0x55e0e611d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1f080b5360 0x7f1f080b7820 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f14020000 tx=0x7f1f1401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 0x55e0e611d060 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f1f14013940 tx=0x7f1f14013e00 comp rx=0 tx=0).stop 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 -- 172.21.15.2:0/1089629145 shutdown_connections 2024-09-10T23:34:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e61224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e611f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 --2- 172.21.15.2:0/1089629145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ac70 0x55e0e611d060 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 -- 172.21.15.2:0/1089629145 >> 172.21.15.2:0/1089629145 conn(0x55e0e61119b0 msgr2=0x55e0e6112740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 -- 172.21.15.2:0/1089629145 shutdown_connections 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.278+0000 7f1f2642d740 1 -- 172.21.15.2:0/1089629145 wait complete. 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 -- start start 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 Processor -- start 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e6124330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e61249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 0x55e0e61255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0e5fafab0 con 0x55e0e611ffe0 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e0e601d730 con 0x55e0e611d5a0 2024-09-10T23:34:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0e6122fc0 con 0x55e0e611ac70 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f2642d740 10 client.0 _ll_register_callbacks cb 0x55e0e60716b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f21bfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 0x55e0e61255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f21bfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 0x55e0e61255a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56584/0 (socket says 172.21.15.2:56584) 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f21bfd640 1 -- 172.21.15.2:0/768701205 learned_addr learned my addr 172.21.15.2:0/768701205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.279+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e61249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f213fc640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e6124330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f21bfd640 1 -- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 msgr2=0x55e0e6124330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e6124330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f21bfd640 1 -- 172.21.15.2:0/768701205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 msgr2=0x55e0e61249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e61249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f21bfd640 1 -- 172.21.15.2:0/768701205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e5dd9790 con 0x55e0e611ffe0 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f213fc640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e6124330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e61249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 0x55e0e61255a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009690 tx=0x7f1f140049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb10e8da3a402ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f04ff9640 1 -- 172.21.15.2:0/768701205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14011c40 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f14011de0 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f04ff9640 1 -- 172.21.15.2:0/768701205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1f14022040 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f04ff9640 1 -- 172.21.15.2:0/768701205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f14005000 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f2642d740 10 client.19050 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0e5e52620 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.280+0000 7f1f04ff9640 1 -- 172.21.15.2:0/768701205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14011de0 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f04ff9640 1 -- 172.21.15.2:0/768701205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1f14026680 con 0x55e0e611ffe0 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f2642d740 10 client.19050 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f2642d740 10 client.19050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f2642d740 20 client.19050 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f2642d740 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e612fa60 0x55e0e6131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f2642d740 4 client.19050 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0e608a640 con 0x55e0e612fa60 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f213fc640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e612fa60 0x55e0e6131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f04ff9640 10 client.19050 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.281+0000 7f1f213fc640 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e612fa60 0x55e0e6131e50 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1493eb89a473d76 server_cookie=a1d555097230e2ca in_seq=0 out_seq=0 2024-09-10T23:34:24.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:24 smithi154 ceph-mon[35136]: pgmap v653: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:24.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:24 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:34:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f04ff9640 1 -- 172.21.15.2:0/768701205 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0e608a640 con 0x55e0e612fa60 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f04ff9640 10 client.19050 handle_command_reply: tid=0 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 client.19050 shutdown 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 msgr2=0x55e0e61255a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 0x55e0e61255a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009690 tx=0x7f1f140049e0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 shutdown_connections 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e612fa60 0x55e0e6131e50 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611ffe0 0x55e0e61255a0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f04ff9640 0 client.19050 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611d5a0 0x55e0e61249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 --2- 172.21.15.2:0/768701205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e6124330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.282+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 >> 172.21.15.2:0/768701205 conn(0x55e0e61119b0 msgr2=0x55e0e6110bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.283+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 shutdown_connections 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.283+0000 7f1f2642d740 1 -- 172.21.15.2:0/768701205 wait complete. 2024-09-10T23:34:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.283+0000 7f1f2642d740 20 client.19050 trim_cache size 0 max 16384 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.297+0000 7f1f2642d740 1 Processor -- start 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 -- start start 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e61203c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6120900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ffe0 0x55e0e6123390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1a7cf0 con 0x55e0e611d5a0 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1a9830 con 0x55e0e611ffe0 2024-09-10T23:34:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f2642d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1a83c0 con 0x55e0e611ac70 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6120900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6120900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56600/0 (socket says 172.21.15.2:56600) 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f213fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e61203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2452648289 learned_addr learned my addr 172.21.15.2:0/2452648289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ffe0 0x55e0e6123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2452648289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 msgr2=0x55e0e61203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e61203c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2452648289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ffe0 msgr2=0x55e0e6123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ffe0 0x55e0e6123390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2452648289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e611fd00 con 0x55e0e611d5a0 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f213fc640 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e61203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6120900 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c02a940 tx=0x7f1f0c031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58544206a6260c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.298+0000 7f1f06ffd640 1 -- 172.21.15.2:0/2452648289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c035070 con 0x55e0e611d5a0 2024-09-10T23:34:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f06ffd640 1 -- 172.21.15.2:0/2452648289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f0c031d70 con 0x55e0e611d5a0 2024-09-10T23:34:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f06ffd640 1 -- 172.21.15.2:0/2452648289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0038e0 con 0x55e0e611d5a0 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 -- 172.21.15.2:0/2452648289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 msgr2=0x55e0e6120900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6120900 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c02a940 tx=0x7f1f0c031bc0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 -- 172.21.15.2:0/2452648289 shutdown_connections 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ffe0 0x55e0e6123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6120900 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2452648289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ac70 0x55e0e61203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 -- 172.21.15.2:0/2452648289 >> 172.21.15.2:0/2452648289 conn(0x55e0e61119b0 msgr2=0x55e0e6112650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 -- 172.21.15.2:0/2452648289 shutdown_connections 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 -- 172.21.15.2:0/2452648289 wait complete. 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 -- start start 2024-09-10T23:34:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.299+0000 7f1f2642d740 1 Processor -- start 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ac70 0x55e0e6128ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6129560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e612a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1a9160 con 0x55e0e611d5a0 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1a8a90 con 0x55e0e611ac70 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1a5cd0 con 0x55e0e611ffe0 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f2642d740 10 client.0 _ll_register_callbacks cb 0x7f1f180a8540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6129560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6129560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56604/0 (socket says 172.21.15.2:56604) 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2281631507 learned_addr learned my addr 172.21.15.2:0/2281631507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f21bfd640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e612a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f213fc640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ac70 0x55e0e6128ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 msgr2=0x55e0e612a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e612a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2281631507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ac70 msgr2=0x55e0e6128ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ac70 0x55e0e6128ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 -- 172.21.15.2:0/2281631507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e612a960 con 0x55e0e611d5a0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f20bfb640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6129560 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005ab0 tx=0x7f1f0c03b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9c6a6599a95383 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.300+0000 7f1f04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f04ff9640 1 -- 172.21.15.2:0/2281631507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c035070 con 0x55e0e611d5a0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f04ff9640 1 -- 172.21.15.2:0/2281631507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1f0c041030 con 0x55e0e611d5a0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f0c031d70 con 0x55e0e611d5a0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f04ff9640 1 -- 172.21.15.2:0/2281631507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f0c03bad0 con 0x55e0e611d5a0 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 10 client.19056 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0e612bd70 con 0x55e0e611d5a0 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f04ff9640 1 -- 172.21.15.2:0/2281631507 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f0c031d70 con 0x55e0e611d5a0 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f04ff9640 1 -- 172.21.15.2:0/2281631507 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1f0c050430 con 0x55e0e611d5a0 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 10 client.19056 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 10 client.19056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 20 client.19056 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e619cb00 0x55e0e619ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 4 client.19056 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0e60860f0 con 0x55e0e619cb00 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.301+0000 7f1f213fc640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e619cb00 0x55e0e619ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.302+0000 7f1f213fc640 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e619cb00 0x55e0e619ef20 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fac5191558e714b server_cookie=e98d0d51309a0e1d in_seq=0 out_seq=0 2024-09-10T23:34:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.302+0000 7f1f04ff9640 10 client.19056 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f04ff9640 1 -- 172.21.15.2:0/2281631507 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e0e60860f0 con 0x55e0e619cb00 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f04ff9640 10 client.19056 handle_command_reply: tid=0 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 client.19056 shutdown 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 msgr2=0x55e0e6129560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6129560 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005ab0 tx=0x7f1f0c03b660 comp rx=0 tx=0).stop 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 shutdown_connections 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e0e619cb00 0x55e0e619ef20 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e0e611ffe0 0x55e0e612a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0e611d5a0 0x55e0e6129560 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 --2- 172.21.15.2:0/2281631507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0e611ac70 0x55e0e6128ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f04ff9640 0 client.19056 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 >> 172.21.15.2:0/2281631507 conn(0x55e0e61119b0 msgr2=0x55e0e61203c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 shutdown_connections 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 1 -- 172.21.15.2:0/2281631507 wait complete. 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.317+0000 7f1f2642d740 20 client.19056 trim_cache size 0 max 16384 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:34:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:34:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1f080b5360 msgr2=0x7f1f080b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1f080b5360 0x7f1f080b7820 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f14020000 tx=0x7f1f1401f000 comp rx=0 tx=0).stop 2024-09-10T23:34:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 msgr2=0x7f1f1c198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 0x7f1f1c198d90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800e9f0 tx=0x7f1f1800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 shutdown_connections 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1f080b5360 0x7f1f080b7820 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f1c104490 0x7f1f1c19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c103ad0 0x7f1f1c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 --2- 172.21.15.2:0/7025545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f1c102980 0x7f1f1c198d90 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 >> 172.21.15.2:0/7025545 conn(0x7f1f1c0fe240 msgr2=0x7f1f1c106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 shutdown_connections 2024-09-10T23:34:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:24.318+0000 7f1f23660640 1 -- 172.21.15.2:0/7025545 wait complete. 2024-09-10T23:34:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:24 smithi177 ceph-mon[35760]: pgmap v653: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:24.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:24 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:34:24.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1368038273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc4108060 msgr2=0x7fdfc410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1368038273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc4108060 0x7fdfc410e860 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009900 tx=0x7fdfbc02a410 comp rx=0 tx=0).stop 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1368038273 shutdown_connections 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1368038273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc4108060 0x7fdfc410e860 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1368038273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfc41076e0 0x7fdfc4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1368038273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc4101cd0 0x7fdfc41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1368038273 >> 172.21.15.2:0/1368038273 conn(0x7fdfc40fd720 msgr2=0x7fdfc40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1368038273 shutdown_connections 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.715+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1368038273 wait complete. 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 Processor -- start 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 -- start start 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfc4101cd0 0x7fdfc4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 0x7fdfc4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc4108060 0x7fdfc419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4111d30 con 0x7fdfc41076e0 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4111bb0 con 0x7fdfc4108060 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfcbf72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4111eb0 con 0x7fdfc4101cd0 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfc950d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 0x7fdfc4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfc950d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 0x7fdfc4199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56610/0 (socket says 172.21.15.2:56610) 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfc950d640 1 -- 172.21.15.2:0/1050653377 learned_addr learned my addr 172.21.15.2:0/1050653377 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.716+0000 7fdfc9d0e640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfc4101cd0 0x7fdfc4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfc950d640 1 -- 172.21.15.2:0/1050653377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfc4101cd0 msgr2=0x7fdfc4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfc950d640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfc4101cd0 0x7fdfc4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfc950d640 1 -- 172.21.15.2:0/1050653377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc4108060 msgr2=0x7fdfc419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfca50f640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc4108060 0x7fdfc419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfc950d640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc4108060 0x7fdfc419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfc950d640 1 -- 172.21.15.2:0/1050653377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc419f3b0 con 0x7fdfc41076e0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfc950d640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 0x7fdfc4199840 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d770 tx=0x7fdfb400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4017070 con 0x7fdfc41076e0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfb40054d0 con 0x7fdfc41076e0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004c30 con 0x7fdfc41076e0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc419f6a0 con 0x7fdfc41076e0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.717+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a5d60 con 0x7fdfc41076e0 2024-09-10T23:34:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.718+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc41020b0 con 0x7fdfc41076e0 2024-09-10T23:34:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.719+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdfb4004dd0 con 0x7fdfc41076e0 2024-09-10T23:34:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.720+0000 7fdfbaffd640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfb00b5360 0x7fdfb00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.720+0000 7fdfc9d0e640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfb00b5360 0x7fdfb00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.720+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdfb40e59a0 con 0x7fdfc41076e0 2024-09-10T23:34:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.721+0000 7fdfc9d0e640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfb00b5360 0x7fdfb00b7820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0005fd0 tx=0x7fdfc0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.723+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdfb40ac8f0 con 0x7fdfc41076e0 2024-09-10T23:34:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.944+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc402e5c0 con 0x7fdfc41076e0 2024-09-10T23:34:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.945+0000 7fdfbaffd640 1 -- 172.21.15.2:0/1050653377 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fdfb40ac1f0 con 0x7fdfc41076e0 2024-09-10T23:34:24.946 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:34:24.946 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:34:24.946 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:34:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.947+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfb00b5360 msgr2=0x7fdfb00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.947+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfb00b5360 0x7fdfb00b7820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0005fd0 tx=0x7fdfc0009680 comp rx=0 tx=0).stop 2024-09-10T23:34:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.947+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 msgr2=0x7fdfc4199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:24.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.947+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 0x7fdfc4199840 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d770 tx=0x7fdfb400dc30 comp rx=0 tx=0).stop 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.947+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 shutdown_connections 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfb00b5360 0x7fdfb00b7820 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc4108060 0x7fdfc419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfc41076e0 0x7fdfc4199840 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 --2- 172.21.15.2:0/1050653377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfc4101cd0 0x7fdfc4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 >> 172.21.15.2:0/1050653377 conn(0x7fdfc40fd720 msgr2=0x7fdfc406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 shutdown_connections 2024-09-10T23:34:24.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:24.948+0000 7fdfcbf72640 1 -- 172.21.15.2:0/1050653377 wait complete. 2024-09-10T23:34:25.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:25 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1050653377' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:34:25.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:25 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1050653377' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:34:25.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:25 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1050653377' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:34:25.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:34:25.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:26.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:26 smithi002 ceph-mon[31150]: pgmap v654: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:26.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:26 smithi154 ceph-mon[35136]: pgmap v654: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 -- 172.21.15.2:0/1293401493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 msgr2=0x7f8b5c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 --2- 172.21.15.2:0/1293401493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c10f950 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009ca0 tx=0x7f8b5402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 -- 172.21.15.2:0/1293401493 shutdown_connections 2024-09-10T23:34:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 --2- 172.21.15.2:0/1293401493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c10f950 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 --2- 172.21.15.2:0/1293401493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c1087d0 0x7f8b5c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 --2- 172.21.15.2:0/1293401493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b5c102dc0 0x7f8b5c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 -- 172.21.15.2:0/1293401493 >> 172.21.15.2:0/1293401493 conn(0x7f8b5c0fe830 msgr2=0x7f8b5c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 -- 172.21.15.2:0/1293401493 shutdown_connections 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 -- 172.21.15.2:0/1293401493 wait complete. 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 Processor -- start 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.352+0000 7f8b62980640 1 -- start start 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b5c102dc0 0x7f8b5c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c1087d0 0x7f8b5c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c112dd0 con 0x7f8b5c109150 2024-09-10T23:34:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c112c50 con 0x7f8b5c1087d0 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c112f50 con 0x7f8b5c102dc0 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56628/0 (socket says 172.21.15.2:56628) 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 -- 172.21.15.2:0/1626972041 learned_addr learned my addr 172.21.15.2:0/1626972041 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b5c102dc0 0x7f8b5c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c1087d0 0x7f8b5c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 -- 172.21.15.2:0/1626972041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b5c102dc0 msgr2=0x7f8b5c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b5c102dc0 0x7f8b5c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 -- 172.21.15.2:0/1626972041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c1087d0 msgr2=0x7f8b5c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c1087d0 0x7f8b5c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 -- 172.21.15.2:0/1626972041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c19f310 con 0x7f8b5c109150 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c19eb40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005cc0 tx=0x7f8b5402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b59ffb640 1 -- 172.21.15.2:0/1626972041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54003bf0 con 0x7f8b5c109150 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b59ffb640 1 -- 172.21.15.2:0/1626972041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b54003d90 con 0x7f8b5c109150 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c19f5a0 con 0x7f8b5c109150 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.353+0000 7f8b59ffb640 1 -- 172.21.15.2:0/1626972041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5402fbc0 con 0x7f8b5c109150 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.354+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c1a5cc0 con 0x7f8b5c109150 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 Processor -- start 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b59ffb640 1 -- 172.21.15.2:0/1626972041 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8b54004610 con 0x7f8b5c109150 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 -- start start 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 0x557a74ea48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea4df0 0x557a74eb0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a74e1aea0 con 0x557a74ea44d0 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557a74e0a2d0 con 0x557a74eb0d80 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.356+0000 7f8b64d55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557a74e0e0e0 con 0x557a74ea4df0 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 0x557a74ea48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 0x557a74ea48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56638/0 (socket says 172.21.15.2:56638) 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 -- 172.21.15.2:0/1744425767 learned_addr learned my addr 172.21.15.2:0/1744425767 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea4df0 0x557a74eb0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 -- 172.21.15.2:0/1744425767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea4df0 msgr2=0x557a74eb0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea4df0 0x557a74eb0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 -- 172.21.15.2:0/1744425767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 msgr2=0x557a74eb3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 -- 172.21.15.2:0/1744425767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a74b68650 con 0x557a74ea44d0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 0x557a74ea48b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8b44013520 tx=0x7f8b4400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836f47176f8da402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b59ffb640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8b480b5360 0x7f8b480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8b480b5360 0x7f8b480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b527fc640 1 -- 172.21.15.2:0/1744425767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44019030 con 0x557a74ea44d0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b59ffb640 1 -- 172.21.15.2:0/1626972041 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8b54107150 con 0x7f8b5c109150 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b527fc640 1 -- 172.21.15.2:0/1744425767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b44005bf0 con 0x557a74ea44d0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.357+0000 7f8b527fc640 1 -- 172.21.15.2:0/1744425767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4401d740 con 0x557a74ea44d0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 -- 172.21.15.2:0/1744425767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 msgr2=0x557a74ea48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8b480b5360 0x7f8b480b7820 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x557a74ea31e0 tx=0x7f8b4c00d300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 0x557a74ea48b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8b44013520 tx=0x7f8b4400b610 comp rx=0 tx=0).stop 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 -- 172.21.15.2:0/1744425767 shutdown_connections 2024-09-10T23:34:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea4df0 0x557a74eb0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1744425767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea44d0 0x557a74ea48b0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 -- 172.21.15.2:0/1744425767 >> 172.21.15.2:0/1744425767 conn(0x557a74ea2300 msgr2=0x557a74ea34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 -- 172.21.15.2:0/1744425767 shutdown_connections 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 -- 172.21.15.2:0/1744425767 wait complete. 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.358+0000 7f8b64d55740 1 -- start start 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 Processor -- start 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74eb0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74eadb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a74c6b700 con 0x557a74ea4df0 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557a74da5160 con 0x557a74eb0d80 2024-09-10T23:34:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557a74eb7d80 con 0x557a74ea44d0 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b64d55740 10 client.0 _ll_register_callbacks cb 0x557a74dbe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74eadb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74eadb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56646/0 (socket says 172.21.15.2:56646) 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b53fff640 1 -- 172.21.15.2:0/2546316524 learned_addr learned my addr 172.21.15.2:0/2546316524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74eb0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b53fff640 1 -- 172.21.15.2:0/2546316524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 msgr2=0x557a74eb0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.359+0000 7f8b53fff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74eb0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b53fff640 1 -- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 msgr2=0x557a74eae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b53fff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b53fff640 1 -- 172.21.15.2:0/2546316524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a74dd2c90 con 0x557a74ea4df0 2024-09-10T23:34:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74eb0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b53fff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74eadb70 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400bb70 tx=0x7f8b44011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd6ede1f1df2e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/2546316524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44019040 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a74e1cdf0 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/2546316524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8b440046c0 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/2546316524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b4400b2c0 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b64d55740 10 client.19074 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a74ec3720 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/2546316524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557a74e1cdf0 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/2546316524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8b44025070 con 0x557a74ea4df0 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b64d55740 10 client.19074 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.360+0000 7f8b64d55740 10 client.19074 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b64d55740 20 client.19074 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:26.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74ec6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b64d55740 4 client.19074 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a74e188a0 con 0x557a74ec4ad0 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74ec6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b3b7fe640 10 client.19074 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.361+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74ec6ec0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8efd32f7e64801e7 server_cookie=305661ee2d15cdad in_seq=0 out_seq=0 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/2546316524 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a74e188a0 con 0x557a74ec4ad0 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b3b7fe640 10 client.19074 handle_command_reply: tid=0 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 client.19074 shutdown 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 msgr2=0x557a74eadb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74eadb70 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400bb70 tx=0x7f8b44011f40 comp rx=0 tx=0).stop 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 shutdown_connections 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74ec6ec0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b3b7fe640 0 client.19074 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74eadb70 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.411 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2546316524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74eb0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 >> 172.21.15.2:0/2546316524 conn(0x557a74ea2300 msgr2=0x557a74ea7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 shutdown_connections 2024-09-10T23:34:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.362+0000 7f8b64d55740 1 -- 172.21.15.2:0/2546316524 wait complete. 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.363+0000 7f8b64d55740 20 client.19074 trim_cache size 0 max 16384 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 Processor -- start 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 -- start start 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ec0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74ea4df0 0x557a74eb2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 0x557a74eb26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1ac170 con 0x557a74eb0d80 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1adcb0 con 0x557a74ea4df0 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b64d55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1ac840 con 0x557a74ea44d0 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 0x557a74eb26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 0x557a74eb26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56650/0 (socket says 172.21.15.2:56650) 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 -- 172.21.15.2:0/2659271530 learned_addr learned my addr 172.21.15.2:0/2659271530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ec0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b53fff640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74ea4df0 0x557a74eb2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 -- 172.21.15.2:0/2659271530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 msgr2=0x557a74ec0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ec0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 -- 172.21.15.2:0/2659271530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74ea4df0 msgr2=0x557a74eb2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74ea4df0 0x557a74eb2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 -- 172.21.15.2:0/2659271530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a74ea2d80 con 0x557a74eb0d80 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ec0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b53fff640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74ea4df0 0x557a74eb2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.376+0000 7f8b60f1d640 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 0x557a74eb26b0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005e30 tx=0x7f8b54003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1502013399320a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b51ffb640 1 -- 172.21.15.2:0/2659271530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b540098d0 con 0x557a74eb0d80 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b51ffb640 1 -- 172.21.15.2:0/2659271530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b54036040 con 0x557a74eb0d80 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b51ffb640 1 -- 172.21.15.2:0/2659271530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b540d6eb0 con 0x557a74eb0d80 2024-09-10T23:34:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 -- 172.21.15.2:0/2659271530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 msgr2=0x557a74eb26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 0x557a74eb26b0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005e30 tx=0x7f8b54003f40 comp rx=0 tx=0).stop 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 -- 172.21.15.2:0/2659271530 shutdown_connections 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74eb0d80 0x557a74eb26b0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74ea4df0 0x557a74eb2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 --2- 172.21.15.2:0/2659271530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ec0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 -- 172.21.15.2:0/2659271530 >> 172.21.15.2:0/2659271530 conn(0x557a74ea2300 msgr2=0x557a74eaf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 -- 172.21.15.2:0/2659271530 shutdown_connections 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.377+0000 7f8b64d55740 1 -- 172.21.15.2:0/2659271530 wait complete. 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 -- start start 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 Processor -- start 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ebd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74ebd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1ad5e0 con 0x557a74ea4df0 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1acf10 con 0x557a74eb0d80 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1aa150 con 0x557a74ea44d0 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b64d55740 10 client.0 _ll_register_callbacks cb 0x7f8b44013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74ebd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74ebd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56660/0 (socket says 172.21.15.2:56660) 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 -- 172.21.15.2:0/1494857002 learned_addr learned my addr 172.21.15.2:0/1494857002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 -- 172.21.15.2:0/1494857002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 msgr2=0x557a74ebd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ebd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 -- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 msgr2=0x557a74eb7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.378+0000 7f8b53fff640 1 -- 172.21.15.2:0/1494857002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a74eb86d0 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b53fff640 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74ebd700 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x557a74ea1cc0 tx=0x7f8b44005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c9b2c336cb3542 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/1494857002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44036060 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/1494857002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8b4400bd60 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b54036040 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/1494857002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b44019030 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 10 client.19080 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a74f321f0 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/1494857002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b54036040 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/1494857002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8b44025070 con 0x557a74ea4df0 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 10 client.19080 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 10 client.19080 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 20 client.19080 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:26.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74f34980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 4 client.19080 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.379+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a74e15cd0 con 0x557a74ec4ad0 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74f34980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b3b7fe640 10 client.19080 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b5bfff640 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74f34980 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=80b4c67e35d629fc server_cookie=c964bdca44409975 in_seq=0 out_seq=0 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b3b7fe640 1 -- 172.21.15.2:0/1494857002 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a74e15cd0 con 0x557a74ec4ad0 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b3b7fe640 10 client.19080 handle_command_reply: tid=0 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 client.19080 shutdown 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 msgr2=0x557a74ebd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74ebd700 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x557a74ea1cc0 tx=0x7f8b44005fb0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 shutdown_connections 2024-09-10T23:34:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x557a74ec4ad0 0x557a74f34980 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a74eb0d80 0x557a74eb7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b3b7fe640 0 client.19080 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a74ea4df0 0x557a74ebd700 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 --2- 172.21.15.2:0/1494857002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557a74ea44d0 0x557a74ebd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.380+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 >> 172.21.15.2:0/1494857002 conn(0x557a74ea2300 msgr2=0x557a74ea0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 shutdown_connections 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b64d55740 1 -- 172.21.15.2:0/1494857002 wait complete. 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b64d55740 20 client.19080 trim_cache size 0 max 16384 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8b480b5360 msgr2=0x7f8b480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8b480b5360 0x7f8b480b7820 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x557a74ea31e0 tx=0x7f8b4c00d300 comp rx=0 tx=0).stop 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 msgr2=0x7f8b5c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c19eb40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005cc0 tx=0x7f8b5402f380 comp rx=0 tx=0).stop 2024-09-10T23:34:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 shutdown_connections 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8b480b5360 0x7f8b480b7820 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b5c109150 0x7f8b5c19eb40 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c1087d0 0x7f8b5c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 --2- 172.21.15.2:0/1626972041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b5c102dc0 0x7f8b5c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 >> 172.21.15.2:0/1626972041 conn(0x7f8b5c0fe830 msgr2=0x7f8b5c0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 shutdown_connections 2024-09-10T23:34:26.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:26.381+0000 7f8b62980640 1 -- 172.21.15.2:0/1626972041 wait complete. 2024-09-10T23:34:26.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:26 smithi177 ceph-mon[35760]: pgmap v654: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:27.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:34:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 -- 172.21.15.2:0/1182346338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30109150 msgr2=0x7ffa3010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/1182346338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30109150 0x7ffa3010f950 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009ca0 tx=0x7ffa2802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 -- 172.21.15.2:0/1182346338 shutdown_connections 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/1182346338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30109150 0x7ffa3010f950 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/1182346338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa301087d0 0x7ffa30108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/1182346338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa30102dc0 0x7ffa301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 -- 172.21.15.2:0/1182346338 >> 172.21.15.2:0/1182346338 conn(0x7ffa300fe830 msgr2=0x7ffa30100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 -- 172.21.15.2:0/1182346338 shutdown_connections 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.928+0000 7ffa35dbc640 1 -- 172.21.15.2:0/1182346338 wait complete. 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 Processor -- start 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 -- start start 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 0x7ffa30199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa301087d0 0x7ffa301997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa30109150 0x7ffa3019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30112dd0 con 0x7ffa30102dc0 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30112c50 con 0x7ffa30109150 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa35dbc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30112f50 con 0x7ffa301087d0 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa2f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 0x7ffa30199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa2f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 0x7ffa30199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56674/0 (socket says 172.21.15.2:56674) 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa2f7fe640 1 -- 172.21.15.2:0/2441636779 learned_addr learned my addr 172.21.15.2:0/2441636779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa30109150 0x7ffa3019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.929+0000 7ffa2effd640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa301087d0 0x7ffa301997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2f7fe640 1 -- 172.21.15.2:0/2441636779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa301087d0 msgr2=0x7ffa301997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa301087d0 0x7ffa301997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2f7fe640 1 -- 172.21.15.2:0/2441636779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa30109150 msgr2=0x7ffa3019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa30109150 0x7ffa3019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2f7fe640 1 -- 172.21.15.2:0/2441636779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3019f310 con 0x7ffa30102dc0 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2effd640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa301087d0 0x7ffa301997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 0x7ffa30199260 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000d950 tx=0x7ffa2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2cff9640 1 -- 172.21.15.2:0/2441636779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20017030 con 0x7ffa30102dc0 2024-09-10T23:34:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3019f600 con 0x7ffa30102dc0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2cff9640 1 -- 172.21.15.2:0/2441636779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa20004020 con 0x7ffa30102dc0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa2cff9640 1 -- 172.21.15.2:0/2441636779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa200047a0 con 0x7ffa30102dc0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.930+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa301a5cc0 con 0x7ffa30102dc0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 Processor -- start 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 -- start start 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2cff9640 1 -- 172.21.15.2:0/2441636779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ffa20009a30 con 0x7ffa30102dc0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 0x561b38ec78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ed7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ed8190 0x561b38eda580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b38e3dea0 con 0x561b38ec74d0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561b38e2d2d0 con 0x561b38ec7df0 2024-09-10T23:34:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa38191740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x561b38e310e0 con 0x561b38ed8190 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 0x561b38ec78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 0x561b38ec78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56690/0 (socket says 172.21.15.2:56690) 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 -- 172.21.15.2:0/1741941272 learned_addr learned my addr 172.21.15.2:0/1741941272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2effd640 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ed8190 0x561b38eda580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ed7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 -- 172.21.15.2:0/1741941272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ed8190 msgr2=0x561b38eda580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ed8190 0x561b38eda580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 -- 172.21.15.2:0/1741941272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 msgr2=0x561b38ed7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ed7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.933+0000 7ffa2ffff640 1 -- 172.21.15.2:0/1741941272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b38b8b650 con 0x561b38ec74d0 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ed7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 0x561b38ec78b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005cc0 tx=0x7ffa280093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45904c64f2cf958 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa2cff9640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa180b52e0 0x7ffa180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa180b52e0 0x7ffa180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa15ffb640 1 -- 172.21.15.2:0/1741941272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28031cf0 con 0x561b38ec74d0 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa15ffb640 1 -- 172.21.15.2:0/1741941272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa28036040 con 0x561b38ec74d0 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa15ffb640 1 -- 172.21.15.2:0/1741941272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa280042a0 con 0x561b38ec74d0 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.934+0000 7ffa2cff9640 1 -- 172.21.15.2:0/2441636779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffa200e57a0 con 0x7ffa30102dc0 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 -- 172.21.15.2:0/1741941272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 msgr2=0x561b38ec78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 0x561b38ec78b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005cc0 tx=0x7ffa280093e0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa2f7fe640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa180b52e0 0x7ffa180b77a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffa200e3620 tx=0x7ffa2001ade0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 -- 172.21.15.2:0/1741941272 shutdown_connections 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ed8190 0x561b38eda580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ed7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 --2- 172.21.15.2:0/1741941272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec74d0 0x561b38ec78b0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 -- 172.21.15.2:0/1741941272 >> 172.21.15.2:0/1741941272 conn(0x561b38ec5300 msgr2=0x561b38ec64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 -- 172.21.15.2:0/1741941272 shutdown_connections 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 -- 172.21.15.2:0/1741941272 wait complete. 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 -- start start 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.935+0000 7ffa38191740 1 Processor -- start 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ed7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 0x561b38ed4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ed8190 0x561b38ed55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b38c8e700 con 0x561b38ec7df0 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561b38dc8160 con 0x561b38ed8190 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x561b38edadb0 con 0x561b38ec74d0 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 10 client.0 _ll_register_callbacks cb 0x561b38de19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 0x561b38ed4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 0x561b38ed4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56702/0 (socket says 172.21.15.2:56702) 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 -- 172.21.15.2:0/3308744204 learned_addr learned my addr 172.21.15.2:0/3308744204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ed7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ed8190 0x561b38ed55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 -- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 msgr2=0x561b38ed7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ed7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 -- 172.21.15.2:0/3308744204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ed8190 msgr2=0x561b38ed55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ed8190 0x561b38ed55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 -- 172.21.15.2:0/3308744204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b38df5c90 con 0x561b38ec7df0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa2effd640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 0x561b38ed4f70 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ffa24010670 tx=0x7ffa24010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d3a1203aa2aa89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa0effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa0effd640 1 -- 172.21.15.2:0/3308744204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24004220 con 0x561b38ec7df0 2024-09-10T23:34:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa0effd640 1 -- 172.21.15.2:0/3308744204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffa240043c0 con 0x561b38ec7df0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.936+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa28036040 con 0x561b38ec7df0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa0effd640 1 -- 172.21.15.2:0/3308744204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa24010e70 con 0x561b38ec7df0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 10 client.19092 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b38ee6700 con 0x561b38ec7df0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa0effd640 1 -- 172.21.15.2:0/3308744204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa28036040 con 0x561b38ec7df0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa0effd640 1 -- 172.21.15.2:0/3308744204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa2400f040 con 0x561b38ec7df0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 10 client.19092 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 10 client.19092 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 20 client.19092 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38ee7cb0 0x561b38eea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 4 client.19092 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b38e3fdf0 con 0x561b38ee7cb0 2024-09-10T23:34:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.937+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38ee7cb0 0x561b38eea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.938+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38ee7cb0 0x561b38eea0a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dbd8eaf48cf27a2c server_cookie=e2717f8d0917c02b in_seq=0 out_seq=0 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.938+0000 7ffa0effd640 10 client.19092 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa0effd640 1 -- 172.21.15.2:0/3308744204 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b38e3fdf0 con 0x561b38ee7cb0 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa0effd640 10 client.19092 handle_command_reply: tid=0 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 client.19092 shutdown 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 msgr2=0x561b38ed4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 0x561b38ed4f70 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ffa24010670 tx=0x7ffa24010b30 comp rx=0 tx=0).stop 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 shutdown_connections 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38ee7cb0 0x561b38eea0a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ed8190 0x561b38ed55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ec7df0 0x561b38ed4f70 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa0effd640 0 client.19092 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 --2- 172.21.15.2:0/3308744204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ed7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 >> 172.21.15.2:0/3308744204 conn(0x561b38ec5300 msgr2=0x561b38ecaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 shutdown_connections 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 1 -- 172.21.15.2:0/3308744204 wait complete. 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.939+0000 7ffa38191740 20 client.19092 trim_cache size 0 max 16384 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 Processor -- start 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 -- start start 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec74d0 0x561b38ee3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec7df0 0x561b38eef990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38eefed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ac1b0 con 0x561b38ed8190 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301adcf0 con 0x561b38ec74d0 2024-09-10T23:34:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa38191740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ac880 con 0x561b38ec7df0 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38eefed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38eefed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56714/0 (socket says 172.21.15.2:56714) 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.952+0000 7ffa2ffff640 1 -- 172.21.15.2:0/503979187 learned_addr learned my addr 172.21.15.2:0/503979187 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa2ffff640 1 -- 172.21.15.2:0/503979187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec7df0 msgr2=0x561b38eef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec7df0 0x561b38eef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa2ffff640 1 -- 172.21.15.2:0/503979187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec74d0 msgr2=0x561b38ee3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec74d0 0x561b38ee3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa2ffff640 1 -- 172.21.15.2:0/503979187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b38ec7c20 con 0x561b38ed8190 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38eefed0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7ffa28003c90 tx=0x7ffa28003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ea8a2ab8804ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa157fa640 1 -- 172.21.15.2:0/503979187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2804a040 con 0x561b38ed8190 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa157fa640 1 -- 172.21.15.2:0/503979187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa28036040 con 0x561b38ed8190 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.953+0000 7ffa157fa640 1 -- 172.21.15.2:0/503979187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28004330 con 0x561b38ed8190 2024-09-10T23:34:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- 172.21.15.2:0/503979187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 msgr2=0x561b38eefed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38eefed0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7ffa28003c90 tx=0x7ffa28003c20 comp rx=0 tx=0).stop 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- 172.21.15.2:0/503979187 shutdown_connections 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38eefed0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec7df0 0x561b38eef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- 172.21.15.2:0/503979187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec74d0 0x561b38ee3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- 172.21.15.2:0/503979187 >> 172.21.15.2:0/503979187 conn(0x561b38ec5300 msgr2=0x561b38ec63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- 172.21.15.2:0/503979187 shutdown_connections 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- 172.21.15.2:0/503979187 wait complete. 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- start start 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 Processor -- start 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ee0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ee0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38edd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ad620 con 0x561b38ed8190 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301acf50 con 0x561b38ec7df0 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301aa190 con 0x561b38ec74d0 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.954+0000 7ffa38191740 10 client.0 _ll_register_callbacks cb 0x7ffa24009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38edd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38edd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56726/0 (socket says 172.21.15.2:56726) 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 -- 172.21.15.2:0/2955615873 learned_addr learned my addr 172.21.15.2:0/2955615873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ee0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2effd640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ee0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 -- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 msgr2=0x561b38ee0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ee0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 -- 172.21.15.2:0/2955615873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 msgr2=0x561b38ee0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ee0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 -- 172.21.15.2:0/2955615873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b38ee0df0 con 0x561b38ed8190 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2effd640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ee0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa2ffff640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38edd010 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005e30 tx=0x7ffa2802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55ea0c4d9a20f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa0effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa0effd640 1 -- 172.21.15.2:0/2955615873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28031bb0 con 0x561b38ed8190 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa0effd640 1 -- 172.21.15.2:0/2955615873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ffa28031d50 con 0x561b38ed8190 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa28036040 con 0x561b38ed8190 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa0effd640 1 -- 172.21.15.2:0/2955615873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa28031450 con 0x561b38ed8190 2024-09-10T23:34:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa38191740 10 client.19098 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.955+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b38f55200 con 0x561b38ed8190 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa0effd640 1 -- 172.21.15.2:0/2955615873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa28036040 con 0x561b38ed8190 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa0effd640 1 -- 172.21.15.2:0/2955615873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa2802f660 con 0x561b38ed8190 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa38191740 10 client.19098 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa38191740 10 client.19098 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa38191740 20 client.19098 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa38191740 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38f553d0 0x561b38f577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa38191740 4 client.19098 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b38e3b8a0 con 0x561b38f553d0 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa2effd640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38f553d0 0x561b38f577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa2effd640 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38f553d0 0x561b38f577c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6eb074da4acf5072 server_cookie=40bf20e805178413 in_seq=0 out_seq=0 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.956+0000 7ffa0effd640 10 client.19098 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa0effd640 1 -- 172.21.15.2:0/2955615873 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b38e3b8a0 con 0x561b38f553d0 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa0effd640 10 client.19098 handle_command_reply: tid=0 2024-09-10T23:34:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 client.19098 shutdown 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 msgr2=0x561b38edd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38edd010 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005e30 tx=0x7ffa2802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 shutdown_connections 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561b38f553d0 0x561b38f577c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b38ed8190 0x561b38edd010 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b38ec7df0 0x561b38ee0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa0effd640 0 client.19098 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 --2- 172.21.15.2:0/2955615873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561b38ec74d0 0x561b38ee0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 >> 172.21.15.2:0/2955615873 conn(0x561b38ec5300 msgr2=0x561b38ec3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 shutdown_connections 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 1 -- 172.21.15.2:0/2955615873 wait complete. 2024-09-10T23:34:27.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa38191740 20 client.19098 trim_cache size 0 max 16384 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa180b52e0 msgr2=0x7ffa180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa180b52e0 0x7ffa180b77a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffa200e3620 tx=0x7ffa2001ade0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.957+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 msgr2=0x7ffa30199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 0x7ffa30199260 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000d950 tx=0x7ffa2000de10 comp rx=0 tx=0).stop 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 shutdown_connections 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ffa180b52e0 0x7ffa180b77a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa30109150 0x7ffa3019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa301087d0 0x7ffa301997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 --2- 172.21.15.2:0/2441636779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa30102dc0 0x7ffa30199260 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 >> 172.21.15.2:0/2441636779 conn(0x7ffa300fe830 msgr2=0x7ffa300ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 shutdown_connections 2024-09-10T23:34:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:27.958+0000 7ffa35dbc640 1 -- 172.21.15.2:0/2441636779 wait complete. 2024-09-10T23:34:28.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:28 smithi002 ceph-mon[31150]: pgmap v655: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:34:28.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:28 smithi154 ceph-mon[35136]: pgmap v655: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:34:28.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:28 smithi177 ceph-mon[35760]: pgmap v655: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:34:28.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:34:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 -- 172.21.15.2:0/1420720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c109150 msgr2=0x7fa28c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 --2- 172.21.15.2:0/1420720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c109150 0x7fa28c10f950 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa284009ca0 tx=0x7fa28402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 -- 172.21.15.2:0/1420720637 shutdown_connections 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 --2- 172.21.15.2:0/1420720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c109150 0x7fa28c10f950 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 --2- 172.21.15.2:0/1420720637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c1087d0 0x7fa28c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 --2- 172.21.15.2:0/1420720637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c102dc0 0x7fa28c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 -- 172.21.15.2:0/1420720637 >> 172.21.15.2:0/1420720637 conn(0x7fa28c0fe830 msgr2=0x7fa28c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:29.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 -- 172.21.15.2:0/1420720637 shutdown_connections 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.437+0000 7fa293419640 1 -- 172.21.15.2:0/1420720637 wait complete. 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 Processor -- start 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 -- start start 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c102dc0 0x7fa28c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 0x7fa28c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c109150 0x7fa28c19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c112e10 con 0x7fa28c1087d0 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c112c90 con 0x7fa28c102dc0 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa293419640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c112f90 con 0x7fa28c109150 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 0x7fa28c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 0x7fa28c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56744/0 (socket says 172.21.15.2:56744) 2024-09-10T23:34:29.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 -- 172.21.15.2:0/1811215226 learned_addr learned my addr 172.21.15.2:0/1811215226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2911b5640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c102dc0 0x7fa28c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2919b6640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c109150 0x7fa28c19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 -- 172.21.15.2:0/1811215226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c109150 msgr2=0x7fa28c19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c109150 0x7fa28c19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 -- 172.21.15.2:0/1811215226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c102dc0 msgr2=0x7fa28c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c102dc0 0x7fa28c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2909b4640 1 -- 172.21.15.2:0/1811215226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c19f470 con 0x7fa28c1087d0 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.438+0000 7fa2919b6640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c109150 0x7fa28c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.439+0000 7fa2909b4640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 0x7fa28c199900 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00b4a0 tx=0x7fa27c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.439+0000 7fa2827fc640 1 -- 172.21.15.2:0/1811215226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c014070 con 0x7fa28c1087d0 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.439+0000 7fa2827fc640 1 -- 172.21.15.2:0/1811215226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa27c010ac0 con 0x7fa28c1087d0 2024-09-10T23:34:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.439+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c19f760 con 0x7fa28c1087d0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.439+0000 7fa2827fc640 1 -- 172.21.15.2:0/1811215226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c017c30 con 0x7fa28c1087d0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.439+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c1a5ff0 con 0x7fa28c1087d0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.441+0000 7fa2957ee740 1 Processor -- start 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.441+0000 7fa2827fc640 1 -- 172.21.15.2:0/1811215226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa27c010610 con 0x7fa28c1087d0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 -- start start 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b7ee841ea0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b7ee8312d0 con 0x55b7ee8cba10 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2957ee740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b7ee8350e0 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2919b6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56754/0 (socket says 172.21.15.2:56754) 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 -- 172.21.15.2:0/4083005430 learned_addr learned my addr 172.21.15.2:0/4083005430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2911b5640 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 -- 172.21.15.2:0/4083005430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 msgr2=0x55b7ee8cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 -- 172.21.15.2:0/4083005430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 msgr2=0x55b7ee8d7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.442+0000 7fa2909b4640 1 -- 172.21.15.2:0/4083005430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ee58f650 con 0x55b7ee8d79a0 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2909b4640 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d9d90 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0eb5e0 tx=0x7fa27c0eb6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48548b32abac64e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2827fc640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa2780b5360 0x7fa2780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2919b6640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa2780b5360 0x7fa2780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2777fe640 1 -- 172.21.15.2:0/4083005430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0f9070 con 0x55b7ee8d79a0 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2777fe640 1 -- 172.21.15.2:0/4083005430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa27c017360 con 0x55b7ee8d79a0 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2777fe640 1 -- 172.21.15.2:0/4083005430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0a82c0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.443+0000 7fa2827fc640 1 -- 172.21.15.2:0/1811215226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa27c0e5500 con 0x7fa28c1087d0 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 -- 172.21.15.2:0/4083005430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 msgr2=0x55b7ee8d9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2919b6640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa2780b5360 0x7fa2780b7820 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa284004af0 tx=0x7fa284005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d9d90 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0eb5e0 tx=0x7fa27c0eb6d0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 -- 172.21.15.2:0/4083005430 shutdown_connections 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d9d90 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 --2- 172.21.15.2:0/4083005430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 -- 172.21.15.2:0/4083005430 >> 172.21.15.2:0/4083005430 conn(0x55b7ee8c8f20 msgr2=0x55b7ee8ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 -- 172.21.15.2:0/4083005430 shutdown_connections 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 -- 172.21.15.2:0/4083005430 wait complete. 2024-09-10T23:34:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 -- start start 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.444+0000 7fa2957ee740 1 Processor -- start 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8d7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b7ee692700 con 0x55b7ee8d79a0 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b7ee7cc160 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b7ee8da620 con 0x55b7ee8cba10 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2957ee740 10 client.0 _ll_register_callbacks cb 0x55b7ee7e59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56768/0 (socket says 172.21.15.2:56768) 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 -- 172.21.15.2:0/3329921256 learned_addr learned my addr 172.21.15.2:0/3329921256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8d7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 -- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cba10 msgr2=0x55b7ee8d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 -- 172.21.15.2:0/3329921256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cb0f0 msgr2=0x55b7ee8d7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8d7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2919b6640 1 -- 172.21.15.2:0/3329921256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ee7f9c90 con 0x55b7ee8d79a0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.445+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8d7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2919b6640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d4d00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fa2840314d0 tx=0x7fa28402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca74f47e5f235a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa274ff9640 1 -- 172.21.15.2:0/3329921256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284004250 con 0x55b7ee8d79a0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa274ff9640 1 -- 172.21.15.2:0/3329921256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa2840043f0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7ee843df0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa274ff9640 1 -- 172.21.15.2:0/3329921256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa2840045f0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 10 client.19110 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7ee8e5f70 con 0x55b7ee8d79a0 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa274ff9640 1 -- 172.21.15.2:0/3329921256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b7ee843df0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa274ff9640 1 -- 172.21.15.2:0/3329921256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa284050070 con 0x55b7ee8d79a0 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 10 client.19110 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 10 client.19110 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 20 client.19110 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.446+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee8e7420 0x55b7ee8e9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.447+0000 7fa2957ee740 4 client.19110 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.447+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7ee83f8a0 con 0x55b7ee8e7420 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.447+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee8e7420 0x55b7ee8e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.447+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee8e7420 0x55b7ee8e9880 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e905c5114f97999 server_cookie=953676d1808df1a8 in_seq=0 out_seq=0 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.447+0000 7fa274ff9640 10 client.19110 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa274ff9640 1 -- 172.21.15.2:0/3329921256 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7ee83f8a0 con 0x55b7ee8e7420 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa274ff9640 10 client.19110 handle_command_reply: tid=0 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 client.19110 shutdown 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 msgr2=0x55b7ee8d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d4d00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fa2840314d0 tx=0x7fa28402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 shutdown_connections 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee8e7420 0x55b7ee8e9880 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d4d00 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3329921256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8d7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa274ff9640 0 client.19110 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 >> 172.21.15.2:0/3329921256 conn(0x55b7ee8c8f20 msgr2=0x55b7ee8cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 shutdown_connections 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.448+0000 7fa2957ee740 1 -- 172.21.15.2:0/3329921256 wait complete. 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.449+0000 7fa2957ee740 20 client.19110 trim_cache size 0 max 16384 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 Processor -- start 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 -- start start 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1ae480 con 0x55b7ee8cba10 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1affc0 con 0x55b7ee8d79a0 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2957ee740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1aeb50 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56774/0 (socket says 172.21.15.2:56774) 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 -- 172.21.15.2:0/3128252008 learned_addr learned my addr 172.21.15.2:0/3128252008 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 -- 172.21.15.2:0/3128252008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 msgr2=0x55b7ee8e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 -- 172.21.15.2:0/3128252008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8d79a0 msgr2=0x55b7ee8d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2919b6640 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2909b4640 1 -- 172.21.15.2:0/3128252008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ee8c9c00 con 0x55b7ee8cba10 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.462+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d6410 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fa27c000c00 tx=0x7fa27c017550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a8d4087f510b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa276ffd640 1 -- 172.21.15.2:0/3128252008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c05bf30 con 0x55b7ee8cba10 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa276ffd640 1 -- 172.21.15.2:0/3128252008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa27c0ab780 con 0x55b7ee8cba10 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa276ffd640 1 -- 172.21.15.2:0/3128252008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c05cc00 con 0x55b7ee8cba10 2024-09-10T23:34:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 -- 172.21.15.2:0/3128252008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 msgr2=0x55b7ee8d6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d6410 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fa27c000c00 tx=0x7fa27c017550 comp rx=0 tx=0).stop 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 -- 172.21.15.2:0/3128252008 shutdown_connections 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cba10 0x55b7ee8d6410 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3128252008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 -- 172.21.15.2:0/3128252008 >> 172.21.15.2:0/3128252008 conn(0x55b7ee8c8f20 msgr2=0x55b7ee8d5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 -- 172.21.15.2:0/3128252008 shutdown_connections 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.463+0000 7fa2957ee740 1 -- 172.21.15.2:0/3128252008 wait complete. 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 -- start start 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 Processor -- start 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8dfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1af8f0 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1af220 con 0x55b7ee8cba10 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c1ac460 con 0x55b7ee8d79a0 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2957ee740 10 client.0 _ll_register_callbacks cb 0x7fa284032f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2911b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2911b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8df8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56788/0 (socket says 172.21.15.2:56788) 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.464+0000 7fa2911b5640 1 -- 172.21.15.2:0/3225220712 learned_addr learned my addr 172.21.15.2:0/3225220712 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8dfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2919b6640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2911b5640 1 -- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8d79a0 msgr2=0x55b7ee8da8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8da8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2911b5640 1 -- 172.21.15.2:0/3225220712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 msgr2=0x55b7ee8dfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:29.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8dfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2911b5640 1 -- 172.21.15.2:0/3225220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ee8dae90 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2911b5640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8df8f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa2880058c0 tx=0x7fa288011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40f17c3c588f08b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa274ff9640 1 -- 172.21.15.2:0/3225220712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288011e10 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa274ff9640 1 -- 172.21.15.2:0/3225220712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa28801d680 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27c0ab780 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa274ff9640 1 -- 172.21.15.2:0/3225220712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa28801d880 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2957ee740 10 client.19116 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7ee954be0 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.465+0000 7fa274ff9640 1 -- 172.21.15.2:0/3225220712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa27c0ab780 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa274ff9640 1 -- 172.21.15.2:0/3225220712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa288024c80 con 0x55b7ee8cb0f0 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2957ee740 10 client.19116 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2957ee740 10 client.19116 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2957ee740 20 client.19116 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:29.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee955340 0x55b7ee957760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2957ee740 4 client.19116 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7ee83ccd0 con 0x55b7ee955340 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee955340 0x55b7ee957760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa274ff9640 10 client.19116 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.466+0000 7fa2909b4640 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee955340 0x55b7ee957760 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6aa6caf72e14c60a server_cookie=1603cd08cf0537d6 in_seq=0 out_seq=0 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa274ff9640 1 -- 172.21.15.2:0/3225220712 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7ee83ccd0 con 0x55b7ee955340 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa274ff9640 10 client.19116 handle_command_reply: tid=0 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 client.19116 shutdown 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 msgr2=0x55b7ee8df8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8df8f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa2880058c0 tx=0x7fa288011810 comp rx=0 tx=0).stop 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 shutdown_connections 2024-09-10T23:34:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b7ee955340 0x55b7ee957760 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b7ee8d79a0 0x55b7ee8da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa274ff9640 0 client.19116 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b7ee8cba10 0x55b7ee8dfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 --2- 172.21.15.2:0/3225220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b7ee8cb0f0 0x55b7ee8df8f0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 >> 172.21.15.2:0/3225220712 conn(0x55b7ee8c8f20 msgr2=0x55b7ee8d5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 shutdown_connections 2024-09-10T23:34:29.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 1 -- 172.21.15.2:0/3225220712 wait complete. 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.467+0000 7fa2957ee740 20 client.19116 trim_cache size 0 max 16384 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa2780b5360 msgr2=0x7fa2780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa2780b5360 0x7fa2780b7820 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa284004af0 tx=0x7fa284005d80 comp rx=0 tx=0).stop 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 msgr2=0x7fa28c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 0x7fa28c199900 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00b4a0 tx=0x7fa27c00b960 comp rx=0 tx=0).stop 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 shutdown_connections 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa2780b5360 0x7fa2780b7820 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa28c109150 0x7fa28c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa28c1087d0 0x7fa28c199900 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 --2- 172.21.15.2:0/1811215226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c102dc0 0x7fa28c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:29.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 >> 172.21.15.2:0/1811215226 conn(0x7fa28c0fe830 msgr2=0x7fa28c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:29.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 shutdown_connections 2024-09-10T23:34:29.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:29.468+0000 7fa293419640 1 -- 172.21.15.2:0/1811215226 wait complete. 2024-09-10T23:34:30.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:30 smithi002 ceph-mon[31150]: pgmap v656: 97 pgs: 97 active+clean; 3.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:34:30.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:34:30.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:30 smithi154 ceph-mon[35136]: pgmap v656: 97 pgs: 97 active+clean; 3.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:34:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:30 smithi177 ceph-mon[35760]: pgmap v656: 97 pgs: 97 active+clean; 3.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:34:30.487 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.947+0000 7f26cc066640 1 -- 172.21.15.2:0/4225690084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c4101cd0 msgr2=0x7f26c41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.947+0000 7f26cc066640 1 --2- 172.21.15.2:0/4225690084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c4101cd0 0x7f26c41020b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009900 tx=0x7f26c002a410 comp rx=0 tx=0).stop 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.947+0000 7f26cc066640 1 -- 172.21.15.2:0/4225690084 shutdown_connections 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.947+0000 7f26cc066640 1 --2- 172.21.15.2:0/4225690084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c4108060 0x7f26c410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.947+0000 7f26cc066640 1 --2- 172.21.15.2:0/4225690084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c41076e0 0x7f26c4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 --2- 172.21.15.2:0/4225690084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c4101cd0 0x7f26c41020b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 -- 172.21.15.2:0/4225690084 >> 172.21.15.2:0/4225690084 conn(0x7f26c40fd700 msgr2=0x7f26c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 -- 172.21.15.2:0/4225690084 shutdown_connections 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 -- 172.21.15.2:0/4225690084 wait complete. 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 Processor -- start 2024-09-10T23:34:30.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 -- start start 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.948+0000 7f26cc066640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c4101cd0 0x7f26c419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 0x7f26c419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c4108060 0x7f26c41a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4111d20 con 0x7f26c41076e0 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4111ba0 con 0x7f26c4108060 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4111ea0 con 0x7f26c4101cd0 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 0x7f26c419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 0x7f26c419b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56802/0 (socket says 172.21.15.2:56802) 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 -- 172.21.15.2:0/1759799395 learned_addr learned my addr 172.21.15.2:0/1759799395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26ca603640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c4108060 0x7f26c41a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9e02640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c4101cd0 0x7f26c419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 -- 172.21.15.2:0/1759799395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c4101cd0 msgr2=0x7f26c419b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c4101cd0 0x7f26c419b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 -- 172.21.15.2:0/1759799395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c4108060 msgr2=0x7f26c41a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c4108060 0x7f26c41a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 -- 172.21.15.2:0/1759799395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c41a1550 con 0x7f26c41076e0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9e02640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c4101cd0 0x7f26c419b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26c9601640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 0x7f26c419b9e0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c970 tx=0x7f26b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26baffd640 1 -- 172.21.15.2:0/1759799395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007bb0 con 0x7f26c41076e0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c41a1840 con 0x7f26c41076e0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26baffd640 1 -- 172.21.15.2:0/1759799395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b4007d50 con 0x7f26c41076e0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26baffd640 1 -- 172.21.15.2:0/1759799395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b400f450 con 0x7f26c41076e0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.949+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c41a7f00 con 0x7f26c41076e0 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26ce43b740 1 Processor -- start 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26ce43b740 1 -- start start 2024-09-10T23:34:30.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea2348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26baffd640 1 -- 172.21.15.2:0/1759799395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f26b4004f20 con 0x7f26c41076e0 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea234df0 0x55f7ea240840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea243170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.952+0000 7f26ce43b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7ea1aaea0 con 0x55f7ea2344d0 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ce43b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f7ea19a2d0 con 0x55f7ea234df0 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ce43b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f7ea19e0e0 con 0x55f7ea240d80 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea2348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea2348b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56812/0 (socket says 172.21.15.2:56812) 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 -- 172.21.15.2:0/3603693998 learned_addr learned my addr 172.21.15.2:0/3603693998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26c9e02640 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea234df0 0x55f7ea240840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26c9601640 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea243170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 -- 172.21.15.2:0/3603693998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 msgr2=0x55f7ea243170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea243170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 -- 172.21.15.2:0/3603693998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea234df0 msgr2=0x55f7ea240840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea234df0 0x55f7ea240840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 -- 172.21.15.2:0/3603693998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e9ef8650 con 0x55f7ea2344d0 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26c9e02640 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea234df0 0x55f7ea240840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26ca603640 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea2348b0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f26bc008dc0 tx=0x7f26bc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53aad60d1aebe32d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26affff640 1 -- 172.21.15.2:0/3603693998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc014070 con 0x55f7ea2344d0 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26baffd640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26b00b52e0 0x7f26b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26affff640 1 -- 172.21.15.2:0/3603693998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc003b70 con 0x55f7ea2344d0 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.953+0000 7f26affff640 1 -- 172.21.15.2:0/3603693998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc010700 con 0x55f7ea2344d0 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26c9e02640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26b00b52e0 0x7f26b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26baffd640 1 -- 172.21.15.2:0/1759799395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f26b40e59c0 con 0x7f26c41076e0 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26c9e02640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26b00b52e0 0x7f26b00b77a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f26c0031440 tx=0x7f26c00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 -- 172.21.15.2:0/3603693998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 msgr2=0x55f7ea2348b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea2348b0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f26bc008dc0 tx=0x7f26bc00e720 comp rx=0 tx=0).stop 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 -- 172.21.15.2:0/3603693998 shutdown_connections 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea243170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea234df0 0x55f7ea240840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3603693998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea2348b0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 -- 172.21.15.2:0/3603693998 >> 172.21.15.2:0/3603693998 conn(0x55f7ea232300 msgr2=0x55f7ea2334a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 -- 172.21.15.2:0/3603693998 shutdown_connections 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.954+0000 7f26ce43b740 1 -- 172.21.15.2:0/3603693998 wait complete. 2024-09-10T23:34:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 -- start start 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 Processor -- start 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea2406f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 0x55f7ea23db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea23e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7e9ffb700 con 0x55f7ea234df0 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f7ea135160 con 0x55f7ea2344d0 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f7ea243a00 con 0x55f7ea240d80 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26ce43b740 10 client.0 _ll_register_callbacks cb 0x55f7ea14e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26c9601640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 0x55f7ea23db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26c9601640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 0x55f7ea23db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56816/0 (socket says 172.21.15.2:56816) 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.955+0000 7f26c9601640 1 -- 172.21.15.2:0/3869264555 learned_addr learned my addr 172.21.15.2:0/3869264555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9e02640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea2406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ca603640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea23e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9601640 1 -- 172.21.15.2:0/3869264555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 msgr2=0x55f7ea23e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9601640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea23e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9601640 1 -- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 msgr2=0x55f7ea2406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9601640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea2406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9601640 1 -- 172.21.15.2:0/3869264555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ea162c90 con 0x55f7ea234df0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ca603640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea23e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26c9601640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 0x55f7ea23db40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ac120 tx=0x7f26b40a8130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7e21ff27deb2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ad7fa640 1 -- 172.21.15.2:0/3869264555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b401d070 con 0x55f7ea234df0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ad7fa640 1 -- 172.21.15.2:0/3869264555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f26b4005240 con 0x55f7ea234df0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26bc003b70 con 0x55f7ea234df0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ad7fa640 1 -- 172.21.15.2:0/3869264555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26b40055f0 con 0x55f7ea234df0 2024-09-10T23:34:30.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ce43b740 10 client.19128 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7ea24f3e0 con 0x55f7ea234df0 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.956+0000 7f26ad7fa640 1 -- 172.21.15.2:0/3869264555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc003b70 con 0x55f7ea234df0 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ad7fa640 1 -- 172.21.15.2:0/3869264555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26b40cdb70 con 0x55f7ea234df0 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ce43b740 10 client.19128 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ce43b740 10 client.19128 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ce43b740 20 client.19128 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2508f0 0x55f7ea252d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ce43b740 4 client.19128 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7ea1acdf0 con 0x55f7ea2508f0 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26c9e02640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2508f0 0x55f7ea252d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26ad7fa640 10 client.19128 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.957+0000 7f26c9e02640 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2508f0 0x55f7ea252d10 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad6fe6cb6575986b server_cookie=3225dac45de4810a in_seq=0 out_seq=0 2024-09-10T23:34:30.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ad7fa640 1 -- 172.21.15.2:0/3869264555 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7ea1acdf0 con 0x55f7ea2508f0 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ad7fa640 10 client.19128 handle_command_reply: tid=0 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 client.19128 shutdown 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 msgr2=0x55f7ea23db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 0x55f7ea23db40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ac120 tx=0x7f26b40a8130 comp rx=0 tx=0).stop 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 shutdown_connections 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea240d80 0x55f7ea23e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2508f0 0x55f7ea252d10 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea234df0 0x55f7ea23db40 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 --2- 172.21.15.2:0/3869264555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea2406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ad7fa640 0 client.19128 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 >> 172.21.15.2:0/3869264555 conn(0x55f7ea232300 msgr2=0x55f7ea237e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.958+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 shutdown_connections 2024-09-10T23:34:30.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.959+0000 7f26ce43b740 1 -- 172.21.15.2:0/3869264555 wait complete. 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.959+0000 7f26ce43b740 20 client.19128 trim_cache size 0 max 16384 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 Processor -- start 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 -- start start 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea23d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea23c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 0x55f7ea23c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41b0590 con 0x55f7ea240d80 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41b20d0 con 0x55f7ea2344d0 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ce43b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41b0c60 con 0x55f7ea234df0 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ca603640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 0x55f7ea23c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ca603640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 0x55f7ea23c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56826/0 (socket says 172.21.15.2:56826) 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26ca603640 1 -- 172.21.15.2:0/964992411 learned_addr learned my addr 172.21.15.2:0/964992411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.972+0000 7f26c9e02640 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea23d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26c9601640 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea23c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26ca603640 1 -- 172.21.15.2:0/964992411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 msgr2=0x55f7ea23c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26ca603640 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea23c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26ca603640 1 -- 172.21.15.2:0/964992411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 msgr2=0x55f7ea23d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26ca603640 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea23d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26ca603640 1 -- 172.21.15.2:0/964992411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ea23e530 con 0x55f7ea240d80 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26c9e02640 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea23d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26ca603640 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 0x55f7ea23c900 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f26bc000f80 tx=0x7f26bc008720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33e67d95f31687c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26af7fe640 1 -- 172.21.15.2:0/964992411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc025070 con 0x55f7ea240d80 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26af7fe640 1 -- 172.21.15.2:0/964992411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc004dc0 con 0x55f7ea240d80 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.973+0000 7f26af7fe640 1 -- 172.21.15.2:0/964992411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc014050 con 0x55f7ea240d80 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 -- 172.21.15.2:0/964992411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 msgr2=0x55f7ea23c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 0x55f7ea23c900 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f26bc000f80 tx=0x7f26bc008720 comp rx=0 tx=0).stop 2024-09-10T23:34:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 -- 172.21.15.2:0/964992411 shutdown_connections 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea240d80 0x55f7ea23c900 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea23c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 --2- 172.21.15.2:0/964992411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea2344d0 0x55f7ea23d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 -- 172.21.15.2:0/964992411 >> 172.21.15.2:0/964992411 conn(0x55f7ea232300 msgr2=0x55f7ea233430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 -- 172.21.15.2:0/964992411 shutdown_connections 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 -- 172.21.15.2:0/964992411 wait complete. 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 -- start start 2024-09-10T23:34:30.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.974+0000 7f26ce43b740 1 Processor -- start 2024-09-10T23:34:30.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea249040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea2495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea240d80 0x55f7ea243dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41b1a00 con 0x55f7ea2344d0 2024-09-10T23:34:30.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41b1330 con 0x55f7ea240d80 2024-09-10T23:34:30.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41ae570 con 0x55f7ea234df0 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ce43b740 10 client.0 _ll_register_callbacks cb 0x7f26b40058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea249040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea249040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56828/0 (socket says 172.21.15.2:56828) 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 -- 172.21.15.2:0/253846066 learned_addr learned my addr 172.21.15.2:0/253846066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9601640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea2495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ca603640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea240d80 0x55f7ea243dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 -- 172.21.15.2:0/253846066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 msgr2=0x55f7ea2495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea2495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 -- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea240d80 msgr2=0x55f7ea243dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea240d80 0x55f7ea243dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 -- 172.21.15.2:0/253846066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ea2445c0 con 0x55f7ea2344d0 2024-09-10T23:34:30.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ca603640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea240d80 0x55f7ea243dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9601640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea2495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26c9e02640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea249040 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f26c0005ab0 tx=0x7f26c002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667f542f48e413f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.975+0000 7f26ad7fa640 1 -- 172.21.15.2:0/253846066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0035050 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ad7fa640 1 -- 172.21.15.2:0/253846066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f26c00043d0 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26bc004dc0 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ad7fa640 1 -- 172.21.15.2:0/253846066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26c0005040 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 10 client.19134 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7ea2be400 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ad7fa640 1 -- 172.21.15.2:0/253846066 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc004dc0 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ad7fa640 1 -- 172.21.15.2:0/253846066 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26c0004bb0 con 0x55f7ea2344d0 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 10 client.19134 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 10 client.19134 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 20 client.19134 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2bebb0 0x55f7ea2c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 4 client.19134 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.976+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7ea1a88a0 con 0x55f7ea2bebb0 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26c9601640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2bebb0 0x55f7ea2c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26c9601640 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2bebb0 0x55f7ea2c0fd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81258f5c8d3a1641 server_cookie=a25fd53df9d8258 in_seq=0 out_seq=0 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ad7fa640 10 client.19134 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ad7fa640 1 -- 172.21.15.2:0/253846066 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7ea1a88a0 con 0x55f7ea2bebb0 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ad7fa640 10 client.19134 handle_command_reply: tid=0 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 client.19134 shutdown 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 msgr2=0x55f7ea249040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea249040 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f26c0005ab0 tx=0x7f26c002a410 comp rx=0 tx=0).stop 2024-09-10T23:34:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 shutdown_connections 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7ea240d80 0x55f7ea243dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f7ea234df0 0x55f7ea2495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x55f7ea2bebb0 0x55f7ea2c0fd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 --2- 172.21.15.2:0/253846066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7ea2344d0 0x55f7ea249040 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 >> 172.21.15.2:0/253846066 conn(0x55f7ea232300 msgr2=0x55f7ea23bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.977+0000 7f26ad7fa640 0 client.19134 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 shutdown_connections 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26ce43b740 1 -- 172.21.15.2:0/253846066 wait complete. 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26ce43b740 20 client.19134 trim_cache size 0 max 16384 2024-09-10T23:34:30.995 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:30.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26b00b52e0 msgr2=0x7f26b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26b00b52e0 0x7f26b00b77a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f26c0031440 tx=0x7f26c00314a0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 msgr2=0x7f26c419b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:30.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 0x7f26c419b9e0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c970 tx=0x7f26b400ce30 comp rx=0 tx=0).stop 2024-09-10T23:34:30.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 shutdown_connections 2024-09-10T23:34:30.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f26b00b52e0 0x7f26b00b77a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c4108060 0x7f26c41a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c41076e0 0x7f26c419b9e0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 --2- 172.21.15.2:0/1759799395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26c4101cd0 0x7f26c419b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 >> 172.21.15.2:0/1759799395 conn(0x7f26c40fd700 msgr2=0x7f26c406b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 shutdown_connections 2024-09-10T23:34:30.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:30.978+0000 7f26cc066640 1 -- 172.21.15.2:0/1759799395 wait complete. 2024-09-10T23:34:31.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:34:31.960 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:32.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:32 smithi002 ceph-mon[31150]: pgmap v657: 97 pgs: 97 active+clean; 3.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:32.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:32 smithi154 ceph-mon[35136]: pgmap v657: 97 pgs: 97 active+clean; 3.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:32 smithi177 ceph-mon[35760]: pgmap v657: 97 pgs: 97 active+clean; 3.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:32.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 -- 172.21.15.2:0/2592992856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 msgr2=0x7fe37810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 --2- 172.21.15.2:0/2592992856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37810f950 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe370009ca0 tx=0x7fe37002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 -- 172.21.15.2:0/2592992856 shutdown_connections 2024-09-10T23:34:32.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 --2- 172.21.15.2:0/2592992856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37810f950 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 --2- 172.21.15.2:0/2592992856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3781087d0 0x7fe378108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 --2- 172.21.15.2:0/2592992856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378102dc0 0x7fe3781031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 -- 172.21.15.2:0/2592992856 >> 172.21.15.2:0/2592992856 conn(0x7fe3780fe830 msgr2=0x7fe378100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 -- 172.21.15.2:0/2592992856 shutdown_connections 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 -- 172.21.15.2:0/2592992856 wait complete. 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 Processor -- start 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.479+0000 7fe37ebea640 1 -- start start 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37ebea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102dc0 0x7fe3781992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37ebea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 0x7fe3781997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37ebea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37ebea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe378112e60 con 0x7fe378109150 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37ebea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe378112ce0 con 0x7fe378102dc0 2024-09-10T23:34:32.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37ebea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe378112fe0 con 0x7fe3781087d0 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37d187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 0x7fe3781997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37d187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37819eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46556/0 (socket says 172.21.15.2:46556) 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 0x7fe3781997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:35398/0 (socket says 172.21.15.2:35398) 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37d187640 1 -- 172.21.15.2:0/4023670246 learned_addr learned my addr 172.21.15.2:0/4023670246 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37c986640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102dc0 0x7fe3781992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 -- 172.21.15.2:0/4023670246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102dc0 msgr2=0x7fe3781992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102dc0 0x7fe3781992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 -- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 msgr2=0x7fe37819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 -- 172.21.15.2:0/4023670246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37819f360 con 0x7fe3781087d0 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe37d187640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:32.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.480+0000 7fe377fff640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 0x7fe3781997f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e9f0 tx=0x7fe36c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.481+0000 7fe375ffb640 1 -- 172.21.15.2:0/4023670246 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00ccc0 con 0x7fe3781087d0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.481+0000 7fe375ffb640 1 -- 172.21.15.2:0/4023670246 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe36c0108e0 con 0x7fe3781087d0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.481+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37819f650 con 0x7fe3781087d0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.481+0000 7fe375ffb640 1 -- 172.21.15.2:0/4023670246 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c018880 con 0x7fe3781087d0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.481+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3781a5d10 con 0x7fe3781087d0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.483+0000 7fe380fbf740 1 Processor -- start 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.483+0000 7fe380fbf740 1 -- start start 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe375ffb640 1 -- 172.21.15.2:0/4023670246 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe36c010430 con 0x7fe3781087d0 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45aea10 0x563cc45be870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe380fbf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563cc4524ea0 con 0x563cc45bedb0 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe380fbf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563cc45142d0 con 0x563cc45aea10 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe380fbf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563cc45180e0 con 0x563cc45ae0f0 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe37d187640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45c11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46566/0 (socket says 172.21.15.2:46566) 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 -- 172.21.15.2:0/1999073070 learned_addr learned my addr 172.21.15.2:0/1999073070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe37c986640 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45aea10 0x563cc45be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 -- 172.21.15.2:0/1999073070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 msgr2=0x563cc45ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 -- 172.21.15.2:0/1999073070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45aea10 msgr2=0x563cc45be870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45aea10 0x563cc45be870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 -- 172.21.15.2:0/1999073070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc4272650 con 0x563cc45bedb0 2024-09-10T23:34:32.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.484+0000 7fe377fff640 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45c11a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0e9f40 tx=0x7fe36c0ee570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a9eae2a2522ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe35effd640 1 -- 172.21.15.2:0/1999073070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0f9070 con 0x563cc45bedb0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe35effd640 1 -- 172.21.15.2:0/1999073070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe36c0f4ab0 con 0x563cc45bedb0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe375ffb640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3600b52e0 0x7fe3600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe35effd640 1 -- 172.21.15.2:0/1999073070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0f3ab0 con 0x563cc45bedb0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe37d187640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3600b52e0 0x7fe3600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe375ffb640 1 -- 172.21.15.2:0/4023670246 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe36c0e5ea0 con 0x7fe3781087d0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe380fbf740 1 -- 172.21.15.2:0/1999073070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 msgr2=0x563cc45c11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe37d187640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3600b52e0 0x7fe3600b77a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe370004af0 tx=0x7fe370005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.485+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45c11a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0e9f40 tx=0x7fe36c0ee570 comp rx=0 tx=0).stop 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 -- 172.21.15.2:0/1999073070 shutdown_connections 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45c11a0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45aea10 0x563cc45be870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1999073070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 -- 172.21.15.2:0/1999073070 >> 172.21.15.2:0/1999073070 conn(0x563cc45abf20 msgr2=0x563cc45ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 -- 172.21.15.2:0/1999073070 shutdown_connections 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 -- 172.21.15.2:0/1999073070 wait complete. 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 -- start start 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 Processor -- start 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45be670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.486+0000 7fe380fbf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563cc4375700 con 0x563cc45bedb0 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe380fbf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563cc44af160 con 0x563cc45ae0f0 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe380fbf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563cc45c1a30 con 0x563cc45aea10 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe380fbf740 10 client.0 _ll_register_callbacks cb 0x563cc44c89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:32.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37c986640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37c986640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45be670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:43194/0 (socket says 172.21.15.2:43194) 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37c986640 1 -- 172.21.15.2:0/1893969450 learned_addr learned my addr 172.21.15.2:0/1893969450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe377fff640 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 -- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 msgr2=0x563cc45bbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 -- 172.21.15.2:0/1893969450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 msgr2=0x563cc45be670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45be670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 -- 172.21.15.2:0/1893969450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc44dcc90 con 0x563cc45bedb0 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe37d187640 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45bc0a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe370005e30 tx=0x7fe37002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f02558e68a1c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe357fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:32.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe357fff640 1 -- 172.21.15.2:0/1893969450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37002f390 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe357fff640 1 -- 172.21.15.2:0/1893969450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe370004250 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.487+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe36c0f4ab0 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe357fff640 1 -- 172.21.15.2:0/1893969450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe370004450 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 10 client.19146 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563cc45cd330 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe357fff640 1 -- 172.21.15.2:0/1893969450 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe36c0f4ab0 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe357fff640 1 -- 172.21.15.2:0/1893969450 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe37005d070 con 0x563cc45bedb0 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 10 client.19146 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 10 client.19146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 20 client.19146 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc45ce7e0 0x563cc45d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 4 client.19146 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:32.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cc4526df0 con 0x563cc45ce7e0 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.488+0000 7fe37c986640 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc45ce7e0 0x563cc45d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.489+0000 7fe357fff640 10 client.19146 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.489+0000 7fe37c986640 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc45ce7e0 0x563cc45d0c20 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b309792699be7d77 server_cookie=b225c15250d9dd46 in_seq=0 out_seq=0 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe357fff640 1 -- 172.21.15.2:0/1893969450 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563cc4526df0 con 0x563cc45ce7e0 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe357fff640 10 client.19146 handle_command_reply: tid=0 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 client.19146 shutdown 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 msgr2=0x563cc45bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45bc0a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe370005e30 tx=0x7fe37002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 shutdown_connections 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc45ce7e0 0x563cc45d0c20 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45bc0a0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe357fff640 0 client.19146 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:32.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 --2- 172.21.15.2:0/1893969450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45be670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 >> 172.21.15.2:0/1893969450 conn(0x563cc45abf20 msgr2=0x563cc45b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 shutdown_connections 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 1 -- 172.21.15.2:0/1893969450 wait complete. 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.490+0000 7fe380fbf740 20 client.19146 trim_cache size 0 max 16384 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.503+0000 7fe380fbf740 1 Processor -- start 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.503+0000 7fe380fbf740 1 -- start start 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.503+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.503+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.503+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45ba340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe380fbf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781ac200 con 0x563cc45bedb0 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe380fbf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781add40 con 0x563cc45ae0f0 2024-09-10T23:34:32.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe380fbf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781ac8d0 con 0x563cc45aea10 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45ba340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46596/0 (socket says 172.21.15.2:46596) 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 -- 172.21.15.2:0/2492627310 learned_addr learned my addr 172.21.15.2:0/2492627310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37c986640 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe377fff640 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 -- 172.21.15.2:0/2492627310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 msgr2=0x563cc45bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 -- 172.21.15.2:0/2492627310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 msgr2=0x563cc45cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 -- 172.21.15.2:0/2492627310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc45b9fc0 con 0x563cc45bedb0 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe377fff640 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe37d187640 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45ba340 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe370009600 tx=0x7fe3700042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7028da45538263f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:32.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe35e7fc640 1 -- 172.21.15.2:0/2492627310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3700045f0 con 0x563cc45bedb0 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe35e7fc640 1 -- 172.21.15.2:0/2492627310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe37005a070 con 0x563cc45bedb0 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.504+0000 7fe35e7fc640 1 -- 172.21.15.2:0/2492627310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37002fb20 con 0x563cc45bedb0 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 -- 172.21.15.2:0/2492627310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 msgr2=0x563cc45ba340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45ba340 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe370009600 tx=0x7fe3700042d0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 -- 172.21.15.2:0/2492627310 shutdown_connections 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45bedb0 0x563cc45ba340 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45aea10 0x563cc45bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 --2- 172.21.15.2:0/2492627310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45ae0f0 0x563cc45cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 -- 172.21.15.2:0/2492627310 >> 172.21.15.2:0/2492627310 conn(0x563cc45abf20 msgr2=0x563cc45c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 -- 172.21.15.2:0/2492627310 shutdown_connections 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 -- 172.21.15.2:0/2492627310 wait complete. 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 -- start start 2024-09-10T23:34:32.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.505+0000 7fe380fbf740 1 Processor -- start 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 0x563cc45c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45bedb0 0x563cc45c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781ad670 con 0x563cc45aea10 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781acfa0 con 0x563cc45bedb0 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3781aa1e0 con 0x563cc45ae0f0 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe380fbf740 10 client.0 _ll_register_callbacks cb 0x7fe370009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 0x563cc45c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 0x563cc45c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46600/0 (socket says 172.21.15.2:46600) 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 -- 172.21.15.2:0/3044859091 learned_addr learned my addr 172.21.15.2:0/3044859091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe37d187640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45bedb0 0x563cc45c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe37c986640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 -- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 msgr2=0x563cc45c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 -- 172.21.15.2:0/3044859091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45bedb0 msgr2=0x563cc45c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45bedb0 0x563cc45c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 -- 172.21.15.2:0/3044859091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc45c5c20 con 0x563cc45aea10 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe377fff640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 0x563cc45c4eb0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0eea70 tx=0x7fe36c0eef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3839691d21633800 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.506+0000 7fe357fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe357fff640 1 -- 172.21.15.2:0/3044859091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0a8d10 con 0x563cc45aea10 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe357fff640 1 -- 172.21.15.2:0/3044859091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe36c0e9a50 con 0x563cc45aea10 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe37005a070 con 0x563cc45aea10 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe357fff640 1 -- 172.21.15.2:0/3044859091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe36c0abe30 con 0x563cc45aea10 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 10 client.19152 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563cc463c6c0 con 0x563cc45aea10 2024-09-10T23:34:32.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe357fff640 1 -- 172.21.15.2:0/3044859091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe36c093e50 con 0x563cc45aea10 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe357fff640 1 -- 172.21.15.2:0/3044859091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe36c0e8040 con 0x563cc45aea10 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 10 client.19152 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 10 client.19152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 20 client.19152 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc463c9f0 0x563cc463ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 4 client.19152 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563cc45228a0 con 0x563cc463c9f0 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.507+0000 7fe37c986640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc463c9f0 0x563cc463ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:32.550 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe37c986640 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc463c9f0 0x563cc463ede0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e9c763569ea71d server_cookie=8b5873db0adce8c8 in_seq=0 out_seq=0 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe357fff640 10 client.19152 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe357fff640 1 -- 172.21.15.2:0/3044859091 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563cc45228a0 con 0x563cc463c9f0 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe357fff640 10 client.19152 handle_command_reply: tid=0 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 client.19152 shutdown 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 msgr2=0x563cc45c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 0x563cc45c4eb0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0eea70 tx=0x7fe36c0eef50 comp rx=0 tx=0).stop 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 shutdown_connections 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x563cc463c9f0 0x563cc463ede0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563cc45bedb0 0x563cc45c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cc45aea10 0x563cc45c4eb0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe357fff640 0 client.19152 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 --2- 172.21.15.2:0/3044859091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cc45ae0f0 0x563cc45c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 >> 172.21.15.2:0/3044859091 conn(0x563cc45abf20 msgr2=0x563cc45ba2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 shutdown_connections 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 1 -- 172.21.15.2:0/3044859091 wait complete. 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.508+0000 7fe380fbf740 20 client.19152 trim_cache size 0 max 16384 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3600b52e0 msgr2=0x7fe3600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3600b52e0 0x7fe3600b77a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe370004af0 tx=0x7fe370005d80 comp rx=0 tx=0).stop 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 msgr2=0x7fe3781997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 0x7fe3781997f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e9f0 tx=0x7fe36c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 shutdown_connections 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe3600b52e0 0x7fe3600b77a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe378109150 0x7fe37819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3781087d0 0x7fe3781997f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 --2- 172.21.15.2:0/4023670246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe378102dc0 0x7fe3781992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:32.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 >> 172.21.15.2:0/4023670246 conn(0x7fe3780fe830 msgr2=0x7fe378100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:32.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 shutdown_connections 2024-09-10T23:34:32.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:32.509+0000 7fe37ebea640 1 -- 172.21.15.2:0/4023670246 wait complete. 2024-09-10T23:34:33.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:33 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:33.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:33 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:33.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:33 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:34.198 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:34:34.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:34:34.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:34 smithi154 ceph-mon[35136]: pgmap v658: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:34.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:34 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:34 smithi177 ceph-mon[35760]: pgmap v658: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:34 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.484 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:34 smithi002 ceph-mon[31150]: pgmap v658: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:34.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:34 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 -- 172.21.15.2:0/2762951703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 msgr2=0x7fe65c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 --2- 172.21.15.2:0/2762951703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c108c10 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe650009ca0 tx=0x7fe65002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 -- 172.21.15.2:0/2762951703 shutdown_connections 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 --2- 172.21.15.2:0/2762951703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c109150 0x7fe65c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 --2- 172.21.15.2:0/2762951703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c108c10 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 --2- 172.21.15.2:0/2762951703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c102dc0 0x7fe65c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 -- 172.21.15.2:0/2762951703 >> 172.21.15.2:0/2762951703 conn(0x7fe65c0fe830 msgr2=0x7fe65c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 -- 172.21.15.2:0/2762951703 shutdown_connections 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.985+0000 7fe660e81640 1 -- 172.21.15.2:0/2762951703 wait complete. 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 Processor -- start 2024-09-10T23:34:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 -- start start 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c102dc0 0x7fe65c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c109150 0x7fe65c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c112e60 con 0x7fe65c1087d0 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c112ce0 con 0x7fe65c109150 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe660e81640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c112fe0 con 0x7fe65c102dc0 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe659d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe659d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46610/0 (socket says 172.21.15.2:46610) 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe659d9b640 1 -- 172.21.15.2:0/3050609873 learned_addr learned my addr 172.21.15.2:0/3050609873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.986+0000 7fe65a59c640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c102dc0 0x7fe65c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c109150 0x7fe65c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe659d9b640 1 -- 172.21.15.2:0/3050609873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c102dc0 msgr2=0x7fe65c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe659d9b640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c102dc0 0x7fe65c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe659d9b640 1 -- 172.21.15.2:0/3050609873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c109150 msgr2=0x7fe65c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe659d9b640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c109150 0x7fe65c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe659d9b640 1 -- 172.21.15.2:0/3050609873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c1a76b0 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe659d9b640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c0759e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe650005e30 tx=0x7fe65002f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe64b7fe640 1 -- 172.21.15.2:0/3050609873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650003bf0 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c1a7940 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe64b7fe640 1 -- 172.21.15.2:0/3050609873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe650003d90 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe64b7fe640 1 -- 172.21.15.2:0/3050609873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65002fb10 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.987+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c1a7ed0 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.990+0000 7fe663256740 1 Processor -- start 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 -- start start 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe64b7fe640 1 -- 172.21.15.2:0/3050609873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe650004680 con 0x7fe65c1087d0 2024-09-10T23:34:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 0x55e34649e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649e800 0x55e3464aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e346414e60 con 0x55e34649dee0 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e346404290 con 0x55e34649e800 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe663256740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e3464080a0 con 0x55e3464aa790 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 0x55e34649e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 0x55e34649e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46618/0 (socket says 172.21.15.2:46618) 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 -- 172.21.15.2:0/2488191279 learned_addr learned my addr 172.21.15.2:0/2488191279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65a59c640 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649e800 0x55e3464aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 -- 172.21.15.2:0/2488191279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 msgr2=0x55e3464acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 -- 172.21.15.2:0/2488191279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649e800 msgr2=0x55e3464aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649e800 0x55e3464aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.991+0000 7fe65ad9d640 1 -- 172.21.15.2:0/2488191279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e346162930 con 0x55e34649dee0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 0x55e34649e2c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe65400b6b0 tx=0x7fe65400bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccaa599e55301e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe648ff9640 1 -- 172.21.15.2:0/2488191279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654003bd0 con 0x55e34649dee0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe648ff9640 1 -- 172.21.15.2:0/2488191279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe654015070 con 0x55e34649dee0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe648ff9640 1 -- 172.21.15.2:0/2488191279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540106a0 con 0x55e34649dee0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe64b7fe640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6440b52e0 0x7fe6440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe65a59c640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6440b52e0 0x7fe6440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.992+0000 7fe64b7fe640 1 -- 172.21.15.2:0/3050609873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe650106e70 con 0x7fe65c1087d0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 -- 172.21.15.2:0/2488191279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 msgr2=0x55e34649e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe65a59c640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6440b52e0 0x7fe6440b77a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x55e3464a1060 tx=0x7fe64c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 0x55e34649e2c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe65400b6b0 tx=0x7fe65400bb70 comp rx=0 tx=0).stop 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 -- 172.21.15.2:0/2488191279 shutdown_connections 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649e800 0x55e3464aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- 172.21.15.2:0/2488191279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649dee0 0x55e34649e2c0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 -- 172.21.15.2:0/2488191279 >> 172.21.15.2:0/2488191279 conn(0x55e34649bd10 msgr2=0x55e34649ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 -- 172.21.15.2:0/2488191279 shutdown_connections 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 -- 172.21.15.2:0/2488191279 wait complete. 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 -- start start 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 Processor -- start 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649e800 0x55e3464a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.993+0000 7fe663256740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3464aa790 0x55e3464a8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe663256740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e346265890 con 0x55e3464aa790 2024-09-10T23:34:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe663256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e34639ed40 con 0x55e34649dee0 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe663256740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e3464ad440 con 0x55e34649e800 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe663256740 10 client.0 _ll_register_callbacks cb 0x55e346402c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:43246/0 (socket says 172.21.15.2:43246) 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 -- 172.21.15.2:0/293155844 learned_addr learned my addr 172.21.15.2:0/293155844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3464aa790 0x55e3464a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe659d9b640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649e800 0x55e3464a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 -- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649e800 msgr2=0x55e3464a7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649e800 0x55e3464a7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 -- 172.21.15.2:0/293155844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3464aa790 msgr2=0x55e3464a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3464aa790 0x55e3464a8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 -- 172.21.15.2:0/293155844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3464b6900 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe659d9b640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649e800 0x55e3464a7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe65a59c640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a7800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01c8f0 tx=0x7fe64c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786f69b9d350818c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.994+0000 7fe641ffb640 1 -- 172.21.15.2:0/293155844 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c02c060 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe641ffb640 1 -- 172.21.15.2:0/293155844 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe64c016030 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe654015070 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe641ffb640 1 -- 172.21.15.2:0/293155844 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe64c027420 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 10 client.27668 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e3464b9310 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe641ffb640 1 -- 172.21.15.2:0/293155844 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe654015070 con 0x55e34649dee0 2024-09-10T23:34:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe641ffb640 1 -- 172.21.15.2:0/293155844 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe64c032460 con 0x55e34649dee0 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 10 client.27668 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 10 client.27668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 20 client.27668 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e3464ba7d0 0x55e3464bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 4 client.27668 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e346416db0 con 0x55e3464ba7d0 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.995+0000 7fe659d9b640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e3464ba7d0 0x55e3464bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.996+0000 7fe641ffb640 10 client.27668 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.996+0000 7fe659d9b640 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e3464ba7d0 0x55e3464bcbe0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea17eeb1ea4b7d7 server_cookie=792b811f49a83624 in_seq=0 out_seq=0 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.996+0000 7fe641ffb640 1 -- 172.21.15.2:0/293155844 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e346416db0 con 0x55e3464ba7d0 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.996+0000 7fe641ffb640 10 client.27668 handle_command_reply: tid=0 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.996+0000 7fe663256740 1 client.27668 shutdown 2024-09-10T23:34:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 msgr2=0x55e3464a7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a7800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01c8f0 tx=0x7fe64c004730 comp rx=0 tx=0).stop 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 shutdown_connections 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e3464ba7d0 0x55e3464bcbe0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e3464aa790 0x55e3464a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649e800 0x55e3464a7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe641ffb640 0 client.27668 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 --2- 172.21.15.2:0/293155844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a7800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 >> 172.21.15.2:0/293155844 conn(0x55e34649bd10 msgr2=0x55e34649af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 shutdown_connections 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 1 -- 172.21.15.2:0/293155844 wait complete. 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:34.997+0000 7fe663256740 20 client.27668 trim_cache size 0 max 16384 2024-09-10T23:34:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.014+0000 7fe663256740 1 Processor -- start 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.014+0000 7fe663256740 1 -- start start 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe663256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe663256740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe663256740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe663256740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c1b0550 con 0x55e34649e800 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe663256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c1b2090 con 0x55e34649dee0 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe663256740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c1b0c20 con 0x55e3464aa790 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46640/0 (socket says 172.21.15.2:46640) 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 -- 172.21.15.2:0/2964606308 learned_addr learned my addr 172.21.15.2:0/2964606308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe65a59c640 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 -- 172.21.15.2:0/2964606308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 msgr2=0x55e3464c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 -- 172.21.15.2:0/2964606308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 msgr2=0x55e3464a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 -- 172.21.15.2:0/2964606308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3464a6760 con 0x55e34649e800 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464c2500 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe6500ca8b0 tx=0x7fe65010a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702714176a959094 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.015+0000 7fe643fff640 1 -- 172.21.15.2:0/2964606308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6500c94e0 con 0x55e34649e800 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe643fff640 1 -- 172.21.15.2:0/2964606308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe650036040 con 0x55e34649e800 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe643fff640 1 -- 172.21.15.2:0/2964606308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6500ccdb0 con 0x55e34649e800 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 -- 172.21.15.2:0/2964606308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 msgr2=0x55e3464c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464c2500 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe6500ca8b0 tx=0x7fe65010a950 comp rx=0 tx=0).stop 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 -- 172.21.15.2:0/2964606308 shutdown_connections 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3464aa790 0x55e3464c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464c2500 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 --2- 172.21.15.2:0/2964606308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e34649dee0 0x55e3464a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 -- 172.21.15.2:0/2964606308 >> 172.21.15.2:0/2964606308 conn(0x55e34649bd10 msgr2=0x55e3464a4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 -- 172.21.15.2:0/2964606308 shutdown_connections 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.016+0000 7fe663256740 1 -- 172.21.15.2:0/2964606308 wait complete. 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 -- start start 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 Processor -- start 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 0x55e3464b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3464aa790 0x55e3464b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c1b19c0 con 0x55e34649e800 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c1b12f0 con 0x55e3464aa790 2024-09-10T23:34:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c1ae530 con 0x55e34649dee0 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe663256740 10 client.0 _ll_register_callbacks cb 0x7fe64c00a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe659d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 0x55e3464b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 0x55e3464b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:35488/0 (socket says 172.21.15.2:35488) 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe659d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46648/0 (socket says 172.21.15.2:46648) 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 -- 172.21.15.2:0/2156365596 learned_addr learned my addr 172.21.15.2:0/2156365596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3464aa790 0x55e3464b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 -- 172.21.15.2:0/2156365596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3464aa790 msgr2=0x55e3464b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3464aa790 0x55e3464b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 -- 172.21.15.2:0/2156365596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 msgr2=0x55e3464b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65a59c640 1 -- 172.21.15.2:0/2156365596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3464b16b0 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe65ad9d640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3464aa790 0x55e3464b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.017+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe65a59c640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 0x55e3464b2eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00a7d0 tx=0x7fe64c032600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc4f72d596bd8236 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe641ffb640 1 -- 172.21.15.2:0/2156365596 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c042060 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe650036040 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe641ffb640 1 -- 172.21.15.2:0/2156365596 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe64c032d00 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe641ffb640 1 -- 172.21.15.2:0/2156365596 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe64c037070 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 10 client.28105 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e346528770 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe641ffb640 1 -- 172.21.15.2:0/2156365596 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe650036040 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe641ffb640 1 -- 172.21.15.2:0/2156365596 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe64c03d480 con 0x55e34649dee0 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 10 client.28105 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 10 client.28105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 20 client.28105 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e346528e30 0x55e34652b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 4 client.28105 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.018+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e346412860 con 0x55e346528e30 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.019+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e346528e30 0x55e34652b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.019+0000 7fe641ffb640 10 client.28105 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.019+0000 7fe659d9b640 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e346528e30 0x55e34652b250 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed06637ec8e9239 server_cookie=5b7fce7bd99c884c in_seq=0 out_seq=0 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe641ffb640 1 -- 172.21.15.2:0/2156365596 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e346412860 con 0x55e346528e30 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe641ffb640 10 client.28105 handle_command_reply: tid=0 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 client.28105 shutdown 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 msgr2=0x55e3464b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 0x55e3464b2eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00a7d0 tx=0x7fe64c032600 comp rx=0 tx=0).stop 2024-09-10T23:34:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 shutdown_connections 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e346528e30 0x55e34652b250 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3464aa790 0x55e3464b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e34649e800 0x55e3464b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe641ffb640 0 client.28105 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 --2- 172.21.15.2:0/2156365596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e34649dee0 0x55e3464b2eb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.020+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 >> 172.21.15.2:0/2156365596 conn(0x55e34649bd10 msgr2=0x55e3464b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 shutdown_connections 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe663256740 1 -- 172.21.15.2:0/2156365596 wait complete. 2024-09-10T23:34:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe663256740 20 client.28105 trim_cache size 0 max 16384 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf", 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6440b52e0 msgr2=0x7fe6440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6440b52e0 0x7fe6440b77a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x55e3464a1060 tx=0x7fe64c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 msgr2=0x7fe65c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c0759e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe650005e30 tx=0x7fe65002f3e0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 shutdown_connections 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe6440b52e0 0x7fe6440b77a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c109150 0x7fe65c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c1087d0 0x7fe65c0759e0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 --2- 172.21.15.2:0/3050609873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe65c102dc0 0x7fe65c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 >> 172.21.15.2:0/3050609873 conn(0x7fe65c0fe830 msgr2=0x7fe65c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 shutdown_connections 2024-09-10T23:34:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:35.021+0000 7fe660e81640 1 -- 172.21.15.2:0/3050609873 wait complete. 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: pgmap v659: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:35.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:34:35.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:35 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:35.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: pgmap v659: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:34:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:35 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:35.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:34:35.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: pgmap v659: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:34:35.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:35 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:34:36.012 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 -- 172.21.15.2:0/1857983483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0102190 msgr2=0x7fa5b010eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/1857983483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0102190 0x7fa5b010eee0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009900 tx=0x7fa5a002a480 comp rx=0 tx=0).stop 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 -- 172.21.15.2:0/1857983483 shutdown_connections 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/1857983483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b010f420 0x7fa5b0111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/1857983483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0102190 0x7fa5b010eee0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/1857983483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b0101870 0x7fa5b0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 -- 172.21.15.2:0/1857983483 >> 172.21.15.2:0/1857983483 conn(0x7fa5b00fd720 msgr2=0x7fa5b00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 -- 172.21.15.2:0/1857983483 shutdown_connections 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.501+0000 7fa5b7d45640 1 -- 172.21.15.2:0/1857983483 wait complete. 2024-09-10T23:34:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 Processor -- start 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 -- start start 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 0x7fa5b019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b0102190 0x7fa5b019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b010f420 0x7fa5b01a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b0114f60 con 0x7fa5b0101870 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b0114de0 con 0x7fa5b0102190 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b7d45640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01150e0 con 0x7fa5b010f420 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b5ae1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 0x7fa5b019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b5ae1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 0x7fa5b019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46664/0 (socket says 172.21.15.2:46664) 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b5ae1640 1 -- 172.21.15.2:0/2011351987 learned_addr learned my addr 172.21.15.2:0/2011351987 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.502+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b010f420 0x7fa5b01a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b5ae1640 1 -- 172.21.15.2:0/2011351987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b010f420 msgr2=0x7fa5b01a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b5ae1640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b010f420 0x7fa5b01a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b5ae1640 1 -- 172.21.15.2:0/2011351987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b0102190 msgr2=0x7fa5b019b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b0102190 0x7fa5b019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b5ae1640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b0102190 0x7fa5b019b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b5ae1640 1 -- 172.21.15.2:0/2011351987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b01a1550 con 0x7fa5b0101870 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b5ae1640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 0x7fa5b019b4a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d950 tx=0x7fa5ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5a6ffd640 1 -- 172.21.15.2:0/2011351987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac017070 con 0x7fa5b0101870 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5a6ffd640 1 -- 172.21.15.2:0/2011351987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5ac009c30 con 0x7fa5b0101870 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b01a1840 con 0x7fa5b0101870 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5a6ffd640 1 -- 172.21.15.2:0/2011351987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00f620 con 0x7fa5b0101870 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.503+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b01a80d0 con 0x7fa5b0101870 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.506+0000 7fa5ba11a740 1 Processor -- start 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.506+0000 7fa5ba11a740 1 -- start start 2024-09-10T23:34:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5a6ffd640 1 -- 172.21.15.2:0/2011351987 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa5ac010460 con 0x7fa5b0101870 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14638860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d146447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14647120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557d145aee50 con 0x557d14638480 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557d1459e280 con 0x557d14644d30 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557d145a2090 con 0x557d14638da0 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14638860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14638860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46674/0 (socket says 172.21.15.2:46674) 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 -- 172.21.15.2:0/4117775256 learned_addr learned my addr 172.21.15.2:0/4117775256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14647120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b5ae1640 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d146447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 -- 172.21.15.2:0/4117775256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 msgr2=0x557d146447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d146447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 -- 172.21.15.2:0/4117775256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 msgr2=0x557d14647120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14647120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.507+0000 7fa5b62e2640 1 -- 172.21.15.2:0/4117775256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d142fc650 con 0x557d14638480 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14638860 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8010370 tx=0x7fa5a8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9692960c892a2b1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa59bfff640 1 -- 172.21.15.2:0/4117775256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8016070 con 0x557d14638480 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa59bfff640 1 -- 172.21.15.2:0/4117775256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a8004d20 con 0x557d14638480 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa59bfff640 1 -- 172.21.15.2:0/4117775256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8005350 con 0x557d14638480 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa5a6ffd640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa59c0b5360 0x7fa59c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa5b5ae1640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa59c0b5360 0x7fa59c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.508+0000 7fa5a6ffd640 1 -- 172.21.15.2:0/2011351987 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa5ac0e5790 con 0x7fa5b0101870 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 -- 172.21.15.2:0/4117775256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 msgr2=0x557d14638860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14638860 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8010370 tx=0x7fa5a8010830 comp rx=0 tx=0).stop 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5b5ae1640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa59c0b5360 0x7fa59c0b7820 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0e3610 tx=0x7fa5ac093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 -- 172.21.15.2:0/4117775256 shutdown_connections 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14647120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d146447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/4117775256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14638860 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 -- 172.21.15.2:0/4117775256 >> 172.21.15.2:0/4117775256 conn(0x557d146362b0 msgr2=0x557d14637450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 -- 172.21.15.2:0/4117775256 shutdown_connections 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 -- 172.21.15.2:0/4117775256 wait complete. 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 -- start start 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.509+0000 7fa5ba11a740 1 Processor -- start 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d14644620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14641a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d146420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557d143ff700 con 0x557d14638da0 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557d14539110 con 0x557d14644d30 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557d146479b0 con 0x557d14638480 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 10 client.0 _ll_register_callbacks cb 0x557d14552990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14641a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14641a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46686/0 (socket says 172.21.15.2:46686) 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 -- 172.21.15.2:0/3656167366 learned_addr learned my addr 172.21.15.2:0/3656167366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d14644620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d146420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 -- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 msgr2=0x557d14644620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d14644620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 -- 172.21.15.2:0/3656167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 msgr2=0x557d146420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d146420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 -- 172.21.15.2:0/3656167366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d14566c40 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d14644620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14641a70 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009230 tx=0x7fa5a0032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460bea39d84e6f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5997fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5997fa640 1 -- 172.21.15.2:0/3656167366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0040070 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5997fa640 1 -- 172.21.15.2:0/3656167366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa5a0004040 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.510+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5a8004d20 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5997fa640 1 -- 172.21.15.2:0/3656167366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa5a0035040 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 10 client.19182 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d14653310 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5997fa640 1 -- 172.21.15.2:0/3656167366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a8004d20 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5997fa640 1 -- 172.21.15.2:0/3656167366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa5a0004750 con 0x557d14638da0 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 10 client.19182 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 10 client.19182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 20 client.19182 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d14654820 0x557d14656c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 4 client.19182 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d145b0da0 con 0x557d14654820 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.511+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d14654820 0x557d14656c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.512+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d14654820 0x557d14656c10 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fdffd29355fbd1 server_cookie=8f47d7f0ae46db88 in_seq=0 out_seq=0 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.512+0000 7fa5997fa640 10 client.19182 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.512+0000 7fa5997fa640 1 -- 172.21.15.2:0/3656167366 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d145b0da0 con 0x557d14654820 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.512+0000 7fa5997fa640 10 client.19182 handle_command_reply: tid=0 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 client.19182 shutdown 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 msgr2=0x557d14641a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14641a70 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009230 tx=0x7fa5a0032f10 comp rx=0 tx=0).stop 2024-09-10T23:34:36.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 shutdown_connections 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d14654820 0x557d14656c10 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d146420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14641a70 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/3656167366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d14644620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5997fa640 0 client.19182 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 >> 172.21.15.2:0/3656167366 conn(0x557d146362b0 msgr2=0x557d1463be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 shutdown_connections 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 1 -- 172.21.15.2:0/3656167366 wait complete. 2024-09-10T23:34:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.513+0000 7fa5ba11a740 20 client.19182 trim_cache size 0 max 16384 2024-09-10T23:34:36.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.531+0000 7fa5ba11a740 1 Processor -- start 2024-09-10T23:34:36.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.531+0000 7fa5ba11a740 1 -- start start 2024-09-10T23:34:36.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14637a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d14646120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14646660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01b0680 con 0x557d14638480 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01b21c0 con 0x557d14644d30 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01b0d50 con 0x557d14638da0 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b62e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14637a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d14646120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b62e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14637a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46698/0 (socket says 172.21.15.2:46698) 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b62e2640 1 -- 172.21.15.2:0/2687180950 learned_addr learned my addr 172.21.15.2:0/2687180950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2687180950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 msgr2=0x557d14646660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14646660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2687180950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 msgr2=0x557d14637a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14637a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2687180950 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d14656f80 con 0x557d14638da0 2024-09-10T23:34:36.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14637a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:34:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.532+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d14646120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0004ba0 tx=0x7fa5a002a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded556ab15084523 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa59b7fe640 1 -- 172.21.15.2:0/2687180950 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0000e60 con 0x557d14638da0 2024-09-10T23:34:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa59b7fe640 1 -- 172.21.15.2:0/2687180950 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a0005240 con 0x557d14638da0 2024-09-10T23:34:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa59b7fe640 1 -- 172.21.15.2:0/2687180950 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0040070 con 0x557d14638da0 2024-09-10T23:34:36.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2687180950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 msgr2=0x557d14646120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d14646120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0004ba0 tx=0x7fa5a002a480 comp rx=0 tx=0).stop 2024-09-10T23:34:36.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2687180950 shutdown_connections 2024-09-10T23:34:36.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14646660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638da0 0x557d14646120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2687180950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638480 0x557d14637a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2687180950 >> 172.21.15.2:0/2687180950 conn(0x557d146362b0 msgr2=0x557d14637300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2687180950 shutdown_connections 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.533+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2687180950 wait complete. 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 -- start start 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 Processor -- start 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d1464d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14647c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14648170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01b1af0 con 0x557d14638da0 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01b1420 con 0x557d14644d30 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b01ae660 con 0x557d14638480 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5ba11a740 10 client.0 _ll_register_callbacks cb 0x7fa5a0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5b52e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14647c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5b52e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14647c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46714/0 (socket says 172.21.15.2:46714) 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2693566213 learned_addr learned my addr 172.21.15.2:0/2693566213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.534+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d1464d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14648170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 msgr2=0x557d1464d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d1464d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2693566213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 msgr2=0x557d14648170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14648170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b52e0640 1 -- 172.21.15.2:0/2693566213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d14648830 con 0x557d14638da0 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14648170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5b52e0640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14647c30 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009340 tx=0x7fa5a00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05fb47d9509ba98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5997fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5997fa640 1 -- 172.21.15.2:0/2693566213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0040040 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5997fa640 1 -- 172.21.15.2:0/2693566213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fa5a0004d90 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5a0005240 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5997fa640 1 -- 172.21.15.2:0/2693566213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa5a0000e40 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5ba11a740 10 client.19188 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d146c25b0 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.535+0000 7fa5997fa640 1 -- 172.21.15.2:0/2693566213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5a0005240 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5997fa640 1 -- 172.21.15.2:0/2693566213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa5a0056070 con 0x557d14638da0 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5ba11a740 10 client.19188 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5ba11a740 10 client.19188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5ba11a740 20 client.19188 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d146c2bc0 0x557d146c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5ba11a740 4 client.19188 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:34:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d145ac850 con 0x557d146c2bc0 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.536+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d146c2bc0 0x557d146c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5997fa640 10 client.19188 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5b62e2640 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d146c2bc0 0x557d146c4fe0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0bec42cb58a3cd9 server_cookie=4ad79fd9f92423a in_seq=0 out_seq=0 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5997fa640 1 -- 172.21.15.2:0/2693566213 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6534 (crc 0 0 0) 0x557d145ac850 con 0x557d146c2bc0 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5997fa640 10 client.19188 handle_command_reply: tid=0 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 client.19188 shutdown 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 msgr2=0x557d14647c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14647c30 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009340 tx=0x7fa5a00035f0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 shutdown_connections 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x557d146c2bc0 0x557d146c4fe0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d14644d30 0x557d14648170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5997fa640 0 client.19188 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d14638da0 0x557d14647c30 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 --2- 172.21.15.2:0/2693566213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557d14638480 0x557d1464d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 >> 172.21.15.2:0/2693566213 conn(0x557d146362b0 msgr2=0x557d14634bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 shutdown_connections 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 1 -- 172.21.15.2:0/2693566213 wait complete. 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.537+0000 7fa5ba11a740 20 client.19188 trim_cache size 0 max 16384 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:34:36.544 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf": { 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf", 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf": { 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:35.019977+0000", 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.545 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "7781c901-0381-483c-8ccc-ce03feed1938": { 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:07.192812+0000", 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:34:36.546 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.547 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:34:36.548 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:34:36.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:34:36.554 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "bd71323f-7f21-4089-95dd-059cf2b66179": { 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:21.624379+0000", 2024-09-10T23:34:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.557 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:34:36.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:34:36.559 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:36.559 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:34:36.559 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:34:36.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa59c0b5360 msgr2=0x7fa59c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa59c0b5360 0x7fa59c0b7820 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0e3610 tx=0x7fa5ac093040 comp rx=0 tx=0).stop 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 msgr2=0x7fa5b019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 0x7fa5b019b4a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d950 tx=0x7fa5ac00de10 comp rx=0 tx=0).stop 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 shutdown_connections 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa59c0b5360 0x7fa59c0b7820 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b010f420 0x7fa5b01a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b0102190 0x7fa5b019b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 --2- 172.21.15.2:0/2011351987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5b0101870 0x7fa5b019b4a0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.538+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 >> 172.21.15.2:0/2011351987 conn(0x7fa5b00fd720 msgr2=0x7fa5b00ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.539+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 shutdown_connections 2024-09-10T23:34:36.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:34:36.539+0000 7fa5b7d45640 1 -- 172.21.15.2:0/2011351987 wait complete. 2024-09-10T23:34:37.304 INFO:tasks.cephfs.filesystem:scrub status for tag:7a1946e9-e469-4779-8ba5-3f12ab8dd9bf - {'path': '/', 'tag': '7a1946e9-e469-4779-8ba5-3f12ab8dd9bf', 'options': 'recursive,force'} 2024-09-10T23:34:37.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- 172.21.15.2:0/2114070861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c1086c0 msgr2=0x7fe48c10ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.412 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- 172.21.15.2:0/2114070861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c1086c0 0x7fe48c10ab80 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fe484009ca0 tx=0x7fe48402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- 172.21.15.2:0/2114070861 shutdown_connections 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- 172.21.15.2:0/2114070861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c1086c0 0x7fe48c10ab80 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- 172.21.15.2:0/2114070861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe48c105b10 0x7fe48c107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- 172.21.15.2:0/2114070861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c06bfb0 0x7fe48c105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- 172.21.15.2:0/2114070861 >> 172.21.15.2:0/2114070861 conn(0x7fe48c0fd150 msgr2=0x7fe48c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- 172.21.15.2:0/2114070861 shutdown_connections 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- 172.21.15.2:0/2114070861 wait complete. 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 Processor -- start 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- start start 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 0x7fe48c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe48c105b10 0x7fe48c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c1086c0 0x7fe48c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c10e5f0 con 0x7fe48c06bfb0 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c10e470 con 0x7fe48c105b10 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe49222a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c10e770 con 0x7fe48c1086c0 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 0x7fe48c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.409+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 0x7fe48c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46740/0 (socket says 172.21.15.2:46740) 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1824920169 learned_addr learned my addr 172.21.15.2:0/1824920169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe483fff640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe48c105b10 0x7fe48c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48bfff640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c1086c0 0x7fe48c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1824920169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c1086c0 msgr2=0x7fe48c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c1086c0 0x7fe48c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1824920169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe48c105b10 msgr2=0x7fe48c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe48c105b10 0x7fe48c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1824920169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c19a8b0 con 0x7fe48c06bfb0 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48bfff640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c1086c0 0x7fe48c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 0x7fe48c198d70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00d950 tx=0x7fe47c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe4897fa640 1 -- 172.21.15.2:0/1824920169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c017030 con 0x7fe48c06bfb0 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe4897fa640 1 -- 172.21.15.2:0/1824920169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe47c004020 con 0x7fe48c06bfb0 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c19aba0 con 0x7fe48c06bfb0 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe4897fa640 1 -- 172.21.15.2:0/1824920169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0047a0 con 0x7fe48c06bfb0 2024-09-10T23:34:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.410+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c1a1270 con 0x7fe48c06bfb0 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 Processor -- start 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 -- start start 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe4897fa640 1 -- 172.21.15.2:0/1824920169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe47c009a30 con 0x7fe48c06bfb0 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6656c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 0x5562d6659580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562d65c66f0 con 0x5562d6657190 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5562d65b5b20 con 0x5562d6654860 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe494ffc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5562d65b9930 con 0x5562d6659bd0 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 0x5562d6659580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 0x5562d6659580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46746/0 (socket says 172.21.15.2:46746) 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe48b7fe640 1 -- 172.21.15.2:0/2236555334 learned_addr learned my addr 172.21.15.2:0/2236555334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe483fff640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.413+0000 7fe48bfff640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6656c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48b7fe640 1 -- 172.21.15.2:0/2236555334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 msgr2=0x5562d665c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48b7fe640 1 -- 172.21.15.2:0/2236555334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 msgr2=0x5562d6656c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6656c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48b7fe640 1 -- 172.21.15.2:0/2236555334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d657b530 con 0x5562d6657190 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe483fff640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48bfff640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6656c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 0x5562d6659580 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0eba80 tx=0x7fe47c0ebf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5a3956fb6de306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe4897fa640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe4780b52e0 0x7fe4780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe481ffb640 1 -- 172.21.15.2:0/2236555334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0f4070 con 0x5562d6657190 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe48bfff640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe4780b52e0 0x7fe4780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe481ffb640 1 -- 172.21.15.2:0/2236555334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe47c0b7e70 con 0x5562d6657190 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe481ffb640 1 -- 172.21.15.2:0/2236555334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c095050 con 0x5562d6657190 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.414+0000 7fe4897fa640 1 -- 172.21.15.2:0/1824920169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe47c0e56e0 con 0x7fe48c06bfb0 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 -- 172.21.15.2:0/2236555334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 msgr2=0x5562d6659580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe48bfff640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe4780b52e0 0x7fe4780b77a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe484005fa0 tx=0x7fe484009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 0x5562d6659580 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0eba80 tx=0x7fe47c0ebf40 comp rx=0 tx=0).stop 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 -- 172.21.15.2:0/2236555334 shutdown_connections 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6657190 0x5562d6659580 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2236555334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6656c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 -- 172.21.15.2:0/2236555334 >> 172.21.15.2:0/2236555334 conn(0x5562d664f9b0 msgr2=0x5562d6650740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 -- 172.21.15.2:0/2236555334 shutdown_connections 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 -- 172.21.15.2:0/2236555334 wait complete. 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 -- start start 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.415+0000 7fe494ffc740 1 Processor -- start 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d665def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6657190 0x5562d665e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562d64edab0 con 0x5562d6654860 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5562d655b730 con 0x5562d6657190 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5562d665cbb0 con 0x5562d6659bd0 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 10 client.0 _ll_register_callbacks cb 0x5562d65af6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d665def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d665def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46762/0 (socket says 172.21.15.2:46762) 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 -- 172.21.15.2:0/3097598297 learned_addr learned my addr 172.21.15.2:0/3097598297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe483fff640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6657190 0x5562d665e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48bfff640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 -- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 msgr2=0x5562d665f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 -- 172.21.15.2:0/3097598297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6657190 msgr2=0x5562d665e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6657190 0x5562d665e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 -- 172.21.15.2:0/3097598297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d6317790 con 0x5562d6654860 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48bfff640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d665def0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0abbb0 tx=0x7fe47c009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14e9358b6204844 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe46affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe46affd640 1 -- 172.21.15.2:0/3097598297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0960e0 con 0x5562d6654860 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe46affd640 1 -- 172.21.15.2:0/3097598297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe47c009d50 con 0x5562d6654860 2024-09-10T23:34:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.416+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe47c0b7e70 con 0x5562d6654860 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe46affd640 1 -- 172.21.15.2:0/3097598297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe47c0962d0 con 0x5562d6654860 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 10 client.19200 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562d6390620 con 0x5562d6654860 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe46affd640 1 -- 172.21.15.2:0/3097598297 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe47c0b7e70 con 0x5562d6654860 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe46affd640 1 -- 172.21.15.2:0/3097598297 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe47c0a8120 con 0x5562d6654860 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 10 client.19200 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 10 client.19200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 20 client.19200 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d6669390 0x5562d666b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 4 client.19200 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562d65c8640 con 0x5562d6669390 2024-09-10T23:34:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.417+0000 7fe483fff640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d6669390 0x5562d666b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.418+0000 7fe483fff640 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d6669390 0x5562d666b780 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243c4e67d58e48e2 server_cookie=7d1de21e755ac0e6 in_seq=0 out_seq=0 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.418+0000 7fe46affd640 10 client.19200 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.418+0000 7fe46affd640 1 -- 172.21.15.2:0/3097598297 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562d65c8640 con 0x5562d6669390 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.418+0000 7fe46affd640 10 client.19200 handle_command_reply: tid=0 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 client.19200 shutdown 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 msgr2=0x5562d665def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d665def0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0abbb0 tx=0x7fe47c009740 comp rx=0 tx=0).stop 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 shutdown_connections 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d6669390 0x5562d666b780 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6659bd0 0x5562d665f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe46affd640 0 client.19200 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6657190 0x5562d665e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 --2- 172.21.15.2:0/3097598297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d665def0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 >> 172.21.15.2:0/3097598297 conn(0x5562d664f9b0 msgr2=0x5562d664ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 shutdown_connections 2024-09-10T23:34:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 1 -- 172.21.15.2:0/3097598297 wait complete. 2024-09-10T23:34:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.419+0000 7fe494ffc740 20 client.19200 trim_cache size 0 max 16384 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 Processor -- start 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 -- start start 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d664eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6659bd0 0x5562d6651d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1a9e90 con 0x5562d6654860 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1ab9d0 con 0x5562d6659bd0 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe494ffc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1aa560 con 0x5562d6657190 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d664eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d664eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46764/0 (socket says 172.21.15.2:46764) 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1689517980 learned_addr learned my addr 172.21.15.2:0/1689517980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48bfff640 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6659bd0 0x5562d6651d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe483fff640 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1689517980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 msgr2=0x5562d66517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1689517980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6659bd0 msgr2=0x5562d6651d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6659bd0 0x5562d6651d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 -- 172.21.15.2:0/1689517980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d6656fc0 con 0x5562d6654860 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe483fff640 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d664eae0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0abe40 tx=0x7fe47c0ab750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38df5231b79e1617 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe4817fa640 1 -- 172.21.15.2:0/1689517980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0f4070 con 0x5562d6654860 2024-09-10T23:34:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.434+0000 7fe4817fa640 1 -- 172.21.15.2:0/1689517980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe47c0eb320 con 0x5562d6654860 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe4817fa640 1 -- 172.21.15.2:0/1689517980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c093640 con 0x5562d6654860 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 -- 172.21.15.2:0/1689517980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 msgr2=0x5562d664eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d664eae0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0abe40 tx=0x7fe47c0ab750 comp rx=0 tx=0).stop 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 -- 172.21.15.2:0/1689517980 shutdown_connections 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6659bd0 0x5562d6651d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 --2- 172.21.15.2:0/1689517980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6654860 0x5562d664eae0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 -- 172.21.15.2:0/1689517980 >> 172.21.15.2:0/1689517980 conn(0x5562d664f9b0 msgr2=0x5562d664e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 -- 172.21.15.2:0/1689517980 shutdown_connections 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 -- 172.21.15.2:0/1689517980 wait complete. 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.435+0000 7fe494ffc740 1 -- start start 2024-09-10T23:34:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 Processor -- start 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6665c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 0x5562d6665090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1ab300 con 0x5562d6659bd0 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1aac30 con 0x5562d6654860 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1a7e70 con 0x5562d6657190 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe494ffc740 10 client.0 _ll_register_callbacks cb 0x7fe47c0eb900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 0x5562d6665090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 0x5562d6665090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46780/0 (socket says 172.21.15.2:46780) 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 -- 172.21.15.2:0/2311011278 learned_addr learned my addr 172.21.15.2:0/2311011278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe483fff640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6665c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 -- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 msgr2=0x5562d66649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 -- 172.21.15.2:0/2311011278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 msgr2=0x5562d6665c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6665c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 -- 172.21.15.2:0/2311011278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d66634b0 con 0x5562d6659bd0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6665c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe48bfff640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 0x5562d6665090 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe484009ca0 tx=0x7fe48403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc13e713cd2f124 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.436+0000 7fe46affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe46affd640 1 -- 172.21.15.2:0/2311011278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484055060 con 0x5562d6659bd0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe46affd640 1 -- 172.21.15.2:0/2311011278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fe484004790 con 0x5562d6659bd0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe47c0eb320 con 0x5562d6659bd0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe46affd640 1 -- 172.21.15.2:0/2311011278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe48402f660 con 0x5562d6659bd0 2024-09-10T23:34:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 10 client.19206 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562d66d62e0 con 0x5562d6659bd0 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe46affd640 1 -- 172.21.15.2:0/2311011278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe47c0eb320 con 0x5562d6659bd0 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe46affd640 1 -- 172.21.15.2:0/2311011278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe484044040 con 0x5562d6659bd0 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 10 client.19206 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 10 client.19206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 20 client.19206 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d66d6cf0 0x5562d66d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 4 client.19206 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5562d65c40f0 con 0x5562d66d6cf0 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.437+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d66d6cf0 0x5562d66d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.438+0000 7fe48b7fe640 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d66d6cf0 0x5562d66d9110 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4df50af2ed70d9ce server_cookie=34cbe4b318f86e32 in_seq=0 out_seq=0 2024-09-10T23:34:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.438+0000 7fe46affd640 10 client.19206 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe46affd640 1 -- 172.21.15.2:0/2311011278 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5562d65c40f0 con 0x5562d66d6cf0 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe46affd640 10 client.19206 handle_command_reply: tid=0 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 client.19206 shutdown 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 msgr2=0x5562d6665090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 0x5562d6665090 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe484009ca0 tx=0x7fe48403f040 comp rx=0 tx=0).stop 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 shutdown_connections 2024-09-10T23:34:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562d66d6cf0 0x5562d66d9110 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562d6659bd0 0x5562d6665090 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562d6657190 0x5562d66649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 --2- 172.21.15.2:0/2311011278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562d6654860 0x5562d6665c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe46affd640 0 client.19206 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 >> 172.21.15.2:0/2311011278 conn(0x5562d664f9b0 msgr2=0x5562d664ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 shutdown_connections 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 1 -- 172.21.15.2:0/2311011278 wait complete. 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe494ffc740 20 client.19206 trim_cache size 0 max 16384 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:34:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:34:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:34:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:34:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe4780b52e0 msgr2=0x7fe4780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe4780b52e0 0x7fe4780b77a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe484005fa0 tx=0x7fe484009360 comp rx=0 tx=0).stop 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 msgr2=0x7fe48c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 0x7fe48c198d70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00d950 tx=0x7fe47c00de10 comp rx=0 tx=0).stop 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 shutdown_connections 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fe4780b52e0 0x7fe4780b77a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c1086c0 0x7fe48c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe48c105b10 0x7fe48c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 --2- 172.21.15.2:0/1824920169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c06bfb0 0x7fe48c198d70 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 >> 172.21.15.2:0/1824920169 conn(0x7fe48c0fd150 msgr2=0x7fe48c103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 shutdown_connections 2024-09-10T23:34:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:37.455+0000 7fe49222a640 1 -- 172.21.15.2:0/1824920169 wait complete. 2024-09-10T23:34:37.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:37 smithi002 ceph-mon[31150]: pgmap v660: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:34:37.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:37 smithi154 ceph-mon[35136]: pgmap v660: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:34:37.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:37 smithi177 ceph-mon[35760]: pgmap v660: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-10T23:34:38.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:38 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:34:38.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:38 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:34:38.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:38 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:34:39.699 INFO:tasks.workunit.client.0.smithi002.stdout:499/600: open fd = 3 2024-09-10T23:34:39.699 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.699 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:500/600: open fd = 3 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:501/600: open fd = 3 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:502/600: open fd = 3 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.700 INFO:tasks.workunit.client.0.smithi002.stdout:503/600: open fd = 3 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:504/600: open fd = 3 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:505/600: open fd = 3 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:506/600: open fd = 3 2024-09-10T23:34:39.701 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:507/600: open fd = 3 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:508/600: open fd = 3 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:509/600: open fd = 3 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.702 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:510/600: open fd = 3 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:511/600: open fd = 3 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:512/600: open fd = 3 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:513/600: open fd = 3 2024-09-10T23:34:39.703 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:514/600: open fd = 3 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:515/600: open fd = 3 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:516/600: open fd = 3 2024-09-10T23:34:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:517/600: open fd = 3 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:518/600: open fd = 3 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.705 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:519/600: open fd = 3 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:520/600: open fd = 3 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:521/600: open fd = 3 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:522/600: open fd = 3 2024-09-10T23:34:39.706 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:523/600: open fd = 3 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:524/600: open fd = 3 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:525/600: open fd = 3 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:526/600: open fd = 3 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:527/600: open fd = 3 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:528/600: open fd = 3 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.708 INFO:tasks.workunit.client.0.smithi002.stdout:529/600: open fd = 3 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:530/600: open fd = 3 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:531/600: open fd = 3 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:532/600: open fd = 3 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.709 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:533/600: open fd = 3 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:534/600: open fd = 3 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:535/600: open fd = 3 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.710 INFO:tasks.workunit.client.0.smithi002.stdout:536/600: open fd = 3 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:537/600: open fd = 3 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:538/600: open fd = 3 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:539/600: open fd = 3 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.711 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:540/600: open fd = 3 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:541/600: open fd = 3 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:542/600: open fd = 3 2024-09-10T23:34:39.712 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:543/600: open fd = 3 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:544/600: open fd = 3 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.713 INFO:tasks.workunit.client.0.smithi002.stdout:545/600: open fd = 3 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:546/600: open fd = 3 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:547/600: open fd = 3 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:548/600: open fd = 3 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:549/600: open fd = 3 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:550/600: open fd = 3 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.715 INFO:tasks.workunit.client.0.smithi002.stdout:551/600: open fd = 3 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:552/600: open fd = 3 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:553/600: open fd = 3 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:554/600: open fd = 3 2024-09-10T23:34:39.716 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:555/600: open fd = 3 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:556/600: open fd = 3 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:557/600: open fd = 3 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.717 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:558/600: open fd = 3 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:559/600: open fd = 3 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:560/600: open fd = 3 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:34:39.718 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:34:39.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:39 smithi002 ceph-mon[31150]: pgmap v661: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:34:39.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:39 smithi154 ceph-mon[35136]: pgmap v661: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:34:39.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:39 smithi177 ceph-mon[35760]: pgmap v661: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:34:41.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:41 smithi002 ceph-mon[31150]: pgmap v662: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:41.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:41 smithi154 ceph-mon[35136]: pgmap v662: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:41.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:41 smithi177 ceph-mon[35760]: pgmap v662: 97 pgs: 97 active+clean; 3.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:34:43.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:43 smithi002 ceph-mon[31150]: pgmap v663: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:43.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:43 smithi154 ceph-mon[35136]: pgmap v663: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:43.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:43 smithi177 ceph-mon[35760]: pgmap v663: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T23:34:45.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:45 smithi177 ceph-mon[35760]: pgmap v664: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:34:45.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:45 smithi154 ceph-mon[35136]: pgmap v664: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:34:45.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:45 smithi002 ceph-mon[31150]: pgmap v664: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-10T23:34:47.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:47 smithi154 ceph-mon[35136]: pgmap v665: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:47.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:47 smithi177 ceph-mon[35760]: pgmap v665: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:47.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:47 smithi002 ceph-mon[31150]: pgmap v665: 97 pgs: 97 active+clean; 3.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-10T23:34:49.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:49 smithi154 ceph-mon[35136]: pgmap v666: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:34:49.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:49 smithi177 ceph-mon[35760]: pgmap v666: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:34:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:49 smithi002 ceph-mon[31150]: pgmap v666: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:34:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 -- 172.21.15.2:0/127670945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 msgr2=0x7f0eec102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/127670945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec102e30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009930 tx=0x7f0ed402a420 comp rx=0 tx=0).stop 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 -- 172.21.15.2:0/127670945 shutdown_connections 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/127670945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 0x7f0eec109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/127670945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec102e30 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/127670945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eec101860 0x7f0eec101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 -- 172.21.15.2:0/127670945 >> 172.21.15.2:0/127670945 conn(0x7f0eec0fd140 msgr2=0x7f0eec0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 -- 172.21.15.2:0/127670945 shutdown_connections 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.558+0000 7f0ef1c47640 1 -- 172.21.15.2:0/127670945 wait complete. 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 Processor -- start 2024-09-10T23:34:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 -- start start 2024-09-10T23:34:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eec101860 0x7f0eec105600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec103e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 0x7f0eec1043a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10d4d0 con 0x7f0eec1029b0 2024-09-10T23:34:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10d350 con 0x7f0eec103370 2024-09-10T23:34:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0ef1c47640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10d650 con 0x7f0eec101860 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec103e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec103e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54420/0 (socket says 172.21.15.2:54420) 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.559+0000 7f0eeaffd640 1 -- 172.21.15.2:0/2143269073 learned_addr learned my addr 172.21.15.2:0/2143269073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eebfff640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 0x7f0eec1043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eec101860 0x7f0eec105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeaffd640 1 -- 172.21.15.2:0/2143269073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eec101860 msgr2=0x7f0eec105600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eec101860 0x7f0eec105600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeaffd640 1 -- 172.21.15.2:0/2143269073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 msgr2=0x7f0eec1043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 0x7f0eec1043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeaffd640 1 -- 172.21.15.2:0/2143269073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec104c10 con 0x7f0eec1029b0 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eebfff640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 0x7f0eec1043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec103e60 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009a50 tx=0x7f0ed4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0ee8ff9640 1 -- 172.21.15.2:0/2143269073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed403f030 con 0x7f0eec1029b0 2024-09-10T23:34:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec1a2dd0 con 0x7f0eec1029b0 2024-09-10T23:34:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0ee8ff9640 1 -- 172.21.15.2:0/2143269073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed40044b0 con 0x7f0eec1029b0 2024-09-10T23:34:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0ee8ff9640 1 -- 172.21.15.2:0/2143269073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4035070 con 0x7f0eec1029b0 2024-09-10T23:34:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.560+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec1a3230 con 0x7f0eec1029b0 2024-09-10T23:34:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 Processor -- start 2024-09-10T23:34:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 -- start start 2024-09-10T23:34:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ee8ff9640 1 -- 172.21.15.2:0/2143269073 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0ed403bbb0 con 0x7f0eec1029b0 2024-09-10T23:34:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1eb860 0x5642fc1edc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 0x5642fc1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5642fc15d6f0 con 0x5642fc1ee190 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642fc14cb20 con 0x5642fc1eb860 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5642fc150930 con 0x5642fc1f0bd0 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 0x5642fc1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 0x5642fc1f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54422/0 (socket says 172.21.15.2:54422) 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.563+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/3543225091 learned_addr learned my addr 172.21.15.2:0/3543225091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eebfff640 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1eb860 0x5642fc1edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/3543225091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 msgr2=0x5642fc1f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/3543225091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1eb860 msgr2=0x5642fc1edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1eb860 0x5642fc1edc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/3543225091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642fc112530 con 0x5642fc1ee190 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 0x5642fc1f0580 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009f60 tx=0x7f0edc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8ef81ee04e638a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0ee8ff9640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0ee1ffb640 1 -- 172.21.15.2:0/3543225091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc016070 con 0x5642fc1ee190 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0ee1ffb640 1 -- 172.21.15.2:0/3543225091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc004d20 con 0x5642fc1ee190 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0ee1ffb640 1 -- 172.21.15.2:0/3543225091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0127d0 con 0x5642fc1ee190 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0eebfff640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.564+0000 7f0ee8ff9640 1 -- 172.21.15.2:0/2143269073 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0ed4106670 con 0x7f0eec1029b0 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 -- 172.21.15.2:0/3543225091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 msgr2=0x5642fc1f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0eebfff640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005fd0 tx=0x7f0ee4005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 0x5642fc1f0580 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009f60 tx=0x7f0edc009f90 comp rx=0 tx=0).stop 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 -- 172.21.15.2:0/3543225091 shutdown_connections 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1ee190 0x5642fc1f0580 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/3543225091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1eb860 0x5642fc1edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 -- 172.21.15.2:0/3543225091 >> 172.21.15.2:0/3543225091 conn(0x5642fc1e69b0 msgr2=0x5642fc1e7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 -- 172.21.15.2:0/3543225091 shutdown_connections 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.565+0000 7f0ef4a16740 1 -- 172.21.15.2:0/3543225091 wait complete. 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 -- start start 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 Processor -- start 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1f5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5642fc084ab0 con 0x5642fc1eb860 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642fc0f2730 con 0x5642fc1f0bd0 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5642fc1f3bb0 con 0x5642fc1ee190 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0ef4a16740 10 client.0 _ll_register_callbacks cb 0x5642fc1466b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54438/0 (socket says 172.21.15.2:54438) 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/2015472904 learned_addr learned my addr 172.21.15.2:0/2015472904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.566+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eebfff640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 msgr2=0x5642fc1f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/2015472904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 msgr2=0x5642fc1f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/2015472904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642fbeae790 con 0x5642fc1eb860 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f4ed0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005970 tx=0x7f0edc004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e2fae330015487 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ecaffd640 1 -- 172.21.15.2:0/2015472904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc028060 con 0x5642fc1eb860 2024-09-10T23:34:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ecaffd640 1 -- 172.21.15.2:0/2015472904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0edc005250 con 0x5642fc1eb860 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0edc004d20 con 0x5642fc1eb860 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ecaffd640 1 -- 172.21.15.2:0/2015472904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0edc016070 con 0x5642fc1eb860 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ef4a16740 10 client.19218 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5642fbf27620 con 0x5642fc1eb860 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.567+0000 7f0ecaffd640 1 -- 172.21.15.2:0/2015472904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc004d20 con 0x5642fc1eb860 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ecaffd640 1 -- 172.21.15.2:0/2015472904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0edc00f040 con 0x5642fc1eb860 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ef4a16740 10 client.19218 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ef4a16740 10 client.19218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ef4a16740 20 client.19218 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc200480 0x5642fc202870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ef4a16740 4 client.19218 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642fc15f640 con 0x5642fc200480 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc200480 0x5642fc202870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.568+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc200480 0x5642fc202870 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ab073bb22434a9 server_cookie=a30e7ae28b14216b in_seq=0 out_seq=0 2024-09-10T23:34:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.569+0000 7f0ecaffd640 10 client.19218 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.569+0000 7f0ecaffd640 1 -- 172.21.15.2:0/2015472904 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642fc15f640 con 0x5642fc200480 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.569+0000 7f0ecaffd640 10 client.19218 handle_command_reply: tid=0 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.569+0000 7f0ef4a16740 1 client.19218 shutdown 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.569+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 msgr2=0x5642fc1f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.569+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f4ed0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005970 tx=0x7f0edc004ed0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 shutdown_connections 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc200480 0x5642fc202870 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ecaffd640 0 client.19218 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/2015472904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f4ed0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 >> 172.21.15.2:0/2015472904 conn(0x5642fc1e69b0 msgr2=0x5642fc1e5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 shutdown_connections 2024-09-10T23:34:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 1 -- 172.21.15.2:0/2015472904 wait complete. 2024-09-10T23:34:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.570+0000 7f0ef4a16740 20 client.19218 trim_cache size 0 max 16384 2024-09-10T23:34:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 Processor -- start 2024-09-10T23:34:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 -- start start 2024-09-10T23:34:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1ee190 0x5642fc1e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1e5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1ac020 con 0x5642fc1eb860 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1adb60 con 0x5642fc1ee190 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1ac6f0 con 0x5642fc1f0bd0 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54440/0 (socket says 172.21.15.2:54440) 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/888610443 learned_addr learned my addr 172.21.15.2:0/888610443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eebfff640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/888610443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 msgr2=0x5642fc1e5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1e5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1ee190 0x5642fc1e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/888610443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1ee190 msgr2=0x5642fc1e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1ee190 0x5642fc1e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/888610443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642fc1f64b0 con 0x5642fc1eb860 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eebfff640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1e5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.585+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1ee190 0x5642fc1e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f5570 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005d70 tx=0x7f0edc009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61005a76b866757f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ee17fa640 1 -- 172.21.15.2:0/888610443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc033020 con 0x5642fc1eb860 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ee17fa640 1 -- 172.21.15.2:0/888610443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc004cc0 con 0x5642fc1eb860 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ee17fa640 1 -- 172.21.15.2:0/888610443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc028070 con 0x5642fc1eb860 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 -- 172.21.15.2:0/888610443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 msgr2=0x5642fc1f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f5570 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005d70 tx=0x7f0edc009f60 comp rx=0 tx=0).stop 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 -- 172.21.15.2:0/888610443 shutdown_connections 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1f0bd0 0x5642fc1e5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1ee190 0x5642fc1e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/888610443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1f5570 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.586+0000 7f0ef4a16740 1 -- 172.21.15.2:0/888610443 >> 172.21.15.2:0/888610443 conn(0x5642fc1e69b0 msgr2=0x5642fc1eacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 -- 172.21.15.2:0/888610443 shutdown_connections 2024-09-10T23:34:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 -- 172.21.15.2:0/888610443 wait complete. 2024-09-10T23:34:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 -- start start 2024-09-10T23:34:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 Processor -- start 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1ad490 con 0x5642fc1eb860 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1acdc0 con 0x5642fc1f0bd0 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1aa000 con 0x5642fc1ee190 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0ef4a16740 10 client.0 _ll_register_callbacks cb 0x7f0edc009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.587+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1fcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54452/0 (socket says 172.21.15.2:54452) 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/1690454870 learned_addr learned my addr 172.21.15.2:0/1690454870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eebfff640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 msgr2=0x5642fc1fb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1fb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/1690454870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 msgr2=0x5642fc1fc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1fc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 -- 172.21.15.2:0/1690454870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642fc1fa440 con 0x5642fc1eb860 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eebfff640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1fc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0eeb7fe640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1fcc20 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005b20 tx=0x7f0edc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c564fe1cbd3d64b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ecaffd640 1 -- 172.21.15.2:0/1690454870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc033030 con 0x5642fc1eb860 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ecaffd640 1 -- 172.21.15.2:0/1690454870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f0edc01ad50 con 0x5642fc1eb860 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0edc004cc0 con 0x5642fc1eb860 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ecaffd640 1 -- 172.21.15.2:0/1690454870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0edc028040 con 0x5642fc1eb860 2024-09-10T23:34:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ef4a16740 10 client.19224 fetch_fsmap learned FSMap version 28 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.588+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5642fc26d520 con 0x5642fc1eb860 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ecaffd640 1 -- 172.21.15.2:0/1690454870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc004cc0 con 0x5642fc1eb860 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ecaffd640 1 -- 172.21.15.2:0/1690454870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0edc0128d0 con 0x5642fc1eb860 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ef4a16740 10 client.19224 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ef4a16740 10 client.19224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ef4a16740 20 client.19224 populate_metadata read hostname 'smithi002' 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc26def0 0x5642fc270310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ef4a16740 4 client.19224 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5642fc15b0f0 con 0x5642fc26def0 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.589+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc26def0 0x5642fc270310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.590+0000 7f0ecaffd640 10 client.19224 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.590+0000 7f0eeaffd640 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc26def0 0x5642fc270310 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eba9a7edeffd18aa server_cookie=37d362724e7bc929 in_seq=0 out_seq=0 2024-09-10T23:34:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ecaffd640 1 -- 172.21.15.2:0/1690454870 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5642fc15b0f0 con 0x5642fc26def0 2024-09-10T23:34:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ecaffd640 10 client.19224 handle_command_reply: tid=0 2024-09-10T23:34:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 client.19224 shutdown 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 msgr2=0x5642fc1fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1fcc20 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005b20 tx=0x7f0edc005bd0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 shutdown_connections 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5642fc26def0 0x5642fc270310 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642fc1f0bd0 0x5642fc1fc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642fc1ee190 0x5642fc1fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 --2- 172.21.15.2:0/1690454870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642fc1eb860 0x5642fc1fcc20 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ecaffd640 0 client.19224 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 >> 172.21.15.2:0/1690454870 conn(0x5642fc1e69b0 msgr2=0x5642fc1ea8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 shutdown_connections 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 1 -- 172.21.15.2:0/1690454870 wait complete. 2024-09-10T23:34:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.606+0000 7f0ef4a16740 20 client.19224 trim_cache size 0 max 16384 2024-09-10T23:34:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:34:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:34:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:34:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ed80b52e0 msgr2=0x7f0ed80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005fd0 tx=0x7f0ee4005f60 comp rx=0 tx=0).stop 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 msgr2=0x7f0eec103e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec103e60 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009a50 tx=0x7f0ed4031a50 comp rx=0 tx=0).stop 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 shutdown_connections 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0eec103370 0x7f0eec1043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eec1029b0 0x7f0eec103e60 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 --2- 172.21.15.2:0/2143269073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eec101860 0x7f0eec105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 >> 172.21.15.2:0/2143269073 conn(0x7f0eec0fd140 msgr2=0x7f0eec0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 shutdown_connections 2024-09-10T23:34:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:34:50.607+0000 7f0ef1c47640 1 -- 172.21.15.2:0/2143269073 wait complete. 2024-09-10T23:34:51.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:51 smithi154 ceph-mon[35136]: pgmap v667: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:51.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:51 smithi177 ceph-mon[35760]: pgmap v667: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:51.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:51 smithi002 ceph-mon[31150]: pgmap v667: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:53.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:53 smithi154 ceph-mon[35136]: pgmap v668: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:34:53.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:53 smithi177 ceph-mon[35760]: pgmap v668: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:34:53.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:53 smithi002 ceph-mon[31150]: pgmap v668: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:34:55.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:55 smithi154 ceph-mon[35136]: pgmap v669: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:55.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:55 smithi177 ceph-mon[35760]: pgmap v669: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:55.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:55 smithi002 ceph-mon[31150]: pgmap v669: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:57.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:57 smithi154 ceph-mon[35136]: pgmap v670: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:57.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:57 smithi177 ceph-mon[35760]: pgmap v670: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:57.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:57 smithi002 ceph-mon[31150]: pgmap v670: 97 pgs: 97 active+clean; 4.0 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T23:34:59.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:34:59 smithi154 ceph-mon[35136]: pgmap v671: 97 pgs: 97 active+clean; 4.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:34:59.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:34:59 smithi177 ceph-mon[35760]: pgmap v671: 97 pgs: 97 active+clean; 4.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:34:59.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:34:59 smithi002 ceph-mon[31150]: pgmap v671: 97 pgs: 97 active+clean; 4.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-10T23:35:01.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:01 smithi154 ceph-mon[35136]: pgmap v672: 97 pgs: 97 active+clean; 4.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:35:01.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:01 smithi177 ceph-mon[35760]: pgmap v672: 97 pgs: 97 active+clean; 4.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:35:01.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:01 smithi002 ceph-mon[31150]: pgmap v672: 97 pgs: 97 active+clean; 4.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.708+0000 7fcb223a3640 1 -- 172.21.15.2:0/3361607831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 msgr2=0x7fcb1c100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.708+0000 7fcb223a3640 1 --2- 172.21.15.2:0/3361607831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c100a40 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009930 tx=0x7fcb0402a420 comp rx=0 tx=0).stop 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 -- 172.21.15.2:0/3361607831 shutdown_connections 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 --2- 172.21.15.2:0/3361607831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c101160 0x7fcb1c10afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 --2- 172.21.15.2:0/3361607831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c100a40 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 --2- 172.21.15.2:0/3361607831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c103fd0 0x7fcb1c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 -- 172.21.15.2:0/3361607831 >> 172.21.15.2:0/3361607831 conn(0x7fcb1c0fc8f0 msgr2=0x7fcb1c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 -- 172.21.15.2:0/3361607831 shutdown_connections 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 -- 172.21.15.2:0/3361607831 wait complete. 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 Processor -- start 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.709+0000 7fcb223a3640 1 -- start start 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb223a3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c101160 0x7fcb1c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb223a3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c103fd0 0x7fcb1c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb223a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb223a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c10e660 con 0x7fcb1c104910 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb223a3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c10e4e0 con 0x7fcb1c101160 2024-09-10T23:35:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb223a3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c10e7e0 con 0x7fcb1c103fd0 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59684/0 (socket says 172.21.15.2:59684) 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 -- 172.21.15.2:0/2026567056 learned_addr learned my addr 172.21.15.2:0/2026567056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c103fd0 0x7fcb1c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c101160 0x7fcb1c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 -- 172.21.15.2:0/2026567056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c103fd0 msgr2=0x7fcb1c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c103fd0 0x7fcb1c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 -- 172.21.15.2:0/2026567056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c101160 msgr2=0x7fcb1c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c101160 0x7fcb1c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb20940640 1 -- 172.21.15.2:0/2026567056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c19a840 con 0x7fcb1c104910 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.710+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c101160 0x7fcb1c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.711+0000 7fcb20940640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c199f80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400eaa0 tx=0x7fcb1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.711+0000 7fcb197fa640 1 -- 172.21.15.2:0/2026567056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400cdb0 con 0x7fcb1c104910 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.711+0000 7fcb197fa640 1 -- 172.21.15.2:0/2026567056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb14005020 con 0x7fcb1c104910 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.711+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c19ab30 con 0x7fcb1c104910 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.711+0000 7fcb197fa640 1 -- 172.21.15.2:0/2026567056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb140116d0 con 0x7fcb1c104910 2024-09-10T23:35:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.711+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c1a1200 con 0x7fcb1c104910 2024-09-10T23:35:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.713+0000 7fcb25248740 1 Processor -- start 2024-09-10T23:35:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.713+0000 7fcb197fa640 1 -- 172.21.15.2:0/2026567056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcb1400f040 con 0x7fcb1c104910 2024-09-10T23:35:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.713+0000 7fcb25248740 1 -- start start 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb25248740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db1341ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb25248740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341b190 0x55db1341d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb25248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13420090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb25248740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db1338a6f0 con 0x55db13418860 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb25248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55db13379b20 con 0x55db1341dbd0 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb25248740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55db1337d930 con 0x55db1341b190 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db1341ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db1341ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59696/0 (socket says 172.21.15.2:59696) 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/1018240926 learned_addr learned my addr 172.21.15.2:0/1018240926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341b190 0x55db1341d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13420090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/1018240926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341b190 msgr2=0x55db1341d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341b190 0x55db1341d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/1018240926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 msgr2=0x55db13420090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13420090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/1018240926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1333f530 con 0x55db13418860 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.714+0000 7fcb197fa640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcb080b52e0 0x7fcb080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcb080b52e0 0x7fcb080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db1341ac50 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fcb04031500 tx=0x7fcb04005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b083b10e69b12e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb197fa640 1 -- 172.21.15.2:0/2026567056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcb140e5a30 con 0x7fcb1c104910 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb127fc640 1 -- 172.21.15.2:0/1018240926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04035070 con 0x55db13418860 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb127fc640 1 -- 172.21.15.2:0/1018240926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb04003e20 con 0x55db13418860 2024-09-10T23:35:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb127fc640 1 -- 172.21.15.2:0/1018240926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04031e60 con 0x55db13418860 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb25248740 1 -- 172.21.15.2:0/1018240926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 msgr2=0x55db1341ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcb080b52e0 0x7fcb080b77a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005fd0 tx=0x7fcb0c0084c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.715+0000 7fcb25248740 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db1341ac50 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fcb04031500 tx=0x7fcb04005c00 comp rx=0 tx=0).stop 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 -- 172.21.15.2:0/1018240926 shutdown_connections 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13420090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341b190 0x55db1341d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 --2- 172.21.15.2:0/1018240926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db1341ac50 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 -- 172.21.15.2:0/1018240926 >> 172.21.15.2:0/1018240926 conn(0x55db134139b0 msgr2=0x55db13414740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 -- 172.21.15.2:0/1018240926 shutdown_connections 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 -- 172.21.15.2:0/1018240926 wait complete. 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 -- start start 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 Processor -- start 2024-09-10T23:35:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db13421f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341b190 0x55db13422600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.716+0000 7fcb25248740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341dbd0 0x55db13423160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb25248740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db132b1ab0 con 0x55db13418860 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb25248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55db1331f730 con 0x55db1341b190 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb25248740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55db13420b50 con 0x55db1341dbd0 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb25248740 10 client.0 _ll_register_callbacks cb 0x55db133736b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db13421f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db13421f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59704/0 (socket says 172.21.15.2:59704) 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 -- 172.21.15.2:0/3641236821 learned_addr learned my addr 172.21.15.2:0/3641236821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341b190 0x55db13422600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb20940640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341dbd0 0x55db13423160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 -- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341dbd0 msgr2=0x55db13423160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341dbd0 0x55db13423160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 -- 172.21.15.2:0/3641236821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341b190 msgr2=0x55db13422600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341b190 0x55db13422600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 -- 172.21.15.2:0/3641236821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db130db790 con 0x55db13418860 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb20940640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341dbd0 0x55db13423160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db13421f60 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c003b80 tx=0x7fcb0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21086548d87697a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcafb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcafb7fe640 1 -- 172.21.15.2:0/3641236821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00ec40 con 0x55db13418860 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcafb7fe640 1 -- 172.21.15.2:0/3641236821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcb0c00ede0 con 0x55db13418860 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.717+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb04003e20 con 0x55db13418860 2024-09-10T23:35:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcafb7fe640 1 -- 172.21.15.2:0/3641236821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb0c01e420 con 0x55db13418860 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 10 client.19236 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55db13154620 con 0x55db13418860 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcafb7fe640 1 -- 172.21.15.2:0/3641236821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb04003e20 con 0x55db13418860 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcafb7fe640 1 -- 172.21.15.2:0/3641236821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb0c0267d0 con 0x55db13418860 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 10 client.19236 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 10 client.19236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 20 client.19236 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1342d7e0 0x55db1342fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 4 client.19236 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db1338c640 con 0x55db1342d7e0 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.718+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1342d7e0 0x55db1342fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.719+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1342d7e0 0x55db1342fbf0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a1a9b484963acb server_cookie=d8920a62558ad69c in_seq=0 out_seq=0 2024-09-10T23:35:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.719+0000 7fcafb7fe640 10 client.19236 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcafb7fe640 1 -- 172.21.15.2:0/3641236821 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db1338c640 con 0x55db1342d7e0 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcafb7fe640 10 client.19236 handle_command_reply: tid=0 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 client.19236 shutdown 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 msgr2=0x55db13421f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db13421f60 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c003b80 tx=0x7fcb0c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 shutdown_connections 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1342d7e0 0x55db1342fbf0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db1341dbd0 0x55db13423160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341b190 0x55db13422600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcafb7fe640 0 client.19236 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 --2- 172.21.15.2:0/3641236821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db13418860 0x55db13421f60 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 >> 172.21.15.2:0/3641236821 conn(0x55db134139b0 msgr2=0x55db13412bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 shutdown_connections 2024-09-10T23:35:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 1 -- 172.21.15.2:0/3641236821 wait complete. 2024-09-10T23:35:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.720+0000 7fcb25248740 20 client.19236 trim_cache size 0 max 16384 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 Processor -- start 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 -- start start 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13414450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134295d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13429b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1a9da0 con 0x55db1341b190 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1ab8e0 con 0x55db1341dbd0 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb25248740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1aa470 con 0x55db13418860 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134295d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134295d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59706/0 (socket says 172.21.15.2:59706) 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.735+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/2117512721 learned_addr learned my addr 172.21.15.2:0/2117512721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb20940640 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13429b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13414450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/2117512721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 msgr2=0x55db13414450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13414450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/2117512721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 msgr2=0x55db13429b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13429b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/2117512721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1341afc0 con 0x55db1341b190 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb20940640 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13429b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134295d0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fcb04031500 tx=0x7fcb04005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce310d8cb42ab7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb11ffb640 1 -- 172.21.15.2:0/2117512721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04035040 con 0x55db1341b190 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb11ffb640 1 -- 172.21.15.2:0/2117512721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb040036f0 con 0x55db1341b190 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.736+0000 7fcb11ffb640 1 -- 172.21.15.2:0/2117512721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0403b680 con 0x55db1341b190 2024-09-10T23:35:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 -- 172.21.15.2:0/2117512721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 msgr2=0x55db134295d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134295d0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fcb04031500 tx=0x7fcb04005850 comp rx=0 tx=0).stop 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 -- 172.21.15.2:0/2117512721 shutdown_connections 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13429b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134295d0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 --2- 172.21.15.2:0/2117512721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13414450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 -- 172.21.15.2:0/2117512721 >> 172.21.15.2:0/2117512721 conn(0x55db134139b0 msgr2=0x55db13417e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 -- 172.21.15.2:0/2117512721 shutdown_connections 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 -- 172.21.15.2:0/2117512721 wait complete. 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 -- start start 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 Processor -- start 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.737+0000 7fcb25248740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13416a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134170b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13496b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1ab210 con 0x55db1341b190 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1aab40 con 0x55db1341dbd0 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1a7d80 con 0x55db13418860 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 10 client.0 _ll_register_callbacks cb 0x7fcb0c008df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134170b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59710/0 (socket says 172.21.15.2:59710) 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/13893230 learned_addr learned my addr 172.21.15.2:0/13893230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13416a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb20940640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13496b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 msgr2=0x55db13416a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13416a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/13893230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 msgr2=0x55db13496b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13496b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 -- 172.21.15.2:0/13893230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db13497350 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13416a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb1b7fe640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134170b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fcb0402a940 tx=0x7fcb040098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d39e49a92b7c570 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcafb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcafb7fe640 1 -- 172.21.15.2:0/13893230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0404d030 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcafb7fe640 1 -- 172.21.15.2:0/13893230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcb04031970 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.738+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb040036f0 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcafb7fe640 1 -- 172.21.15.2:0/13893230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb04035040 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 10 client.19242 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55db1349e6d0 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcafb7fe640 1 -- 172.21.15.2:0/13893230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb040036f0 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcafb7fe640 1 -- 172.21.15.2:0/13893230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb0403bb10 con 0x55db1341b190 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 10 client.19242 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 10 client.19242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 20 client.19242 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1349ec80 0x55db134a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 4 client.19242 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db133880f0 con 0x55db1349ec80 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.739+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1349ec80 0x55db134a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.740+0000 7fcb1bfff640 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1349ec80 0x55db134a1070 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6e3624ad909e588 server_cookie=4eca78f8e26fba65 in_seq=0 out_seq=0 2024-09-10T23:35:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.740+0000 7fcafb7fe640 10 client.19242 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.756+0000 7fcafb7fe640 1 -- 172.21.15.2:0/13893230 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db133880f0 con 0x55db1349ec80 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.756+0000 7fcafb7fe640 10 client.19242 handle_command_reply: tid=0 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.756+0000 7fcb25248740 1 client.19242 shutdown 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 msgr2=0x55db134170b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134170b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fcb0402a940 tx=0x7fcb040098c0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 shutdown_connections 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55db1349ec80 0x55db134a1070 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db1341dbd0 0x55db13496b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcafb7fe640 0 client.19242 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1341b190 0x55db134170b0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 --2- 172.21.15.2:0/13893230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55db13418860 0x55db13416a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 >> 172.21.15.2:0/13893230 conn(0x55db134139b0 msgr2=0x55db13414450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 shutdown_connections 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 1 -- 172.21.15.2:0/13893230 wait complete. 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb25248740 20 client.19242 trim_cache size 0 max 16384 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:35:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:35:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcb080b52e0 msgr2=0x7fcb080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb223a3640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcb080b52e0 0x7fcb080b77a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005fd0 tx=0x7fcb0c0084c0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 msgr2=0x7fcb1c199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.757+0000 7fcb223a3640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c199f80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400eaa0 tx=0x7fcb1400ef60 comp rx=0 tx=0).stop 2024-09-10T23:35:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 shutdown_connections 2024-09-10T23:35:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcb080b52e0 0x7fcb080b77a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb1c104910 0x7fcb1c199f80 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1c103fd0 0x7fcb1c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 --2- 172.21.15.2:0/2026567056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c101160 0x7fcb1c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 >> 172.21.15.2:0/2026567056 conn(0x7fcb1c0fc8f0 msgr2=0x7fcb1c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 shutdown_connections 2024-09-10T23:35:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:03.758+0000 7fcb223a3640 1 -- 172.21.15.2:0/2026567056 wait complete. 2024-09-10T23:35:03.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:03 smithi154 ceph-mon[35136]: pgmap v673: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-10T23:35:03.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:03 smithi177 ceph-mon[35760]: pgmap v673: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-10T23:35:03.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:03 smithi002 ceph-mon[31150]: pgmap v673: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-10T23:35:05.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:05 smithi154 ceph-mon[35136]: pgmap v674: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:35:05.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:05 smithi177 ceph-mon[35760]: pgmap v674: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:35:05.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:05 smithi002 ceph-mon[31150]: pgmap v674: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-10T23:35:07.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:35:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:07.702 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:07 smithi002 ceph-mon[31150]: pgmap v675: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:35:07.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:07 smithi154 ceph-mon[35136]: pgmap v675: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:35:07.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:07 smithi177 ceph-mon[35760]: pgmap v675: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-10T23:35:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 -- 172.21.15.2:0/491908552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1076e0 msgr2=0x7f624c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 --2- 172.21.15.2:0/491908552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1076e0 0x7f624c107b20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f6240009900 tx=0x7f624002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 -- 172.21.15.2:0/491908552 shutdown_connections 2024-09-10T23:35:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 --2- 172.21.15.2:0/491908552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c108060 0x7f624c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 --2- 172.21.15.2:0/491908552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c1076e0 0x7f624c107b20 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 --2- 172.21.15.2:0/491908552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c101cd0 0x7f624c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 -- 172.21.15.2:0/491908552 >> 172.21.15.2:0/491908552 conn(0x7f624c0fd720 msgr2=0x7f624c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 -- 172.21.15.2:0/491908552 shutdown_connections 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.228+0000 7f6250be1640 1 -- 172.21.15.2:0/491908552 wait complete. 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 Processor -- start 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 -- start start 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 0x7f624c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c1076e0 0x7f624c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c108060 0x7f624c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f624c111d20 con 0x7f624c101cd0 2024-09-10T23:35:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f624c111ba0 con 0x7f624c108060 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6250be1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f624c111ea0 con 0x7f624c1076e0 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 0x7f624c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 0x7f624c19a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59728/0 (socket says 172.21.15.2:59728) 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f624a59c640 1 -- 172.21.15.2:0/791130908 learned_addr learned my addr 172.21.15.2:0/791130908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f6249d9b640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c1076e0 0x7f624c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f624ad9d640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c108060 0x7f624c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f624a59c640 1 -- 172.21.15.2:0/791130908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c1076e0 msgr2=0x7f624c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.229+0000 7f624a59c640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c1076e0 0x7f624c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f624a59c640 1 -- 172.21.15.2:0/791130908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c108060 msgr2=0x7f624c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f624a59c640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c108060 0x7f624c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f624a59c640 1 -- 172.21.15.2:0/791130908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c1a54b0 con 0x7f624c101cd0 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f624ad9d640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c108060 0x7f624c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f624a59c640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 0x7f624c19a0b0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f623c00b4a0 tx=0x7f623c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f623b7fe640 1 -- 172.21.15.2:0/791130908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c014070 con 0x7f624c101cd0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c1a57a0 con 0x7f624c101cd0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f623b7fe640 1 -- 172.21.15.2:0/791130908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623c010ac0 con 0x7f624c101cd0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f623b7fe640 1 -- 172.21.15.2:0/791130908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c017c30 con 0x7f624c101cd0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.230+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1a5d80 con 0x7f624c101cd0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 Processor -- start 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f623b7fe640 1 -- 172.21.15.2:0/791130908 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f623c010610 con 0x7f624c101cd0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 -- start start 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3480 0x5640aecc3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 0x5640aecd3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aecd6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640aec39e50 con 0x5640aecc3da0 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5640aec29280 con 0x5640aecc3480 2024-09-10T23:35:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6252fb6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5640aec2d090 con 0x5640aecd4140 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 0x5640aecd3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 0x5640aecd3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59738/0 (socket says 172.21.15.2:59738) 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f624a59c640 1 -- 172.21.15.2:0/1515832285 learned_addr learned my addr 172.21.15.2:0/1515832285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.233+0000 7f6249d9b640 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aecd6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624ad9d640 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3480 0x5640aecc3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624a59c640 1 -- 172.21.15.2:0/1515832285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 msgr2=0x5640aecd6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624a59c640 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aecd6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624a59c640 1 -- 172.21.15.2:0/1515832285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3480 msgr2=0x5640aecc3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624a59c640 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3480 0x5640aecc3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624a59c640 1 -- 172.21.15.2:0/1515832285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ae987650 con 0x5640aecc3da0 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f623b7fe640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62340b52e0 0x7f62340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624ad9d640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62340b52e0 0x7f62340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f623b7fe640 1 -- 172.21.15.2:0/791130908 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f623c0e5480 con 0x7f624c101cd0 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624a59c640 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 0x5640aecd3c00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f623c0eb620 tx=0x7f623c0eb710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef63ff955ec8237 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f6238ff9640 1 -- 172.21.15.2:0/1515832285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c01e020 con 0x5640aecc3da0 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f624ad9d640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62340b52e0 0x7f62340b77a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6244005fd0 tx=0x7f6244008470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f6238ff9640 1 -- 172.21.15.2:0/1515832285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623c017360 con 0x5640aecc3da0 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.234+0000 7f6238ff9640 1 -- 172.21.15.2:0/1515832285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0aba20 con 0x5640aecc3da0 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 -- 172.21.15.2:0/1515832285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 msgr2=0x5640aecd3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 0x5640aecd3c00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f623c0eb620 tx=0x7f623c0eb710 comp rx=0 tx=0).stop 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 -- 172.21.15.2:0/1515832285 shutdown_connections 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aecd6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3da0 0x5640aecd3c00 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1515832285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3480 0x5640aecc3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 -- 172.21.15.2:0/1515832285 >> 172.21.15.2:0/1515832285 conn(0x5640aecc12b0 msgr2=0x5640aecc2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 -- 172.21.15.2:0/1515832285 shutdown_connections 2024-09-10T23:35:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 -- 172.21.15.2:0/1515832285 wait complete. 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.235+0000 7f6252fb6740 1 -- start start 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 Processor -- start 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecd39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecd0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aecd13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640aea8a700 con 0x5640aecc3480 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5640aebc4110 con 0x5640aecd4140 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5640aecd6df0 con 0x5640aecc3da0 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6252fb6740 10 client.0 _ll_register_callbacks cb 0x5640aebdd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecd39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecd39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59752/0 (socket says 172.21.15.2:59752) 2024-09-10T23:35:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 -- 172.21.15.2:0/3794557662 learned_addr learned my addr 172.21.15.2:0/3794557662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f6249d9b640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecd0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624ad9d640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aecd13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 -- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 msgr2=0x5640aecd0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecd0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 -- 172.21.15.2:0/3794557662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 msgr2=0x5640aecd13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aecd13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624a59c640 1 -- 172.21.15.2:0/3794557662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640aebf1c40 con 0x5640aecc3480 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.236+0000 7f624ad9d640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aecd13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f624a59c640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecd39e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f623c0abbe0 tx=0x7f623c0eb3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760d3ff96792ebf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6231ffb640 1 -- 172.21.15.2:0/3794557662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c01e070 con 0x5640aecc3480 2024-09-10T23:35:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6231ffb640 1 -- 172.21.15.2:0/3794557662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f623c0a7ec0 con 0x5640aecc3480 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640aec3bda0 con 0x5640aecc3480 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6231ffb640 1 -- 172.21.15.2:0/3794557662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f623c0ab3c0 con 0x5640aecc3480 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 10 client.19254 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640aece26e0 con 0x5640aecc3480 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6231ffb640 1 -- 172.21.15.2:0/3794557662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5640aec3bda0 con 0x5640aecc3480 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6231ffb640 1 -- 172.21.15.2:0/3794557662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f623c0ebc40 con 0x5640aecc3480 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 10 client.19254 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 10 client.19254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 20 client.19254 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aece3a30 0x5640aece5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 4 client.19254 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.237+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640aec37850 con 0x5640aece3a30 2024-09-10T23:35:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.238+0000 7f6249d9b640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aece3a30 0x5640aece5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.238+0000 7f6249d9b640 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aece3a30 0x5640aece5e20 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22bdde54b3a828dc server_cookie=e9df1b57457f2e2d in_seq=0 out_seq=0 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.238+0000 7f6231ffb640 10 client.19254 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6231ffb640 1 -- 172.21.15.2:0/3794557662 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640aec37850 con 0x5640aece3a30 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6231ffb640 10 client.19254 handle_command_reply: tid=0 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 client.19254 shutdown 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 msgr2=0x5640aecd39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecd39e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f623c0abbe0 tx=0x7f623c0eb3a0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 shutdown_connections 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aece3a30 0x5640aece5e20 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aecd13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecd0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6231ffb640 0 client.19254 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3794557662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecd39e0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 >> 172.21.15.2:0/3794557662 conn(0x5640aecc12b0 msgr2=0x5640aecc6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:08.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 shutdown_connections 2024-09-10T23:35:08.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 1 -- 172.21.15.2:0/3794557662 wait complete. 2024-09-10T23:35:08.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.239+0000 7f6252fb6740 20 client.19254 trim_cache size 0 max 16384 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 Processor -- start 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 -- start start 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aece0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecc2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aece8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1ac1a0 con 0x5640aecc3480 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1adce0 con 0x5640aecd4140 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f6252fb6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1ac870 con 0x5640aecc3da0 2024-09-10T23:35:08.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aece0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aece0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59754/0 (socket says 172.21.15.2:59754) 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.257+0000 7f624a59c640 1 -- 172.21.15.2:0/3111837301 learned_addr learned my addr 172.21.15.2:0/3111837301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f6249d9b640 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecc2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624ad9d640 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aece8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624a59c640 1 -- 172.21.15.2:0/3111837301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 msgr2=0x5640aecc2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624a59c640 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecc2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624a59c640 1 -- 172.21.15.2:0/3111837301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 msgr2=0x5640aece8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624a59c640 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aece8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624a59c640 1 -- 172.21.15.2:0/3111837301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640aecc10e0 con 0x5640aecc3480 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624ad9d640 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aece8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f624a59c640 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aece0090 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f623c009420 tx=0x7f623c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c97cd4211ebd2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f6233fff640 1 -- 172.21.15.2:0/3111837301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c01e030 con 0x5640aecc3480 2024-09-10T23:35:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f6233fff640 1 -- 172.21.15.2:0/3111837301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623c0930f0 con 0x5640aecc3480 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.258+0000 7f6233fff640 1 -- 172.21.15.2:0/3111837301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0ab5a0 con 0x5640aecc3480 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 -- 172.21.15.2:0/3111837301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 msgr2=0x5640aece0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aece0090 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f623c009420 tx=0x7f623c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 -- 172.21.15.2:0/3111837301 shutdown_connections 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecd4140 0x5640aece8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecc3da0 0x5640aecc2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 --2- 172.21.15.2:0/3111837301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aece0090 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 -- 172.21.15.2:0/3111837301 >> 172.21.15.2:0/3111837301 conn(0x5640aecc12b0 msgr2=0x5640aecc23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 -- 172.21.15.2:0/3111837301 shutdown_connections 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 -- 172.21.15.2:0/3111837301 wait complete. 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 -- start start 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.259+0000 7f6252fb6740 1 Processor -- start 2024-09-10T23:35:08.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3da0 0x5640aecca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aeccaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1ad610 con 0x5640aecc3480 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1acf40 con 0x5640aecc3da0 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1aa180 con 0x5640aecd4140 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6252fb6740 10 client.0 _ll_register_callbacks cb 0x7f6240009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59764/0 (socket says 172.21.15.2:59764) 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 -- 172.21.15.2:0/1441325674 learned_addr learned my addr 172.21.15.2:0/1441325674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624ad9d640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aeccaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6249d9b640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3da0 0x5640aecca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 -- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 msgr2=0x5640aeccaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aeccaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 -- 172.21.15.2:0/1441325674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3da0 msgr2=0x5640aecca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3da0 0x5640aecca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 -- 172.21.15.2:0/1441325674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640aece8e90 con 0x5640aecc3480 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624ad9d640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aeccaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f624a59c640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecca040 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f623c0a8220 tx=0x7f623c010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c6b820e9ac2a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.260+0000 7f6231ffb640 1 -- 172.21.15.2:0/1441325674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0ab5a0 con 0x5640aecc3480 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6231ffb640 1 -- 172.21.15.2:0/1441325674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f623c0b4f60 con 0x5640aecc3480 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f623c0930f0 con 0x5640aecc3480 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6231ffb640 1 -- 172.21.15.2:0/1441325674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f623c0b51e0 con 0x5640aecc3480 2024-09-10T23:35:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 10 client.19260 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640aece8e90 con 0x5640aecc3480 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6231ffb640 1 -- 172.21.15.2:0/1441325674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623c0930f0 con 0x5640aecc3480 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6231ffb640 1 -- 172.21.15.2:0/1441325674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f623c0e50f0 con 0x5640aecc3480 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 10 client.19260 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 10 client.19260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 20 client.19260 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aed55370 0x5640aed57760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 4 client.19260 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.261+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640aec34c80 con 0x5640aed55370 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6249d9b640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aed55370 0x5640aed57760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6231ffb640 10 client.19260 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6249d9b640 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aed55370 0x5640aed57760 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb1a990ff23aace server_cookie=b28e1b5a5516c10 in_seq=0 out_seq=0 2024-09-10T23:35:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6231ffb640 1 -- 172.21.15.2:0/1441325674 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x5640aec34c80 con 0x5640aed55370 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6231ffb640 10 client.19260 handle_command_reply: tid=0 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6252fb6740 1 client.19260 shutdown 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 msgr2=0x5640aecca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecca040 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f623c0a8220 tx=0x7f623c010f00 comp rx=0 tx=0).stop 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 shutdown_connections 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.262+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5640aed55370 0x5640aed57760 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640aecd4140 0x5640aeccaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5640aecc3da0 0x5640aecca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 1 --2- 172.21.15.2:0/1441325674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640aecc3480 0x5640aecca040 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6231ffb640 0 client.19260 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 >> 172.21.15.2:0/1441325674 conn(0x5640aecc12b0 msgr2=0x5640aecbfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 shutdown_connections 2024-09-10T23:35:08.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 1 -- 172.21.15.2:0/1441325674 wait complete. 2024-09-10T23:35:08.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6252fb6740 20 client.19260 trim_cache size 0 max 16384 2024-09-10T23:35:08.273 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:35:08.273 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:35:08.273 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:35:08.273 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:35:08.273 INFO:teuthology.orchestra.run.smithi002.stdout: "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf": { 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:35.019977+0000", 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "7781c901-0381-483c-8ccc-ce03feed1938": { 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:07.192812+0000", 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.274 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:35:08.275 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.277 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:35:08.278 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.282 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.283 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "bd71323f-7f21-4089-95dd-059cf2b66179": { 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:21.624379+0000", 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.284 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.285 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:08.286 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62340b52e0 msgr2=0x7f62340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62340b52e0 0x7f62340b77a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6244005fd0 tx=0x7f6244008470 comp rx=0 tx=0).stop 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 msgr2=0x7f624c19a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 0x7f624c19a0b0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f623c00b4a0 tx=0x7f623c00b960 comp rx=0 tx=0).stop 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 shutdown_connections 2024-09-10T23:35:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f62340b52e0 0x7f62340b77a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c108060 0x7f624c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.263+0000 7f6250be1640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f624c1076e0 0x7f624c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.264+0000 7f6250be1640 1 --2- 172.21.15.2:0/791130908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f624c101cd0 0x7f624c19a0b0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.264+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 >> 172.21.15.2:0/791130908 conn(0x7f624c0fd720 msgr2=0x7f624c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.264+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 shutdown_connections 2024-09-10T23:35:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:08.264+0000 7f6250be1640 1 -- 172.21.15.2:0/791130908 wait complete. 2024-09-10T23:35:09.203 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:35:09.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:35:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:09.773 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:09 smithi002 ceph-mon[31150]: pgmap v676: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:09.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:09 smithi154 ceph-mon[35136]: pgmap v676: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:09.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:09 smithi177 ceph-mon[35760]: pgmap v676: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 -- 172.21.15.2:0/2470281994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708103ce0 msgr2=0x7fb7081040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 --2- 172.21.15.2:0/2470281994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708103ce0 0x7fb7081040c0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb704009900 tx=0x7fb70402a410 comp rx=0 tx=0).stop 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 -- 172.21.15.2:0/2470281994 shutdown_connections 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 --2- 172.21.15.2:0/2470281994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 0x7fb70810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 --2- 172.21.15.2:0/2470281994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb708104600 0x7fb70810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 --2- 172.21.15.2:0/2470281994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708103ce0 0x7fb7081040c0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 -- 172.21.15.2:0/2470281994 >> 172.21.15.2:0/2470281994 conn(0x7fb7080fd700 msgr2=0x7fb7080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 -- 172.21.15.2:0/2470281994 shutdown_connections 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.951+0000 7fb7105c8640 1 -- 172.21.15.2:0/2470281994 wait complete. 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 Processor -- start 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 -- start start 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb708103ce0 0x7fb70819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 0x7fb70819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 0x7fb7081a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb708112db0 con 0x7fb708104600 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb708112c30 con 0x7fb708103ce0 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb7105c8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb708112f30 con 0x7fb70810d140 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb70db63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 0x7fb70819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb70db63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 0x7fb70819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59788/0 (socket says 172.21.15.2:59788) 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb70db63640 1 -- 172.21.15.2:0/3125291379 learned_addr learned my addr 172.21.15.2:0/3125291379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.952+0000 7fb70e364640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb708103ce0 0x7fb70819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70eb65640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 0x7fb7081a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70db63640 1 -- 172.21.15.2:0/3125291379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 msgr2=0x7fb7081a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70db63640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 0x7fb7081a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70db63640 1 -- 172.21.15.2:0/3125291379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb708103ce0 msgr2=0x7fb70819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70db63640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb708103ce0 0x7fb70819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70db63640 1 -- 172.21.15.2:0/3125291379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7081a1550 con 0x7fb708104600 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70eb65640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 0x7fb7081a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb70db63640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 0x7fb70819b9e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800d750 tx=0x7fb6f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8017070 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7081a1840 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f8004020 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8003c00 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.953+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7081a7f00 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.954+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7081040c0 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.956+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb6f8009a30 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.956+0000 7fb6ff7fe640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6f40b52e0 0x7fb6f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.957+0000 7fb70e364640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6f40b52e0 0x7fb6f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.957+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb6f80e58e0 con 0x7fb708104600 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.957+0000 7fb70e364640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6f40b52e0 0x7fb6f40b77a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb704031440 tx=0x7fb704005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:09.959+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb6f80ac7b0 con 0x7fb708104600 2024-09-10T23:35:10.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.188+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb70819c5d0 con 0x7fb708104600 2024-09-10T23:35:10.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.189+0000 7fb6ff7fe640 1 -- 172.21.15.2:0/3125291379 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7fb6f80ac0b0 con 0x7fb708104600 2024-09-10T23:35:10.190 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:35:10.190 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:35:10.191 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:35:10.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.191+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6f40b52e0 msgr2=0x7fb6f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:10.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.191+0000 7fb7105c8640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6f40b52e0 0x7fb6f40b77a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb704031440 tx=0x7fb704005b50 comp rx=0 tx=0).stop 2024-09-10T23:35:10.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.191+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 msgr2=0x7fb70819b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:10.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.191+0000 7fb7105c8640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 0x7fb70819b9e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800d750 tx=0x7fb6f800dc10 comp rx=0 tx=0).stop 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 shutdown_connections 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6f40b52e0 0x7fb6f40b77a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70810d140 0x7fb7081a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb708104600 0x7fb70819b9e0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 --2- 172.21.15.2:0/3125291379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb708103ce0 0x7fb70819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 >> 172.21.15.2:0/3125291379 conn(0x7fb7080fd700 msgr2=0x7fb70810f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 shutdown_connections 2024-09-10T23:35:10.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:10.192+0000 7fb7105c8640 1 -- 172.21.15.2:0/3125291379 wait complete. 2024-09-10T23:35:10.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:10 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3125291379' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:35:10.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:10 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3125291379' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:35:10.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:10 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3125291379' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:35:10.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:35:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:11.672 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:11 smithi002 ceph-mon[31150]: pgmap v677: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:35:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 -- 172.21.15.2:0/3428922925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f123810d140 msgr2=0x7f123810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 --2- 172.21.15.2:0/3428922925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f123810d140 0x7f123810f5a0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f1230009900 tx=0x7f123002a410 comp rx=0 tx=0).stop 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 -- 172.21.15.2:0/3428922925 shutdown_connections 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 --2- 172.21.15.2:0/3428922925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f123810d140 0x7f123810f5a0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 --2- 172.21.15.2:0/3428922925 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1238104600 0x7f123810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 --2- 172.21.15.2:0/3428922925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1238103ce0 0x7f12381040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 -- 172.21.15.2:0/3428922925 >> 172.21.15.2:0/3428922925 conn(0x7f12380fd700 msgr2=0x7f12380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.755+0000 7f124048e640 1 -- 172.21.15.2:0/3428922925 shutdown_connections 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 -- 172.21.15.2:0/3428922925 wait complete. 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 Processor -- start 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 -- start start 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 0x7f12381992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1238104600 0x7f1238199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123810d140 0x7f123819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1238112df0 con 0x7f1238103ce0 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1238112c70 con 0x7f123810d140 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f124048e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1238112f70 con 0x7f1238104600 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f123e22a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 0x7f12381992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f123e22a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 0x7f12381992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48476/0 (socket says 172.21.15.2:48476) 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.756+0000 7f123e22a640 1 -- 172.21.15.2:0/1516909180 learned_addr learned my addr 172.21.15.2:0/1516909180 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123da29640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1238104600 0x7f1238199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123ea2b640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123810d140 0x7f123819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123e22a640 1 -- 172.21.15.2:0/1516909180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1238104600 msgr2=0x7f1238199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123e22a640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1238104600 0x7f1238199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123e22a640 1 -- 172.21.15.2:0/1516909180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123810d140 msgr2=0x7f123819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123e22a640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123810d140 0x7f123819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123e22a640 1 -- 172.21.15.2:0/1516909180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123819f370 con 0x7f1238103ce0 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f123e22a640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 0x7f12381992c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f122800ba50 tx=0x7f122800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f12377fe640 1 -- 172.21.15.2:0/1516909180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228019070 con 0x7f1238103ce0 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123819f660 con 0x7f1238103ce0 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f12377fe640 1 -- 172.21.15.2:0/1516909180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f122800cbe0 con 0x7f1238103ce0 2024-09-10T23:35:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f12377fe640 1 -- 172.21.15.2:0/1516909180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280075d0 con 0x7f1238103ce0 2024-09-10T23:35:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.757+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381a5da0 con 0x7f1238103ce0 2024-09-10T23:35:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 Processor -- start 2024-09-10T23:35:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 -- start start 2024-09-10T23:35:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f12377fe640 1 -- 172.21.15.2:0/1516909180 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1228007830 con 0x7f1238103ce0 2024-09-10T23:35:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 0x55ca5372b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5373b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5373bdb0 0x55ca5373e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca536a1ea0 con 0x55ca5372b0f0 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca536912d0 con 0x55ca5373bdb0 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f1242863740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ca536950e0 con 0x55ca5372ba10 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 0x55ca5372b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 0x55ca5372b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48492/0 (socket says 172.21.15.2:48492) 2024-09-10T23:35:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.760+0000 7f123ea2b640 1 -- 172.21.15.2:0/3385869142 learned_addr learned my addr 172.21.15.2:0/3385869142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123da29640 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5373bdb0 0x55ca5373e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123e22a640 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5373b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123ea2b640 1 -- 172.21.15.2:0/3385869142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 msgr2=0x55ca5373b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5373b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123ea2b640 1 -- 172.21.15.2:0/3385869142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5373bdb0 msgr2=0x55ca5373e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5373bdb0 0x55ca5373e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123ea2b640 1 -- 172.21.15.2:0/3385869142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca533ef650 con 0x55ca5372b0f0 2024-09-10T23:35:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123e22a640 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5373b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f12377fe640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f12200b52e0 0x7f12200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 0x55ca5372b4d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f1230005ab0 tx=0x7f1230031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fffb4e7b982555 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f123e22a640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f12200b52e0 0x7f12200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f12377fe640 1 -- 172.21.15.2:0/1516909180 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f12280e5450 con 0x7f1238103ce0 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f1234ff9640 1 -- 172.21.15.2:0/3385869142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123003f070 con 0x55ca5372b0f0 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f1234ff9640 1 -- 172.21.15.2:0/3385869142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1230031e30 con 0x55ca5372b0f0 2024-09-10T23:35:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.761+0000 7f1234ff9640 1 -- 172.21.15.2:0/3385869142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230035070 con 0x55ca5372b0f0 2024-09-10T23:35:11.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 -- 172.21.15.2:0/3385869142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 msgr2=0x55ca5372b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 0x55ca5372b4d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f1230005ab0 tx=0x7f1230031c40 comp rx=0 tx=0).stop 2024-09-10T23:35:11.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f123e22a640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f12200b52e0 0x7f12200b77a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f12280e32d0 tx=0x7f1228004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:11.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 -- 172.21.15.2:0/3385869142 shutdown_connections 2024-09-10T23:35:11.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5373bdb0 0x55ca5373e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5373b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 --2- 172.21.15.2:0/3385869142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5372b0f0 0x55ca5372b4d0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 -- 172.21.15.2:0/3385869142 >> 172.21.15.2:0/3385869142 conn(0x55ca53728f20 msgr2=0x55ca5372a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 -- 172.21.15.2:0/3385869142 shutdown_connections 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.762+0000 7f1242863740 1 -- 172.21.15.2:0/3385869142 wait complete. 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 -- start start 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 Processor -- start 2024-09-10T23:35:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca5373b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca53738ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca537390b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca534f2700 con 0x55ca5373bdb0 2024-09-10T23:35:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca5362c160 con 0x55ca5372b0f0 2024-09-10T23:35:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ca5373ea00 con 0x55ca5372ba10 2024-09-10T23:35:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f1242863740 10 client.0 _ll_register_callbacks cb 0x55ca536459e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca537390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca537390b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48496/0 (socket says 172.21.15.2:48496) 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 -- 172.21.15.2:0/3058338811 learned_addr learned my addr 172.21.15.2:0/3058338811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123da29640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca53738ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca5373b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 -- 172.21.15.2:0/3058338811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 msgr2=0x55ca53738ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca53738ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 -- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 msgr2=0x55ca5373b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca5373b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.763+0000 7f123ea2b640 1 -- 172.21.15.2:0/3058338811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca53659c90 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca537390b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f123002a930 tx=0x7f1230005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20009f2991a0e29f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f121dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f121dffb640 1 -- 172.21.15.2:0/3058338811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230035030 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1230031e30 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f121dffb640 1 -- 172.21.15.2:0/3058338811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1230004460 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f121dffb640 1 -- 172.21.15.2:0/3058338811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f123003f040 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 10 client.19278 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca5374a310 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f121dffb640 1 -- 172.21.15.2:0/3058338811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1230031e30 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f121dffb640 1 -- 172.21.15.2:0/3058338811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1230003a00 con 0x55ca5373bdb0 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 10 client.19278 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 10 client.19278 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 20 client.19278 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca5374b660 0x55ca5374da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 4 client.19278 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.764+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca536a3df0 con 0x55ca5374b660 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.765+0000 7f123da29640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca5374b660 0x55ca5374da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.765+0000 7f123da29640 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca5374b660 0x55ca5374da50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3f6bf6959464cdb7 server_cookie=8d1184cb3e069fec in_seq=0 out_seq=0 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.765+0000 7f121dffb640 10 client.19278 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f121dffb640 1 -- 172.21.15.2:0/3058338811 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca536a3df0 con 0x55ca5374b660 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f121dffb640 10 client.19278 handle_command_reply: tid=0 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 client.19278 shutdown 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 msgr2=0x55ca537390b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca537390b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f123002a930 tx=0x7f1230005b50 comp rx=0 tx=0).stop 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 shutdown_connections 2024-09-10T23:35:11.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca5374b660 0x55ca5374da50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca537390b0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca53738ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 --2- 172.21.15.2:0/3058338811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca5373b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 >> 172.21.15.2:0/3058338811 conn(0x55ca53728f20 msgr2=0x55ca5372ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f121dffb640 0 client.19278 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 shutdown_connections 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 1 -- 172.21.15.2:0/3058338811 wait complete. 2024-09-10T23:35:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.766+0000 7f1242863740 20 client.19278 trim_cache size 0 max 16384 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 Processor -- start 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 -- start start 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca53747ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5372a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca53750690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12381ac250 con 0x55ca5373bdb0 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12381add90 con 0x55ca5372b0f0 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f1242863740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12381ac920 con 0x55ca5372ba10 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca53750690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca53750690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48512/0 (socket says 172.21.15.2:48512) 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f123ea2b640 1 -- 172.21.15.2:0/3007365879 learned_addr learned my addr 172.21.15.2:0/3007365879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f123da29640 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5372a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.780+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca53747ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f123ea2b640 1 -- 172.21.15.2:0/3007365879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 msgr2=0x55ca5372a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5372a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f123ea2b640 1 -- 172.21.15.2:0/3007365879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 msgr2=0x55ca53747ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca53747ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f123ea2b640 1 -- 172.21.15.2:0/3007365879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca53736fd0 con 0x55ca5373bdb0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f123ea2b640 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca53750690 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f1230054040 tx=0x7f1230005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9501f9a1158c262 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f121ffff640 1 -- 172.21.15.2:0/3007365879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230035030 con 0x55ca5373bdb0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f121ffff640 1 -- 172.21.15.2:0/3007365879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1230003aa0 con 0x55ca5373bdb0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.781+0000 7f121ffff640 1 -- 172.21.15.2:0/3007365879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230004b20 con 0x55ca5373bdb0 2024-09-10T23:35:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 -- 172.21.15.2:0/3007365879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 msgr2=0x55ca53750690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca53750690 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f1230054040 tx=0x7f1230005740 comp rx=0 tx=0).stop 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 -- 172.21.15.2:0/3007365879 shutdown_connections 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca53750690 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372ba10 0x55ca5372a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 --2- 172.21.15.2:0/3007365879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372b0f0 0x55ca53747ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 -- 172.21.15.2:0/3007365879 >> 172.21.15.2:0/3007365879 conn(0x55ca53728f20 msgr2=0x55ca53729ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 -- 172.21.15.2:0/3007365879 shutdown_connections 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 -- 172.21.15.2:0/3007365879 wait complete. 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 -- start start 2024-09-10T23:35:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.782+0000 7f1242863740 1 Processor -- start 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372b0f0 0x55ca53750f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372ba10 0x55ca5374e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca5374eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12381ad6c0 con 0x55ca5373bdb0 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12381acff0 con 0x55ca5372ba10 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12381aa230 con 0x55ca5372b0f0 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 10 client.0 _ll_register_callbacks cb 0x7f123806c4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca5374eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca5374eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48522/0 (socket says 172.21.15.2:48522) 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 -- 172.21.15.2:0/1965595507 learned_addr learned my addr 172.21.15.2:0/1965595507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372b0f0 0x55ca53750f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123da29640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372ba10 0x55ca5374e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 -- 172.21.15.2:0/1965595507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372b0f0 msgr2=0x55ca53750f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372b0f0 0x55ca53750f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 -- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372ba10 msgr2=0x55ca5374e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372ba10 0x55ca5374e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 -- 172.21.15.2:0/1965595507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca537b71d0 con 0x55ca5373bdb0 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123da29640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372ba10 0x55ca5374e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f123ea2b640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca5374eb20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f1230003ed0 tx=0x7f1230000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67da6867c890d730 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f121dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f121dffb640 1 -- 172.21.15.2:0/1965595507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12300048a0 con 0x55ca5373bdb0 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f121dffb640 1 -- 172.21.15.2:0/1965595507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1230004a40 con 0x55ca5373bdb0 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.783+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1230003aa0 con 0x55ca5373bdb0 2024-09-10T23:35:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f121dffb640 1 -- 172.21.15.2:0/1965595507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1230004c40 con 0x55ca5373bdb0 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 10 client.19284 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca537b8340 con 0x55ca5373bdb0 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f121dffb640 1 -- 172.21.15.2:0/1965595507 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1230003aa0 con 0x55ca5373bdb0 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f121dffb640 1 -- 172.21.15.2:0/1965595507 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f123003b430 con 0x55ca5373bdb0 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 10 client.19284 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 10 client.19284 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 20 client.19284 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca537b8860 0x55ca537bac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 4 client.19284 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca5369f8a0 con 0x55ca537b8860 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.784+0000 7f123da29640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca537b8860 0x55ca537bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f123da29640 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca537b8860 0x55ca537bac80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=55c23f5cb0944673 server_cookie=2349622fc07557b9 in_seq=0 out_seq=0 2024-09-10T23:35:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f121dffb640 10 client.19284 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f121dffb640 1 -- 172.21.15.2:0/1965595507 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca5369f8a0 con 0x55ca537b8860 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f121dffb640 10 client.19284 handle_command_reply: tid=0 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 client.19284 shutdown 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 msgr2=0x55ca5374eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca5374eb20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f1230003ed0 tx=0x7f1230000bc0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 shutdown_connections 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x55ca537b8860 0x55ca537bac80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca5373bdb0 0x55ca5374eb20 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca5372ba10 0x55ca5374e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 --2- 172.21.15.2:0/1965595507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ca5372b0f0 0x55ca53750f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f121dffb640 0 client.19284 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 >> 172.21.15.2:0/1965595507 conn(0x55ca53728f20 msgr2=0x55ca53727750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 shutdown_connections 2024-09-10T23:35:11.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 1 -- 172.21.15.2:0/1965595507 wait complete. 2024-09-10T23:35:11.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.785+0000 7f1242863740 20 client.19284 trim_cache size 0 max 16384 2024-09-10T23:35:11.799 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f12200b52e0 msgr2=0x7f12200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f12200b52e0 0x7f12200b77a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f12280e32d0 tx=0x7f1228004b50 comp rx=0 tx=0).stop 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 msgr2=0x7f12381992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 0x7f12381992c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f122800ba50 tx=0x7f122800bf10 comp rx=0 tx=0).stop 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 shutdown_connections 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f12200b52e0 0x7f12200b77a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123810d140 0x7f123819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1238104600 0x7f1238199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 --2- 172.21.15.2:0/1516909180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1238103ce0 0x7f12381992c0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:11.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 >> 172.21.15.2:0/1516909180 conn(0x7f12380fd700 msgr2=0x7f12380fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:11.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 shutdown_connections 2024-09-10T23:35:11.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:11.786+0000 7f124048e640 1 -- 172.21.15.2:0/1516909180 wait complete. 2024-09-10T23:35:11.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:11 smithi177 ceph-mon[35760]: pgmap v677: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:35:12.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:11 smithi154 ceph-mon[35136]: pgmap v677: 97 pgs: 97 active+clean; 4.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T23:35:12.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:35:12.964 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 -- 172.21.15.2:0/356424150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc81087d0 msgr2=0x7f8fc8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/356424150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc81087d0 0x7f8fc8108c10 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009900 tx=0x7f8fb402a410 comp rx=0 tx=0).stop 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 -- 172.21.15.2:0/356424150 shutdown_connections 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/356424150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fc8109150 0x7f8fc810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/356424150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc81087d0 0x7f8fc8108c10 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/356424150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc8102dc0 0x7f8fc81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 -- 172.21.15.2:0/356424150 >> 172.21.15.2:0/356424150 conn(0x7f8fc80fe830 msgr2=0x7f8fc8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 -- 172.21.15.2:0/356424150 shutdown_connections 2024-09-10T23:35:13.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.468+0000 7f8fceb1e640 1 -- 172.21.15.2:0/356424150 wait complete. 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 Processor -- start 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 -- start start 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fc8102dc0 0x7f8fc80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc81087d0 0x7f8fc80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 0x7f8fc8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc8112da0 con 0x7f8fc8109150 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc8112c20 con 0x7f8fc81087d0 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fceb1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc8112f20 con 0x7f8fc8102dc0 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.469+0000 7f8fcd0bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 0x7f8fc8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 0x7f8fc8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48550/0 (socket says 172.21.15.2:48550) 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 -- 172.21.15.2:0/2405968405 learned_addr learned my addr 172.21.15.2:0/2405968405 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fc8102dc0 0x7f8fc80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc81087d0 0x7f8fc80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 -- 172.21.15.2:0/2405968405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fc8102dc0 msgr2=0x7f8fc80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fc8102dc0 0x7f8fc80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 -- 172.21.15.2:0/2405968405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc81087d0 msgr2=0x7f8fc80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc81087d0 0x7f8fc80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 -- 172.21.15.2:0/2405968405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc81a7610 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fcd0bb640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 0x7f8fc8075f20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000eaa0 tx=0x7f8fc000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fc5ffb640 1 -- 172.21.15.2:0/2405968405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0004d20 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fc5ffb640 1 -- 172.21.15.2:0/2405968405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fc0005020 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc81a7900 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.470+0000 7f8fc5ffb640 1 -- 172.21.15.2:0/2405968405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00116b0 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.471+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc81a7dc0 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fc5ffb640 1 -- 172.21.15.2:0/2405968405 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8fc000f040 con 0x7f8fc8109150 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 Processor -- start 2024-09-10T23:35:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 -- start start 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b134d0 0x561eb8b138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b1fd80 0x561eb8b22170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561eb8a89ea0 con 0x561eb8b1fd80 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561eb8a792d0 con 0x561eb8b13df0 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x561eb8a7d0e0 con 0x561eb8b134d0 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b1fd80 0x561eb8b22170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b134d0 0x561eb8b138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.473+0000 7f8fcc8ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.2:32890/0 (socket says 172.21.15.2:32890) 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 -- 172.21.15.2:0/181320402 learned_addr learned my addr 172.21.15.2:0/181320402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b134d0 0x561eb8b138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:56640/0 (socket says 172.21.15.2:56640) 2024-09-10T23:35:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fc5ffb640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fb80b52e0 0x7f8fb80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 -- 172.21.15.2:0/181320402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b134d0 msgr2=0x561eb8b138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b134d0 0x561eb8b138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 -- 172.21.15.2:0/181320402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b1fd80 msgr2=0x561eb8b22170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b1fd80 0x561eb8b22170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 -- 172.21.15.2:0/181320402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb87d7650 con 0x561eb8b13df0 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcd0bb640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fb80b52e0 0x7f8fb80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1f840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00ad00 tx=0x7f8fbc00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ff1d9873e43fce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fc5ffb640 1 -- 172.21.15.2:0/2405968405 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8fc00e5b40 con 0x7f8fc8109150 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/181320402 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc01d070 con 0x561eb8b13df0 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/181320402 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fbc018af0 con 0x561eb8b13df0 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.474+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/181320402 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc010a70 con 0x561eb8b13df0 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/181320402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 msgr2=0x561eb8b1f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fcd0bb640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fb80b52e0 0x7f8fb80b77a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0070de0 tx=0x7f8fc0076380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1f840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00ad00 tx=0x7f8fbc00f790 comp rx=0 tx=0).stop 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/181320402 shutdown_connections 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b1fd80 0x561eb8b22170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1f840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/181320402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b134d0 0x561eb8b138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/181320402 >> 172.21.15.2:0/181320402 conn(0x561eb8b11300 msgr2=0x561eb8b124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/181320402 shutdown_connections 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.475+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/181320402 wait complete. 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 -- start start 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 Processor -- start 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b1f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b1d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561eb88da700 con 0x561eb8b134d0 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561eb8a14160 con 0x561eb8b13df0 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x561eb8b22a00 con 0x561eb8b1fd80 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fd0ef3740 10 client.0 _ll_register_callbacks cb 0x561eb8a2d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b1f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b1f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48566/0 (socket says 172.21.15.2:48566) 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fc7fff640 1 -- 172.21.15.2:0/2186433903 learned_addr learned my addr 172.21.15.2:0/2186433903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.476+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b1d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fc7fff640 1 -- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 msgr2=0x561eb8b1d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b1d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fc7fff640 1 -- 172.21.15.2:0/2186433903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 msgr2=0x561eb8b1cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fc7fff640 1 -- 172.21.15.2:0/2186433903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb8a41c90 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b1f670 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009900 tx=0x7f8fb4032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d98d4bf830d46ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fa7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fa7fff640 1 -- 172.21.15.2:0/2186433903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4035040 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fa7fff640 1 -- 172.21.15.2:0/2186433903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8fb40035f0 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fbc018af0 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fa7fff640 1 -- 172.21.15.2:0/2186433903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fb40037f0 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fd0ef3740 10 client.19296 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561eb8b2e330 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.477+0000 7f8fa7fff640 1 -- 172.21.15.2:0/2186433903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fbc018af0 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fa7fff640 1 -- 172.21.15.2:0/2186433903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fb404a9f0 con 0x561eb8b134d0 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fd0ef3740 10 client.19296 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fd0ef3740 10 client.19296 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fd0ef3740 20 client.19296 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b2f7f0 0x561eb8b31be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fd0ef3740 4 client.19296 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eb8a8bdf0 con 0x561eb8b2f7f0 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b2f7f0 0x561eb8b31be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b2f7f0 0x561eb8b31be0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1fe92da98bffc9c server_cookie=c4525fb366cb9c9b in_seq=0 out_seq=0 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.478+0000 7f8fa7fff640 10 client.19296 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.479+0000 7f8fa7fff640 1 -- 172.21.15.2:0/2186433903 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561eb8a8bdf0 con 0x561eb8b2f7f0 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.479+0000 7f8fa7fff640 10 client.19296 handle_command_reply: tid=0 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.479+0000 7f8fd0ef3740 1 client.19296 shutdown 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 msgr2=0x561eb8b1f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b1f670 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009900 tx=0x7f8fb4032b20 comp rx=0 tx=0).stop 2024-09-10T23:35:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 shutdown_connections 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b2f7f0 0x561eb8b31be0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b1d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b1cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/2186433903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b1f670 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 >> 172.21.15.2:0/2186433903 conn(0x561eb8b11300 msgr2=0x561eb8b16ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fa7fff640 0 client.19296 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 shutdown_connections 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/2186433903 wait complete. 2024-09-10T23:35:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.480+0000 7f8fd0ef3740 20 client.19296 trim_cache size 0 max 16384 2024-09-10T23:35:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.493+0000 7f8fd0ef3740 1 Processor -- start 2024-09-10T23:35:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.493+0000 7f8fd0ef3740 1 -- start start 2024-09-10T23:35:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b10310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b13df0 0x561eb8b21170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b1fd80 0x561eb8b216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81b04c0 con 0x561eb8b134d0 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81b2000 con 0x561eb8b1fd80 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81b0b90 con 0x561eb8b13df0 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b10310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b10310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48582/0 (socket says 172.21.15.2:48582) 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1004255833 learned_addr learned my addr 172.21.15.2:0/1004255833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b13df0 0x561eb8b21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b1fd80 0x561eb8b216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1004255833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b13df0 msgr2=0x561eb8b21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b13df0 0x561eb8b21170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1004255833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b1fd80 msgr2=0x561eb8b216b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b1fd80 0x561eb8b216b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1004255833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb8b13c20 con 0x561eb8b134d0 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b10310 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f8fb404adf0 tx=0x7f8fb403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149f93f09ed52bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.494+0000 7f8fb27fc640 1 -- 172.21.15.2:0/1004255833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4035040 con 0x561eb8b134d0 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fb27fc640 1 -- 172.21.15.2:0/1004255833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fb40044d0 con 0x561eb8b134d0 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fb27fc640 1 -- 172.21.15.2:0/1004255833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb403d830 con 0x561eb8b134d0 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1004255833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 msgr2=0x561eb8b10310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b10310 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f8fb404adf0 tx=0x7f8fb403f040 comp rx=0 tx=0).stop 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1004255833 shutdown_connections 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b1fd80 0x561eb8b216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b13df0 0x561eb8b21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1004255833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b10310 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1004255833 >> 172.21.15.2:0/1004255833 conn(0x561eb8b11300 msgr2=0x561eb8b0fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1004255833 shutdown_connections 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.495+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1004255833 wait complete. 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 -- start start 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 Processor -- start 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b281d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b25ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81b1930 con 0x561eb8b134d0 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81b1260 con 0x561eb8b13df0 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81ae4a0 con 0x561eb8b1fd80 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fd0ef3740 10 client.0 _ll_register_callbacks cb 0x7f8fb4031710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b281d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48592/0 (socket says 172.21.15.2:48592) 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.496+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1019613196 learned_addr learned my addr 172.21.15.2:0/1019613196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b25ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 msgr2=0x561eb8b261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1019613196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 msgr2=0x561eb8b25ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b25ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 -- 172.21.15.2:0/1019613196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb8b267a0 con 0x561eb8b134d0 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fc7fff640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b281d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4000c00 tx=0x7f8fb4003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d0d15907807d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fa7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fa7fff640 1 -- 172.21.15.2:0/1019613196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4035070 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fa7fff640 1 -- 172.21.15.2:0/1019613196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8fb4031ac0 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fb40044d0 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fa7fff640 1 -- 172.21.15.2:0/1019613196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fb4031cc0 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fd0ef3740 10 client.19302 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.497+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561eb8b9d480 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fa7fff640 1 -- 172.21.15.2:0/1019613196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fb40044d0 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fa7fff640 1 -- 172.21.15.2:0/1019613196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fb403d950 con 0x561eb8b134d0 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fd0ef3740 10 client.19302 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fd0ef3740 10 client.19302 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:35:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fd0ef3740 20 client.19302 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b9da70 0x561eb8b9fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fd0ef3740 4 client.19302 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561eb8a878a0 con 0x561eb8b9da70 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.498+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b9da70 0x561eb8b9fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fcc8ba640 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b9da70 0x561eb8b9fe90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e6bbf8056243ff41 server_cookie=430241a1063da6df in_seq=0 out_seq=0 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fa7fff640 10 client.19302 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fa7fff640 1 -- 172.21.15.2:0/1019613196 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561eb8a878a0 con 0x561eb8b9da70 2024-09-10T23:35:13.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fa7fff640 10 client.19302 handle_command_reply: tid=0 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 client.19302 shutdown 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 msgr2=0x561eb8b281d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b281d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4000c00 tx=0x7f8fb4003c60 comp rx=0 tx=0).stop 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 shutdown_connections 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x561eb8b9da70 0x561eb8b9fe90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561eb8b1fd80 0x561eb8b261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561eb8b13df0 0x561eb8b25ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 --2- 172.21.15.2:0/1019613196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561eb8b134d0 0x561eb8b281d0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 >> 172.21.15.2:0/1019613196 conn(0x561eb8b11300 msgr2=0x561eb8b1e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fa7fff640 0 client.19302 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 shutdown_connections 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 1 -- 172.21.15.2:0/1019613196 wait complete. 2024-09-10T23:35:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.499+0000 7f8fd0ef3740 20 client.19302 trim_cache size 0 max 16384 2024-09-10T23:35:13.516 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fb80b52e0 msgr2=0x7f8fb80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fb80b52e0 0x7f8fb80b77a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0070de0 tx=0x7f8fc0076380 comp rx=0 tx=0).stop 2024-09-10T23:35:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 msgr2=0x7f8fc8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 0x7f8fc8075f20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000eaa0 tx=0x7f8fc000eea0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 shutdown_connections 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8fb80b52e0 0x7f8fb80b77a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fc8109150 0x7f8fc8075f20 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc81087d0 0x7f8fc80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 --2- 172.21.15.2:0/2405968405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fc8102dc0 0x7f8fc80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 >> 172.21.15.2:0/2405968405 conn(0x7f8fc80fe830 msgr2=0x7f8fc8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 shutdown_connections 2024-09-10T23:35:13.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:13.500+0000 7f8fceb1e640 1 -- 172.21.15.2:0/2405968405 wait complete. 2024-09-10T23:35:13.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:13 smithi002 ceph-mon[31150]: pgmap v678: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:13.831 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:13 smithi154 ceph-mon[35136]: pgmap v678: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:13.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:13 smithi177 ceph-mon[35760]: pgmap v678: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:14.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:35:14.642 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.120+0000 7f34b6710640 1 -- 172.21.15.2:0/2909141262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 msgr2=0x7f34b010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.120+0000 7f34b6710640 1 --2- 172.21.15.2:0/2909141262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b010caf0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009900 tx=0x7f34a402a410 comp rx=0 tx=0).stop 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 -- 172.21.15.2:0/2909141262 shutdown_connections 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 --2- 172.21.15.2:0/2909141262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 0x7f34b010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 --2- 172.21.15.2:0/2909141262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b010caf0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 --2- 172.21.15.2:0/2909141262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b0103ce0 0x7f34b01040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 -- 172.21.15.2:0/2909141262 >> 172.21.15.2:0/2909141262 conn(0x7f34b00fd720 msgr2=0x7f34b00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 -- 172.21.15.2:0/2909141262 shutdown_connections 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 -- 172.21.15.2:0/2909141262 wait complete. 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 Processor -- start 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.121+0000 7f34b6710640 1 -- start start 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b6710640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b0103ce0 0x7f34b0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b6710640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b6710640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 0x7f34b019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b6710640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34b0112db0 con 0x7f34b0104600 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b6710640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34b0112c30 con 0x7f34b010d140 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b6710640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34b0112f30 con 0x7f34b0103ce0 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b0199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48608/0 (socket says 172.21.15.2:48608) 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 -- 172.21.15.2:0/3306121943 learned_addr learned my addr 172.21.15.2:0/3306121943 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34affff640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b0103ce0 0x7f34b0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b4cad640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 0x7f34b019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 -- 172.21.15.2:0/3306121943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b0103ce0 msgr2=0x7f34b0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b0103ce0 0x7f34b0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 -- 172.21.15.2:0/3306121943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 msgr2=0x7f34b019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 0x7f34b019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 -- 172.21.15.2:0/3306121943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b019f3d0 con 0x7f34b0104600 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34b4cad640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 0x7f34b019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.122+0000 7f34af7fe640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b0199860 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f34a4032fd0 tx=0x7f34a4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.123+0000 7f34ad7fa640 1 -- 172.21.15.2:0/3306121943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a403f030 con 0x7f34b0104600 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.123+0000 7f34ad7fa640 1 -- 172.21.15.2:0/3306121943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a4004490 con 0x7f34b0104600 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.123+0000 7f34ad7fa640 1 -- 172.21.15.2:0/3306121943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4035070 con 0x7f34b0104600 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.123+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b019f660 con 0x7f34b0104600 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.123+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b01a5d80 con 0x7f34b0104600 2024-09-10T23:35:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.125+0000 7f34b8ae5740 1 Processor -- start 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.125+0000 7f34ad7fa640 1 -- 172.21.15.2:0/3306121943 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f34a403ba30 con 0x7f34b0104600 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 -- start start 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 0x55b01b7e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b01b758ea0 con 0x55b01b7e20f0 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b01b7482d0 con 0x55b01b7e2a10 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b01b74c0e0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 0x55b01b7e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 0x55b01b7e24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48624/0 (socket says 172.21.15.2:48624) 2024-09-10T23:35:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 -- 172.21.15.2:0/2056300886 learned_addr learned my addr 172.21.15.2:0/2056300886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34affff640 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34af7fe640 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 -- 172.21.15.2:0/2056300886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 msgr2=0x55b01b7f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 -- 172.21.15.2:0/2056300886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 msgr2=0x55b01b7ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 -- 172.21.15.2:0/2056300886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01b4a6650 con 0x55b01b7e20f0 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34ad7fa640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34980b5360 0x7f34980b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.126+0000 7f34b4cad640 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 0x55b01b7e24d0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009fd0 tx=0x7f34a80108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b37e4ef58598c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34affff640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34980b5360 0x7f34980b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34ad7fa640 1 -- 172.21.15.2:0/3306121943 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f34a41061f0 con 0x7f34b0104600 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34967fc640 1 -- 172.21.15.2:0/2056300886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8011760 con 0x55b01b7e20f0 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34967fc640 1 -- 172.21.15.2:0/2056300886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a8011db0 con 0x55b01b7e20f0 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34967fc640 1 -- 172.21.15.2:0/2056300886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a800e3c0 con 0x55b01b7e20f0 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2056300886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 msgr2=0x55b01b7e24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34affff640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34980b5360 0x7f34980b7820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x55b01b7e0e00 tx=0x7f34a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.127+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 0x55b01b7e24d0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009fd0 tx=0x7f34a80108e0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2056300886 shutdown_connections 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2056300886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e20f0 0x55b01b7e24d0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2056300886 >> 172.21.15.2:0/2056300886 conn(0x55b01b7dff20 msgr2=0x55b01b7e10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2056300886 shutdown_connections 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2056300886 wait complete. 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- start start 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 Processor -- start 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e2a10 0x55b01b7eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b01b5a9700 con 0x55b01b7ee9a0 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b01b6e3160 con 0x55b01b7e20f0 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.128+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b01b7f1620 con 0x55b01b7e2a10 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b8ae5740 10 client.0 _ll_register_callbacks cb 0x55b01b6fc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:15.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7ebd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48636/0 (socket says 172.21.15.2:48636) 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 -- 172.21.15.2:0/2417663926 learned_addr learned my addr 172.21.15.2:0/2417663926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34affff640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34af7fe640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e2a10 0x55b01b7eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 -- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e2a10 msgr2=0x55b01b7eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e2a10 0x55b01b7eb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 -- 172.21.15.2:0/2417663926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 msgr2=0x55b01b7ee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7ee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 -- 172.21.15.2:0/2417663926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01b710c90 con 0x55b01b7ee9a0 2024-09-10T23:35:15.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34affff640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b4cad640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7ebd30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f34a801ba60 tx=0x7f34a8009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00268361c088357 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f348f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f348f7fe640 1 -- 172.21.15.2:0/2417663926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a802b060 con 0x55b01b7ee9a0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f348f7fe640 1 -- 172.21.15.2:0/2417663926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f34a8011560 con 0x55b01b7ee9a0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a8011db0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.129+0000 7f348f7fe640 1 -- 172.21.15.2:0/2417663926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34a801b800 con 0x55b01b7ee9a0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 10 client.19314 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b01b7fcfe0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f348f7fe640 1 -- 172.21.15.2:0/2417663926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a8011db0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f348f7fe640 1 -- 172.21.15.2:0/2417663926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34a80057a0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 10 client.19314 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 10 client.19314 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 20 client.19314 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b7fe3e0 0x55b01b8007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 4 client.19314 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b01b75adf0 con 0x55b01b7fe3e0 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.130+0000 7f34affff640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b7fe3e0 0x55b01b8007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.131+0000 7f34affff640 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b7fe3e0 0x55b01b8007d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cff4a666cde23493 server_cookie=69681ffb407863eb in_seq=0 out_seq=0 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.131+0000 7f348f7fe640 10 client.19314 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:35:15.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.131+0000 7f348f7fe640 1 -- 172.21.15.2:0/2417663926 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b01b75adf0 con 0x55b01b7fe3e0 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.131+0000 7f348f7fe640 10 client.19314 handle_command_reply: tid=0 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.131+0000 7f34b8ae5740 1 client.19314 shutdown 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 msgr2=0x55b01b7ebd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7ebd30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f34a801ba60 tx=0x7f34a8009940 comp rx=0 tx=0).stop 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 shutdown_connections 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b7fe3e0 0x55b01b8007d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7ebd30 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e2a10 0x55b01b7eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/2417663926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f348f7fe640 0 client.19314 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:35:15.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 >> 172.21.15.2:0/2417663926 conn(0x55b01b7dff20 msgr2=0x55b01b7e5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:15.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 shutdown_connections 2024-09-10T23:35:15.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 1 -- 172.21.15.2:0/2417663926 wait complete. 2024-09-10T23:35:15.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.132+0000 7f34b8ae5740 20 client.19314 trim_cache size 0 max 16384 2024-09-10T23:35:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 Processor -- start 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 -- start start 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e20f0 0x55b01b7fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34b01ae3d0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34b01aff10 con 0x55b01b7e2a10 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34b01aeaa0 con 0x55b01b7e20f0 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b4cad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b4cad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48638/0 (socket says 172.21.15.2:48638) 2024-09-10T23:35:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.145+0000 7f34b4cad640 1 -- 172.21.15.2:0/1497386895 learned_addr learned my addr 172.21.15.2:0/1497386895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34af7fe640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34b4cad640 1 -- 172.21.15.2:0/1497386895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e20f0 msgr2=0x55b01b7fa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34affff640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e20f0 0x55b01b7fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34b4cad640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e20f0 0x55b01b7fa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34b4cad640 1 -- 172.21.15.2:0/1497386895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 msgr2=0x55b01b7ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34b4cad640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34b4cad640 1 -- 172.21.15.2:0/1497386895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01b7ee620 con 0x55b01b7ee9a0 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34af7fe640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34affff640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e20f0 0x55b01b7fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f34b4cad640 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7efd90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009650 tx=0x7f34a80108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e88c50d1060a871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f3495ffb640 1 -- 172.21.15.2:0/1497386895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8036030 con 0x55b01b7ee9a0 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f3495ffb640 1 -- 172.21.15.2:0/1497386895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a8031e60 con 0x55b01b7ee9a0 2024-09-10T23:35:15.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.146+0000 7f3495ffb640 1 -- 172.21.15.2:0/1497386895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a802b070 con 0x55b01b7ee9a0 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 -- 172.21.15.2:0/1497386895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 msgr2=0x55b01b7efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7efd90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009650 tx=0x7f34a80108e0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 -- 172.21.15.2:0/1497386895 shutdown_connections 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7ee9a0 0x55b01b7efd90 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e2a10 0x55b01b7ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/1497386895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7e20f0 0x55b01b7fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 -- 172.21.15.2:0/1497386895 >> 172.21.15.2:0/1497386895 conn(0x55b01b7dff20 msgr2=0x55b01b7ecd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 -- 172.21.15.2:0/1497386895 shutdown_connections 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 -- 172.21.15.2:0/1497386895 wait complete. 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 -- start start 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.147+0000 7f34b8ae5740 1 Processor -- start 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 0x55b01b7f7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34b01af840 con 0x55b01b7e2a10 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34b01af170 con 0x55b01b7e20f0 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34b01ac3b0 con 0x55b01b7ee9a0 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b8ae5740 10 client.0 _ll_register_callbacks cb 0x7f34a0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 0x55b01b7f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 0x55b01b7f7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48646/0 (socket says 172.21.15.2:48646) 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 -- 172.21.15.2:0/988619490 learned_addr learned my addr 172.21.15.2:0/988619490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34affff640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b4cad640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 -- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 msgr2=0x55b01b7f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 -- 172.21.15.2:0/988619490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 msgr2=0x55b01b7f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 -- 172.21.15.2:0/988619490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01b7f1ee0 con 0x55b01b7e2a10 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34b4cad640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f34af7fe640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 0x55b01b7f7010 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f34a40c9c30 tx=0x7f34a4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694902c24b85c651 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f348f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.148+0000 7f348f7fe640 1 -- 172.21.15.2:0/988619490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4049040 con 0x55b01b7e2a10 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f348f7fe640 1 -- 172.21.15.2:0/988619490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f34a40c8c30 con 0x55b01b7e2a10 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a8031e60 con 0x55b01b7e2a10 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f348f7fe640 1 -- 172.21.15.2:0/988619490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34a40cc790 con 0x55b01b7e2a10 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 10 client.19320 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b01b86fcc0 con 0x55b01b7e2a10 2024-09-10T23:35:15.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f348f7fe640 1 -- 172.21.15.2:0/988619490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a8031e60 con 0x55b01b7e2a10 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f348f7fe640 1 -- 172.21.15.2:0/988619490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34a40ccc20 con 0x55b01b7e2a10 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 10 client.19320 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 10 client.19320 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 20 client.19320 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b870470 0x55b01b872890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 4 client.19320 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b01b7568a0 con 0x55b01b870470 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.149+0000 7f34affff640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b870470 0x55b01b872890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f348f7fe640 10 client.19320 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34affff640 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b870470 0x55b01b872890 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2bfa9a23f37f504 server_cookie=e36c372d1d87b56c in_seq=0 out_seq=0 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f348f7fe640 1 -- 172.21.15.2:0/988619490 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b01b7568a0 con 0x55b01b870470 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f348f7fe640 10 client.19320 handle_command_reply: tid=0 2024-09-10T23:35:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 client.19320 shutdown 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 msgr2=0x55b01b7f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 0x55b01b7f7010 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f34a40c9c30 tx=0x7f34a4003f60 comp rx=0 tx=0).stop 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 shutdown_connections 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55b01b870470 0x55b01b872890 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b01b7ee9a0 0x55b01b7f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b01b7e2a10 0x55b01b7f7010 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f348f7fe640 0 client.19320 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 --2- 172.21.15.2:0/988619490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b01b7e20f0 0x55b01b7f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 >> 172.21.15.2:0/988619490 conn(0x55b01b7dff20 msgr2=0x55b01b7ed550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 shutdown_connections 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 1 -- 172.21.15.2:0/988619490 wait complete. 2024-09-10T23:35:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.150+0000 7f34b8ae5740 20 client.19320 trim_cache size 0 max 16384 2024-09-10T23:35:15.163 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:15.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34980b5360 msgr2=0x7f34980b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34980b5360 0x7f34980b7820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x55b01b7e0e00 tx=0x7f34a000b390 comp rx=0 tx=0).stop 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 msgr2=0x7f34b0199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b0199860 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f34a4032fd0 tx=0x7f34a4031a20 comp rx=0 tx=0).stop 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 shutdown_connections 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f34980b5360 0x7f34980b7820 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34b010d140 0x7f34b019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b0104600 0x7f34b0199860 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 --2- 172.21.15.2:0/3306121943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34b0103ce0 0x7f34b0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 >> 172.21.15.2:0/3306121943 conn(0x7f34b00fd720 msgr2=0x7f34b00fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 shutdown_connections 2024-09-10T23:35:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:15.151+0000 7f34b6710640 1 -- 172.21.15.2:0/3306121943 wait complete. 2024-09-10T23:35:15.961 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:15 smithi002 ceph-mon[31150]: pgmap v679: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:35:15.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:15 smithi177 ceph-mon[35760]: pgmap v679: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:35:15.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:35:16.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:15 smithi154 ceph-mon[35136]: pgmap v679: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T23:35:16.262 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 -- 172.21.15.2:0/4273158892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8101cd0 msgr2=0x7f21e81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 --2- 172.21.15.2:0/4273158892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8101cd0 0x7f21e81020b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009900 tx=0x7f21d802a410 comp rx=0 tx=0).stop 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 -- 172.21.15.2:0/4273158892 shutdown_connections 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 --2- 172.21.15.2:0/4273158892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8108060 0x7f21e810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 --2- 172.21.15.2:0/4273158892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 0x7f21e8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 --2- 172.21.15.2:0/4273158892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8101cd0 0x7f21e81020b0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 -- 172.21.15.2:0/4273158892 >> 172.21.15.2:0/4273158892 conn(0x7f21e80fd700 msgr2=0x7f21e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 -- 172.21.15.2:0/4273158892 shutdown_connections 2024-09-10T23:35:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.756+0000 7f21edad3640 1 -- 172.21.15.2:0/4273158892 wait complete. 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 Processor -- start 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 -- start start 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8101cd0 0x7f21e819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 0x7f21e819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 0x7f21e819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8111ce0 con 0x7f21e8108060 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8111b60 con 0x7f21e8101cd0 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21edad3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8111e60 con 0x7f21e81076e0 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 0x7f21e819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 0x7f21e819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48666/0 (socket says 172.21.15.2:48666) 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.757+0000 7f21e7fff640 1 -- 172.21.15.2:0/2246592940 learned_addr learned my addr 172.21.15.2:0/2246592940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8101cd0 0x7f21e819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 0x7f21e819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e7fff640 1 -- 172.21.15.2:0/2246592940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 msgr2=0x7f21e819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e7fff640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 0x7f21e819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e7fff640 1 -- 172.21.15.2:0/2246592940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8101cd0 msgr2=0x7f21e819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e7fff640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8101cd0 0x7f21e819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e7fff640 1 -- 172.21.15.2:0/2246592940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e81a5430 con 0x7f21e8108060 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 0x7f21e819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8101cd0 0x7f21e819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e7fff640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 0x7f21e819aaf0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f21e000eaa0 tx=0x7f21e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e4ff9640 1 -- 172.21.15.2:0/2246592940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e000cdb0 con 0x7f21e8108060 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e4ff9640 1 -- 172.21.15.2:0/2246592940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e0005020 con 0x7f21e8108060 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e81a5720 con 0x7f21e8108060 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21e4ff9640 1 -- 172.21.15.2:0/2246592940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e00116d0 con 0x7f21e8108060 2024-09-10T23:35:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.758+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e81a5c10 con 0x7f21e8108060 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 Processor -- start 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21e4ff9640 1 -- 172.21.15.2:0/2246592940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f21e000f040 con 0x7f21e8108060 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 -- start start 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae0a7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562aae00eea0 con 0x562aae0a4d80 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562aadffe2d0 con 0x562aae0984d0 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21efea8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562aae0020e0 con 0x562aae098df0 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae0a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae0a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48668/0 (socket says 172.21.15.2:48668) 2024-09-10T23:35:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21e6ffd640 1 -- 172.21.15.2:0/3090016841 learned_addr learned my addr 172.21.15.2:0/3090016841 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.761+0000 7f21e77fe640 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e6ffd640 1 -- 172.21.15.2:0/3090016841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 msgr2=0x562aae0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e6ffd640 1 -- 172.21.15.2:0/3090016841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 msgr2=0x562aae0988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e6ffd640 1 -- 172.21.15.2:0/3090016841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aadd5c650 con 0x562aae0a4d80 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e77fe640 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae0a7170 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f21d0012880 tx=0x7f21d000d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97dd682a3250431b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e4ff9640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f21d40b52e0 0x7f21d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21ddffb640 1 -- 172.21.15.2:0/3090016841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d000aa60 con 0x562aae0a4d80 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21ddffb640 1 -- 172.21.15.2:0/3090016841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d00054d0 con 0x562aae0a4d80 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21ddffb640 1 -- 172.21.15.2:0/3090016841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0004a90 con 0x562aae0a4d80 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f21d40b52e0 0x7f21d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.762+0000 7f21e4ff9640 1 -- 172.21.15.2:0/2246592940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21e00e5b20 con 0x7f21e8108060 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 -- 172.21.15.2:0/3090016841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 msgr2=0x562aae0a7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f21d40b52e0 0x7f21d40b77a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f21d8031440 tx=0x7f21d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae0a7170 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f21d0012880 tx=0x7f21d000d440 comp rx=0 tx=0).stop 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 -- 172.21.15.2:0/3090016841 shutdown_connections 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae0a7170 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 --2- 172.21.15.2:0/3090016841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 -- 172.21.15.2:0/3090016841 >> 172.21.15.2:0/3090016841 conn(0x562aae096300 msgr2=0x562aae0974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 -- 172.21.15.2:0/3090016841 shutdown_connections 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 -- 172.21.15.2:0/3090016841 wait complete. 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.763+0000 7f21efea8740 1 -- start start 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.764+0000 7f21efea8740 1 Processor -- start 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.764+0000 7f21efea8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 0x562aae0a4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.764+0000 7f21efea8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21efea8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0a4d80 0x562aae0a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21efea8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562aade5f700 con 0x562aae0984d0 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21efea8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562aadf99160 con 0x562aae0a4d80 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21efea8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562aae0a7a00 con 0x562aae098df0 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21efea8740 10 client.0 _ll_register_callbacks cb 0x562aadfb29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 0x562aae0a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 0x562aae0a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48684/0 (socket says 172.21.15.2:48684) 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e77fe640 1 -- 172.21.15.2:0/2573226204 learned_addr learned my addr 172.21.15.2:0/2573226204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e7fff640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0a4d80 0x562aae0a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0a4d80 msgr2=0x562aae0a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0a4d80 0x562aae0a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2573226204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 msgr2=0x562aae0a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 0x562aae0a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2573226204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aadfc6c90 con 0x562aae098df0 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e7fff640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0a4d80 0x562aae0a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 0x562aae0a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a47d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005cb0 tx=0x7f21d000af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0520a9053444f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.765+0000 7f21c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-10T23:35:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.766+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2573226204 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d000aa60 con 0x562aae098df0 2024-09-10T23:35:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.766+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d00054d0 con 0x562aae098df0 2024-09-10T23:35:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.766+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2573226204 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21d000ac00 con 0x562aae098df0 2024-09-10T23:35:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.766+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2573226204 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21d0012520 con 0x562aae098df0 2024-09-10T23:35:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.766+0000 7f21efea8740 10 client.28231 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.766+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aae0bbb00 con 0x562aae098df0 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2573226204 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d00054d0 con 0x562aae098df0 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2573226204 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21d0030520 con 0x562aae098df0 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21efea8740 10 client.28231 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21efea8740 10 client.28231 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21efea8740 20 client.28231 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21efea8740 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae0bceb0 0x562aae0bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21efea8740 4 client.28231 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aae010df0 con 0x562aae0bceb0 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.767+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae0bceb0 0x562aae0bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.768+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae0bceb0 0x562aae0bf2a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20990f4a3f11ee20 server_cookie=c28e1ea9f6c93332 in_seq=0 out_seq=0 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.768+0000 7f21c6ffd640 10 client.28231 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:35:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2573226204 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562aae010df0 con 0x562aae0bceb0 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21c6ffd640 10 client.28231 handle_command_reply: tid=0 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 client.28231 shutdown 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 msgr2=0x562aae0a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a47d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005cb0 tx=0x7f21d000af40 comp rx=0 tx=0).stop 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 shutdown_connections 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0a4d80 0x562aae0a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a47d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae0bceb0 0x562aae0bf2a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 --2- 172.21.15.2:0/2573226204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0984d0 0x562aae0a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21c6ffd640 0 client.28231 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 >> 172.21.15.2:0/2573226204 conn(0x562aae096300 msgr2=0x562aae09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 shutdown_connections 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 1 -- 172.21.15.2:0/2573226204 wait complete. 2024-09-10T23:35:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.769+0000 7f21efea8740 20 client.28231 trim_cache size 0 max 16384 2024-09-10T23:35:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 Processor -- start 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 -- start start 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0a6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae09ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81ac030 con 0x562aae0a4d80 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81adb70 con 0x562aae0984d0 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21efea8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81ac700 con 0x562aae098df0 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae09ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae09ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48692/0 (socket says 172.21.15.2:48692) 2024-09-10T23:35:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21e7fff640 1 -- 172.21.15.2:0/4148296337 learned_addr learned my addr 172.21.15.2:0/4148296337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21e77fe640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.797+0000 7f21e7fff640 1 -- 172.21.15.2:0/4148296337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 msgr2=0x562aae0a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e7fff640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e7fff640 1 -- 172.21.15.2:0/4148296337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 msgr2=0x562aae0a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e7fff640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e7fff640 1 -- 172.21.15.2:0/4148296337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aae0a1ff0 con 0x562aae0a4d80 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e77fe640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21e7fff640 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae09ec80 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f21e00a88c0 tx=0x7f21e00b52d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60e1bd61855f9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21dd7fa640 1 -- 172.21.15.2:0/4148296337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e001f070 con 0x562aae0a4d80 2024-09-10T23:35:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21dd7fa640 1 -- 172.21.15.2:0/4148296337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e00b0dd0 con 0x562aae0a4d80 2024-09-10T23:35:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.798+0000 7f21dd7fa640 1 -- 172.21.15.2:0/4148296337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e00e3af0 con 0x562aae0a4d80 2024-09-10T23:35:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 -- 172.21.15.2:0/4148296337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 msgr2=0x562aae09ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae09ec80 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f21e00a88c0 tx=0x7f21e00b52d0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 -- 172.21.15.2:0/4148296337 shutdown_connections 2024-09-10T23:35:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae0a4d80 0x562aae09ec80 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae098df0 0x562aae0a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 --2- 172.21.15.2:0/4148296337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 -- 172.21.15.2:0/4148296337 >> 172.21.15.2:0/4148296337 conn(0x562aae096300 msgr2=0x562aae097350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 -- 172.21.15.2:0/4148296337 shutdown_connections 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 -- 172.21.15.2:0/4148296337 wait complete. 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 -- start start 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.799+0000 7f21efea8740 1 Processor -- start 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 0x562aae0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae0a4d80 0x562aae0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81ad4a0 con 0x562aae098df0 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81acdd0 con 0x562aae0984d0 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81aa010 con 0x562aae0a4d80 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21efea8740 10 client.0 _ll_register_callbacks cb 0x7f21d000de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 0x562aae0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 0x562aae0b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48702/0 (socket says 172.21.15.2:48702) 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2126274845 learned_addr learned my addr 172.21.15.2:0/2126274845 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e7fff640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae0a4d80 0x562aae0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2126274845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae0a4d80 msgr2=0x562aae0b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae0a4d80 0x562aae0b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 msgr2=0x562aae0ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 -- 172.21.15.2:0/2126274845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aae128a10 con 0x562aae098df0 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21e6ffd640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 0x562aae0b58c0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f21d0015040 tx=0x7f21d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b217ef0a3a403c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.800+0000 7f21c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2126274845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d003e060 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2126274845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21d0030ae0 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e00b0dd0 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2126274845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21d0030d00 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 10 client.19338 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aae129c30 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2126274845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e00b0dd0 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2126274845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21d001d430 con 0x562aae098df0 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 10 client.19338 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 10 client.19338 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 20 client.19338 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae12a380 0x562aae12c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 4 client.19338 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:16.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.801+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562aae00c8a0 con 0x562aae12a380 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.802+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae12a380 0x562aae12c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.802+0000 7f21e77fe640 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae12a380 0x562aae12c7a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a57f0acfd944056d server_cookie=9305b4366ae3717 in_seq=0 out_seq=0 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.802+0000 7f21c6ffd640 10 client.19338 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.802+0000 7f21c6ffd640 1 -- 172.21.15.2:0/2126274845 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562aae00c8a0 con 0x562aae12a380 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.802+0000 7f21c6ffd640 10 client.19338 handle_command_reply: tid=0 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.802+0000 7f21efea8740 1 client.19338 shutdown 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 msgr2=0x562aae0b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 0x562aae0b58c0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f21d0015040 tx=0x7f21d0005840 comp rx=0 tx=0).stop 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 shutdown_connections 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562aae0a4d80 0x562aae0b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x562aae12a380 0x562aae12c7a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21c6ffd640 0 client.19338 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:35:16.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562aae098df0 0x562aae0b58c0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 --2- 172.21.15.2:0/2126274845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aae0984d0 0x562aae0ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 >> 172.21.15.2:0/2126274845 conn(0x562aae096300 msgr2=0x562aae0a9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 shutdown_connections 2024-09-10T23:35:16.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 1 -- 172.21.15.2:0/2126274845 wait complete. 2024-09-10T23:35:16.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21efea8740 20 client.19338 trim_cache size 0 max 16384 2024-09-10T23:35:16.810 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f21d40b52e0 msgr2=0x7f21d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.803+0000 7f21edad3640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f21d40b52e0 0x7f21d40b77a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f21d8031440 tx=0x7f21d80058d0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 msgr2=0x7f21e819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 0x7f21e819aaf0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f21e000eaa0 tx=0x7f21e000ef60 comp rx=0 tx=0).stop 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 shutdown_connections 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f21d40b52e0 0x7f21d40b77a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21e8108060 0x7f21e819aaf0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21e81076e0 0x7f21e819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 --2- 172.21.15.2:0/2246592940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e8101cd0 0x7f21e819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 >> 172.21.15.2:0/2246592940 conn(0x7f21e80fd700 msgr2=0x7f21e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 shutdown_connections 2024-09-10T23:35:16.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:16.804+0000 7f21edad3640 1 -- 172.21.15.2:0/2246592940 wait complete. 2024-09-10T23:35:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 -- 172.21.15.2:0/1764162738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 msgr2=0x7fee4c105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 --2- 172.21.15.2:0/1764162738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c105530 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009900 tx=0x7fee3c02a410 comp rx=0 tx=0).stop 2024-09-10T23:35:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 -- 172.21.15.2:0/1764162738 shutdown_connections 2024-09-10T23:35:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 --2- 172.21.15.2:0/1764162738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee4c108670 0x7fee4c10ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 --2- 172.21.15.2:0/1764162738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 0x7fee4c107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 --2- 172.21.15.2:0/1764162738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c105530 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 -- 172.21.15.2:0/1764162738 >> 172.21.15.2:0/1764162738 conn(0x7fee4c0fd140 msgr2=0x7fee4c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 -- 172.21.15.2:0/1764162738 shutdown_connections 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 -- 172.21.15.2:0/1764162738 wait complete. 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 Processor -- start 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.861+0000 7fee53023640 1 -- start start 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 0x7fee4c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee4c108670 0x7fee4c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c10e610 con 0x7fee4c06b470 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c10e490 con 0x7fee4c105ac0 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c10e790 con 0x7fee4c108670 2024-09-10T23:35:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48716/0 (socket says 172.21.15.2:48716) 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 -- 172.21.15.2:0/2685458570 learned_addr learned my addr 172.21.15.2:0/2685458570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee4bfff640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 0x7fee4c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee515c0640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee4c108670 0x7fee4c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 -- 172.21.15.2:0/2685458570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee4c108670 msgr2=0x7fee4c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee4c108670 0x7fee4c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 -- 172.21.15.2:0/2685458570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 msgr2=0x7fee4c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 0x7fee4c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 -- 172.21.15.2:0/2685458570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c19a8b0 con 0x7fee4c06b470 2024-09-10T23:35:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee4bfff640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 0x7fee4c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee50dbf640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c198d70 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fee3c005ab0 tx=0x7fee3c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee49ffb640 1 -- 172.21.15.2:0/2685458570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c03f070 con 0x7fee4c06b470 2024-09-10T23:35:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee49ffb640 1 -- 172.21.15.2:0/2685458570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee3c03b460 con 0x7fee4c06b470 2024-09-10T23:35:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4c19ab40 con 0x7fee4c06b470 2024-09-10T23:35:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.862+0000 7fee49ffb640 1 -- 172.21.15.2:0/2685458570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c035030 con 0x7fee4c06b470 2024-09-10T23:35:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.863+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4c1a1270 con 0x7fee4c06b470 2024-09-10T23:35:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 Processor -- start 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 -- start start 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 0x55e587ef8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587efb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587efbbd0 0x55e587efe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e587e686f0 con 0x55e587ef9190 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e587e57b20 con 0x55e587efbbd0 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee55df1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e587e5b930 con 0x55e587ef6860 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee49ffb640 1 -- 172.21.15.2:0/2685458570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fee3c03b8d0 con 0x7fee4c06b470 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 0x55e587ef8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 0x55e587ef8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.2:56832/0 (socket says 172.21.15.2:56832) 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 -- 172.21.15.2:0/433804145 learned_addr learned my addr 172.21.15.2:0/433804145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee50dbf640 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587efb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee4bfff640 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587efbbd0 0x55e587efe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 -- 172.21.15.2:0/433804145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587efbbd0 msgr2=0x55e587efe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587efbbd0 0x55e587efe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 -- 172.21.15.2:0/433804145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 msgr2=0x55e587efb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587efb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.866+0000 7fee515c0640 1 -- 172.21.15.2:0/433804145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e587e1d530 con 0x55e587ef6860 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee515c0640 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 0x55e587ef8c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee44009e30 tx=0x7fee44010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e100560a3623b5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee49ffb640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee340b5360 0x7fee340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee32ffd640 1 -- 172.21.15.2:0/433804145 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44016070 con 0x55e587ef6860 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee32ffd640 1 -- 172.21.15.2:0/433804145 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee44004d20 con 0x55e587ef6860 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee32ffd640 1 -- 172.21.15.2:0/433804145 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44012780 con 0x55e587ef6860 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee50dbf640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee340b5360 0x7fee340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.867+0000 7fee49ffb640 1 -- 172.21.15.2:0/2685458570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fee3c1067e0 con 0x7fee4c06b470 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 -- 172.21.15.2:0/433804145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 msgr2=0x55e587ef8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee50dbf640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee340b5360 0x7fee340b7820 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ca220 tx=0x7fee3c10c550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 0x55e587ef8c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee44009e30 tx=0x7fee44010740 comp rx=0 tx=0).stop 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 -- 172.21.15.2:0/433804145 shutdown_connections 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587efbbd0 0x55e587efe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587efb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 --2- 172.21.15.2:0/433804145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587ef6860 0x55e587ef8c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 -- 172.21.15.2:0/433804145 >> 172.21.15.2:0/433804145 conn(0x55e587ef19b0 msgr2=0x55e587ef2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 -- 172.21.15.2:0/433804145 shutdown_connections 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 -- 172.21.15.2:0/433804145 wait complete. 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 -- start start 2024-09-10T23:35:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.868+0000 7fee55df1740 1 Processor -- start 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587f005d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f011a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e587d8fab0 con 0x55e587ef6860 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e587dfd730 con 0x55e587ef9190 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e587efebb0 con 0x55e587efbbd0 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee55df1740 10 client.0 _ll_register_callbacks cb 0x55e587e516b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48730/0 (socket says 172.21.15.2:48730) 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 -- 172.21.15.2:0/4287795981 learned_addr learned my addr 172.21.15.2:0/4287795981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee4bfff640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587f005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 -- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 msgr2=0x55e587f011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 -- 172.21.15.2:0/4287795981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 msgr2=0x55e587f005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587f005d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 -- 172.21.15.2:0/4287795981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e587bb9790 con 0x55e587ef6860 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee515c0640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efff30 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fee44005cc0 tx=0x7fee44010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792d8e84571ac458 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.869+0000 7fee2bfff640 1 -- 172.21.15.2:0/4287795981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44016050 con 0x55e587ef6860 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee2bfff640 1 -- 172.21.15.2:0/4287795981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fee440124c0 con 0x55e587ef6860 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee44004d20 con 0x55e587ef6860 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee2bfff640 1 -- 172.21.15.2:0/4287795981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee440126c0 con 0x55e587ef6860 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 10 client.19350 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e587c32620 con 0x55e587ef6860 2024-09-10T23:35:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee2bfff640 1 -- 172.21.15.2:0/4287795981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee44004d20 con 0x55e587ef6860 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee2bfff640 1 -- 172.21.15.2:0/4287795981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee44027020 con 0x55e587ef6860 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 10 client.19350 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 10 client.19350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 20 client.19350 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f0b4e0 0x55e587f0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 4 client.19350 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e587e6a640 con 0x55e587f0b4e0 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.870+0000 7fee4bfff640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f0b4e0 0x55e587f0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.871+0000 7fee4bfff640 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f0b4e0 0x55e587f0d8d0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3deeeb95a99e9e30 server_cookie=4ed6481070d29dbc in_seq=0 out_seq=0 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.871+0000 7fee2bfff640 10 client.19350 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee2bfff640 1 -- 172.21.15.2:0/4287795981 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e587e6a640 con 0x55e587f0b4e0 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee2bfff640 10 client.19350 handle_command_reply: tid=0 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 client.19350 shutdown 2024-09-10T23:35:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 msgr2=0x55e587efff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efff30 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fee44005cc0 tx=0x7fee44010f10 comp rx=0 tx=0).stop 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 shutdown_connections 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f0b4e0 0x55e587f0d8d0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587f005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 --2- 172.21.15.2:0/4287795981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efff30 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 >> 172.21.15.2:0/4287795981 conn(0x55e587ef19b0 msgr2=0x55e587ef0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee2bfff640 0 client.19350 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 shutdown_connections 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 1 -- 172.21.15.2:0/4287795981 wait complete. 2024-09-10T23:35:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.872+0000 7fee55df1740 20 client.19350 trim_cache size 0 max 16384 2024-09-10T23:35:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 Processor -- start 2024-09-10T23:35:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 -- start start 2024-09-10T23:35:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587efc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587ef37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1a9e30 con 0x55e587ef6860 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1ab970 con 0x55e587ef9190 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee55df1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1aa500 con 0x55e587efbbd0 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48746/0 (socket says 172.21.15.2:48746) 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 -- 172.21.15.2:0/850390084 learned_addr learned my addr 172.21.15.2:0/850390084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587ef37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee4bfff640 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587efc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 -- 172.21.15.2:0/850390084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 msgr2=0x55e587ef37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587ef37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 -- 172.21.15.2:0/850390084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 msgr2=0x55e587efc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587efc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 -- 172.21.15.2:0/850390084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e587ef8fc0 con 0x55e587ef6860 2024-09-10T23:35:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.887+0000 7fee515c0640 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efbfb0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fee44004bd0 tx=0x7fee44010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ad9b8ce2c8cbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee327fc640 1 -- 172.21.15.2:0/850390084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4403a070 con 0x55e587ef6860 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee327fc640 1 -- 172.21.15.2:0/850390084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4401e030 con 0x55e587ef6860 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee327fc640 1 -- 172.21.15.2:0/850390084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44016040 con 0x55e587ef6860 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 -- 172.21.15.2:0/850390084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 msgr2=0x55e587efbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efbfb0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fee44004bd0 tx=0x7fee44010f80 comp rx=0 tx=0).stop 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 -- 172.21.15.2:0/850390084 shutdown_connections 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587ef37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef9190 0x55e587efc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 --2- 172.21.15.2:0/850390084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef6860 0x55e587efbfb0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 -- 172.21.15.2:0/850390084 >> 172.21.15.2:0/850390084 conn(0x55e587ef19b0 msgr2=0x55e587ef5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 -- 172.21.15.2:0/850390084 shutdown_connections 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.888+0000 7fee55df1740 1 -- 172.21.15.2:0/850390084 wait complete. 2024-09-10T23:35:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 -- start start 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 Processor -- start 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef6860 0x55e587f07830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587f06530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f06a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1ab2a0 con 0x55e587ef9190 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1aabd0 con 0x55e587ef6860 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1a7e10 con 0x55e587efbbd0 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee55df1740 10 client.0 _ll_register_callbacks cb 0x7fee3c10c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587f06530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587f06530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48756/0 (socket says 172.21.15.2:48756) 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 -- 172.21.15.2:0/1838735950 learned_addr learned my addr 172.21.15.2:0/1838735950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee515c0640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef6860 0x55e587f07830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee515c0640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f06a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 -- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 msgr2=0x55e587f06a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f06a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 -- 172.21.15.2:0/1838735950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef6860 msgr2=0x55e587f07830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.889+0000 7fee4bfff640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef6860 0x55e587f07830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee4bfff640 1 -- 172.21.15.2:0/1838735950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e587f070b0 con 0x55e587ef9190 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee515c0640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f06a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee4bfff640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587f06530 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x55e587f0dfd0 tx=0x7fee400042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e60388ca4c1f793 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee2bfff640 1 -- 172.21.15.2:0/1838735950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40025470 con 0x55e587ef9190 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee2bfff640 1 -- 172.21.15.2:0/1838735950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fee40011440 con 0x55e587ef9190 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee4401e030 con 0x55e587ef9190 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee2bfff640 1 -- 172.21.15.2:0/1838735950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee40025610 con 0x55e587ef9190 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 10 client.19356 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e587f782b0 con 0x55e587ef9190 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee2bfff640 1 -- 172.21.15.2:0/1838735950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4401e030 con 0x55e587ef9190 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee2bfff640 1 -- 172.21.15.2:0/1838735950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee40011a60 con 0x55e587ef9190 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 10 client.19356 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 10 client.19356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 20 client.19356 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f78aa0 0x55e587f7aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 4 client.19356 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.890+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e587e660f0 con 0x55e587f78aa0 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.891+0000 7fee515c0640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f78aa0 0x55e587f7aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.891+0000 7fee515c0640 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f78aa0 0x55e587f7aec0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f92d029a0f5ba1f server_cookie=15e0c83c59712f15 in_seq=0 out_seq=0 2024-09-10T23:35:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.891+0000 7fee2bfff640 10 client.19356 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee2bfff640 1 -- 172.21.15.2:0/1838735950 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e587e660f0 con 0x55e587f78aa0 2024-09-10T23:35:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee2bfff640 10 client.19356 handle_command_reply: tid=0 2024-09-10T23:35:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 client.19356 shutdown 2024-09-10T23:35:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 msgr2=0x55e587f06530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587f06530 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x55e587f0dfd0 tx=0x7fee400042e0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 shutdown_connections 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55e587f78aa0 0x55e587f7aec0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e587efbbd0 0x55e587f06a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e587ef9190 0x55e587f06530 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee2bfff640 0 client.19356 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 --2- 172.21.15.2:0/1838735950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e587ef6860 0x55e587f07830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 >> 172.21.15.2:0/1838735950 conn(0x55e587ef19b0 msgr2=0x55e587efbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 shutdown_connections 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 1 -- 172.21.15.2:0/1838735950 wait complete. 2024-09-10T23:35:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.907+0000 7fee55df1740 20 client.19356 trim_cache size 0 max 16384 2024-09-10T23:35:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-10T23:35:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-10T23:35:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-10T23:35:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee340b5360 msgr2=0x7fee340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee340b5360 0x7fee340b7820 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ca220 tx=0x7fee3c10c550 comp rx=0 tx=0).stop 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 msgr2=0x7fee4c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c198d70 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fee3c005ab0 tx=0x7fee3c003cd0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 shutdown_connections 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fee340b5360 0x7fee340b7820 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee4c108670 0x7fee4c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee4c105ac0 0x7fee4c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 --2- 172.21.15.2:0/2685458570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c06b470 0x7fee4c198d70 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 >> 172.21.15.2:0/2685458570 conn(0x7fee4c0fd140 msgr2=0x7fee4c103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 shutdown_connections 2024-09-10T23:35:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-10T23:35:16.908+0000 7fee53023640 1 -- 172.21.15.2:0/2685458570 wait complete. 2024-09-10T23:35:17.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:35:17.881 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:17.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:17 smithi177 ceph-mon[35760]: pgmap v680: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T23:35:17.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:17 smithi002 ceph-mon[31150]: pgmap v680: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T23:35:18.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:17 smithi154 ceph-mon[35136]: pgmap v680: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T23:35:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 -- 172.21.15.2:0/3891590320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 msgr2=0x7fd76010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 --2- 172.21.15.2:0/3891590320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd76010f950 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd758009ca0 tx=0x7fd75802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 -- 172.21.15.2:0/3891590320 shutdown_connections 2024-09-10T23:35:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 --2- 172.21.15.2:0/3891590320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd76010f950 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 --2- 172.21.15.2:0/3891590320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7601087d0 0x7fd760108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 --2- 172.21.15.2:0/3891590320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd760102dc0 0x7fd7601031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 -- 172.21.15.2:0/3891590320 >> 172.21.15.2:0/3891590320 conn(0x7fd7600fe830 msgr2=0x7fd760100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 -- 172.21.15.2:0/3891590320 shutdown_connections 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 -- 172.21.15.2:0/3891590320 wait complete. 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 Processor -- start 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.384+0000 7fd7664ae640 1 -- start start 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd7664ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd760102dc0 0x7fd76019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd7664ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7601087d0 0x7fd76019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd7664ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd7601a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd7664ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112dd0 con 0x7fd760109150 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd7664ae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112c50 con 0x7fd760102dc0 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd7664ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112f50 con 0x7fd7601087d0 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd7601a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd7601a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48780/0 (socket says 172.21.15.2:48780) 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 -- 172.21.15.2:0/559618412 learned_addr learned my addr 172.21.15.2:0/559618412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7601087d0 0x7fd76019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd75ffff640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd760102dc0 0x7fd76019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 -- 172.21.15.2:0/559618412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7601087d0 msgr2=0x7fd76019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7601087d0 0x7fd76019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 -- 172.21.15.2:0/559618412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd760102dc0 msgr2=0x7fd76019b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd760102dc0 0x7fd76019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 -- 172.21.15.2:0/559618412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7601a1510 con 0x7fd760109150 2024-09-10T23:35:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.385+0000 7fd764a4b640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd7601a0d40 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fd758005cc0 tx=0x7fd75802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.386+0000 7fd75d7fa640 1 -- 172.21.15.2:0/559618412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758003bf0 con 0x7fd760109150 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.386+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7601a17a0 con 0x7fd760109150 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.386+0000 7fd75d7fa640 1 -- 172.21.15.2:0/559618412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd758003d90 con 0x7fd760109150 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.386+0000 7fd75d7fa640 1 -- 172.21.15.2:0/559618412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75802fbc0 con 0x7fd760109150 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.386+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7601a7ec0 con 0x7fd760109150 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.388+0000 7fd75d7fa640 1 -- 172.21.15.2:0/559618412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd758004610 con 0x7fd760109150 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.388+0000 7fd768883740 1 Processor -- start 2024-09-10T23:35:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.388+0000 7fd768883740 1 -- start start 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd768883740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd768883740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d8df0 0x55d34b9e4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd768883740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd768883740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d34b94eea0 con 0x55d34b9d84d0 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd768883740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d34b93e2d0 con 0x55d34b9e4d80 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd768883740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d34b9420e0 con 0x55d34b9d8df0 2024-09-10T23:35:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48782/0 (socket says 172.21.15.2:48782) 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 -- 172.21.15.2:0/4264112500 learned_addr learned my addr 172.21.15.2:0/4264112500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75ffff640 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d8df0 0x55d34b9e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 -- 172.21.15.2:0/4264112500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d8df0 msgr2=0x55d34b9e4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d8df0 0x55d34b9e4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 -- 172.21.15.2:0/4264112500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 msgr2=0x55d34b9e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 -- 172.21.15.2:0/4264112500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34b69c650 con 0x55d34b9d84d0 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75d7fa640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd764a4b640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d88b0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd7540124f0 tx=0x7fd75400c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44d0ff70d75cf20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd75d7fa640 1 -- 172.21.15.2:0/559618412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd7581072d0 con 0x7fd760109150 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.389+0000 7fd7467fc640 1 -- 172.21.15.2:0/4264112500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754018070 con 0x55d34b9d84d0 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd7467fc640 1 -- 172.21.15.2:0/4264112500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7540047a0 con 0x55d34b9d84d0 2024-09-10T23:35:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd7467fc640 1 -- 172.21.15.2:0/4264112500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7540108a0 con 0x55d34b9d84d0 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 -- 172.21.15.2:0/4264112500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 msgr2=0x55d34b9d88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd764a4b640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd7580cd9d0 tx=0x7fd75802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d88b0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd7540124f0 tx=0x7fd75400c5a0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 -- 172.21.15.2:0/4264112500 shutdown_connections 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d8df0 0x55d34b9e4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 --2- 172.21.15.2:0/4264112500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d88b0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 -- 172.21.15.2:0/4264112500 >> 172.21.15.2:0/4264112500 conn(0x55d34b9d6300 msgr2=0x55d34b9d74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 -- 172.21.15.2:0/4264112500 shutdown_connections 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.390+0000 7fd768883740 1 -- 172.21.15.2:0/4264112500 wait complete. 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 -- start start 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 Processor -- start 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d34b79f700 con 0x55d34b9d8df0 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d34b8d9160 con 0x55d34b9e4d80 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d34b9e7a00 con 0x55d34b9d84d0 2024-09-10T23:35:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd768883740 10 client.0 _ll_register_callbacks cb 0x55d34b8f29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd75ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd75ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9e1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48796/0 (socket says 172.21.15.2:48796) 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.391+0000 7fd75ffff640 1 -- 172.21.15.2:0/2992574395 learned_addr learned my addr 172.21.15.2:0/2992574395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75ffff640 1 -- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 msgr2=0x55d34b9e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75ffff640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75ffff640 1 -- 172.21.15.2:0/2992574395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 msgr2=0x55d34b9e2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75ffff640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75ffff640 1 -- 172.21.15.2:0/2992574395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34b906c90 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd75ffff640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9e1b10 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd750010470 tx=0x7fd750010930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3efc35db4549ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd73f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd73f7fe640 1 -- 172.21.15.2:0/2992574395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750012920 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7540047a0 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd73f7fe640 1 -- 172.21.15.2:0/2992574395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd750012ac0 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd73f7fe640 1 -- 172.21.15.2:0/2992574395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd750012cc0 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd768883740 10 client.19368 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d34b9f33e0 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.392+0000 7fd73f7fe640 1 -- 172.21.15.2:0/2992574395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7540047a0 con 0x55d34b9d8df0 2024-09-10T23:35:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd73f7fe640 1 -- 172.21.15.2:0/2992574395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd75000f040 con 0x55d34b9d8df0 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd768883740 10 client.19368 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd768883740 10 client.19368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd768883740 20 client.19368 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd768883740 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34b9f4890 0x55d34b9f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd768883740 4 client.19368 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d34b950df0 con 0x55d34b9f4890 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34b9f4890 0x55d34b9f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd73f7fe640 10 client.19368 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.393+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34b9f4890 0x55d34b9f6cb0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890bf1f23a451e12 server_cookie=5e9e33c1ce38a3bb in_seq=0 out_seq=0 2024-09-10T23:35:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd73f7fe640 1 -- 172.21.15.2:0/2992574395 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d34b950df0 con 0x55d34b9f4890 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd73f7fe640 10 client.19368 handle_command_reply: tid=0 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 client.19368 shutdown 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 msgr2=0x55d34b9e1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9e1b10 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd750010470 tx=0x7fd750010930 comp rx=0 tx=0).stop 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 shutdown_connections 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34b9f4890 0x55d34b9f6cb0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9e1b10 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd73f7fe640 0 client.19368 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 --2- 172.21.15.2:0/2992574395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.394+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 >> 172.21.15.2:0/2992574395 conn(0x55d34b9d6300 msgr2=0x55d34b9dbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.395+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 shutdown_connections 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.395+0000 7fd768883740 1 -- 172.21.15.2:0/2992574395 wait complete. 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.395+0000 7fd768883740 20 client.19368 trim_cache size 0 max 16384 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 Processor -- start 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 -- start start 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9d8df0 0x55d34b9e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9e4d80 0x55d34b9e6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601b04d0 con 0x55d34b9d84d0 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601b2010 con 0x55d34b9d8df0 2024-09-10T23:35:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd768883740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601b0ba0 con 0x55d34b9e4d80 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48810/0 (socket says 172.21.15.2:48810) 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.408+0000 7fd75f7fe640 1 -- 172.21.15.2:0/3564319635 learned_addr learned my addr 172.21.15.2:0/3564319635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75ffff640 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9d8df0 0x55d34b9e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75f7fe640 1 -- 172.21.15.2:0/3564319635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9e4d80 msgr2=0x55d34b9e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9e4d80 0x55d34b9e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75f7fe640 1 -- 172.21.15.2:0/3564319635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9d8df0 msgr2=0x55d34b9e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9d8df0 0x55d34b9e3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75f7fe640 1 -- 172.21.15.2:0/3564319635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34b9d1de0 con 0x55d34b9d84d0 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d5c10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c850 tx=0x7fd754014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1230a80828483b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:18.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd745ffb640 1 -- 172.21.15.2:0/3564319635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754018040 con 0x55d34b9d84d0 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd745ffb640 1 -- 172.21.15.2:0/3564319635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd754004220 con 0x55d34b9d84d0 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.409+0000 7fd745ffb640 1 -- 172.21.15.2:0/3564319635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7540035f0 con 0x55d34b9d84d0 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- 172.21.15.2:0/3564319635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 msgr2=0x55d34b9d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d5c10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c850 tx=0x7fd754014040 comp rx=0 tx=0).stop 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- 172.21.15.2:0/3564319635 shutdown_connections 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9e4d80 0x55d34b9e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9d8df0 0x55d34b9e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- 172.21.15.2:0/3564319635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d84d0 0x55d34b9d5c10 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- 172.21.15.2:0/3564319635 >> 172.21.15.2:0/3564319635 conn(0x55d34b9d6300 msgr2=0x55d34b9e3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- 172.21.15.2:0/3564319635 shutdown_connections 2024-09-10T23:35:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- 172.21.15.2:0/3564319635 wait complete. 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- start start 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 Processor -- start 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.410+0000 7fd768883740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601b1940 con 0x55d34b9d8df0 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd768883740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601b1270 con 0x55d34b9e4d80 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd768883740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7601ae4b0 con 0x55d34b9d84d0 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd768883740 10 client.0 _ll_register_callbacks cb 0x7fd75000e310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48824/0 (socket says 172.21.15.2:48824) 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 -- 172.21.15.2:0/1929728139 learned_addr learned my addr 172.21.15.2:0/1929728139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 -- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 msgr2=0x55d34b9ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 -- 172.21.15.2:0/1929728139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 msgr2=0x55d34b9e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 -- 172.21.15.2:0/1929728139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34b9e84e0 con 0x55d34b9d8df0 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:18.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd75ffff640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9ed500 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fd750010470 tx=0x7fd75000e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63ed456b4d45c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd73f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd73f7fe640 1 -- 172.21.15.2:0/1929728139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750012920 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd73f7fe640 1 -- 172.21.15.2:0/1929728139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fd750012ac0 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.411+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd754004220 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd73f7fe640 1 -- 172.21.15.2:0/1929728139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd750010e30 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 10 client.19374 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d34ba62300 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd73f7fe640 1 -- 172.21.15.2:0/1929728139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd754004220 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd73f7fe640 1 -- 172.21.15.2:0/1929728139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd750026930 con 0x55d34b9d8df0 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 10 client.19374 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 10 client.19374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 20 client.19374 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34ba628f0 0x55d34ba64d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 4 client.19374 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d34b94c8a0 con 0x55d34ba628f0 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.412+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34ba628f0 0x55d34ba64d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd75f7fe640 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34ba628f0 0x55d34ba64d10 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22d78c4a5f19126d server_cookie=8e44313a04e9463d in_seq=0 out_seq=0 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd73f7fe640 10 client.19374 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd73f7fe640 1 -- 172.21.15.2:0/1929728139 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d34b94c8a0 con 0x55d34ba628f0 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd73f7fe640 10 client.19374 handle_command_reply: tid=0 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 client.19374 shutdown 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 msgr2=0x55d34b9ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9ed500 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fd750010470 tx=0x7fd75000e5f0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 shutdown_connections 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55d34ba628f0 0x55d34ba64d10 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d34b9e4d80 0x55d34b9e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d34b9d8df0 0x55d34b9ed500 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd73f7fe640 0 client.19374 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 --2- 172.21.15.2:0/1929728139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d34b9d84d0 0x55d34b9ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 >> 172.21.15.2:0/1929728139 conn(0x55d34b9d6300 msgr2=0x55d34b9e3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 shutdown_connections 2024-09-10T23:35:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 1 -- 172.21.15.2:0/1929728139 wait complete. 2024-09-10T23:35:18.450 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.413+0000 7fd768883740 20 client.19374 trim_cache size 0 max 16384 2024-09-10T23:35:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 msgr2=0x7fd7480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd7580cd9d0 tx=0x7fd75802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 msgr2=0x7fd7601a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd7601a0d40 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fd758005cc0 tx=0x7fd75802f380 comp rx=0 tx=0).stop 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 shutdown_connections 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fd7480b52e0 0x7fd7480b77a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760109150 0x7fd7601a0d40 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7601087d0 0x7fd76019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 --2- 172.21.15.2:0/559618412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd760102dc0 0x7fd76019b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 >> 172.21.15.2:0/559618412 conn(0x7fd7600fe830 msgr2=0x7fd760106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 shutdown_connections 2024-09-10T23:35:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:18.414+0000 7fd7664ae640 1 -- 172.21.15.2:0/559618412 wait complete. 2024-09-10T23:35:19.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:19 smithi002 ceph-mon[31150]: pgmap v681: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-10T23:35:19.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:19 smithi177 ceph-mon[35760]: pgmap v681: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-10T23:35:20.006 INFO:tasks.workunit.client.0.smithi002.stdout:561/600: open fd = 3 2024-09-10T23:35:20.006 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.006 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.006 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:562/600: open fd = 3 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:563/600: open fd = 3 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:564/600: open fd = 3 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.007 INFO:tasks.workunit.client.0.smithi002.stdout:565/600: open fd = 3 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:566/600: open fd = 3 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:567/600: open fd = 3 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:568/600: open fd = 3 2024-09-10T23:35:20.008 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:569/600: open fd = 3 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:570/600: open fd = 3 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:571/600: open fd = 3 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.009 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:572/600: open fd = 3 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:573/600: open fd = 3 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:574/600: open fd = 3 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.010 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:575/600: open fd = 3 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:576/600: open fd = 3 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.011 INFO:tasks.workunit.client.0.smithi002.stdout:577/600: open fd = 3 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:578/600: open fd = 3 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:579/600: open fd = 3 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:580/600: open fd = 3 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:581/600: open fd = 3 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:582/600: open fd = 3 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:583/600: open fd = 3 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.013 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:584/600: open fd = 3 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:585/600: open fd = 3 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:586/600: open fd = 3 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.014 INFO:tasks.workunit.client.0.smithi002.stdout:587/600: open fd = 3 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:588/600: open fd = 3 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:589/600: open fd = 3 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:590/600: open fd = 3 2024-09-10T23:35:20.015 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:591/600: open fd = 3 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:592/600: open fd = 3 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:593/600: open fd = 3 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.016 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:594/600: open fd = 3 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:595/600: open fd = 3 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:596/600: open fd = 3 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.017 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:597/600: open fd = 3 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:598/600: open fd = 3 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:599/600: open fd = 3 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.018 INFO:tasks.workunit.client.0.smithi002.stdout:600/600: open fd = 3 2024-09-10T23:35:20.019 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.019 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-10T23:35:20.019 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-10T23:35:20.019 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo OK 2024-09-10T23:35:20.020 INFO:tasks.workunit.client.0.smithi002.stdout:OK 2024-09-10T23:35:20.020 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:35:20.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:35:20.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:19 smithi154 ceph-mon[35136]: pgmap v681: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-10T23:35:20.061 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-10T23:35:20.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T23:35:20.343 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:35:20.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:35:20.412 DEBUG:teuthology.parallel:result is None 2024-09-10T23:35:20.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:35:20.445 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:35:20.445 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-10T23:35:20.456 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:35:20.494 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T23:35:20.503 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T23:35:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 -- 172.21.15.2:0/3244008555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 msgr2=0x7f2ddc10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 --2- 172.21.15.2:0/3244008555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc10f970 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009ca0 tx=0x7f2dd402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 -- 172.21.15.2:0/3244008555 shutdown_connections 2024-09-10T23:35:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 --2- 172.21.15.2:0/3244008555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc10f970 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 --2- 172.21.15.2:0/3244008555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ddc1087f0 0x7f2ddc108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 --2- 172.21.15.2:0/3244008555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ddc102de0 0x7f2ddc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 -- 172.21.15.2:0/3244008555 >> 172.21.15.2:0/3244008555 conn(0x7f2ddc0fe830 msgr2=0x7f2ddc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 -- 172.21.15.2:0/3244008555 shutdown_connections 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.160+0000 7f2de1da3640 1 -- 172.21.15.2:0/3244008555 wait complete. 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 Processor -- start 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 -- start start 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ddc102de0 0x7f2ddc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ddc1087f0 0x7f2ddc199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc112e30 con 0x7f2ddc109170 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc112cb0 con 0x7f2ddc102de0 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2de1da3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc112fb0 con 0x7f2ddc1087f0 2024-09-10T23:35:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57396/0 (socket says 172.21.15.2:57396) 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 -- 172.21.15.2:0/2967388359 learned_addr learned my addr 172.21.15.2:0/2967388359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ddc102de0 0x7f2ddc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ddc1087f0 0x7f2ddc199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 -- 172.21.15.2:0/2967388359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ddc1087f0 msgr2=0x7f2ddc199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ddc1087f0 0x7f2ddc199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 -- 172.21.15.2:0/2967388359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ddc102de0 msgr2=0x7f2ddc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ddc102de0 0x7f2ddc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.161+0000 7f2ddbfff640 1 -- 172.21.15.2:0/2967388359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc19f3b0 con 0x7f2ddc109170 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.162+0000 7f2ddbfff640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc19ebe0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4005cc0 tx=0x7f2dd402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.162+0000 7f2dd8ff9640 1 -- 172.21.15.2:0/2967388359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4003bf0 con 0x7f2ddc109170 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.162+0000 7f2dd8ff9640 1 -- 172.21.15.2:0/2967388359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd4003d90 con 0x7f2ddc109170 2024-09-10T23:35:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.162+0000 7f2dd8ff9640 1 -- 172.21.15.2:0/2967388359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd402fb20 con 0x7f2ddc109170 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.162+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc19f640 con 0x7f2ddc109170 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.162+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc1a5d60 con 0x7f2ddc109170 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.164+0000 7f2dd8ff9640 1 -- 172.21.15.2:0/2967388359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2dd4004580 con 0x7f2ddc109170 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.164+0000 7f2de4178740 1 Processor -- start 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 -- start start 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70d9e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9e800 0x555c70dae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70daeba0 0x555c70db0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c70d14e60 con 0x555c70daeba0 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555c70d04290 con 0x555c70d9e800 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2de4178740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555c70d080a0 con 0x555c70d9dee0 2024-09-10T23:35:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70daeba0 0x555c70db0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70daeba0 0x555c70db0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57412/0 (socket says 172.21.15.2:57412) 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddaffd640 1 -- 172.21.15.2:0/1970432000 learned_addr learned my addr 172.21.15.2:0/1970432000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9e800 0x555c70dae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70d9e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2dd8ff9640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2dc80b52e0 0x7f2dc80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1970432000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 msgr2=0x555c70d9e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70d9e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1970432000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70daeba0 msgr2=0x555c70db0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70daeba0 0x555c70db0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1970432000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c70a62930 con 0x555c70d9e800 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.165+0000 7f2ddbfff640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2dc80b52e0 0x7f2dc80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.166+0000 7f2dd8ff9640 1 -- 172.21.15.2:0/2967388359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2dd4106f30 con 0x7f2ddc109170 2024-09-10T23:35:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.166+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9e800 0x555c70dae660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc004630 tx=0x7f2dcc00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=413a8dbc517575d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.166+0000 7f2dd1ffb640 1 -- 172.21.15.2:0/1970432000 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc003b50 con 0x555c70d9e800 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.166+0000 7f2ddbfff640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2dc80b52e0 0x7f2dc80b77a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40cd630 tx=0x7f2dd4091e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.166+0000 7f2dd1ffb640 1 -- 172.21.15.2:0/1970432000 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dcc015070 con 0x555c70d9e800 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.166+0000 7f2dd1ffb640 1 -- 172.21.15.2:0/1970432000 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc004be0 con 0x555c70d9e800 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 -- 172.21.15.2:0/1970432000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9e800 msgr2=0x555c70dae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9e800 0x555c70dae660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc004630 tx=0x7f2dcc00bb20 comp rx=0 tx=0).stop 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 -- 172.21.15.2:0/1970432000 shutdown_connections 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70daeba0 0x555c70db0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9e800 0x555c70dae660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 --2- 172.21.15.2:0/1970432000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70d9e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 -- 172.21.15.2:0/1970432000 >> 172.21.15.2:0/1970432000 conn(0x555c70d9bd10 msgr2=0x555c70d9ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 -- 172.21.15.2:0/1970432000 shutdown_connections 2024-09-10T23:35:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 -- 172.21.15.2:0/1970432000 wait complete. 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 -- start start 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.167+0000 7f2de4178740 1 Processor -- start 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9dee0 0x555c70dabb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70dac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70daeba0 0x555c70dac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c70b65890 con 0x555c70d9e800 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555c70c9ed40 con 0x555c70d9dee0 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555c70db1850 con 0x555c70daeba0 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 10 client.0 _ll_register_callbacks cb 0x555c70d02c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70dac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70dac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57424/0 (socket says 172.21.15.2:57424) 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1433124267 learned_addr learned my addr 172.21.15.2:0/1433124267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9dee0 0x555c70dabb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70daeba0 0x555c70dac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70daeba0 msgr2=0x555c70dac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70daeba0 0x555c70dac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1433124267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9dee0 msgr2=0x555c70dabb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9dee0 0x555c70dabb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/1433124267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c70dbac00 con 0x555c70d9e800 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70daeba0 0x555c70dac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70dac080 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc005cd0 tx=0x7f2dcc00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5839f1eb27b5148 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2dbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2dbaffd640 1 -- 172.21.15.2:0/1433124267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc028060 con 0x555c70d9e800 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2dbaffd640 1 -- 172.21.15.2:0/1433124267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2dcc011640 con 0x555c70d9e800 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.168+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dcc015070 con 0x555c70d9e800 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2dbaffd640 1 -- 172.21.15.2:0/1433124267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2dcc003ea0 con 0x555c70d9e800 2024-09-10T23:35:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 10 client.19386 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c70dbd5b0 con 0x555c70d9e800 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2dbaffd640 1 -- 172.21.15.2:0/1433124267 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dcc015070 con 0x555c70d9e800 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2dbaffd640 1 -- 172.21.15.2:0/1433124267 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2dcc022070 con 0x555c70d9e800 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 10 client.19386 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 10 client.19386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 20 client.19386 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70dbea10 0x555c70dc0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 4 client.19386 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c70d16db0 con 0x555c70dbea10 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.169+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70dbea10 0x555c70dc0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.170+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70dbea10 0x555c70dc0e00 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30bc34d46570b837 server_cookie=c64f3f4be04f08a in_seq=0 out_seq=0 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.170+0000 7f2dbaffd640 10 client.19386 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.170+0000 7f2dbaffd640 1 -- 172.21.15.2:0/1433124267 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c70d16db0 con 0x555c70dbea10 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.170+0000 7f2dbaffd640 10 client.19386 handle_command_reply: tid=0 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.170+0000 7f2de4178740 1 client.19386 shutdown 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 msgr2=0x555c70dac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70dac080 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc005cd0 tx=0x7f2dcc00bfa0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 shutdown_connections 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70dbea10 0x555c70dc0e00 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70daeba0 0x555c70dac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70dac080 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2dbaffd640 0 client.19386 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 --2- 172.21.15.2:0/1433124267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70d9dee0 0x555c70dabb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 >> 172.21.15.2:0/1433124267 conn(0x555c70d9bd10 msgr2=0x555c70d9af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 shutdown_connections 2024-09-10T23:35:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 1 -- 172.21.15.2:0/1433124267 wait complete. 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.171+0000 7f2de4178740 20 client.19386 trim_cache size 0 max 16384 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 Processor -- start 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 -- start start 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70da9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70daa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70daa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1ac120 con 0x555c70d9e800 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1adc60 con 0x555c70daeba0 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2de4178740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1ac7f0 con 0x555c70d9dee0 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70daa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70daa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57426/0 (socket says 172.21.15.2:57426) 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/2674132234 learned_addr learned my addr 172.21.15.2:0/2674132234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70da9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70daa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/2674132234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 msgr2=0x555c70da9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70da9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/2674132234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 msgr2=0x555c70daa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70daa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 -- 172.21.15.2:0/2674132234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c70d9d8c0 con 0x555c70d9e800 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70da9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.189+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70daa3e0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00bb60 tx=0x7f2dcc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89645bd192011788 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2dd17fa640 1 -- 172.21.15.2:0/2674132234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc033030 con 0x555c70d9e800 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2dd17fa640 1 -- 172.21.15.2:0/2674132234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dcc015070 con 0x555c70d9e800 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2dd17fa640 1 -- 172.21.15.2:0/2674132234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc028070 con 0x555c70d9e800 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 -- 172.21.15.2:0/2674132234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 msgr2=0x555c70daa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70daa3e0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00bb60 tx=0x7f2dcc004290 comp rx=0 tx=0).stop 2024-09-10T23:35:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 -- 172.21.15.2:0/2674132234 shutdown_connections 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70daa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9e800 0x555c70daa3e0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 --2- 172.21.15.2:0/2674132234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9dee0 0x555c70da9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 -- 172.21.15.2:0/2674132234 >> 172.21.15.2:0/2674132234 conn(0x555c70d9bd10 msgr2=0x555c70d9cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 -- 172.21.15.2:0/2674132234 shutdown_connections 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.190+0000 7f2de4178740 1 -- 172.21.15.2:0/2674132234 wait complete. 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 -- start start 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 Processor -- start 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 0x555c70dc62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9e800 0x555c70dc67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70dc6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1ad590 con 0x555c70d9dee0 2024-09-10T23:35:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1acec0 con 0x555c70daeba0 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1aa100 con 0x555c70d9e800 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2de4178740 10 client.0 _ll_register_callbacks cb 0x7f2dc400aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2ddaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 0x555c70dc62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2ddaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 0x555c70dc62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57438/0 (socket says 172.21.15.2:57438) 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.191+0000 7f2ddaffd640 1 -- 172.21.15.2:0/3763429324 learned_addr learned my addr 172.21.15.2:0/3763429324 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9e800 0x555c70dc67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddaffd640 1 -- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9e800 msgr2=0x555c70dc67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9e800 0x555c70dc67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddaffd640 1 -- 172.21.15.2:0/3763429324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 msgr2=0x555c70dc6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70dc6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddaffd640 1 -- 172.21.15.2:0/3763429324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c70db6260 con 0x555c70d9dee0 2024-09-10T23:35:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2ddaffd640 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 0x555c70dc62b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400afd0 tx=0x7f2dc4011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a9155648ccccf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2dbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2dbaffd640 1 -- 172.21.15.2:0/3763429324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc402e030 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2dbaffd640 1 -- 172.21.15.2:0/3763429324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2dc401a040 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dcc015070 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2dbaffd640 1 -- 172.21.15.2:0/3763429324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2dc4024730 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2de4178740 10 client.19392 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.192+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c70e2b9f0 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2dbaffd640 1 -- 172.21.15.2:0/3763429324 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dcc015070 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2dbaffd640 1 -- 172.21.15.2:0/3763429324 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2dc4021af0 con 0x555c70d9dee0 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2de4178740 10 client.19392 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2de4178740 10 client.19392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2de4178740 20 client.19392 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2de4178740 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70e2c180 0x555c70e2e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2de4178740 4 client.19392 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:35:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555c70d12860 con 0x555c70e2c180 2024-09-10T23:35:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.193+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70e2c180 0x555c70e2e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.194+0000 7f2ddb7fe640 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70e2c180 0x555c70e2e5a0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99be048cad7b037 server_cookie=22fbe6b503dff681 in_seq=0 out_seq=0 2024-09-10T23:35:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.194+0000 7f2dbaffd640 10 client.19392 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2dbaffd640 1 -- 172.21.15.2:0/3763429324 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555c70d12860 con 0x555c70e2c180 2024-09-10T23:35:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2dbaffd640 10 client.19392 handle_command_reply: tid=0 2024-09-10T23:35:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2de4178740 1 client.19392 shutdown 2024-09-10T23:35:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 msgr2=0x555c70dc62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2de4178740 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 0x555c70dc62b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400afd0 tx=0x7f2dc4011920 comp rx=0 tx=0).stop 2024-09-10T23:35:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 shutdown_connections 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.195+0000 7f2de4178740 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x555c70e2c180 0x555c70e2e5a0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c70daeba0 0x555c70dc6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c70d9e800 0x555c70dc67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2dbaffd640 0 client.19392 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 1 --2- 172.21.15.2:0/3763429324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c70d9dee0 0x555c70dc62b0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 >> 172.21.15.2:0/3763429324 conn(0x555c70d9bd10 msgr2=0x555c70d9c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 shutdown_connections 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 1 -- 172.21.15.2:0/3763429324 wait complete. 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de4178740 20 client.19392 trim_cache size 0 max 16384 2024-09-10T23:35:21.211 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:35:21.212 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-10T23:35:21.212 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b", 2024-09-10T23:35:21.212 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-10T23:35:21.212 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:35:21.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2dc80b52e0 msgr2=0x7f2dc80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de1da3640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2dc80b52e0 0x7f2dc80b77a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40cd630 tx=0x7f2dd4091e70 comp rx=0 tx=0).stop 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 msgr2=0x7f2ddc19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de1da3640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc19ebe0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4005cc0 tx=0x7f2dd402f380 comp rx=0 tx=0).stop 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.196+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 shutdown_connections 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2dc80b52e0 0x7f2dc80b77a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc109170 0x7f2ddc19ebe0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ddc1087f0 0x7f2ddc199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 --2- 172.21.15.2:0/2967388359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ddc102de0 0x7f2ddc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 >> 172.21.15.2:0/2967388359 conn(0x7f2ddc0fe830 msgr2=0x7f2ddc104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 shutdown_connections 2024-09-10T23:35:21.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:21.197+0000 7f2de1da3640 1 -- 172.21.15.2:0/2967388359 wait complete. 2024-09-10T23:35:21.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:21 smithi002 ceph-mon[31150]: pgmap v682: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:35:21.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:21 smithi002 ceph-mon[31150]: scrub queued for path: / 2024-09-10T23:35:21.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:35:21.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:21 smithi002 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-10T23:35:21.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:21 smithi002 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-10T23:35:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:21 smithi177 ceph-mon[35760]: pgmap v682: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:35:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:21 smithi177 ceph-mon[35760]: scrub queued for path: / 2024-09-10T23:35:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:35:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:21 smithi177 ceph-mon[35760]: scrub summary: active paths [/] 2024-09-10T23:35:21.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:21 smithi177 ceph-mon[35760]: scrub summary: idle+waiting paths [/] 2024-09-10T23:35:22.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:35:22.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:21 smithi154 ceph-mon[35136]: pgmap v682: 97 pgs: 97 active+clean; 4.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T23:35:22.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:21 smithi154 ceph-mon[35136]: scrub queued for path: / 2024-09-10T23:35:22.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:35:22.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:21 smithi154 ceph-mon[35136]: scrub summary: active paths [/] 2024-09-10T23:35:22.030 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:21 smithi154 ceph-mon[35136]: scrub summary: idle+waiting paths [/] 2024-09-10T23:35:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 -- 172.21.15.2:0/1455127262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f48104570 msgr2=0x7f2f4810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/1455127262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f48104570 0x7f2f4810cb50 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009900 tx=0x7f2f3002a410 comp rx=0 tx=0).stop 2024-09-10T23:35:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 -- 172.21.15.2:0/1455127262 shutdown_connections 2024-09-10T23:35:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/1455127262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f4810d120 0x7f2f4810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/1455127262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f48104570 0x7f2f4810cb50 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/1455127262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f48103b70 0x7f2f48103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 -- 172.21.15.2:0/1455127262 >> 172.21.15.2:0/1455127262 conn(0x7f2f480fd700 msgr2=0x7f2f480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 -- 172.21.15.2:0/1455127262 shutdown_connections 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.784+0000 7f2f4ce13640 1 -- 172.21.15.2:0/1455127262 wait complete. 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 Processor -- start 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 -- start start 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f48103b70 0x7f2f48199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f48104570 0x7f2f481997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 0x7f2f4819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48112da0 con 0x7f2f4810d120 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48112c20 con 0x7f2f48104570 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4ce13640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48112f20 con 0x7f2f48103b70 2024-09-10T23:35:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 0x7f2f4819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 0x7f2f4819eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57452/0 (socket says 172.21.15.2:57452) 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f46d9d640 1 -- 172.21.15.2:0/2897061272 learned_addr learned my addr 172.21.15.2:0/2897061272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.785+0000 7f2f4659c640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f48103b70 0x7f2f48199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f48104570 0x7f2f481997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f46d9d640 1 -- 172.21.15.2:0/2897061272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f48103b70 msgr2=0x7f2f48199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f46d9d640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f48103b70 0x7f2f48199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f46d9d640 1 -- 172.21.15.2:0/2897061272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f48104570 msgr2=0x7f2f481997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f46d9d640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f48104570 0x7f2f481997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f46d9d640 1 -- 172.21.15.2:0/2897061272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4819f320 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f46d9d640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 0x7f2f4819eb50 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000eaa0 tx=0x7f2f4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f3f7fe640 1 -- 172.21.15.2:0/2897061272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000cdb0 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f3f7fe640 1 -- 172.21.15.2:0/2897061272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f40005020 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4819f610 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f3f7fe640 1 -- 172.21.15.2:0/2897061272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f400116d0 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.786+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f481a5cd0 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 Processor -- start 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f3f7fe640 1 -- 172.21.15.2:0/2897061272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2f4000f040 con 0x7f2f4810d120 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 -- start start 2024-09-10T23:35:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961750a0 0x55cb96175480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb961759c0 0x55cb96181410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 0x55cb96183d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cb960ebe50 con 0x55cb96181950 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cb960db280 con 0x55cb961750a0 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cb960df090 con 0x55cb961759c0 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 0x55cb96183d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 0x55cb96183d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57458/0 (socket says 172.21.15.2:57458) 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f3ffff640 1 -- 172.21.15.2:0/103854793 learned_addr learned my addr 172.21.15.2:0/103854793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.789+0000 7f2f4659c640 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb961759c0 0x55cb96181410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961750a0 0x55cb96175480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 -- 172.21.15.2:0/103854793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb961759c0 msgr2=0x55cb96181410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb961759c0 0x55cb96181410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 -- 172.21.15.2:0/103854793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961750a0 msgr2=0x55cb96175480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961750a0 0x55cb96175480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3f7fe640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f340b52e0 0x7f2f340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 -- 172.21.15.2:0/103854793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb95e39650 con 0x55cb96181950 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f46d9d640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f340b52e0 0x7f2f340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 0x55cb96183d40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009900 tx=0x7f2f30005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98009e684168b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3f7fe640 1 -- 172.21.15.2:0/2897061272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f400e5a00 con 0x7f2f4810d120 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3cff9640 1 -- 172.21.15.2:0/103854793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30043020 con 0x55cb96181950 2024-09-10T23:35:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3cff9640 1 -- 172.21.15.2:0/103854793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f30031720 con 0x55cb96181950 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.790+0000 7f2f3cff9640 1 -- 172.21.15.2:0/103854793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30035040 con 0x55cb96181950 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/103854793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 msgr2=0x55cb96183d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f46d9d640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f340b52e0 0x7f2f340b77a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2f400a9440 tx=0x7f2f400cf040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 0x55cb96183d40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009900 tx=0x7f2f30005b50 comp rx=0 tx=0).stop 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/103854793 shutdown_connections 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb96181950 0x55cb96183d40 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb961759c0 0x55cb96181410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/103854793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961750a0 0x55cb96175480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/103854793 >> 172.21.15.2:0/103854793 conn(0x55cb96172ed0 msgr2=0x55cb96174070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/103854793 shutdown_connections 2024-09-10T23:35:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/103854793 wait complete. 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.791+0000 7f2f4f1e8740 1 -- start start 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 Processor -- start 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96181270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb9617ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cb95f3c700 con 0x55cb961750a0 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cb96076110 con 0x55cb961759c0 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cb96184570 con 0x55cb96181950 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4f1e8740 10 client.0 _ll_register_callbacks cb 0x55cb9608f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96181270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96181270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57472/0 (socket says 172.21.15.2:57472) 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3897796293 learned_addr learned my addr 172.21.15.2:0/3897796293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f4659c640 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 msgr2=0x55cb9617ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb9617ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3897796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 msgr2=0x55cb9617e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3897796293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb960a3c40 con 0x55cb961750a0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96181270 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2f3002a930 tx=0x7f2f300053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb15861117d682a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.792+0000 7f2f2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f2dffb640 1 -- 172.21.15.2:0/3897796293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3004d020 con 0x55cb961750a0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f2dffb640 1 -- 172.21.15.2:0/3897796293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f30004460 con 0x55cb961750a0 2024-09-10T23:35:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f30031720 con 0x55cb961750a0 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f2dffb640 1 -- 172.21.15.2:0/3897796293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f30035070 con 0x55cb961750a0 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 10 client.19404 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb9618ff30 con 0x55cb961750a0 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f2dffb640 1 -- 172.21.15.2:0/3897796293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f30031720 con 0x55cb961750a0 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f2dffb640 1 -- 172.21.15.2:0/3897796293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f3003a040 con 0x55cb961750a0 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 10 client.19404 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 10 client.19404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 20 client.19404 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb96191280 0x55cb96193670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 4 client.19404 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.793+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb960edda0 con 0x55cb96191280 2024-09-10T23:35:22.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.794+0000 7f2f4659c640 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb96191280 0x55cb96193670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.794+0000 7f2f4659c640 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb96191280 0x55cb96193670 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b86902890aa9a0f3 server_cookie=2d11f8af3974211d in_seq=0 out_seq=0 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.794+0000 7f2f2dffb640 10 client.19404 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f2dffb640 1 -- 172.21.15.2:0/3897796293 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb960edda0 con 0x55cb96191280 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f2dffb640 10 client.19404 handle_command_reply: tid=0 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 client.19404 shutdown 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 msgr2=0x55cb96181270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96181270 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2f3002a930 tx=0x7f2f300053c0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 shutdown_connections 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb96191280 0x55cb96193670 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb9617ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3897796293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96181270 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 >> 172.21.15.2:0/3897796293 conn(0x55cb96172ed0 msgr2=0x55cb96178a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:22.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f2dffb640 0 client.19404 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:22.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 shutdown_connections 2024-09-10T23:35:22.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3897796293 wait complete. 2024-09-10T23:35:22.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.795+0000 7f2f4f1e8740 20 client.19404 trim_cache size 0 max 16384 2024-09-10T23:35:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 Processor -- start 2024-09-10T23:35:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 -- start start 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb9618d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb9617da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481ae340 con 0x55cb961750a0 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481afe80 con 0x55cb961759c0 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481aea10 con 0x55cb96181950 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb9618d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb9618d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57474/0 (socket says 172.21.15.2:57474) 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3293453694 learned_addr learned my addr 172.21.15.2:0/3293453694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4659c640 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3293453694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 msgr2=0x55cb9617da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb9617da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3293453694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 msgr2=0x55cb9617d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f3ffff640 1 -- 172.21.15.2:0/3293453694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9617f060 con 0x55cb961750a0 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.813+0000 7f2f4659c640 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb9618d870 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2f30032af0 tx=0x7f2f30004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e476c9e153a83a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f2ffff640 1 -- 172.21.15.2:0/3293453694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30061070 con 0x55cb961750a0 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f2ffff640 1 -- 172.21.15.2:0/3293453694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f30004c10 con 0x55cb961750a0 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f2ffff640 1 -- 172.21.15.2:0/3293453694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3004d070 con 0x55cb961750a0 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3293453694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 msgr2=0x55cb9618d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb9618d870 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2f30032af0 tx=0x7f2f30004b40 comp rx=0 tx=0).stop 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3293453694 shutdown_connections 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb9617da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb9617d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/3293453694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb9618d870 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.814+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3293453694 >> 172.21.15.2:0/3293453694 conn(0x55cb96172ed0 msgr2=0x55cb9617ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3293453694 shutdown_connections 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/3293453694 wait complete. 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 -- start start 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 Processor -- start 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96194590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb96194ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb961fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481af7b0 con 0x55cb961750a0 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481af0e0 con 0x55cb961759c0 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481ac320 con 0x55cb96181950 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f4f1e8740 10 client.0 _ll_register_callbacks cb 0x7f2f3800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96194590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96194590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57476/0 (socket says 172.21.15.2:57476) 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.815+0000 7f2f3ffff640 1 -- 172.21.15.2:0/2695548408 learned_addr learned my addr 172.21.15.2:0/2695548408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f4659c640 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb96194ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f3ffff640 1 -- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 msgr2=0x55cb961fcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb961fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f3ffff640 1 -- 172.21.15.2:0/2695548408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 msgr2=0x55cb96194ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb96194ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f3ffff640 1 -- 172.21.15.2:0/2695548408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb961fd330 con 0x55cb961750a0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f3ffff640 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96194590 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f2f300059d0 tx=0x7f2f3002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8293d4ef64b6fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f2dffb640 1 -- 172.21.15.2:0/2695548408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30061070 con 0x55cb961750a0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f2dffb640 1 -- 172.21.15.2:0/2695548408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2f30031a40 con 0x55cb961750a0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f30004c10 con 0x55cb961750a0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f2dffb640 1 -- 172.21.15.2:0/2695548408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f3004d030 con 0x55cb961750a0 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f4f1e8740 10 client.19410 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb961fe490 con 0x55cb961750a0 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.816+0000 7f2f2dffb640 1 -- 172.21.15.2:0/2695548408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f30004c10 con 0x55cb961750a0 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f2dffb640 1 -- 172.21.15.2:0/2695548408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f3005b030 con 0x55cb961750a0 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4f1e8740 10 client.19410 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4f1e8740 10 client.19410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4f1e8740 20 client.19410 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb961fe910 0x55cb96200d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4f1e8740 4 client.19410 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb960e9850 con 0x55cb961fe910 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.817+0000 7f2f4659c640 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb961fe910 0x55cb96200d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4659c640 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb961fe910 0x55cb96200d00 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcdc46900fcbca4f server_cookie=ef30343acead118a in_seq=0 out_seq=0 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f2dffb640 10 client.19410 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f2dffb640 1 -- 172.21.15.2:0/2695548408 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6818 (crc 0 0 0) 0x55cb960e9850 con 0x55cb961fe910 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f2dffb640 10 client.19410 handle_command_reply: tid=0 2024-09-10T23:35:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 client.19410 shutdown 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 msgr2=0x55cb96194590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96194590 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f2f300059d0 tx=0x7f2f3002a410 comp rx=0 tx=0).stop 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 shutdown_connections 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x55cb961fe910 0x55cb96200d00 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cb96181950 0x55cb961fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb961759c0 0x55cb96194ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 --2- 172.21.15.2:0/2695548408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb961750a0 0x55cb96194590 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 >> 172.21.15.2:0/2695548408 conn(0x55cb96172ed0 msgr2=0x55cb9617d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f2dffb640 0 client.19410 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 shutdown_connections 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 1 -- 172.21.15.2:0/2695548408 wait complete. 2024-09-10T23:35:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.818+0000 7f2f4f1e8740 20 client.19410 trim_cache size 0 max 16384 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: "e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b": { 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b", 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:22.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf": { 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:35.019977+0000", 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "7781c901-0381-483c-8ccc-ce03feed1938": { 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:07.192812+0000", 2024-09-10T23:35:22.834 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.835 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:35:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.838 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.839 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:35:22.840 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.842 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.843 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.844 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "bd71323f-7f21-4089-95dd-059cf2b66179": { 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:21.624379+0000", 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b": { 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:35:21.194589+0000", 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f340b52e0 msgr2=0x7f2f340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f340b52e0 0x7f2f340b77a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2f400a9440 tx=0x7f2f400cf040 comp rx=0 tx=0).stop 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 msgr2=0x7f2f4819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 0x7f2f4819eb50 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000eaa0 tx=0x7f2f4000ef60 comp rx=0 tx=0).stop 2024-09-10T23:35:22.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 shutdown_connections 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2f340b52e0 0x7f2f340b77a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4810d120 0x7f2f4819eb50 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f48104570 0x7f2f481997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 --2- 172.21.15.2:0/2897061272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f48103b70 0x7f2f48199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 >> 172.21.15.2:0/2897061272 conn(0x7f2f480fd700 msgr2=0x7f2f480fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 shutdown_connections 2024-09-10T23:35:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:22.819+0000 7f2f4ce13640 1 -- 172.21.15.2:0/2897061272 wait complete. 2024-09-10T23:35:23.654 INFO:tasks.cephfs.filesystem:scrub status for tag:e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b - {'path': '/', 'tag': 'e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b', 'options': 'recursive,force'} 2024-09-10T23:35:23.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:23 smithi177 ceph-mon[35760]: pgmap v683: 97 pgs: 97 active+clean; 4.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:23.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:23 smithi177 ceph-mon[35760]: scrub summary: idle 2024-09-10T23:35:23.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:23 smithi002 ceph-mon[31150]: pgmap v683: 97 pgs: 97 active+clean; 4.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:23.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:23 smithi002 ceph-mon[31150]: scrub summary: idle 2024-09-10T23:35:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:23 smithi154 ceph-mon[35136]: pgmap v683: 97 pgs: 97 active+clean; 4.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-10T23:35:24.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:23 smithi154 ceph-mon[35136]: scrub summary: idle 2024-09-10T23:35:25.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:25 smithi177 ceph-mon[35760]: pgmap v684: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:35:25.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:25 smithi002 ceph-mon[31150]: pgmap v684: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:35:26.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:25 smithi154 ceph-mon[35136]: pgmap v684: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:35:27.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:27 smithi177 ceph-mon[35760]: pgmap v685: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:35:27.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:27 smithi002 ceph-mon[31150]: pgmap v685: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:35:28.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:27 smithi154 ceph-mon[35136]: pgmap v685: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-09-10T23:35:29.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:29 smithi177 ceph-mon[35760]: pgmap v686: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 20 op/s 2024-09-10T23:35:29.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:29 smithi002 ceph-mon[31150]: pgmap v686: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 20 op/s 2024-09-10T23:35:30.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:29 smithi154 ceph-mon[35136]: pgmap v686: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 20 op/s 2024-09-10T23:35:31.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:31 smithi177 ceph-mon[35760]: pgmap v687: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2024-09-10T23:35:31.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:31 smithi002 ceph-mon[31150]: pgmap v687: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2024-09-10T23:35:32.028 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:31 smithi154 ceph-mon[35136]: pgmap v687: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2024-09-10T23:35:33.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:33 smithi177 ceph-mon[35760]: pgmap v688: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.9 KiB/s wr, 17 op/s 2024-09-10T23:35:33.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:33 smithi002 ceph-mon[31150]: pgmap v688: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.9 KiB/s wr, 17 op/s 2024-09-10T23:35:34.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:33 smithi154 ceph-mon[35136]: pgmap v688: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.9 KiB/s wr, 17 op/s 2024-09-10T23:35:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: pgmap v689: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-10T23:35:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:35 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: pgmap v689: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:35.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:35 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: pgmap v689: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:35 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:36.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:36.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:36.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:36.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:36.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:37.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:35:38.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:37 smithi154 ceph-mon[35136]: pgmap v690: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-10T23:35:38.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:37 smithi177 ceph-mon[35760]: pgmap v690: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-10T23:35:38.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:37 smithi002 ceph-mon[31150]: pgmap v690: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-10T23:35:40.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:39 smithi154 ceph-mon[35136]: pgmap v691: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-10T23:35:40.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:39 smithi177 ceph-mon[35760]: pgmap v691: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-10T23:35:40.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:39 smithi002 ceph-mon[31150]: pgmap v691: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-10T23:35:42.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:41 smithi154 ceph-mon[35136]: pgmap v692: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:35:42.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:41 smithi177 ceph-mon[35760]: pgmap v692: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:35:42.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:41 smithi002 ceph-mon[31150]: pgmap v692: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T23:35:44.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:43 smithi154 ceph-mon[35136]: pgmap v693: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T23:35:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:43 smithi177 ceph-mon[35760]: pgmap v693: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T23:35:44.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:43 smithi002 ceph-mon[31150]: pgmap v693: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T23:35:46.029 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:45 smithi154 ceph-mon[35136]: pgmap v694: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T23:35:46.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:45 smithi177 ceph-mon[35760]: pgmap v694: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T23:35:46.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:45 smithi002 ceph-mon[31150]: pgmap v694: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T23:35:48.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:47 smithi177 ceph-mon[35760]: pgmap v695: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T23:35:48.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:47 smithi002 ceph-mon[31150]: pgmap v695: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T23:35:48.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:47 smithi154 ceph-mon[35136]: pgmap v695: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T23:35:50.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:49 smithi177 ceph-mon[35760]: pgmap v696: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T23:35:50.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:49 smithi002 ceph-mon[31150]: pgmap v696: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T23:35:50.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:49 smithi154 ceph-mon[35136]: pgmap v696: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T23:35:52.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:51 smithi177 ceph-mon[35760]: pgmap v697: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:35:52.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:51 smithi002 ceph-mon[31150]: pgmap v697: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:35:52.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:51 smithi154 ceph-mon[35136]: pgmap v697: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:35:53.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:35:53.930 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:53.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:53 smithi002 ceph-mon[31150]: pgmap v698: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:35:54.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:53 smithi177 ceph-mon[35760]: pgmap v698: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:35:54.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:53 smithi154 ceph-mon[35136]: pgmap v698: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 -- 172.21.15.2:0/3613948959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 msgr2=0x7f21b0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/3613948959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b0107ae0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2198009900 tx=0x7f219802a410 comp rx=0 tx=0).stop 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 -- 172.21.15.2:0/3613948959 shutdown_connections 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/3613948959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21b0108020 0x7f21b010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/3613948959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b0107ae0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/3613948959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21b0101c90 0x7f21b0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 -- 172.21.15.2:0/3613948959 >> 172.21.15.2:0/3613948959 conn(0x7f21b00fd700 msgr2=0x7f21b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 -- 172.21.15.2:0/3613948959 shutdown_connections 2024-09-10T23:35:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.505+0000 7f21b4ca7640 1 -- 172.21.15.2:0/3613948959 wait complete. 2024-09-10T23:35:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 Processor -- start 2024-09-10T23:35:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 -- start start 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21b0101c90 0x7f21b01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b01997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21b0108020 0x7f21b019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0112dc0 con 0x7f21b01076a0 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0112c40 con 0x7f21b0101c90 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21b4ca7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0112f40 con 0x7f21b0108020 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b01997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b01997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59608/0 (socket says 172.21.15.2:59608) 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21add9b640 1 -- 172.21.15.2:0/2803849457 learned_addr learned my addr 172.21.15.2:0/2803849457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.506+0000 7f21ae59c640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21b0101c90 0x7f21b01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21add9b640 1 -- 172.21.15.2:0/2803849457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21b0108020 msgr2=0x7f21b019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21add9b640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21b0108020 0x7f21b019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21add9b640 1 -- 172.21.15.2:0/2803849457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21b0101c90 msgr2=0x7f21b01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21add9b640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21b0101c90 0x7f21b01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21add9b640 1 -- 172.21.15.2:0/2803849457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b019f360 con 0x7f21b01076a0 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21add9b640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b01997f0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f2198005940 tx=0x7f21980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21a77fe640 1 -- 172.21.15.2:0/2803849457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219803f030 con 0x7f21b01076a0 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21a77fe640 1 -- 172.21.15.2:0/2803849457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2198003cb0 con 0x7f21b01076a0 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21a77fe640 1 -- 172.21.15.2:0/2803849457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198035070 con 0x7f21b01076a0 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b019f5f0 con 0x7f21b01076a0 2024-09-10T23:35:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.507+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b01a5d10 con 0x7f21b01076a0 2024-09-10T23:35:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 Processor -- start 2024-09-10T23:35:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21a77fe640 1 -- 172.21.15.2:0/2803849457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f219803bbf0 con 0x7f21b01076a0 2024-09-10T23:35:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 -- start start 2024-09-10T23:35:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56535f82ee50 con 0x56535f8b8da0 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56535f81e280 con 0x56535f8b8480 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21b707c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56535f822090 con 0x56535f8c4d30 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.510+0000 7f21ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59616/0 (socket says 172.21.15.2:59616) 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 -- 172.21.15.2:0/3530775029 learned_addr learned my addr 172.21.15.2:0/3530775029 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21aed9d640 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21add9b640 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 -- 172.21.15.2:0/3530775029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 msgr2=0x56535f8c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 -- 172.21.15.2:0/3530775029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 msgr2=0x56535f8b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 -- 172.21.15.2:0/3530775029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56535f57c650 con 0x56535f8b8da0 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21a77fe640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f219c0b5360 0x7f219c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21ae59c640 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8c47f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f21a800ac20 tx=0x7f21a800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3039967168dd82e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21aed9d640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f219c0b5360 0x7f219c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21a77fe640 1 -- 172.21.15.2:0/2803849457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21981066c0 con 0x7f21b01076a0 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21a4ff9640 1 -- 172.21.15.2:0/3530775029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a801d070 con 0x56535f8b8da0 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21a4ff9640 1 -- 172.21.15.2:0/3530775029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21a8018af0 con 0x56535f8b8da0 2024-09-10T23:35:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.511+0000 7f21a4ff9640 1 -- 172.21.15.2:0/3530775029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8010ab0 con 0x56535f8b8da0 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 -- 172.21.15.2:0/3530775029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 msgr2=0x56535f8c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21aed9d640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f219c0b5360 0x7f219c0b7820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009270 tx=0x7f21a00095e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8c47f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f21a800ac20 tx=0x7f21a800f790 comp rx=0 tx=0).stop 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 -- 172.21.15.2:0/3530775029 shutdown_connections 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8c47f0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 --2- 172.21.15.2:0/3530775029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 -- 172.21.15.2:0/3530775029 >> 172.21.15.2:0/3530775029 conn(0x56535f8b62b0 msgr2=0x56535f8b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 -- 172.21.15.2:0/3530775029 shutdown_connections 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.512+0000 7f21b707c740 1 -- 172.21.15.2:0/3530775029 wait complete. 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 -- start start 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 Processor -- start 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8da0 0x56535f8c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56535f67f700 con 0x56535f8c4d30 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56535f7b9110 con 0x56535f8b8480 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56535f8c79b0 con 0x56535f8b8da0 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21b707c740 10 client.0 _ll_register_callbacks cb 0x56535f7d2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59626/0 (socket says 172.21.15.2:59626) 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21aed9d640 1 -- 172.21.15.2:0/2402834104 learned_addr learned my addr 172.21.15.2:0/2402834104 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21ae59c640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.513+0000 7f21add9b640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8da0 0x56535f8c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21aed9d640 1 -- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8da0 msgr2=0x56535f8c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21aed9d640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8da0 0x56535f8c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21aed9d640 1 -- 172.21.15.2:0/2402834104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 msgr2=0x56535f8c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21aed9d640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21aed9d640 1 -- 172.21.15.2:0/2402834104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56535f7e6c40 con 0x56535f8c4d30 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21aed9d640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c1f70 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f21a00127b0 tx=0x7f21a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36014a95458aca69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f2195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f2195ffb640 1 -- 172.21.15.2:0/2402834104 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0003b70 con 0x56535f8c4d30 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f2195ffb640 1 -- 172.21.15.2:0/2402834104 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21a0003d10 con 0x56535f8c4d30 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a8018af0 con 0x56535f8c4d30 2024-09-10T23:35:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f2195ffb640 1 -- 172.21.15.2:0/2402834104 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21a0004b20 con 0x56535f8c4d30 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21b707c740 10 client.19422 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56535f8d32c0 con 0x56535f8c4d30 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.514+0000 7f2195ffb640 1 -- 172.21.15.2:0/2402834104 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21a8018af0 con 0x56535f8c4d30 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f2195ffb640 1 -- 172.21.15.2:0/2402834104 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21a000f040 con 0x56535f8c4d30 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21b707c740 10 client.19422 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21b707c740 10 client.19422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21b707c740 20 client.19422 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21b707c740 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f8d4780 0x56535f8d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21b707c740 4 client.19422 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56535f830da0 con 0x56535f8d4780 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21ae59c640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f8d4780 0x56535f8d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f21ae59c640 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f8d4780 0x56535f8d6bc0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93fecca1aa602e88 server_cookie=e1ce81c0721a7b41 in_seq=0 out_seq=0 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.515+0000 7f2195ffb640 10 client.19422 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f2195ffb640 1 -- 172.21.15.2:0/2402834104 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56535f830da0 con 0x56535f8d4780 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f2195ffb640 10 client.19422 handle_command_reply: tid=0 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 client.19422 shutdown 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 msgr2=0x56535f8c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c1f70 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f21a00127b0 tx=0x7f21a0004a40 comp rx=0 tx=0).stop 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 shutdown_connections 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f8d4780 0x56535f8d6bc0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c1f70 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8da0 0x56535f8c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 --2- 172.21.15.2:0/2402834104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 >> 172.21.15.2:0/2402834104 conn(0x56535f8b62b0 msgr2=0x56535f8bbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.516+0000 7f2195ffb640 0 client.19422 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.517+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 shutdown_connections 2024-09-10T23:35:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.517+0000 7f21b707c740 1 -- 172.21.15.2:0/2402834104 wait complete. 2024-09-10T23:35:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.517+0000 7f21b707c740 20 client.19422 trim_cache size 0 max 16384 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 Processor -- start 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 -- start start 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01ae370 con 0x56535f8b8da0 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01afeb0 con 0x56535f8b8480 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21b707c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01aea40 con 0x56535f8c4d30 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59642/0 (socket says 172.21.15.2:59642) 2024-09-10T23:35:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.534+0000 7f21add9b640 1 -- 172.21.15.2:0/3866548701 learned_addr learned my addr 172.21.15.2:0/3866548701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21aed9d640 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21add9b640 1 -- 172.21.15.2:0/3866548701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 msgr2=0x56535f8bcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21add9b640 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8bcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21add9b640 1 -- 172.21.15.2:0/3866548701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 msgr2=0x56535f8d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21add9b640 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21add9b640 1 -- 172.21.15.2:0/3866548701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56535f8c0950 con 0x56535f8b8da0 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21add9b640 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8b7a10 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f21980ca100 tx=0x7f219802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57cbf2aabe4b8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f2197fff640 1 -- 172.21.15.2:0/3866548701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198049040 con 0x56535f8b8da0 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f2197fff640 1 -- 172.21.15.2:0/3866548701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21980cc9a0 con 0x56535f8b8da0 2024-09-10T23:35:54.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f2197fff640 1 -- 172.21.15.2:0/3866548701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21980d6420 con 0x56535f8b8da0 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21b707c740 1 -- 172.21.15.2:0/3866548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 msgr2=0x56535f8b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.535+0000 7f21b707c740 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8b7a10 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f21980ca100 tx=0x7f219802a410 comp rx=0 tx=0).stop 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- 172.21.15.2:0/3866548701 shutdown_connections 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8c4d30 0x56535f8bcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8b8da0 0x56535f8b7a10 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 --2- 172.21.15.2:0/3866548701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8480 0x56535f8d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- 172.21.15.2:0/3866548701 >> 172.21.15.2:0/3866548701 conn(0x56535f8b62b0 msgr2=0x56535f8b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:54.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- 172.21.15.2:0/3866548701 shutdown_connections 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- 172.21.15.2:0/3866548701 wait complete. 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- start start 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 Processor -- start 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8480 0x56535f8cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8da0 0x56535f8c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01af7e0 con 0x56535f8c4d30 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01af110 con 0x56535f8b8da0 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01ac350 con 0x56535f8b8480 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21b707c740 10 client.0 _ll_register_callbacks cb 0x7f21a0009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59648/0 (socket says 172.21.15.2:59648) 2024-09-10T23:35:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21aed9d640 1 -- 172.21.15.2:0/4250881405 learned_addr learned my addr 172.21.15.2:0/4250881405 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.536+0000 7f21add9b640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8da0 0x56535f8c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21ae59c640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8480 0x56535f8cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21aed9d640 1 -- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8480 msgr2=0x56535f8cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21aed9d640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8480 0x56535f8cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21aed9d640 1 -- 172.21.15.2:0/4250881405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8da0 msgr2=0x56535f8c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21aed9d640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8da0 0x56535f8c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21aed9d640 1 -- 172.21.15.2:0/4250881405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56535f8b8bd0 con 0x56535f8c4d30 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21ae59c640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8480 0x56535f8cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21aed9d640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c8140 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f21a00099f0 tx=0x7f21a001d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d314c768a610cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f2195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f2195ffb640 1 -- 172.21.15.2:0/4250881405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a001dbf0 con 0x56535f8c4d30 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f2195ffb640 1 -- 172.21.15.2:0/4250881405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f21a001dd90 con 0x56535f8c4d30 2024-09-10T23:35:54.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21980cc9a0 con 0x56535f8c4d30 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f2195ffb640 1 -- 172.21.15.2:0/4250881405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21a0003970 con 0x56535f8c4d30 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21b707c740 10 client.19428 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.537+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56535f942320 con 0x56535f8c4d30 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f2195ffb640 1 -- 172.21.15.2:0/4250881405 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21980cc9a0 con 0x56535f8c4d30 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f2195ffb640 1 -- 172.21.15.2:0/4250881405 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21a0045020 con 0x56535f8c4d30 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21b707c740 10 client.19428 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21b707c740 10 client.19428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21b707c740 20 client.19428 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21b707c740 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f942af0 0x56535f944f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21b707c740 4 client.19428 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56535f82c850 con 0x56535f942af0 2024-09-10T23:35:54.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.538+0000 7f21ae59c640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f942af0 0x56535f944f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21ae59c640 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f942af0 0x56535f944f10 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e40cb79a6db026c server_cookie=660a19e5aa2d9dc0 in_seq=0 out_seq=0 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f2195ffb640 10 client.19428 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f2195ffb640 1 -- 172.21.15.2:0/4250881405 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x56535f82c850 con 0x56535f942af0 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f2195ffb640 10 client.19428 handle_command_reply: tid=0 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 client.19428 shutdown 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 msgr2=0x56535f8c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c8140 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f21a00099f0 tx=0x7f21a001d940 comp rx=0 tx=0).stop 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 shutdown_connections 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x56535f942af0 0x56535f944f10 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56535f8c4d30 0x56535f8c8140 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56535f8b8da0 0x56535f8c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f2195ffb640 0 client.19428 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 --2- 172.21.15.2:0/4250881405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56535f8b8480 0x56535f8cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 >> 172.21.15.2:0/4250881405 conn(0x56535f8b62b0 msgr2=0x56535f8c3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 shutdown_connections 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 1 -- 172.21.15.2:0/4250881405 wait complete. 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.539+0000 7f21b707c740 20 client.19428 trim_cache size 0 max 16384 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {}, 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_stats": { 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stdout: "7a1946e9-e469-4779-8ba5-3f12ab8dd9bf": { 2024-09-10T23:35:54.547 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:35.019977+0000", 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "7781c901-0381-483c-8ccc-ce03feed1938": { 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:07.192812+0000", 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.548 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "307b0b48-8904-48ca-a507-77002ebac5a2": { 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:21.130192+0000", 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "6587ca4e-8c3a-4a6e-b3a3-e7a40efd4cec": { 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:20.669999+0000", 2024-09-10T23:35:54.549 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "22551de4-dce0-4301-af81-91cac1191329": { 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:32:07.035406+0000", 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "321f56bb-834f-4ce6-8722-b0a77258430e": { 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:06.696217+0000", 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "d286be0d-7f8e-4b41-8c4c-3ae5cc460094": { 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:06.524922+0000", 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.551 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "5ec070e2-21f4-4ff8-b35f-6dee14a62655": { 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:21.643478+0000", 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "954996e6-3229-41a9-9ed5-393c0330a189": { 2024-09-10T23:35:54.552 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:25:35.600067+0000", 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "4ce86e71-3790-4dc4-83b9-c3f2ec6980cd": { 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:33:06.647625+0000", 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.553 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "0a539842-3f91-48e1-8a14-92a99f499a19": { 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:26:20.544745+0000", 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "8337d245-b578-4ff3-bb11-3177035a5f2c": { 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:20.874196+0000", 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "9b301a8d-b45f-42a9-a43f-b6395c81e299": { 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:06.340396+0000", 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "32e5e900-25de-4eae-a23d-81ec44329fc7": { 2024-09-10T23:35:54.555 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:21.168590+0000", 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "d8b58120-d4f2-47b5-930a-fbe4c2c18a91": { 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:24:20.476276+0000", 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.556 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "0020802e-f8b2-4bdc-92e4-b96f6e4fd60a": { 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:27:52.217042+0000", 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "a55e0d40-3ceb-448b-9d62-a8e8528ccc2d": { 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:28:06.821611+0000", 2024-09-10T23:35:54.557 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "6461a3b2-cafe-4c21-a837-2340144cd956": { 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:06.702837+0000", 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "bd71323f-7f21-4089-95dd-059cf2b66179": { 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:34:21.624379+0000", 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "8bf5845a-755e-46de-a436-3072cf7bd949": { 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:29:20.855417+0000", 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.559 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "e60a5cfb-71d4-43b3-8a8f-7ae4cf1bea0b": { 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:35:21.194589+0000", 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "583febb8-d786-4e38-9455-bb4c26027f3e": { 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:31:20.902789+0000", 2024-09-10T23:35:54.560 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "0ac8c6b8-fe2f-4ae7-97f7-91ec4d2dd23b": { 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "start_time": "2024-09-10T23:30:07.017020+0000", 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_passed": 0, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_failed": 0, 2024-09-10T23:35:54.561 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_skipped": 0 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f219c0b5360 msgr2=0x7f219c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f219c0b5360 0x7f219c0b7820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009270 tx=0x7f21a00095e0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 msgr2=0x7f21b01997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b01997f0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f2198005940 tx=0x7f21980042f0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 shutdown_connections 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f219c0b5360 0x7f219c0b7820 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21b0108020 0x7f21b019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b01076a0 0x7f21b01997f0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 --2- 172.21.15.2:0/2803849457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21b0101c90 0x7f21b01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 >> 172.21.15.2:0/2803849457 conn(0x7f21b00fd700 msgr2=0x7f21b00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 shutdown_connections 2024-09-10T23:35:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:54.540+0000 7f21b4ca7640 1 -- 172.21.15.2:0/2803849457 wait complete. 2024-09-10T23:35:55.348 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:35:55.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:35:55.612 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:55.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:55 smithi002 ceph-mon[31150]: pgmap v699: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 -- 172.21.15.2:0/4187774093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf81087d0 msgr2=0x7f1cf8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 --2- 172.21.15.2:0/4187774093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf81087d0 0x7f1cf8108c10 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009900 tx=0x7f1cec02a410 comp rx=0 tx=0).stop 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 -- 172.21.15.2:0/4187774093 shutdown_connections 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 --2- 172.21.15.2:0/4187774093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cf8109150 0x7f1cf810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 --2- 172.21.15.2:0/4187774093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf81087d0 0x7f1cf8108c10 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 --2- 172.21.15.2:0/4187774093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8102dc0 0x7f1cf81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 -- 172.21.15.2:0/4187774093 >> 172.21.15.2:0/4187774093 conn(0x7f1cf80fe830 msgr2=0x7f1cf8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 -- 172.21.15.2:0/4187774093 shutdown_connections 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.109+0000 7f1cfd713640 1 -- 172.21.15.2:0/4187774093 wait complete. 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 Processor -- start 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 -- start start 2024-09-10T23:35:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 0x7f1cf8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cf81087d0 0x7f1cf8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8109150 0x7f1cf819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8112e10 con 0x7f1cf8102dc0 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8112c90 con 0x7f1cf8109150 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cfd713640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8112f90 con 0x7f1cf81087d0 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cf6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 0x7f1cf8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cf6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 0x7f1cf8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59678/0 (socket says 172.21.15.2:59678) 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.110+0000 7f1cf6ffd640 1 -- 172.21.15.2:0/3290032547 learned_addr learned my addr 172.21.15.2:0/3290032547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf67fc640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cf81087d0 0x7f1cf8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf77fe640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8109150 0x7f1cf819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf6ffd640 1 -- 172.21.15.2:0/3290032547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cf81087d0 msgr2=0x7f1cf8199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:56.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf6ffd640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cf81087d0 0x7f1cf8199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf6ffd640 1 -- 172.21.15.2:0/3290032547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8109150 msgr2=0x7f1cf819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf6ffd640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8109150 0x7f1cf819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf6ffd640 1 -- 172.21.15.2:0/3290032547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf819f3d0 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf77fe640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8109150 0x7f1cf819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cf6ffd640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 0x7f1cf8199320 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c890 tx=0x7f1ce800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004220 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce80043c0 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf819f6c0 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004a00 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.111+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf81a5f50 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.112+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf81031a0 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.114+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1ce80079b0 con 0x7f1cf8102dc0 2024-09-10T23:35:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.114+0000 7f1cdffff640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ce00b5360 0x7f1ce00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.115+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1ce80e5d30 con 0x7f1cf8102dc0 2024-09-10T23:35:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.115+0000 7f1cf67fc640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ce00b5360 0x7f1ce00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.115+0000 7f1cf67fc640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ce00b5360 0x7f1ce00b7820 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1cec031440 tx=0x7f1cec0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.117+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1ce8014030 con 0x7f1cf8102dc0 2024-09-10T23:35:56.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:55 smithi177 ceph-mon[35760]: pgmap v699: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:35:56.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:55 smithi154 ceph-mon[35136]: pgmap v699: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:35:56.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.342+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cf819a450 con 0x7f1cf8102dc0 2024-09-10T23:35:56.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.343+0000 7f1cdffff640 1 -- 172.21.15.2:0/3290032547 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f1ce80acc80 con 0x7f1cf8102dc0 2024-09-10T23:35:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:35:56.345 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:35:56.345 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:35:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ce00b5360 msgr2=0x7f1ce00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ce00b5360 0x7f1ce00b7820 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1cec031440 tx=0x7f1cec0095f0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 msgr2=0x7f1cf8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:56.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 0x7f1cf8199320 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c890 tx=0x7f1ce800cd50 comp rx=0 tx=0).stop 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 shutdown_connections 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1ce00b5360 0x7f1ce00b7820 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf8109150 0x7f1cf819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cf81087d0 0x7f1cf8199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 --2- 172.21.15.2:0/3290032547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf8102dc0 0x7f1cf8199320 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.345+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 >> 172.21.15.2:0/3290032547 conn(0x7f1cf80fe830 msgr2=0x7f1cf8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.346+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 shutdown_connections 2024-09-10T23:35:56.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:56.346+0000 7f1cfd713640 1 -- 172.21.15.2:0/3290032547 wait complete. 2024-09-10T23:35:56.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:56 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3290032547' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:35:57.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T23:35:57.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:56 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3290032547' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:35:57.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:56 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3290032547' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:35:57.421 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 -- 172.21.15.2:0/2026238989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 msgr2=0x7f49a410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/2026238989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a410f950 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ca0 tx=0x7f499402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 -- 172.21.15.2:0/2026238989 shutdown_connections 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/2026238989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a410f950 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/2026238989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a41087d0 0x7f49a4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/2026238989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 0x7f49a41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.894+0000 7f49ab2f2640 1 -- 172.21.15.2:0/2026238989 >> 172.21.15.2:0/2026238989 conn(0x7f49a40fe830 msgr2=0x7f49a4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 -- 172.21.15.2:0/2026238989 shutdown_connections 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 -- 172.21.15.2:0/2026238989 wait complete. 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 Processor -- start 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 -- start start 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 0x7f49a4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a41087d0 0x7f49a4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.895+0000 7f49ab2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49ab2f2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4112e10 con 0x7f49a4109150 2024-09-10T23:35:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49ab2f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4112c90 con 0x7f49a41087d0 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49ab2f2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4112f90 con 0x7f49a4102dc0 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a419ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59708/0 (socket says 172.21.15.2:59708) 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 -- 172.21.15.2:0/1751970519 learned_addr learned my addr 172.21.15.2:0/1751970519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a888d640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a41087d0 0x7f49a4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a908e640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 0x7f49a4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 -- 172.21.15.2:0/1751970519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 msgr2=0x7f49a4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 0x7f49a4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 -- 172.21.15.2:0/1751970519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a41087d0 msgr2=0x7f49a4199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a41087d0 0x7f49a4199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 -- 172.21.15.2:0/1751970519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a419f3d0 con 0x7f49a4109150 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a908e640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 0x7f49a4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a988f640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a419ec00 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4994005cc0 tx=0x7f499402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a27fc640 1 -- 172.21.15.2:0/1751970519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994003cf0 con 0x7f49a4109150 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a419f660 con 0x7f49a4109150 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a27fc640 1 -- 172.21.15.2:0/1751970519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49940044f0 con 0x7f49a4109150 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49a27fc640 1 -- 172.21.15.2:0/1751970519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499402fc30 con 0x7f49a4109150 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.896+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a41a5d80 con 0x7f49a4109150 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.899+0000 7f49ad6c7740 1 Processor -- start 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.899+0000 7f49a27fc640 1 -- 172.21.15.2:0/1751970519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f4994004040 con 0x7f49a4109150 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.899+0000 7f49ad6c7740 1 -- start start 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0fed4d0 0x5569a0fed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 0x5569a0ffdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0ffe190 0x5569a1000580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569a0f63ea0 con 0x5569a0feddf0 2024-09-10T23:35:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569a0f532d0 con 0x5569a0fed4d0 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5569a0f570e0 con 0x5569a0ffe190 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 0x5569a0ffdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 0x5569a0ffdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59712/0 (socket says 172.21.15.2:59712) 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 -- 172.21.15.2:0/3428065251 learned_addr learned my addr 172.21.15.2:0/3428065251 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a888d640 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0fed4d0 0x5569a0fed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a888d640 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0ffe190 0x5569a1000580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 -- 172.21.15.2:0/3428065251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0ffe190 msgr2=0x5569a1000580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0ffe190 0x5569a1000580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 -- 172.21.15.2:0/3428065251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0fed4d0 msgr2=0x5569a0fed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0fed4d0 0x5569a0fed8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a908e640 1 -- 172.21.15.2:0/3428065251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569a0cb1650 con 0x5569a0feddf0 2024-09-10T23:35:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.900+0000 7f49a888d640 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0ffe190 0x5569a1000580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f49a27fc640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f498c0b52e0 0x7f498c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f49a908e640 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 0x5569a0ffdc50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f499c00bba0 tx=0x7f499c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d84ed71edfce67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f49a888d640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f498c0b52e0 0x7f498c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f498b7fe640 1 -- 172.21.15.2:0/3428065251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c017620 con 0x5569a0feddf0 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f49a27fc640 1 -- 172.21.15.2:0/1751970519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f4994107240 con 0x7f49a4109150 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f498b7fe640 1 -- 172.21.15.2:0/3428065251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f499c017c70 con 0x5569a0feddf0 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.901+0000 7f498b7fe640 1 -- 172.21.15.2:0/3428065251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c00fa40 con 0x5569a0feddf0 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 -- 172.21.15.2:0/3428065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 msgr2=0x5569a0ffdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 0x5569a0ffdc50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f499c00bba0 tx=0x7f499c00d710 comp rx=0 tx=0).stop 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49a888d640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f498c0b52e0 0x7f498c0b77a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f49a4104f50 tx=0x7f49980046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 -- 172.21.15.2:0/3428065251 shutdown_connections 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0ffe190 0x5569a1000580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0feddf0 0x5569a0ffdc50 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/3428065251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0fed4d0 0x5569a0fed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 -- 172.21.15.2:0/3428065251 >> 172.21.15.2:0/3428065251 conn(0x5569a0feb300 msgr2=0x5569a0fec4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 -- 172.21.15.2:0/3428065251 shutdown_connections 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 -- 172.21.15.2:0/3428065251 wait complete. 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 -- start start 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.902+0000 7f49ad6c7740 1 Processor -- start 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a0ffda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0ffae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0ffb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569a0db4700 con 0x5569a0ffe190 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569a0eee160 con 0x5569a0feddf0 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5569a1000e40 con 0x5569a0fed4d0 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 10 client.0 _ll_register_callbacks cb 0x5569a0f079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0ffb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0ffb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59722/0 (socket says 172.21.15.2:59722) 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 -- 172.21.15.2:0/2621296897 learned_addr learned my addr 172.21.15.2:0/2621296897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a908e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a0ffda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a888d640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0ffae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 -- 172.21.15.2:0/2621296897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 msgr2=0x5569a0ffda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a0ffda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 -- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 msgr2=0x5569a0ffae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0ffae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 -- 172.21.15.2:0/2621296897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569a0f1bc90 con 0x5569a0ffe190 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a888d640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0ffae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49a988f640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0ffb440 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f49940cd710 tx=0x7f49940cd420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6772d6eeab2fdecc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f4988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:57.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f4988ff9640 1 -- 172.21.15.2:0/2621296897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940cd520 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f4988ff9640 1 -- 172.21.15.2:0/2621296897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f49940c9c80 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.903+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499c017c70 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f4988ff9640 1 -- 172.21.15.2:0/2621296897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f49940ce110 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 10 client.19446 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5569a100c6d0 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f4988ff9640 1 -- 172.21.15.2:0/2621296897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f499c017c70 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f4988ff9640 1 -- 172.21.15.2:0/2621296897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f49940d20d0 con 0x5569a0ffe190 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 10 client.19446 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 10 client.19446 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 20 client.19446 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a100dc20 0x5569a10100a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 4 client.19446 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569a0f65df0 con 0x5569a100dc20 2024-09-10T23:35:57.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.904+0000 7f49a908e640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a100dc20 0x5569a10100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.905+0000 7f49a908e640 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a100dc20 0x5569a10100a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6aa563b275d4debc server_cookie=c9fd38be773f423f in_seq=0 out_seq=0 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.905+0000 7f4988ff9640 10 client.19446 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.905+0000 7f4988ff9640 1 -- 172.21.15.2:0/2621296897 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569a0f65df0 con 0x5569a100dc20 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.905+0000 7f4988ff9640 10 client.19446 handle_command_reply: tid=0 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.905+0000 7f49ad6c7740 1 client.19446 shutdown 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 msgr2=0x5569a0ffb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0ffb440 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f49940cd710 tx=0x7f49940cd420 comp rx=0 tx=0).stop 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 shutdown_connections 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a100dc20 0x5569a10100a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0ffb440 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0ffae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/2621296897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a0ffda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 >> 172.21.15.2:0/2621296897 conn(0x5569a0feb300 msgr2=0x5569a0ff0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:57.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f4988ff9640 0 client.19446 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:57.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 shutdown_connections 2024-09-10T23:35:57.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 1 -- 172.21.15.2:0/2621296897 wait complete. 2024-09-10T23:35:57.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.906+0000 7f49ad6c7740 20 client.19446 trim_cache size 0 max 16384 2024-09-10T23:35:57.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.919+0000 7f49ad6c7740 1 Processor -- start 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.919+0000 7f49ad6c7740 1 -- start start 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a100a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0fec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0fec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49a41ac160 con 0x5569a0ffe190 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49a41adca0 con 0x5569a0feddf0 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49a41ac830 con 0x5569a0fed4d0 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0fec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0fec6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59734/0 (socket says 172.21.15.2:59734) 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 -- 172.21.15.2:0/819658543 learned_addr learned my addr 172.21.15.2:0/819658543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a888d640 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0fec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a908e640 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a100a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 -- 172.21.15.2:0/819658543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 msgr2=0x5569a100a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a100a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 -- 172.21.15.2:0/819658543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 msgr2=0x5569a0fec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0fec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 -- 172.21.15.2:0/819658543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569a0ffdda0 con 0x5569a0ffe190 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.920+0000 7f49a988f640 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0fec6e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f4994005fa0 tx=0x7f49940d6fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4f000b19de6531 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f498affd640 1 -- 172.21.15.2:0/819658543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940c98b0 con 0x5569a0ffe190 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f498affd640 1 -- 172.21.15.2:0/819658543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4994036020 con 0x5569a0ffe190 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f498affd640 1 -- 172.21.15.2:0/819658543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940d24f0 con 0x5569a0ffe190 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 -- 172.21.15.2:0/819658543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 msgr2=0x5569a0fec6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0fec6e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f4994005fa0 tx=0x7f49940d6fc0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 -- 172.21.15.2:0/819658543 shutdown_connections 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a0fec6e0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a0fec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/819658543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a100a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 -- 172.21.15.2:0/819658543 >> 172.21.15.2:0/819658543 conn(0x5569a0feb300 msgr2=0x5569a0ffff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 -- 172.21.15.2:0/819658543 shutdown_connections 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.921+0000 7f49ad6c7740 1 -- 172.21.15.2:0/819658543 wait complete. 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 -- start start 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 Processor -- start 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a1006390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a1006910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a1015070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49a41ad5d0 con 0x5569a0ffe190 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49a41acf00 con 0x5569a0feddf0 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49a41aa140 con 0x5569a0fed4d0 2024-09-10T23:35:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49ad6c7740 10 client.0 _ll_register_callbacks cb 0x7f4994005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a1015070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49a988f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a1015070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59744/0 (socket says 172.21.15.2:59744) 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.922+0000 7f49a988f640 1 -- 172.21.15.2:0/4165677106 learned_addr learned my addr 172.21.15.2:0/4165677106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a888d640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a1006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a908e640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a1006390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a988f640 1 -- 172.21.15.2:0/4165677106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 msgr2=0x5569a1006390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a988f640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a1006390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a988f640 1 -- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 msgr2=0x5569a1006910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a988f640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a1006910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a988f640 1 -- 172.21.15.2:0/4165677106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569a10158a0 con 0x5569a0ffe190 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a888d640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a1006910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:57.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a908e640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a1006390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49a988f640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a1015070 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f4994031a90 tx=0x7f49940c9e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86817d0fa46f6a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f4988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f4988ff9640 1 -- 172.21.15.2:0/4165677106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940ed060 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f4988ff9640 1 -- 172.21.15.2:0/4165677106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f49940d6b10 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4994036020 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f4988ff9640 1 -- 172.21.15.2:0/4165677106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f49940ac050 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49ad6c7740 10 client.19452 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5569a10158a0 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.923+0000 7f4988ff9640 1 -- 172.21.15.2:0/4165677106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4994036020 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f4988ff9640 1 -- 172.21.15.2:0/4165677106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f49940ccc70 con 0x5569a0ffe190 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49ad6c7740 10 client.19452 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49ad6c7740 10 client.19452 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T23:35:57.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49ad6c7740 20 client.19452 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a107aa10 0x5569a107ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49ad6c7740 4 client.19452 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 --> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569a0f618a0 con 0x5569a107aa10 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49a908e640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a107aa10 0x5569a107ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f49a908e640 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a107aa10 0x5569a107ce30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7c2733a972c67317 server_cookie=1628bb143f81e9cf in_seq=0 out_seq=0 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.924+0000 7f4988ff9640 10 client.19452 ms_handle_connect on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f4988ff9640 1 -- 172.21.15.2:0/4165677106 <== mds.4 v2:172.21.15.154:6836/4148932474 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569a0f618a0 con 0x5569a107aa10 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f4988ff9640 10 client.19452 handle_command_reply: tid=0 2024-09-10T23:35:57.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 client.19452 shutdown 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 msgr2=0x5569a1015070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a1015070 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f4994031a90 tx=0x7f49940c9e90 comp rx=0 tx=0).stop 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 shutdown_connections 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:6836/4148932474,v1:172.21.15.154:6837/4148932474] conn(0x5569a107aa10 0x5569a107ce30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569a0ffe190 0x5569a1015070 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569a0feddf0 0x5569a1006910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 --2- 172.21.15.2:0/4165677106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5569a0fed4d0 0x5569a1006390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 >> 172.21.15.2:0/4165677106 conn(0x5569a0feb300 msgr2=0x5569a0fec110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f4988ff9640 0 client.19452 ms_handle_reset on v2:172.21.15.154:6836/4148932474 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 shutdown_connections 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 1 -- 172.21.15.2:0/4165677106 wait complete. 2024-09-10T23:35:57.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.925+0000 7f49ad6c7740 20 client.19452 trim_cache size 0 max 16384 2024-09-10T23:35:57.937 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:57.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f498c0b52e0 msgr2=0x7f498c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f498c0b52e0 0x7f498c0b77a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f49a4104f50 tx=0x7f49980046c0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 msgr2=0x7f49a419ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:57.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a419ec00 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4994005cc0 tx=0x7f499402f470 comp rx=0 tx=0).stop 2024-09-10T23:35:57.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 shutdown_connections 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f498c0b52e0 0x7f498c0b77a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a4109150 0x7f49a419ec00 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a41087d0 0x7f49a4199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 --2- 172.21.15.2:0/1751970519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49a4102dc0 0x7f49a4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 >> 172.21.15.2:0/1751970519 conn(0x7f49a40fe830 msgr2=0x7f49a4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 shutdown_connections 2024-09-10T23:35:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:57.926+0000 7f49ab2f2640 1 -- 172.21.15.2:0/1751970519 wait complete. 2024-09-10T23:35:58.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:57 smithi177 ceph-mon[35760]: pgmap v700: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:35:58.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:57 smithi002 ceph-mon[31150]: pgmap v700: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:35:58.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:57 smithi154 ceph-mon[35136]: pgmap v700: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:35:58.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T23:35:59.027 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:35:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 -- 172.21.15.2:0/3777472739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a981076c0 msgr2=0x7f2a98107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 --2- 172.21.15.2:0/3777472739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a981076c0 0x7f2a98107b00 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009900 tx=0x7f2a8c02a410 comp rx=0 tx=0).stop 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 -- 172.21.15.2:0/3777472739 shutdown_connections 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 --2- 172.21.15.2:0/3777472739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a98108040 0x7f2a9810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 --2- 172.21.15.2:0/3777472739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a981076c0 0x7f2a98107b00 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 --2- 172.21.15.2:0/3777472739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a98101cb0 0x7f2a98102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 -- 172.21.15.2:0/3777472739 >> 172.21.15.2:0/3777472739 conn(0x7f2a980fd700 msgr2=0x7f2a980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 -- 172.21.15.2:0/3777472739 shutdown_connections 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.589+0000 7f2a9df88640 1 -- 172.21.15.2:0/3777472739 wait complete. 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 Processor -- start 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 -- start start 2024-09-10T23:35:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 0x7f2a98198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a981076c0 0x7f2a981986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a98108040 0x7f2a9819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111cc0 con 0x7f2a98101cb0 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111b40 con 0x7f2a98108040 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a9df88640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111e40 con 0x7f2a981076c0 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 0x7f2a98198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 0x7f2a98198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59768/0 (socket says 172.21.15.2:59768) 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a977fe640 1 -- 172.21.15.2:0/27119228 learned_addr learned my addr 172.21.15.2:0/27119228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.590+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a981076c0 0x7f2a981986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a977fe640 1 -- 172.21.15.2:0/27119228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a981076c0 msgr2=0x7f2a981986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a977fe640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a981076c0 0x7f2a981986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a97fff640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a98108040 0x7f2a9819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a977fe640 1 -- 172.21.15.2:0/27119228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a98108040 msgr2=0x7f2a9819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a977fe640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a98108040 0x7f2a9819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a977fe640 1 -- 172.21.15.2:0/27119228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9819e220 con 0x7f2a98101cb0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a981076c0 0x7f2a981986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a977fe640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 0x7f2a98198170 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800c890 tx=0x7f2a8800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a94ff9640 1 -- 172.21.15.2:0/27119228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88004220 con 0x7f2a98101cb0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9819e510 con 0x7f2a98101cb0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a94ff9640 1 -- 172.21.15.2:0/27119228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a880043c0 con 0x7f2a98101cb0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a94ff9640 1 -- 172.21.15.2:0/27119228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88004a00 con 0x7f2a98101cb0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.591+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981a4bd0 con 0x7f2a98101cb0 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.594+0000 7f2aa035d740 1 Processor -- start 2024-09-10T23:35:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.594+0000 7f2aa035d740 1 -- start start 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.594+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39d46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.594+0000 7f2a94ff9640 1 -- 172.21.15.2:0/27119228 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2a880079b0 con 0x7f2a98101cb0 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.594+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39e0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2aa035d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1e3948ea0 con 0x55c1e39d4300 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2aa035d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c1e39382d0 con 0x55c1e39e0bb0 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2aa035d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c1e393c0e0 con 0x55c1e39d4c20 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39d46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39d46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59770/0 (socket says 172.21.15.2:59770) 2024-09-10T23:35:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 -- 172.21.15.2:0/2427217337 learned_addr learned my addr 172.21.15.2:0/2427217337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a977fe640 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 -- 172.21.15.2:0/2427217337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 msgr2=0x55c1e39e0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39e0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 -- 172.21.15.2:0/2427217337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 msgr2=0x55c1e39e2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 -- 172.21.15.2:0/2427217337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e3696650 con 0x55c1e39d4300 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a97fff640 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39d46e0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009df0 tx=0x7f2a9000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbf6b448d39b11d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a7dffb640 1 -- 172.21.15.2:0/2427217337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90003970 con 0x55c1e39d4300 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a7dffb640 1 -- 172.21.15.2:0/2427217337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a90004030 con 0x55c1e39d4300 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a7dffb640 1 -- 172.21.15.2:0/2427217337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90011720 con 0x55c1e39d4300 2024-09-10T23:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.595+0000 7f2a94ff9640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2a800b52e0 0x7f2a800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2a977fe640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2a800b52e0 0x7f2a800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2a94ff9640 1 -- 172.21.15.2:0/27119228 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2a880e59f0 con 0x7f2a98101cb0 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 -- 172.21.15.2:0/2427217337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 msgr2=0x55c1e39d46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39d46e0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009df0 tx=0x7f2a9000f730 comp rx=0 tx=0).stop 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2a977fe640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2a800b52e0 0x7f2a800b77a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2a880e3870 tx=0x7f2a88000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 -- 172.21.15.2:0/2427217337 shutdown_connections 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39e0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 --2- 172.21.15.2:0/2427217337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39d46e0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 -- 172.21.15.2:0/2427217337 >> 172.21.15.2:0/2427217337 conn(0x55c1e39d2130 msgr2=0x55c1e39d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 -- 172.21.15.2:0/2427217337 shutdown_connections 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.596+0000 7f2aa035d740 1 -- 172.21.15.2:0/2427217337 wait complete. 2024-09-10T23:35:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 -- start start 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 Processor -- start 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4300 0x55c1e39e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 0x55c1e39ddf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1e3799700 con 0x55c1e39e0bb0 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c1e38d3160 con 0x55c1e39d4c20 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c1e39e3830 con 0x55c1e39d4300 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2aa035d740 10 client.0 _ll_register_callbacks cb 0x55c1e38ec9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 0x55c1e39ddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 0x55c1e39ddf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59772/0 (socket says 172.21.15.2:59772) 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.597+0000 7f2a97fff640 1 -- 172.21.15.2:0/3113947721 learned_addr learned my addr 172.21.15.2:0/3113947721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4300 0x55c1e39e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 -- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4300 msgr2=0x55c1e39e04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4300 0x55c1e39e04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 -- 172.21.15.2:0/3113947721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 msgr2=0x55c1e39dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 -- 172.21.15.2:0/3113947721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e3900c90 con 0x55c1e39e0bb0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 0x55c1e39ddf20 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009470 tx=0x7f2a900093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210f374f57b40f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3113947721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90003970 con 0x55c1e39e0bb0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a90004030 con 0x55c1e39e0bb0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3113947721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2a90003b10 con 0x55c1e39e0bb0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3113947721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a90030050 con 0x55c1e39e0bb0 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2aa035d740 10 client.19464 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1e39ef160 con 0x55c1e39e0bb0 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.598+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3113947721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a90004030 con 0x55c1e39e0bb0 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3113947721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a90028020 con 0x55c1e39e0bb0 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2aa035d740 10 client.19464 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2aa035d740 10 client.19464 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2aa035d740 20 client.19464 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e39f0510 0x55c1e39f2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2aa035d740 4 client.19464 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1e394adf0 con 0x55c1e39f0510 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e39f0510 0x55c1e39f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2a76ffd640 10 client.19464 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.599+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e39f0510 0x55c1e39f2900 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b8f134ef63d2a6a0 server_cookie=cf2a001560326bb4 in_seq=0 out_seq=0 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3113947721 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1e394adf0 con 0x55c1e39f0510 2024-09-10T23:35:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2a76ffd640 10 client.19464 handle_command_reply: tid=0 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 client.19464 shutdown 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 msgr2=0x55c1e39ddf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 0x55c1e39ddf20 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009470 tx=0x7f2a900093e0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 shutdown_connections 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e39f0510 0x55c1e39f2900 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39e0bb0 0x55c1e39ddf20 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3113947721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4300 0x55c1e39e04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 >> 172.21.15.2:0/3113947721 conn(0x55c1e39d2130 msgr2=0x55c1e39d7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.600+0000 7f2a76ffd640 0 client.19464 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.601+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 shutdown_connections 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.601+0000 7f2aa035d740 1 -- 172.21.15.2:0/3113947721 wait complete. 2024-09-10T23:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.601+0000 7f2aa035d740 20 client.19464 trim_cache size 0 max 16384 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.614+0000 7f2aa035d740 1 Processor -- start 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.614+0000 7f2aa035d740 1 -- start start 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39dce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2aa035d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ac110 con 0x55c1e39d4300 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2aa035d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981adc50 con 0x55c1e39e0bb0 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2aa035d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ac7e0 con 0x55c1e39d4c20 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59780/0 (socket says 172.21.15.2:59780) 2024-09-10T23:35:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 -- 172.21.15.2:0/1531232931 learned_addr learned my addr 172.21.15.2:0/1531232931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 -- 172.21.15.2:0/1531232931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 msgr2=0x55c1e39dce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39dce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 -- 172.21.15.2:0/1531232931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 msgr2=0x55c1e39e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 -- 172.21.15.2:0/1531232931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e39d1f60 con 0x55c1e39d4300 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39dce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a97fff640 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39e2ed0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009b80 tx=0x7f2a900096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1a6fcea6dca3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a7d7fa640 1 -- 172.21.15.2:0/1531232931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90039070 con 0x55c1e39d4300 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a7d7fa640 1 -- 172.21.15.2:0/1531232931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a9001f020 con 0x55c1e39d4300 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.615+0000 7f2a7d7fa640 1 -- 172.21.15.2:0/1531232931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90011880 con 0x55c1e39d4300 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 -- 172.21.15.2:0/1531232931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 msgr2=0x55c1e39e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39e2ed0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009b80 tx=0x7f2a900096c0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 -- 172.21.15.2:0/1531232931 shutdown_connections 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39e0bb0 0x55c1e39e1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39d4c20 0x55c1e39dce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 --2- 172.21.15.2:0/1531232931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39e2ed0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 -- 172.21.15.2:0/1531232931 >> 172.21.15.2:0/1531232931 conn(0x55c1e39d2130 msgr2=0x55c1e39d8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 -- 172.21.15.2:0/1531232931 shutdown_connections 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 -- 172.21.15.2:0/1531232931 wait complete. 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.616+0000 7f2aa035d740 1 -- start start 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 Processor -- start 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39daae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39db020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39e0bb0 0x55c1e39db560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ad580 con 0x55c1e39d4300 2024-09-10T23:35:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981aceb0 con 0x55c1e39d4c20 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981aa0f0 con 0x55c1e39e0bb0 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2aa035d740 10 client.0 _ll_register_callbacks cb 0x7f2a90009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39daae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39daae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59790/0 (socket says 172.21.15.2:59790) 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 -- 172.21.15.2:0/3972458738 learned_addr learned my addr 172.21.15.2:0/3972458738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 -- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39e0bb0 msgr2=0x55c1e39db560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39e0bb0 0x55c1e39db560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 -- 172.21.15.2:0/3972458738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 msgr2=0x55c1e39db020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39db020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.617+0000 7f2a97fff640 1 -- 172.21.15.2:0/3972458738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e39e50c0 con 0x55c1e39d4300 2024-09-10T23:35:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39daae0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f2a90037040 tx=0x7f2a900047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f00c67d7bcd52f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3972458738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90039070 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3972458738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2a90003e80 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a9001f020 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3972458738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a90011440 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 10 client.19470 fetch_fsmap learned FSMap version 28 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1e3a5d4b0 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3972458738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a9001f020 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3972458738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a90028040 con 0x55c1e39d4300 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 10 client.19470 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 10 client.19470 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 20 client.19470 populate_metadata read hostname 'smithi002' 2024-09-10T23:35:59.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e3a5dbc0 0x55c1e3a5ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 4 client.19470 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.618+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 --> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1e39468a0 con 0x55c1e3a5dbc0 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.619+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e3a5dbc0 0x55c1e3a5ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.619+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e3a5dbc0 0x55c1e3a5ffe0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49d846b404b3de60 server_cookie=b2262a5206b2f5a1 in_seq=0 out_seq=0 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.619+0000 7f2a76ffd640 10 client.19470 ms_handle_connect on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.619+0000 7f2a76ffd640 1 -- 172.21.15.2:0/3972458738 <== mds.3 v2:172.21.15.177:6834/2192031560 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1e39468a0 con 0x55c1e3a5dbc0 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.619+0000 7f2a76ffd640 10 client.19470 handle_command_reply: tid=0 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.619+0000 7f2aa035d740 1 client.19470 shutdown 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 msgr2=0x55c1e39daae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39daae0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f2a90037040 tx=0x7f2a900047f0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 shutdown_connections 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:6834/2192031560,v1:172.21.15.177:6835/2192031560] conn(0x55c1e3a5dbc0 0x55c1e3a5ffe0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c1e39e0bb0 0x55c1e39db560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c1e39d4c20 0x55c1e39db020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 --2- 172.21.15.2:0/3972458738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1e39d4300 0x55c1e39daae0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 >> 172.21.15.2:0/3972458738 conn(0x55c1e39d2130 msgr2=0x55c1e39ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a76ffd640 0 client.19470 ms_handle_reset on v2:172.21.15.177:6834/2192031560 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 shutdown_connections 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 1 -- 172.21.15.2:0/3972458738 wait complete. 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2aa035d740 20 client.19470 trim_cache size 0 max 16384 2024-09-10T23:35:59.630 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:35:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2a800b52e0 msgr2=0x7f2a800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2a800b52e0 0x7f2a800b77a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2a880e3870 tx=0x7f2a88000bc0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 msgr2=0x7f2a98198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 0x7f2a98198170 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800c890 tx=0x7f2a8800cd50 comp rx=0 tx=0).stop 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 shutdown_connections 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2a800b52e0 0x7f2a800b77a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a98108040 0x7f2a9819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a981076c0 0x7f2a981986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 --2- 172.21.15.2:0/27119228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98101cb0 0x7f2a98198170 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.620+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 >> 172.21.15.2:0/27119228 conn(0x7f2a980fd700 msgr2=0x7f2a980ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.621+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 shutdown_connections 2024-09-10T23:35:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:35:59.621+0000 7f2a9df88640 1 -- 172.21.15.2:0/27119228 wait complete. 2024-09-10T23:36:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:35:59 smithi177 ceph-mon[35760]: pgmap v701: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:00.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:35:59 smithi002 ceph-mon[31150]: pgmap v701: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:00.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:35:59 smithi154 ceph-mon[35136]: pgmap v701: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:00.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:36:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 -- 172.21.15.2:0/1418747263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 msgr2=0x7fdfe010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/1418747263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe010e820 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009ca0 tx=0x7fdfd802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 -- 172.21.15.2:0/1418747263 shutdown_connections 2024-09-10T23:36:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/1418747263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe010e820 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/1418747263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfe01076a0 0x7fdfe0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/1418747263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe0101c90 0x7fdfe0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 -- 172.21.15.2:0/1418747263 >> 172.21.15.2:0/1418747263 conn(0x7fdfe00fd700 msgr2=0x7fdfe00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 -- 172.21.15.2:0/1418747263 shutdown_connections 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 -- 172.21.15.2:0/1418747263 wait complete. 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.195+0000 7fdfe69dd640 1 Processor -- start 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 -- start start 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe0101c90 0x7fdfe00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfe01076a0 0x7fdfe00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe0111ce0 con 0x7fdfe0108020 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe0111b60 con 0x7fdfe01076a0 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe69dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe0111e60 con 0x7fdfe0101c90 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe00fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56736/0 (socket says 172.21.15.2:56736) 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 -- 172.21.15.2:0/4282962726 learned_addr learned my addr 172.21.15.2:0/4282962726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfdffff640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe0101c90 0x7fdfe00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfe01076a0 0x7fdfe00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 -- 172.21.15.2:0/4282962726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe0101c90 msgr2=0x7fdfe00fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe0101c90 0x7fdfe00fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 -- 172.21.15.2:0/4282962726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfe01076a0 msgr2=0x7fdfe00fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfe01076a0 0x7fdfe00fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.196+0000 7fdfe4f7a640 1 -- 172.21.15.2:0/4282962726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe01a76e0 con 0x7fdfe0108020 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.197+0000 7fdfe4f7a640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe00fe680 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098d0 tx=0x7fdfd80317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.197+0000 7fdfdd7fa640 1 -- 172.21.15.2:0/4282962726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8003b70 con 0x7fdfe0108020 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.197+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe01a7970 con 0x7fdfe0108020 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.197+0000 7fdfdd7fa640 1 -- 172.21.15.2:0/4282962726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd8003d10 con 0x7fdfe0108020 2024-09-10T23:36:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.197+0000 7fdfdd7fa640 1 -- 172.21.15.2:0/4282962726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd802fa20 con 0x7fdfe0108020 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.197+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe01a7eb0 con 0x7fdfe0108020 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.199+0000 7fdfdd7fa640 1 -- 172.21.15.2:0/4282962726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdfd802fc20 con 0x7fdfe0108020 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.199+0000 7fdfe8db2740 1 Processor -- start 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 -- start start 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9de4d0 0x55eeee9de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9dedf0 0x55eeee9ea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9ed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eeee954ea0 con 0x55eeee9ead80 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eeee9442d0 con 0x55eeee9dedf0 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eeee9480e0 con 0x55eeee9de4d0 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9ed170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56744/0 (socket says 172.21.15.2:56744) 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/3988791064 learned_addr learned my addr 172.21.15.2:0/3988791064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdffff640 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9dedf0 0x55eeee9ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9de4d0 0x55eeee9de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdd7fa640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfc80b52e0 0x7fdfc80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/3988791064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9de4d0 msgr2=0x55eeee9de8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9de4d0 0x55eeee9de8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/3988791064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9dedf0 msgr2=0x55eeee9ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfe4f7a640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfc80b52e0 0x7fdfc80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9dedf0 0x55eeee9ea840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/3988791064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeee6a2650 con 0x55eeee9ead80 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdffff640 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9dedf0 0x55eeee9ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:36:01.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.200+0000 7fdfdd7fa640 1 -- 172.21.15.2:0/4282962726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdfd8107040 con 0x7fdfe0108020 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9ed170 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4014950 tx=0x7fdfd400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e262b307f241729 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfc67fc640 1 -- 172.21.15.2:0/3988791064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40142d0 con 0x55eeee9ead80 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfc67fc640 1 -- 172.21.15.2:0/3988791064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd400fc10 con 0x55eeee9ead80 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfc67fc640 1 -- 172.21.15.2:0/3988791064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4012a90 con 0x55eeee9ead80 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfe8db2740 1 -- 172.21.15.2:0/3988791064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 msgr2=0x55eeee9ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9ed170 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4014950 tx=0x7fdfd400c450 comp rx=0 tx=0).stop 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.201+0000 7fdfe4f7a640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfc80b52e0 0x7fdfc80b77a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80cd550 tx=0x7fdfd8092020 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- 172.21.15.2:0/3988791064 shutdown_connections 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9ed170 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9dedf0 0x55eeee9ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/3988791064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9de4d0 0x55eeee9de8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- 172.21.15.2:0/3988791064 >> 172.21.15.2:0/3988791064 conn(0x55eeee9dc300 msgr2=0x55eeee9dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- 172.21.15.2:0/3988791064 shutdown_connections 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- 172.21.15.2:0/3988791064 wait complete. 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- start start 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 Processor -- start 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 0x55eeee9e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9ead80 0x55eeee9e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55eeee7a5700 con 0x55eeee9dedf0 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eeee8df160 con 0x55eeee9de4d0 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.202+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eeee9eda00 con 0x55eeee9ead80 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfe8db2740 10 client.0 _ll_register_callbacks cb 0x55eeee8f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 0x55eeee9e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 0x55eeee9e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56752/0 (socket says 172.21.15.2:56752) 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 -- 172.21.15.2:0/32481846 learned_addr learned my addr 172.21.15.2:0/32481846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9ead80 0x55eeee9e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 -- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9ead80 msgr2=0x55eeee9e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9ead80 0x55eeee9e81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 -- 172.21.15.2:0/32481846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 msgr2=0x55eeee9ea6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9ea6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 -- 172.21.15.2:0/32481846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeee90cc90 con 0x55eeee9dedf0 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfdffff640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 0x55eeee9e7b40 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0012740 tx=0x7fdfd0012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588686b6edd3f74d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/32481846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0004050 con 0x55eeee9dedf0 2024-09-10T23:36:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/32481846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdfd00041f0 con 0x55eeee9dedf0 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfd400fc10 con 0x55eeee9dedf0 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.203+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/32481846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdfd00043f0 con 0x55eeee9dedf0 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 10 client.19482 fetch_fsmap learned FSMap version 28 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eeee9f9440 con 0x55eeee9dedf0 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/32481846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd400fc10 con 0x55eeee9dedf0 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/32481846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdfd0003c10 con 0x55eeee9dedf0 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 10 client.19482 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 10 client.19482 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 20 client.19482 populate_metadata read hostname 'smithi002' 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeee9fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 4 client.19482 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eeee956df0 con 0x55eeee9fa900 2024-09-10T23:36:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.204+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeee9fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.205+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeee9fcd50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf05fb644761e9af server_cookie=cc1b906d1ae5fc3 in_seq=0 out_seq=0 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.205+0000 7fdfbf7fe640 10 client.19482 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.205+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/32481846 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eeee956df0 con 0x55eeee9fa900 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.205+0000 7fdfbf7fe640 10 client.19482 handle_command_reply: tid=0 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.205+0000 7fdfe8db2740 1 client.19482 shutdown 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 msgr2=0x55eeee9e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 0x55eeee9e7b40 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0012740 tx=0x7fdfd0012c00 comp rx=0 tx=0).stop 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 shutdown_connections 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeee9fcd50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9ead80 0x55eeee9e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfbf7fe640 0 client.19482 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9dedf0 0x55eeee9e7b40 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/32481846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9ea6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 >> 172.21.15.2:0/32481846 conn(0x55eeee9dc300 msgr2=0x55eeee9e1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 shutdown_connections 2024-09-10T23:36:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 1 -- 172.21.15.2:0/32481846 wait complete. 2024-09-10T23:36:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.206+0000 7fdfe8db2740 20 client.19482 trim_cache size 0 max 16384 2024-09-10T23:36:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 Processor -- start 2024-09-10T23:36:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 -- start start 2024-09-10T23:36:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 0x55eeee9ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9ead80 0x55eeee9ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe01b0540 con 0x55eeee9de4d0 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe01b2080 con 0x55eeee9ead80 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe01b0c10 con 0x55eeee9dedf0 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.219+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 0x55eeee9ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 0x55eeee9ddab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56758/0 (socket says 172.21.15.2:56758) 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/383728537 learned_addr learned my addr 172.21.15.2:0/383728537 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/383728537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 msgr2=0x55eeee9dbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/383728537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9ead80 msgr2=0x55eeee9ec170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9ead80 0x55eeee9ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/383728537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeee9dec20 con 0x55eeee9de4d0 2024-09-10T23:36:01.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 0x55eeee9ddab0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4012640 tx=0x7fdfd4012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beee72b1b5a10e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfc5ffb640 1 -- 172.21.15.2:0/383728537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40140b0 con 0x55eeee9de4d0 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfc5ffb640 1 -- 172.21.15.2:0/383728537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd4014250 con 0x55eeee9de4d0 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.220+0000 7fdfc5ffb640 1 -- 172.21.15.2:0/383728537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4005520 con 0x55eeee9de4d0 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 -- 172.21.15.2:0/383728537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 msgr2=0x55eeee9ddab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 0x55eeee9ddab0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4012640 tx=0x7fdfd4012670 comp rx=0 tx=0).stop 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 -- 172.21.15.2:0/383728537 shutdown_connections 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9ead80 0x55eeee9ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9dbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/383728537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9de4d0 0x55eeee9ddab0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 -- 172.21.15.2:0/383728537 >> 172.21.15.2:0/383728537 conn(0x55eeee9dc300 msgr2=0x55eeee9dd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 -- 172.21.15.2:0/383728537 shutdown_connections 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 -- 172.21.15.2:0/383728537 wait complete. 2024-09-10T23:36:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 -- start start 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.221+0000 7fdfe8db2740 1 Processor -- start 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9f3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9edc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe01b19b0 con 0x55eeee9ead80 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe01b12e0 con 0x55eeee9de4d0 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe01ae520 con 0x55eeee9dedf0 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfe8db2740 10 client.0 _ll_register_callbacks cb 0x7fdfd0009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56770/0 (socket says 172.21.15.2:56770) 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/551558030 learned_addr learned my addr 172.21.15.2:0/551558030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:01.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdffff640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 msgr2=0x55eeee9f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/551558030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 msgr2=0x55eeee9f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 -- 172.21.15.2:0/551558030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeee9ee1c0 con 0x55eeee9ead80 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfdf7fe640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9edc80 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005780 tx=0x7fdfd4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ec63e04171cf1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.222+0000 7fdfbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/551558030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4005520 con 0x55eeee9ead80 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/551558030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fdfd400f730 con 0x55eeee9ead80 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfd4014250 con 0x55eeee9ead80 2024-09-10T23:36:01.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/551558030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdfd400f930 con 0x55eeee9ead80 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 10 client.19488 fetch_fsmap learned FSMap version 28 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eeeea67fc0 con 0x55eeee9ead80 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/551558030 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd4014250 con 0x55eeee9ead80 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/551558030 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdfd4043020 con 0x55eeee9ead80 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 10 client.19488 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 10 client.19488 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 20 client.19488 populate_metadata read hostname 'smithi002' 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeeea6a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 4 client.19488 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.223+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 --> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eeee9528a0 con 0x55eeee9fa900 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfdffff640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeeea6a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:01.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfdffff640 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeeea6a4a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35cbf6a76c2dbd66 server_cookie=1686fa51151c272c in_seq=0 out_seq=0 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfbf7fe640 10 client.19488 ms_handle_connect on v2:172.21.15.177:6836/4092191728 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfbf7fe640 1 -- 172.21.15.2:0/551558030 <== mds.2 v2:172.21.15.177:6836/4092191728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eeee9528a0 con 0x55eeee9fa900 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfbf7fe640 10 client.19488 handle_command_reply: tid=0 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 client.19488 shutdown 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 msgr2=0x55eeee9edc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9edc80 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005780 tx=0x7fdfd4005850 comp rx=0 tx=0).stop 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 shutdown_connections 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:6836/4092191728,v1:172.21.15.177:6837/4092191728] conn(0x55eeee9fa900 0x55eeeea6a4a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55eeee9ead80 0x55eeee9edc80 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfbf7fe640 0 client.19488 ms_handle_reset on v2:172.21.15.177:6836/4092191728 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eeee9dedf0 0x55eeee9f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 --2- 172.21.15.2:0/551558030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eeee9de4d0 0x55eeee9f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.224+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 >> 172.21.15.2:0/551558030 conn(0x55eeee9dc300 msgr2=0x55eeee9e9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 shutdown_connections 2024-09-10T23:36:01.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe8db2740 1 -- 172.21.15.2:0/551558030 wait complete. 2024-09-10T23:36:01.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe8db2740 20 client.19488 trim_cache size 0 max 16384 2024-09-10T23:36:01.232 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfc80b52e0 msgr2=0x7fdfc80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfc80b52e0 0x7fdfc80b77a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80cd550 tx=0x7fdfd8092020 comp rx=0 tx=0).stop 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 msgr2=0x7fdfe00fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe00fe680 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098d0 tx=0x7fdfd80317b0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 shutdown_connections 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fdfc80b52e0 0x7fdfc80b77a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0108020 0x7fdfe00fe680 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfe01076a0 0x7fdfe00fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 --2- 172.21.15.2:0/4282962726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe0101c90 0x7fdfe00fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 >> 172.21.15.2:0/4282962726 conn(0x7fdfe00fd700 msgr2=0x7fdfe006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 shutdown_connections 2024-09-10T23:36:01.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:01.225+0000 7fdfe69dd640 1 -- 172.21.15.2:0/4282962726 wait complete. 2024-09-10T23:36:01.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:01 smithi002 ceph-mon[31150]: pgmap v702: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:02.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:36:02.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:01 smithi177 ceph-mon[35760]: pgmap v702: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:02.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:01 smithi154 ceph-mon[35136]: pgmap v702: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:02.351 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.846+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2434960109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 msgr2=0x7fb67810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.846+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2434960109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb67810caf0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009900 tx=0x7fb66c02a410 comp rx=0 tx=0).stop 2024-09-10T23:36:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2434960109 shutdown_connections 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2434960109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67810d140 0x7fb67810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2434960109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb67810caf0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2434960109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb678103ce0 0x7fb6781040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2434960109 >> 172.21.15.2:0/2434960109 conn(0x7fb6780fd720 msgr2=0x7fb6780ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2434960109 shutdown_connections 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2434960109 wait complete. 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 Processor -- start 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.847+0000 7fb67dcbb640 1 -- start start 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb67dcbb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb678103ce0 0x7fb6781992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb67dcbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb678199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb67dcbb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67810d140 0x7fb67819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb67dcbb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb678112db0 con 0x7fb678104600 2024-09-10T23:36:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb67dcbb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb678112c30 con 0x7fb678103ce0 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb67dcbb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb678112f30 con 0x7fb67810d140 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb678199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb678199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56792/0 (socket says 172.21.15.2:56792) 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 -- 172.21.15.2:0/2441570815 learned_addr learned my addr 172.21.15.2:0/2441570815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb6777fe640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb678103ce0 0x7fb6781992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb677fff640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67810d140 0x7fb67819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 -- 172.21.15.2:0/2441570815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67810d140 msgr2=0x7fb67819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67810d140 0x7fb67819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 -- 172.21.15.2:0/2441570815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb678103ce0 msgr2=0x7fb6781992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb678103ce0 0x7fb6781992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 -- 172.21.15.2:0/2441570815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67819f390 con 0x7fb678104600 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.848+0000 7fb676ffd640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb678199820 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fb66c032fd0 tx=0x7fb66c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.849+0000 7fb674ff9640 1 -- 172.21.15.2:0/2441570815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c03f030 con 0x7fb678104600 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.849+0000 7fb674ff9640 1 -- 172.21.15.2:0/2441570815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c004490 con 0x7fb678104600 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.849+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67819f620 con 0x7fb678104600 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.849+0000 7fb674ff9640 1 -- 172.21.15.2:0/2441570815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035070 con 0x7fb678104600 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.849+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781a5d40 con 0x7fb678104600 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 Processor -- start 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 -- start start 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe8630f0 0x558bfe8634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb674ff9640 1 -- 172.21.15.2:0/2441570815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb66c03ba30 con 0x7fb678104600 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe86f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe86f9a0 0x558bfe871d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558bfe7d9ea0 con 0x558bfe863a10 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558bfe7c92d0 con 0x558bfe8630f0 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb680090740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558bfe7cd0e0 con 0x558bfe86f9a0 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.851+0000 7fb6777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe86f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe86f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56808/0 (socket says 172.21.15.2:56808) 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 -- 172.21.15.2:0/3869928804 learned_addr learned my addr 172.21.15.2:0/3869928804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb677fff640 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe8630f0 0x558bfe8634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb676ffd640 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe86f9a0 0x558bfe871d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 -- 172.21.15.2:0/3869928804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe86f9a0 msgr2=0x558bfe871d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe86f9a0 0x558bfe871d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 -- 172.21.15.2:0/3869928804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe8630f0 msgr2=0x558bfe8634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe8630f0 0x558bfe8634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 -- 172.21.15.2:0/3869928804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfe527650 con 0x558bfe863a10 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb677fff640 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe8630f0 0x558bfe8634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb6777fe640 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe86f460 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fb668009cf0 tx=0x7fb668011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759343545807f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb674ff9640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6600b5360 0x7fb6600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb677fff640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6600b5360 0x7fb6600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb674ff9640 1 -- 172.21.15.2:0/2441570815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb66c106180 con 0x7fb678104600 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb65dffb640 1 -- 172.21.15.2:0/3869928804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668004230 con 0x558bfe863a10 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb65dffb640 1 -- 172.21.15.2:0/3869928804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6680043d0 con 0x558bfe863a10 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.852+0000 7fb65dffb640 1 -- 172.21.15.2:0/3869928804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668019880 con 0x558bfe863a10 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 -- 172.21.15.2:0/3869928804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 msgr2=0x558bfe86f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb677fff640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6600b5360 0x7fb6600b7820 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb670005fd0 tx=0x7fb670009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe86f460 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fb668009cf0 tx=0x7fb668011810 comp rx=0 tx=0).stop 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 -- 172.21.15.2:0/3869928804 shutdown_connections 2024-09-10T23:36:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe86f9a0 0x558bfe871d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe86f460 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 --2- 172.21.15.2:0/3869928804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe8630f0 0x558bfe8634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 -- 172.21.15.2:0/3869928804 >> 172.21.15.2:0/3869928804 conn(0x558bfe860f20 msgr2=0x558bfe8620c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 -- 172.21.15.2:0/3869928804 shutdown_connections 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 -- 172.21.15.2:0/3869928804 wait complete. 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.853+0000 7fb680090740 1 -- start start 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 Processor -- start 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe86f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe86c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe86cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558bfe62a700 con 0x558bfe8630f0 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558bfe764160 con 0x558bfe86f9a0 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558bfe872620 con 0x558bfe863a10 2024-09-10T23:36:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb680090740 10 client.0 _ll_register_callbacks cb 0x558bfe77d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe86f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe86f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56810/0 (socket says 172.21.15.2:56810) 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 -- 172.21.15.2:0/1184216173 learned_addr learned my addr 172.21.15.2:0/1184216173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb677fff640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe86cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb676ffd640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe86c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 -- 172.21.15.2:0/1184216173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 msgr2=0x558bfe86c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe86c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 -- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 msgr2=0x558bfe86cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe86cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.854+0000 7fb6777fe640 1 -- 172.21.15.2:0/1184216173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfe791c90 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb677fff640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe86cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb6777fe640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe86f2e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb668019460 tx=0x7fb6680096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b249e325d89adf0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb656ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb656ffd640 1 -- 172.21.15.2:0/1184216173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668027070 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb656ffd640 1 -- 172.21.15.2:0/1184216173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb668005040 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6680043d0 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb656ffd640 1 -- 172.21.15.2:0/1184216173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb668033050 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb680090740 10 client.19500 fetch_fsmap learned FSMap version 28 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558bfe87e000 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb656ffd640 1 -- 172.21.15.2:0/1184216173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6680043d0 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb656ffd640 1 -- 172.21.15.2:0/1184216173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb668004a60 con 0x558bfe8630f0 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.855+0000 7fb680090740 10 client.19500 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:36:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb680090740 10 client.19500 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb680090740 20 client.19500 populate_metadata read hostname 'smithi002' 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb680090740 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe87f3b0 0x558bfe8817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb680090740 4 client.19500 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bfe7dbdf0 con 0x558bfe87f3b0 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb676ffd640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe87f3b0 0x558bfe8817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb676ffd640 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe87f3b0 0x558bfe8817a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1019a89dc8b3e9d7 server_cookie=cbdc809bc390210c in_seq=0 out_seq=0 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.856+0000 7fb656ffd640 10 client.19500 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb656ffd640 1 -- 172.21.15.2:0/1184216173 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558bfe7dbdf0 con 0x558bfe87f3b0 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb656ffd640 10 client.19500 handle_command_reply: tid=0 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 client.19500 shutdown 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 msgr2=0x558bfe86f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe86f2e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb668019460 tx=0x7fb6680096f0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 shutdown_connections 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe86cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe86c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe87f3b0 0x558bfe8817a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 --2- 172.21.15.2:0/1184216173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe86f2e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb656ffd640 0 client.19500 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 >> 172.21.15.2:0/1184216173 conn(0x558bfe860f20 msgr2=0x558bfe866ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 shutdown_connections 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 1 -- 172.21.15.2:0/1184216173 wait complete. 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.857+0000 7fb680090740 20 client.19500 trim_cache size 0 max 16384 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.870+0000 7fb680090740 1 Processor -- start 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.870+0000 7fb680090740 1 -- start start 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb680090740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe8630f0 0x558bfe87b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb680090740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe870d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb680090740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe8712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb680090740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781ae380 con 0x558bfe863a10 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb680090740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781afec0 con 0x558bfe86f9a0 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb680090740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781aea50 con 0x558bfe8630f0 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe870d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe870d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56822/0 (socket says 172.21.15.2:56822) 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 -- 172.21.15.2:0/890351607 learned_addr learned my addr 172.21.15.2:0/890351607 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb677fff640 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe8712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 -- 172.21.15.2:0/890351607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe8630f0 msgr2=0x558bfe87b8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe8630f0 0x558bfe87b8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 -- 172.21.15.2:0/890351607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 msgr2=0x558bfe8712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe8712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 -- 172.21.15.2:0/890351607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfe86d120 con 0x558bfe863a10 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb677fff640 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe8712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.871+0000 7fb676ffd640 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe870d90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c03b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae02e67bc907589 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb65d7fa640 1 -- 172.21.15.2:0/890351607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c049040 con 0x558bfe863a10 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb65d7fa640 1 -- 172.21.15.2:0/890351607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c0cc460 con 0x558bfe863a10 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb65d7fa640 1 -- 172.21.15.2:0/890351607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c003d30 con 0x558bfe863a10 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 -- 172.21.15.2:0/890351607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 msgr2=0x558bfe870d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe870d90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c03b560 comp rx=0 tx=0).stop 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 -- 172.21.15.2:0/890351607 shutdown_connections 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe8712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe863a10 0x558bfe870d90 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 --2- 172.21.15.2:0/890351607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe8630f0 0x558bfe87b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 -- 172.21.15.2:0/890351607 >> 172.21.15.2:0/890351607 conn(0x558bfe860f20 msgr2=0x558bfe861fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 -- 172.21.15.2:0/890351607 shutdown_connections 2024-09-10T23:36:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.872+0000 7fb680090740 1 -- 172.21.15.2:0/890351607 wait complete. 2024-09-10T23:36:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 -- start start 2024-09-10T23:36:02.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 Processor -- start 2024-09-10T23:36:02.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe8e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe877900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe877e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781af7f0 con 0x558bfe8630f0 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781af120 con 0x558bfe86f9a0 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781ac360 con 0x558bfe863a10 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb680090740 10 client.0 _ll_register_callbacks cb 0x7fb668009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb6777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe8e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb6777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe8e9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56836/0 (socket says 172.21.15.2:56836) 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.873+0000 7fb6777fe640 1 -- 172.21.15.2:0/4126048192 learned_addr learned my addr 172.21.15.2:0/4126048192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb676ffd640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe877900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb677fff640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe877e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb6777fe640 1 -- 172.21.15.2:0/4126048192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 msgr2=0x558bfe877900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb6777fe640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe877900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb6777fe640 1 -- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 msgr2=0x558bfe877e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb6777fe640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe877e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb6777fe640 1 -- 172.21.15.2:0/4126048192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfe878480 con 0x558bfe8630f0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb677fff640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe877e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb6777fe640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe8e9bd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb6680058c0 tx=0x7fb6680197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8730f2b020588d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb656ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb656ffd640 1 -- 172.21.15.2:0/4126048192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668030020 con 0x558bfe8630f0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb656ffd640 1 -- 172.21.15.2:0/4126048192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fb668019990 con 0x558bfe8630f0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb66c0cc460 con 0x558bfe8630f0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb656ffd640 1 -- 172.21.15.2:0/4126048192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb668027070 con 0x558bfe8630f0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb680090740 10 client.19506 fetch_fsmap learned FSMap version 28 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.874+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558bfe8f4dd0 con 0x558bfe8630f0 2024-09-10T23:36:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb656ffd640 1 -- 172.21.15.2:0/4126048192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c0cc460 con 0x558bfe8630f0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb656ffd640 1 -- 172.21.15.2:0/4126048192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb668019bd0 con 0x558bfe8630f0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb680090740 10 client.19506 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb680090740 10 client.19506 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb680090740 20 client.19506 populate_metadata read hostname 'smithi002' 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb680090740 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe8f53b0 0x558bfe8f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb680090740 4 client.19506 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 --> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558bfe7d78a0 con 0x558bfe8f53b0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb676ffd640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe8f53b0 0x558bfe8f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb676ffd640 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe8f53b0 0x558bfe8f77d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae2cfdfedefda890 server_cookie=311a470ea3f5ab5b in_seq=0 out_seq=0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.875+0000 7fb656ffd640 10 client.19506 ms_handle_connect on v2:172.21.15.154:6838/3482947796 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb656ffd640 1 -- 172.21.15.2:0/4126048192 <== mds.1 v2:172.21.15.154:6838/3482947796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558bfe7d78a0 con 0x558bfe8f53b0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb656ffd640 10 client.19506 handle_command_reply: tid=0 2024-09-10T23:36:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 client.19506 shutdown 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 msgr2=0x558bfe8e9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe8e9bd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb6680058c0 tx=0x7fb6680197f0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 shutdown_connections 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bfe86f9a0 0x558bfe877e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bfe863a10 0x558bfe877900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.154:6838/3482947796,v1:172.21.15.154:6839/3482947796] conn(0x558bfe8f53b0 0x558bfe8f77d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 --2- 172.21.15.2:0/4126048192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558bfe8630f0 0x558bfe8e9bd0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 >> 172.21.15.2:0/4126048192 conn(0x558bfe860f20 msgr2=0x558bfe86dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb656ffd640 0 client.19506 ms_handle_reset on v2:172.21.15.154:6838/3482947796 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 shutdown_connections 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 1 -- 172.21.15.2:0/4126048192 wait complete. 2024-09-10T23:36:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.876+0000 7fb680090740 20 client.19506 trim_cache size 0 max 16384 2024-09-10T23:36:02.893 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:36:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6600b5360 msgr2=0x7fb6600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6600b5360 0x7fb6600b7820 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb670005fd0 tx=0x7fb670009580 comp rx=0 tx=0).stop 2024-09-10T23:36:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 msgr2=0x7fb678199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb678199820 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fb66c032fd0 tx=0x7fb66c031a20 comp rx=0 tx=0).stop 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 shutdown_connections 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fb6600b5360 0x7fb6600b7820 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67810d140 0x7fb67819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb678104600 0x7fb678199820 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 --2- 172.21.15.2:0/2441570815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb678103ce0 0x7fb6781992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 >> 172.21.15.2:0/2441570815 conn(0x7fb6780fd720 msgr2=0x7fb6780fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 shutdown_connections 2024-09-10T23:36:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:02.877+0000 7fb67dcbb640 1 -- 172.21.15.2:0/2441570815 wait complete. 2024-09-10T23:36:03.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:36:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:04.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:03 smithi002 ceph-mon[31150]: pgmap v703: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:36:04.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:03 smithi177 ceph-mon[35760]: pgmap v703: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:36:04.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:03 smithi154 ceph-mon[35136]: pgmap v703: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:36:04.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/2154060732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc101cd0 msgr2=0x7fc0bc1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/2154060732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc101cd0 0x7fc0bc1020b0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009900 tx=0x7fc0ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:36:04.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/2154060732 shutdown_connections 2024-09-10T23:36:04.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/2154060732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 0x7fc0bc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/2154060732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/2154060732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc101cd0 0x7fc0bc1020b0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/2154060732 >> 172.21.15.2:0/2154060732 conn(0x7fc0bc0fd700 msgr2=0x7fc0bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/2154060732 shutdown_connections 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.550+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/2154060732 wait complete. 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 Processor -- start 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 -- start start 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0bc101cd0 0x7fc0bc1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 0x7fc0bc19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc111d20 con 0x7fc0bc1076e0 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc111ba0 con 0x7fc0bc108060 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0c0ef9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc111ea0 con 0x7fc0bc101cd0 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0b9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0b9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56862/0 (socket says 172.21.15.2:56862) 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/1829773355 learned_addr learned my addr 172.21.15.2:0/1829773355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:04.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0bc101cd0 0x7fc0bc1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 0x7fc0bc19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/1829773355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0bc101cd0 msgr2=0x7fc0bc1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.551+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0bc101cd0 0x7fc0bc1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/1829773355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 msgr2=0x7fc0bc19dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 0x7fc0bc19dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/1829773355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc19e2a0 con 0x7fc0bc1076e0 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 0x7fc0bc19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc198730 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b4a0 tx=0x7fc0b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:04.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0ab7fe640 1 -- 172.21.15.2:0/1829773355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0014070 con 0x7fc0bc1076e0 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0ab7fe640 1 -- 172.21.15.2:0/1829773355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b0010ac0 con 0x7fc0bc1076e0 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc19e590 con 0x7fc0bc1076e0 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0ab7fe640 1 -- 172.21.15.2:0/1829773355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0017c30 con 0x7fc0bc1076e0 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.552+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc06b510 con 0x7fc0bc1076e0 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.554+0000 7fc0ab7fe640 1 -- 172.21.15.2:0/1829773355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc0b0010610 con 0x7fc0bc1076e0 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 Processor -- start 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 -- start start 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae6230f0 0x5562ae6234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 0x5562ae62f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae62f9a0 0x5562ae631d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ae599ea0 con 0x5562ae623a10 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5562ae5892d0 con 0x5562ae62f9a0 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5562ae58d0e0 con 0x5562ae6230f0 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 0x5562ae62f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 0x5562ae62f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56866/0 (socket says 172.21.15.2:56866) 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0ba59c640 1 -- 172.21.15.2:0/2631743232 learned_addr learned my addr 172.21.15.2:0/2631743232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae6230f0 0x5562ae6234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.555+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae62f9a0 0x5562ae631d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ba59c640 1 -- 172.21.15.2:0/2631743232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae6230f0 msgr2=0x5562ae6234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae6230f0 0x5562ae6234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ba59c640 1 -- 172.21.15.2:0/2631743232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae62f9a0 msgr2=0x5562ae631d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae62f9a0 0x5562ae631d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ba59c640 1 -- 172.21.15.2:0/2631743232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ae2e7650 con 0x5562ae623a10 2024-09-10T23:36:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ab7fe640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc0a40b52e0 0x7fc0a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 0x5562ae62f460 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009900 tx=0x7fc0ac032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dabf5a3f2811d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc0a40b52e0 0x7fc0a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0ab7fe640 1 -- 172.21.15.2:0/1829773355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc0b00e5180 con 0x7fc0bc1076e0 2024-09-10T23:36:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0a8ff9640 1 -- 172.21.15.2:0/2631743232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac040070 con 0x5562ae623a10 2024-09-10T23:36:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0a8ff9640 1 -- 172.21.15.2:0/2631743232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0ac0316a0 con 0x5562ae623a10 2024-09-10T23:36:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.556+0000 7fc0a8ff9640 1 -- 172.21.15.2:0/2631743232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac035040 con 0x5562ae623a10 2024-09-10T23:36:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 -- 172.21.15.2:0/2631743232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 msgr2=0x5562ae62f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 0x5562ae62f460 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009900 tx=0x7fc0ac032e60 comp rx=0 tx=0).stop 2024-09-10T23:36:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc0a40b52e0 0x7fc0a40b77a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4005fd0 tx=0x7fc0b4009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 -- 172.21.15.2:0/2631743232 shutdown_connections 2024-09-10T23:36:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae62f9a0 0x5562ae631d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae623a10 0x5562ae62f460 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/2631743232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae6230f0 0x5562ae6234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 -- 172.21.15.2:0/2631743232 >> 172.21.15.2:0/2631743232 conn(0x5562ae620f20 msgr2=0x5562ae6220c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 -- 172.21.15.2:0/2631743232 shutdown_connections 2024-09-10T23:36:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 -- 172.21.15.2:0/2631743232 wait complete. 2024-09-10T23:36:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 -- start start 2024-09-10T23:36:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.557+0000 7fc0c32ce740 1 Processor -- start 2024-09-10T23:36:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae62f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae62c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae62cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ae3ea700 con 0x5562ae6230f0 2024-09-10T23:36:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5562ae524160 con 0x5562ae623a10 2024-09-10T23:36:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5562ae6325c0 con 0x5562ae62f9a0 2024-09-10T23:36:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 10 client.0 _ll_register_callbacks cb 0x5562ae53d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:36:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae62f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae62f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56872/0 (socket says 172.21.15.2:56872) 2024-09-10T23:36:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 -- 172.21.15.2:0/1037539802 learned_addr learned my addr 172.21.15.2:0/1037539802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae62c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae62cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 -- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 msgr2=0x5562ae62cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae62cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 -- 172.21.15.2:0/1037539802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 msgr2=0x5562ae62c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae62c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 -- 172.21.15.2:0/1037539802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ae551c90 con 0x5562ae6230f0 2024-09-10T23:36:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae62cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae62f230 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac031a80 tx=0x7fc0ac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fabc98eafd34c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:36:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/1037539802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac04c060 con 0x5562ae6230f0 2024-09-10T23:36:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/1037539802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc0ac004230 con 0x5562ae6230f0 2024-09-10T23:36:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.558+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0ac0316a0 con 0x5562ae6230f0 2024-09-10T23:36:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/1037539802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0ac035070 con 0x5562ae6230f0 2024-09-10T23:36:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 10 client.19518 fetch_fsmap learned FSMap version 28 2024-09-10T23:36:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562ae63de90 con 0x5562ae6230f0 2024-09-10T23:36:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/1037539802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0ac0316a0 con 0x5562ae6230f0 2024-09-10T23:36:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/1037539802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc0ac03c4d0 con 0x5562ae6230f0 2024-09-10T23:36:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 10 client.19518 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:36:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 10 client.19518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:36:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 20 client.19518 populate_metadata read hostname 'smithi002' 2024-09-10T23:36:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae63f1e0 0x5562ae6415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 4 client.19518 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:36:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562ae59bdf0 con 0x5562ae63f1e0 2024-09-10T23:36:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.559+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae63f1e0 0x5562ae6415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.560+0000 7fc0a1ffb640 10 client.19518 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:36:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.560+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae63f1e0 0x5562ae6415d0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a13263eb61d62bd server_cookie=59e9d54f25c0ba4f in_seq=0 out_seq=0 2024-09-10T23:36:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/1037539802 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562ae59bdf0 con 0x5562ae63f1e0 2024-09-10T23:36:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0a1ffb640 10 client.19518 handle_command_reply: tid=0 2024-09-10T23:36:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 client.19518 shutdown 2024-09-10T23:36:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 msgr2=0x5562ae62f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae62f230 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac031a80 tx=0x7fc0ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:36:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 shutdown_connections 2024-09-10T23:36:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae63f1e0 0x5562ae6415d0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae62cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae62c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0a1ffb640 0 client.19518 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:36:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/1037539802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae62f230 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 >> 172.21.15.2:0/1037539802 conn(0x5562ae620f20 msgr2=0x5562ae626ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 shutdown_connections 2024-09-10T23:36:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 1 -- 172.21.15.2:0/1037539802 wait complete. 2024-09-10T23:36:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.561+0000 7fc0c32ce740 20 client.19518 trim_cache size 0 max 16384 2024-09-10T23:36:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 Processor -- start 2024-09-10T23:36:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 -- start start 2024-09-10T23:36:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae6230f0 0x5562ae620760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae623a10 0x5562ae62e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 0x5562ae630d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1ae3e0 con 0x5562ae62f9a0 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1aff20 con 0x5562ae6230f0 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1aeab0 con 0x5562ae623a10 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 0x5562ae630d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 0x5562ae630d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56888/0 (socket says 172.21.15.2:56888) 2024-09-10T23:36:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 -- 172.21.15.2:0/99430966 learned_addr learned my addr 172.21.15.2:0/99430966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae623a10 0x5562ae62e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae6230f0 0x5562ae620760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 -- 172.21.15.2:0/99430966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae623a10 msgr2=0x5562ae62e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae623a10 0x5562ae62e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 -- 172.21.15.2:0/99430966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae6230f0 msgr2=0x5562ae620760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae6230f0 0x5562ae620760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0bad9d640 1 -- 172.21.15.2:0/99430966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ae62ab80 con 0x5562ae62f9a0 2024-09-10T23:36:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.575+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae6230f0 0x5562ae620760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 0x5562ae630d90 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009a70 tx=0x7fc0b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6aeb60b15abfef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0a3fff640 1 -- 172.21.15.2:0/99430966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b402b070 con 0x5562ae62f9a0 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0a3fff640 1 -- 172.21.15.2:0/99430966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b401ec00 con 0x5562ae62f9a0 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0a3fff640 1 -- 172.21.15.2:0/99430966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b401cd40 con 0x5562ae62f9a0 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 -- 172.21.15.2:0/99430966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 msgr2=0x5562ae630d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 0x5562ae630d90 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009a70 tx=0x7fc0b4015000 comp rx=0 tx=0).stop 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 -- 172.21.15.2:0/99430966 shutdown_connections 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae62f9a0 0x5562ae630d90 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae623a10 0x5562ae62e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/99430966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae6230f0 0x5562ae620760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.576+0000 7fc0c32ce740 1 -- 172.21.15.2:0/99430966 >> 172.21.15.2:0/99430966 conn(0x5562ae620f20 msgr2=0x5562ae62dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 -- 172.21.15.2:0/99430966 shutdown_connections 2024-09-10T23:36:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 -- 172.21.15.2:0/99430966 wait complete. 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 -- start start 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 Processor -- start 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae637c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae6381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae632980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1af850 con 0x5562ae6230f0 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1af180 con 0x5562ae623a10 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1ac3c0 con 0x5562ae62f9a0 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0c32ce740 10 client.0 _ll_register_callbacks cb 0x7fc0b40095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae637c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae637c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56900/0 (socket says 172.21.15.2:56900) 2024-09-10T23:36:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0ba59c640 1 -- 172.21.15.2:0/3316874764 learned_addr learned my addr 172.21.15.2:0/3316874764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.577+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae632980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae6381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0ba59c640 1 -- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 msgr2=0x5562ae632980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae632980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0ba59c640 1 -- 172.21.15.2:0/3316874764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 msgr2=0x5562ae6381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae6381b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0ba59c640 1 -- 172.21.15.2:0/3316874764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ae6331b0 con 0x5562ae6230f0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae632980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae637c30 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009900 tx=0x7fc0ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bfc7b16ca2f98d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/3316874764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac057070 con 0x5562ae6230f0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/3316874764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fc0ac03c640 con 0x5562ae6230f0 2024-09-10T23:36:04.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b401ec00 con 0x5562ae6230f0 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/3316874764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0ac04c070 con 0x5562ae6230f0 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0c32ce740 10 client.19524 fetch_fsmap learned FSMap version 28 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562ae6b0de0 con 0x5562ae6230f0 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.578+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/3316874764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b401ec00 con 0x5562ae6230f0 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/3316874764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc0ac053ba0 con 0x5562ae6230f0 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0c32ce740 10 client.19524 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0c32ce740 10 client.19524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0c32ce740 20 client.19524 populate_metadata read hostname 'smithi002' 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae6b1500 0x5562ae6b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0c32ce740 4 client.19524 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 --> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5562ae5978a0 con 0x5562ae6b1500 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae6b1500 0x5562ae6b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0a1ffb640 10 client.19524 ms_handle_connect on v2:172.21.15.177:6838/2078594456 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.579+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae6b1500 0x5562ae6b3920 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2972447774119edb server_cookie=63bb79c9c384ff4a in_seq=0 out_seq=0 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0a1ffb640 1 -- 172.21.15.2:0/3316874764 <== mds.0 v2:172.21.15.177:6838/2078594456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5562ae5978a0 con 0x5562ae6b1500 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0a1ffb640 10 client.19524 handle_command_reply: tid=0 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 client.19524 shutdown 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 msgr2=0x5562ae637c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae637c30 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009900 tx=0x7fc0ac001e70 comp rx=0 tx=0).stop 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 shutdown_connections 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:6838/2078594456,v1:172.21.15.177:6839/2078594456] conn(0x5562ae6b1500 0x5562ae6b3920 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5562ae62f9a0 0x5562ae632980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562ae623a10 0x5562ae6381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 --2- 172.21.15.2:0/3316874764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ae6230f0 0x5562ae637c30 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 >> 172.21.15.2:0/3316874764 conn(0x5562ae620f20 msgr2=0x5562ae62e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0a1ffb640 0 client.19524 ms_handle_reset on v2:172.21.15.177:6838/2078594456 2024-09-10T23:36:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 shutdown_connections 2024-09-10T23:36:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 1 -- 172.21.15.2:0/3316874764 wait complete. 2024-09-10T23:36:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c32ce740 20 client.19524 trim_cache size 0 max 16384 2024-09-10T23:36:04.614 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc0a40b52e0 msgr2=0x7fc0a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc0a40b52e0 0x7fc0a40b77a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4005fd0 tx=0x7fc0b4009700 comp rx=0 tx=0).stop 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 msgr2=0x7fc0bc198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.580+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc198730 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b4a0 tx=0x7fc0b000b960 comp rx=0 tx=0).stop 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 shutdown_connections 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fc0a40b52e0 0x7fc0a40b77a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0bc108060 0x7fc0bc19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc1076e0 0x7fc0bc198730 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 --2- 172.21.15.2:0/1829773355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0bc101cd0 0x7fc0bc1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 >> 172.21.15.2:0/1829773355 conn(0x7fc0bc0fd700 msgr2=0x7fc0bc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 shutdown_connections 2024-09-10T23:36:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:04.581+0000 7fc0c0ef9640 1 -- 172.21.15.2:0/1829773355 wait complete. 2024-09-10T23:36:05.409 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T23:36:05.409 INFO:tasks.fwd_scrub:done joining 2024-09-10T23:36:05.410 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T23:36:05.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:36:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 -- 172.21.15.2:0/2458841951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 msgr2=0x7ff338107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 --2- 172.21.15.2:0/2458841951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338107d80 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009900 tx=0x7ff32c02a410 comp rx=0 tx=0).stop 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 -- 172.21.15.2:0/2458841951 shutdown_connections 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 --2- 172.21.15.2:0/2458841951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3381084c0 0x7ff33810a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 --2- 172.21.15.2:0/2458841951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338107d80 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 --2- 172.21.15.2:0/2458841951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff33806bcc0 0x7ff338105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 -- 172.21.15.2:0/2458841951 >> 172.21.15.2:0/2458841951 conn(0x7ff3380fcf50 msgr2=0x7ff3380ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 -- 172.21.15.2:0/2458841951 shutdown_connections 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.536+0000 7ff33759e640 1 -- 172.21.15.2:0/2458841951 wait complete. 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 Processor -- start 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 -- start start 2024-09-10T23:36:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff33806bcc0 0x7ff338198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3381084c0 0x7ff338199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff33810e460 con 0x7ff338105910 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff33810e2e0 con 0x7ff3381084c0 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff33759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff33810e5e0 con 0x7ff33806bcc0 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff335d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.537+0000 7ff335d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56916/0 (socket says 172.21.15.2:56916) 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 -- 172.21.15.2:0/2888801747 learned_addr learned my addr 172.21.15.2:0/2888801747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff33659c640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff33806bcc0 0x7ff338198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff336d9d640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3381084c0 0x7ff338199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 -- 172.21.15.2:0/2888801747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff33806bcc0 msgr2=0x7ff338198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff33806bcc0 0x7ff338198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 -- 172.21.15.2:0/2888801747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3381084c0 msgr2=0x7ff338199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3381084c0 0x7ff338199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 -- 172.21.15.2:0/2888801747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33819a6f0 con 0x7ff338105910 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff336d9d640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3381084c0 0x7ff338199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff335d9b640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338199200 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff32c005ab0 tx=0x7ff32c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c03f070 con 0x7ff338105910 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32c03b460 con 0x7ff338105910 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33819a980 con 0x7ff338105910 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c035030 con 0x7ff338105910 2024-09-10T23:36:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.538+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33819ac90 con 0x7ff338105910 2024-09-10T23:36:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.539+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3380fea40 con 0x7ff338105910 2024-09-10T23:36:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.541+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff32c03b8d0 con 0x7ff338105910 2024-09-10T23:36:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.542+0000 7ff3277fe640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3200b52e0 0x7ff3200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.542+0000 7ff33659c640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3200b52e0 0x7ff3200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.542+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff32c106c90 con 0x7ff338105910 2024-09-10T23:36:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.542+0000 7ff33659c640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3200b52e0 0x7ff3200b77a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff328005fd0 tx=0x7ff328005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:05.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.545+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff32c0cdb00 con 0x7ff338105910 2024-09-10T23:36:05.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.731+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff33802e810 con 0x7ff338105910 2024-09-10T23:36:05.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.733+0000 7ff3277fe640 1 -- 172.21.15.2:0/2888801747 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7ff32c0cd400 con 0x7ff338105910 2024-09-10T23:36:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:36:05.734 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3200b52e0 msgr2=0x7ff3200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3200b52e0 0x7ff3200b77a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff328005fd0 tx=0x7ff328005850 comp rx=0 tx=0).stop 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 msgr2=0x7ff338199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338199200 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff32c005ab0 tx=0x7ff32c003cd0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 shutdown_connections 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3200b52e0 0x7ff3200b77a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3381084c0 0x7ff338199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338105910 0x7ff338199200 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 --2- 172.21.15.2:0/2888801747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff33806bcc0 0x7ff338198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 >> 172.21.15.2:0/2888801747 conn(0x7ff3380fcf50 msgr2=0x7ff338103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:05.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 shutdown_connections 2024-09-10T23:36:05.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.735+0000 7ff33759e640 1 -- 172.21.15.2:0/2888801747 wait complete. 2024-09-10T23:36:05.747 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:17:34.596978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:22:13.247903+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:22:15.004607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:36:05.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:36:05.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 -- 172.21.15.2:0/1033599831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 msgr2=0x7f86e0109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 --2- 172.21.15.2:0/1033599831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e0109d20 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009cd0 tx=0x7f86d802a8e0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 -- 172.21.15.2:0/1033599831 shutdown_connections 2024-09-10T23:36:05.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 --2- 172.21.15.2:0/1033599831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e0109d20 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 --2- 172.21.15.2:0/1033599831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86e01029e0 0x7f86e0102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 --2- 172.21.15.2:0/1033599831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e0101890 0x7f86e0101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 -- 172.21.15.2:0/1033599831 >> 172.21.15.2:0/1033599831 conn(0x7f86e00fd150 msgr2=0x7f86e00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 -- 172.21.15.2:0/1033599831 shutdown_connections 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.853+0000 7f86e56dd640 1 -- 172.21.15.2:0/1033599831 wait complete. 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 Processor -- start 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 -- start start 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86e0101890 0x7f86e0198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e01029e0 0x7f86e0199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86e010e630 con 0x7f86e01033a0 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86e010e4b0 con 0x7f86e0101890 2024-09-10T23:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86e56dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f86e010e7b0 con 0x7f86e01029e0 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56932/0 (socket says 172.21.15.2:56932) 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86df7fe640 1 -- 172.21.15.2:0/2124735484 learned_addr learned my addr 172.21.15.2:0/2124735484 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86deffd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86e0101890 0x7f86e0198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.854+0000 7f86d7fff640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e01029e0 0x7f86e0199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86df7fe640 1 -- 172.21.15.2:0/2124735484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e01029e0 msgr2=0x7f86e0199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86df7fe640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e01029e0 0x7f86e0199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86df7fe640 1 -- 172.21.15.2:0/2124735484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86e0101890 msgr2=0x7f86e0198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86df7fe640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86e0101890 0x7f86e0198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86df7fe640 1 -- 172.21.15.2:0/2124735484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e019a900 con 0x7f86e01033a0 2024-09-10T23:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86d7fff640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e01029e0 0x7f86e0199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86df7fe640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e019a040 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f86d8033040 tx=0x7f86d8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8004450 con 0x7f86e01033a0 2024-09-10T23:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86d8003e10 con 0x7f86e01033a0 2024-09-10T23:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e019ab90 con 0x7f86e01033a0 2024-09-10T23:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d803b400 con 0x7f86e01033a0 2024-09-10T23:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.855+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e01a12c0 con 0x7f86e01033a0 2024-09-10T23:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.856+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e0101c90 con 0x7f86e01033a0 2024-09-10T23:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.857+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f86d804d020 con 0x7f86e01033a0 2024-09-10T23:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.858+0000 7f86dcff9640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86cc0b52e0 0x7f86cc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.858+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f86d802e030 con 0x7f86e01033a0 2024-09-10T23:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.858+0000 7f86deffd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86cc0b52e0 0x7f86cc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.859+0000 7f86deffd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86cc0b52e0 0x7f86cc0b77a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f86d0005fd0 tx=0x7f86d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:05.861+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f86d80cdad0 con 0x7f86e01033a0 2024-09-10T23:36:06.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.046+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86e002e5c0 con 0x7f86e01033a0 2024-09-10T23:36:06.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.046+0000 7f86dcff9640 1 -- 172.21.15.2:0/2124735484 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f86d80cd3d0 con 0x7f86e01033a0 2024-09-10T23:36:06.047 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86cc0b52e0 msgr2=0x7f86cc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86cc0b52e0 0x7f86cc0b77a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f86d0005fd0 tx=0x7f86d000b390 comp rx=0 tx=0).stop 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 msgr2=0x7f86e019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e019a040 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f86d8033040 tx=0x7f86d8003c20 comp rx=0 tx=0).stop 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 shutdown_connections 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f86cc0b52e0 0x7f86cc0b77a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86e01033a0 0x7f86e019a040 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86e01029e0 0x7f86e0199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 --2- 172.21.15.2:0/2124735484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86e0101890 0x7f86e0198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 >> 172.21.15.2:0/2124735484 conn(0x7f86e00fd150 msgr2=0x7f86e0105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:06.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 shutdown_connections 2024-09-10T23:36:06.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.049+0000 7f86e56dd640 1 -- 172.21.15.2:0/2124735484 wait complete. 2024-09-10T23:36:06.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.167+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3801013887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 msgr2=0x7f8c6c101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.167+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3801013887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c101c60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009cd0 tx=0x7f8c5c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3801013887 shutdown_connections 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3801013887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c6c103370 0x7f8c6c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3801013887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6c1029b0 0x7f8c6c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3801013887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c101c60 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3801013887 >> 172.21.15.2:0/3801013887 conn(0x7f8c6c0fd140 msgr2=0x7f8c6c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3801013887 shutdown_connections 2024-09-10T23:36:06.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3801013887 wait complete. 2024-09-10T23:36:06.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 Processor -- start 2024-09-10T23:36:06.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.168+0000 7f8c71fe8640 1 -- start start 2024-09-10T23:36:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c6c1029b0 0x7f8c6c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6c103370 0x7f8c6c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10e620 con 0x7f8c6c101860 2024-09-10T23:36:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10e4a0 con 0x7f8c6c103370 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10e7a0 con 0x7f8c6c1029b0 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56946/0 (socket says 172.21.15.2:56946) 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 -- 172.21.15.2:0/3623163015 learned_addr learned my addr 172.21.15.2:0/3623163015 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6affd640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c6c1029b0 0x7f8c6c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 -- 172.21.15.2:0/3623163015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c6c1029b0 msgr2=0x7f8c6c1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c6c1029b0 0x7f8c6c1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 -- 172.21.15.2:0/3623163015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6c103370 msgr2=0x7f8c6c199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6bfff640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6c103370 0x7f8c6c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6c103370 0x7f8c6c199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 -- 172.21.15.2:0/3623163015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c19a890 con 0x7f8c6c101860 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c6b7fe640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c198d50 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000f80 tx=0x7f8c5c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c004450 con 0x7f8c6c101860 2024-09-10T23:36:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c5c003e50 con 0x7f8c6c101860 2024-09-10T23:36:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c19ab20 con 0x7f8c6c101860 2024-09-10T23:36:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.169+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c03a660 con 0x7f8c6c101860 2024-09-10T23:36:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.170+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c1a1250 con 0x7f8c6c101860 2024-09-10T23:36:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.170+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6c108bd0 con 0x7f8c6c101860 2024-09-10T23:36:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.172+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8c5c04d020 con 0x7f8c6c101860 2024-09-10T23:36:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.173+0000 7f8c68ff9640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8c540b52e0 0x7f8c540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.173+0000 7f8c6affd640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8c540b52e0 0x7f8c540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.173+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8c5c02e030 con 0x7f8c6c101860 2024-09-10T23:36:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.173+0000 7f8c6affd640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8c540b52e0 0x7f8c540b77a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8c60005e10 tx=0x7f8c60005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.176+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8c5c0cde70 con 0x7f8c6c101860 2024-09-10T23:36:06.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:06 smithi154 ceph-mon[35136]: pgmap v704: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:36:06.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:06 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2888801747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:06.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.360+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c6c063d50 con 0x7f8c6c101860 2024-09-10T23:36:06.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.361+0000 7f8c68ff9640 1 -- 172.21.15.2:0/3623163015 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f8c5c0cd770 con 0x7f8c6c101860 2024-09-10T23:36:06.362 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-10T23:36:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8c540b52e0 msgr2=0x7f8c540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8c540b52e0 0x7f8c540b77a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8c60005e10 tx=0x7f8c60005da0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 msgr2=0x7f8c6c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c198d50 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000f80 tx=0x7f8c5c003ba0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 shutdown_connections 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f8c540b52e0 0x7f8c540b77a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6c103370 0x7f8c6c199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c6c1029b0 0x7f8c6c1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 --2- 172.21.15.2:0/3623163015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c6c101860 0x7f8c6c198d50 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 >> 172.21.15.2:0/3623163015 conn(0x7f8c6c0fd140 msgr2=0x7f8c6c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 shutdown_connections 2024-09-10T23:36:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.363+0000 7f8c71fe8640 1 -- 172.21.15.2:0/3623163015 wait complete. 2024-09-10T23:36:06.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:06 smithi002 ceph-mon[31150]: pgmap v704: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:36:06.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:06 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2888801747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:06.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:36:06.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:06 smithi177 ceph-mon[35760]: pgmap v704: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:36:06.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:06 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2888801747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 -- 172.21.15.2:0/554876973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 msgr2=0x7efd48102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 --2- 172.21.15.2:0/554876973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48102c90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7efd38009930 tx=0x7efd3802a420 comp rx=0 tx=0).stop 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 -- 172.21.15.2:0/554876973 shutdown_connections 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 --2- 172.21.15.2:0/554876973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 0x7efd48109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 --2- 172.21.15.2:0/554876973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48102c90 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 --2- 172.21.15.2:0/554876973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 0x7efd48101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 -- 172.21.15.2:0/554876973 >> 172.21.15.2:0/554876973 conn(0x7efd480fcf80 msgr2=0x7efd480ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 -- 172.21.15.2:0/554876973 shutdown_connections 2024-09-10T23:36:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.481+0000 7efd4df9d640 1 -- 172.21.15.2:0/554876973 wait complete. 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 Processor -- start 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 -- start start 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 0x7efd48198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 0x7efd48199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd4810d330 con 0x7efd48102810 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd4810d1b0 con 0x7efd481016c0 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4df9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd4810d4b0 con 0x7efd481031d0 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56952/0 (socket says 172.21.15.2:56952) 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 -- 172.21.15.2:0/3116125710 learned_addr learned my addr 172.21.15.2:0/3116125710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4cf9b640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 0x7efd48198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4d79c640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 0x7efd48199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 -- 172.21.15.2:0/3116125710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 msgr2=0x7efd48199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 0x7efd48199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 -- 172.21.15.2:0/3116125710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 msgr2=0x7efd48198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 0x7efd48198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 -- 172.21.15.2:0/3116125710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4819a600 con 0x7efd48102810 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4d79c640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 0x7efd48199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd4cf9b640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 0x7efd48198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd47fff640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48199180 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7efd38009a50 tx=0x7efd38031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.482+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3803f030 con 0x7efd48102810 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.483+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd380044b0 con 0x7efd48102810 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.483+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4819a890 con 0x7efd48102810 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.483+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38035070 con 0x7efd48102810 2024-09-10T23:36:06.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.483+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481a0fc0 con 0x7efd48102810 2024-09-10T23:36:06.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.484+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd48101ac0 con 0x7efd48102810 2024-09-10T23:36:06.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.485+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7efd3803bb90 con 0x7efd48102810 2024-09-10T23:36:06.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.486+0000 7efd45ffb640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd340b5360 0x7efd340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.486+0000 7efd4cf9b640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd340b5360 0x7efd340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.486+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7efd38106a90 con 0x7efd48102810 2024-09-10T23:36:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.487+0000 7efd4cf9b640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd340b5360 0x7efd340b7820 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efd3000abe0 tx=0x7efd3000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.489+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efd380cd900 con 0x7efd48102810 2024-09-10T23:36:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.676+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efd481a1300 con 0x7efd48102810 2024-09-10T23:36:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.676+0000 7efd45ffb640 1 -- 172.21.15.2:0/3116125710 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7efd380cd200 con 0x7efd48102810 2024-09-10T23:36:06.677 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd340b5360 msgr2=0x7efd340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd340b5360 0x7efd340b7820 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efd3000abe0 tx=0x7efd3000a5c0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 msgr2=0x7efd48199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48199180 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7efd38009a50 tx=0x7efd38031a50 comp rx=0 tx=0).stop 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 shutdown_connections 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7efd340b5360 0x7efd340b7820 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd481031d0 0x7efd48199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd48102810 0x7efd48199180 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 --2- 172.21.15.2:0/3116125710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd481016c0 0x7efd48198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 >> 172.21.15.2:0/3116125710 conn(0x7efd480fcf80 msgr2=0x7efd480fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 shutdown_connections 2024-09-10T23:36:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.679+0000 7efd4df9d640 1 -- 172.21.15.2:0/3116125710 wait complete. 2024-09-10T23:36:06.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T23:36:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2808547356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b34102a00 msgr2=0x7f2b34102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2808547356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b34102a00 0x7f2b34102e80 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009930 tx=0x7f2b2402a420 comp rx=0 tx=0).stop 2024-09-10T23:36:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2808547356 shutdown_connections 2024-09-10T23:36:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2808547356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b341033c0 0x7f2b34109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2808547356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b34102a00 0x7f2b34102e80 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2808547356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b341018b0 0x7f2b34101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2808547356 >> 172.21.15.2:0/2808547356 conn(0x7f2b340fd190 msgr2=0x7f2b340ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2808547356 shutdown_connections 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2808547356 wait complete. 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 Processor -- start 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.793+0000 7f2b3bed4640 1 -- start start 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3bed4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 0x7f2b34198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3bed4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b34102a00 0x7f2b34199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3bed4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b341033c0 0x7f2b3419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3bed4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3410e610 con 0x7f2b341018b0 2024-09-10T23:36:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3bed4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3410e490 con 0x7f2b341033c0 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3bed4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3410e790 con 0x7f2b34102a00 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 0x7f2b34198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 0x7f2b34198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56966/0 (socket says 172.21.15.2:56966) 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 -- 172.21.15.2:0/2736614583 learned_addr learned my addr 172.21.15.2:0/2736614583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3946f640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b34102a00 0x7f2b34199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b3a471640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b341033c0 0x7f2b3419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 -- 172.21.15.2:0/2736614583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b34102a00 msgr2=0x7f2b34199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b34102a00 0x7f2b34199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 -- 172.21.15.2:0/2736614583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b341033c0 msgr2=0x7f2b3419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b341033c0 0x7f2b3419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 -- 172.21.15.2:0/2736614583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3419a960 con 0x7f2b341018b0 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b39c70640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 0x7f2b34198e20 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000c890 tx=0x7f2b3000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:06.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.794+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30004220 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.795+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b300043c0 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.795+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3419ac50 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.795+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30004a00 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.795+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b341a1320 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.795+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b341a14f0 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.797+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2b300079b0 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.798+0000 7f2b2affd640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2b200b52e0 0x7f2b200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.798+0000 7f2b3946f640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2b200b52e0 0x7f2b200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.798+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f2b300e5d70 con 0x7f2b341018b0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.798+0000 7f2b3946f640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2b200b52e0 0x7f2b200b77a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2b24006010 tx=0x7f2b240314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:06.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:06.800+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2b30014030 con 0x7f2b341018b0 2024-09-10T23:36:07.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.034+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f2b341a16c0 con 0x7f2b341018b0 2024-09-10T23:36:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.042+0000 7f2b2affd640 1 -- 172.21.15.2:0/2736614583 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+827935 (secure 0 0 0) 0x7f2b300acbe0 con 0x7f2b341018b0 2024-09-10T23:36:07.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:36:07.053 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:36:07.053 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 18, 2024-09-10T23:36:07.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.053 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 14150, 2024-09-10T23:36:07.053 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3310548901 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3310548901 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:07.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/3310548901", 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-09-10T23:14:50.129336+0000", 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24115, 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540719139924082687, 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-10T23:36:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:36:07.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.057 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-10T23:36:07.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.068 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-10T23:36:07.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-10T23:36:07.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.075 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:36:07.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:36:07.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:36:07.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.084 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-10T23:36:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:36:07.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:36:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.094 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:36:07.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-10T23:36:07.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.103 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.104 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nginx": { 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nginx", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nginx container image", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:36:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-10T23:36:07.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba_metrics": { 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:36:07.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:36:07.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.141 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:36:07.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:36:07.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:36:07.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:36:07.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.164 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.165 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.166 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.173 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:36:07.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:36:07.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:36:07.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:36:07.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:36:07.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:36:07.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:36:07.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "[]", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.197 INFO:teuthology.orchestra.run.smithi002.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "{}", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.198 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:07.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-10T23:36:07.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-10T23:36:07.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-10T23:36:07.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.227 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:07.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-10T23:36:07.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.244 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.247 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-10T23:36:07.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-10T23:36:07.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-10T23:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:36:07.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.259 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-10T23:36:07.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.273 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.274 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:07.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.284 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.285 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.286 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.291 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.299 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.301 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-10T23:36:07.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.308 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.309 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-10T23:36:07.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-10T23:36:07.320 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.321 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.328 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.330 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.333 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.337 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.340 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.342 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.345 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-10T23:36:07.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.353 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.354 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.355 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.358 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.359 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.360 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.363 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.372 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.375 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.383 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:36:07.385 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.389 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-10T23:36:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-10T23:36:07.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.405 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.407 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:36:07.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:36:07.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.415 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.418 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.419 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max_requests": { 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_requests", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:07.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.422 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.425 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.426 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.429 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.433 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.434 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smb", 2024-09-10T23:36:07.460 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "internal_store_backend": { 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "internal_store_backend", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.462 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "update_orchestration": { 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "update_orchestration", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:36:07.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.472 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.481 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.484 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.485 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-10T23:36:07.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.492 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.493 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.494 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.499 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-10T23:36:07.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-10T23:36:07.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-10T23:36:07.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.510 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.511 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.512 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.514 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.533 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-10T23:36:07.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-10T23:36:07.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.537 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.538 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.540 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-10T23:36:07.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.547 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.550 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24128, 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540719139924082687, 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.554 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.556 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.567 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:36:07.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:36:07.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:36:07.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.578 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-10T23:36:07.584 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:07.589 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.600 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:36:07.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:36:07.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:36:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-10T23:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nginx": { 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nginx", 2024-09-10T23:36:07.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nginx container image", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-10T23:36:07.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-10T23:36:07.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:36:07.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-10T23:36:07.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.617 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba_metrics": { 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:36:07.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:36:07.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:36:07.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:36:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:36:07.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.633 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:36:07.639 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-10T23:36:07.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.644 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-10T23:36:07.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-10T23:36:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-10T23:36:07.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-10T23:36:07.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-10T23:36:07.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:36:07.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:36:07.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.661 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-10T23:36:07.669 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:07.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "[]", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "{}", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:36:07.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:36:07.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:36:07.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.701 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.702 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.703 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.704 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.725 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.727 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.735 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-10T23:36:07.738 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.740 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.743 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-10T23:36:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-10T23:36:07.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-10T23:36:07.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.751 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.754 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-10T23:36:07.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-10T23:36:07.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.771 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.781 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.787 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.788 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.800 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.802 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-10T23:36:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.807 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-10T23:36:07.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-10T23:36:07.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.813 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.819 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.824 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.828 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.833 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-10T23:36:07.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.843 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.844 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.848 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.858 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.859 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.864 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.868 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.873 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.886 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:07.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.893 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-10T23:36:07.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-10T23:36:07.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.901 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-10T23:36:07.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:36:07.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.905 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.906 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.907 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.913 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max_requests": { 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_requests", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.920 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.923 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:36:07.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.926 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.927 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.938 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-10T23:36:07.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-10T23:36:07.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-10T23:36:07.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-10T23:36:07.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.945 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.946 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.953 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smb", 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "internal_store_backend": { 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "internal_store_backend", 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.954 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "update_orchestration": { 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "update_orchestration", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.963 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-10T23:36:07.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.966 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.968 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.969 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.970 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.972 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.974 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.975 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.979 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.985 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.987 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.988 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:07.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-10T23:36:07.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-10T23:36:07.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.000 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.008 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.011 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.017 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.018 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.019 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.021 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.025 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.027 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.028 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:36:08.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.037 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.042 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-10T23:36:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-10T23:36:08.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-10T23:36:08.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "restful" 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-10T23:36:08.049 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:36:08.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.051 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-10T23:36:08.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.065 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:08.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:36:08.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:36:08.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-10T23:36:08.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.075 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.076 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.077 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:36:08.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-10T23:36:08.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.089 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.090 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:36:08.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-10T23:36:08.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-10T23:36:08.095 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.097 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:36:08.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-10T23:36:08.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.104 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-10T23:36:08.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.108 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nginx": { 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nginx", 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nginx container image", 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-10T23:36:08.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.117 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:36:08.120 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba_metrics": { 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-10T23:36:08.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.131 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:36:08.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.135 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:36:08.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.142 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.143 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-10T23:36:08.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-10T23:36:08.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.152 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-10T23:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-10T23:36:08.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.173 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.177 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:36:08.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:36:08.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:36:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:36:08.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:36:08.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "[]", 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "{}", 2024-09-10T23:36:08.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.214 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:36:08.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.220 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:36:08.221 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:36:08.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:36:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.234 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.236 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:36:08.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-10T23:36:08.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-10T23:36:08.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.251 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.254 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-10T23:36:08.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-10T23:36:08.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:08.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:08.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.348 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.349 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-10T23:36:08.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.356 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-10T23:36:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-10T23:36:08.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.366 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.380 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.381 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.386 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.390 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.394 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.397 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.398 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.404 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.405 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:36:08.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:36:08.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.414 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.422 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.422 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.422 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.423 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.425 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-10T23:36:08.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.431 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.432 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.435 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-10T23:36:08.440 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.441 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.444 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.447 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-10T23:36:08.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.456 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-10T23:36:08.461 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-10T23:36:08.463 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.464 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.467 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-10T23:36:08.470 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.471 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.474 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.479 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.480 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.481 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.492 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-10T23:36:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:36:08.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.500 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-10T23:36:08.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.518 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:36:08.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.525 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.528 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.530 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.531 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max_requests": { 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_requests", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.545 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.546 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-10T23:36:08.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.553 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.554 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.557 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-10T23:36:08.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-10T23:36:08.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-10T23:36:08.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-10T23:36:08.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-10T23:36:08.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.570 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smb", 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.573 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "internal_store_backend": { 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "internal_store_backend", 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.578 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "update_orchestration": { 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "update_orchestration", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.586 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.596 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.598 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.600 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.602 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.609 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-10T23:36:08.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-10T23:36:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-10T23:36:08.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.620 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.633 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.640 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.649 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.650 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-10T23:36:08.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-10T23:36:08.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:36:08.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.656 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.657 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-10T23:36:08.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.660 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.662 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "dev", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-10T23:36:08.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-09-10T23:36:08.671 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-10T23:36:08.672 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-10T23:36:08.673 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-10T23:36:08.674 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-10T23:36:08.675 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "force_disabled_modules": {}, 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 3, 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1546777247 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 544951218 2024-09-10T23:36:08.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4289370929 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3900533474 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T23:36:08.679 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:36:08.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2b200b52e0 msgr2=0x7f2b200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2b200b52e0 0x7f2b200b77a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2b24006010 tx=0x7f2b240314a0 comp rx=0 tx=0).stop 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 msgr2=0x7f2b34198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 0x7f2b34198e20 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000c890 tx=0x7f2b3000cd50 comp rx=0 tx=0).stop 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 shutdown_connections 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f2b200b52e0 0x7f2b200b77a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b341033c0 0x7f2b3419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b34102a00 0x7f2b34199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 --2- 172.21.15.2:0/2736614583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b341018b0 0x7f2b34198e20 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 >> 172.21.15.2:0/2736614583 conn(0x7f2b340fd190 msgr2=0x7f2b34103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 shutdown_connections 2024-09-10T23:36:08.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:07.048+0000 7f2b3bed4640 1 -- 172.21.15.2:0/2736614583 wait complete. 2024-09-10T23:36:08.689 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T23:36:08.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T23:36:08.690 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:07 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2124735484' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.690 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:07 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3623163015' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.690 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:07 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3116125710' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.690 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:08 smithi002 ceph-mon[31150]: pgmap v705: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:36:08.690 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:08 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2736614583' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:36:08.691 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:07 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2124735484' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.691 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:07 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3623163015' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.691 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:07 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3116125710' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.691 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:08 smithi177 ceph-mon[35760]: pgmap v705: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:36:08.691 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:08 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2736614583' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:36:08.691 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:07 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2124735484' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:07 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3623163015' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:07 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3116125710' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:36:08.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:08 smithi154 ceph-mon[35136]: pgmap v705: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:36:08.692 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:08 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2736614583' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:36:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:09.577 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:36:09.577 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:09.577 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 1644, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 1646, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 492499, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 522793, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 6, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.180256877, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.082257964, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.039412469, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.043981440, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 1644, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.057479827, 2024-09-10T23:36:09.578 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000034963 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 745, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 914, 2024-09-10T23:36:09.579 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 185796, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 626204, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 4, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.098990767, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.045970839, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.019703974, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.025434181, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 913, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.040420756, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000044272 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.580 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 390816 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 239, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 235, 2024-09-10T23:36:09.581 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 550908, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 141086, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.036849191, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.019803251, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.021194742, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000023687, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 234, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.012565069, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000053696 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.582 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 550640, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 140768 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 1, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "finisher-MDSRank": { 2024-09-10T23:36:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "queue_len": 0, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "complete_latency": { 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3801, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.103820740, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000027314 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "queue_len": 0, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "complete_latency": { 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "request": 0, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "reply": 0, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "reply_latency": { 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "slow_reply": 0, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "forward": 0, 2024-09-10T23:36:09.585 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_commit": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_split": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_merge": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_top": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_bottom": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_pinned": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_expired": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": 0, 2024-09-10T23:36:09.586 INFO:teuthology.orchestra.run.smithi002.stdout: "subtrees": 1, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_hit": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_forward": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_discover": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_lock": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "load_cent": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "q": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "exported": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "exported_inodes": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "imported": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "imported_inodes": 0, 2024-09-10T23:36:09.587 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rfiles": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rbytes": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rsnaps": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:09.588 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_caps": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "process_request_cap_release": 0 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache": { 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_update": 0, 2024-09-10T23:36:09.589 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_try_discover": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_send_discover": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_created": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_enqueued": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_migrated": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:09.590 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_started": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_completed": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_flush": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_write_failed": 0 2024-09-10T23:36:09.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log": { 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "evlrg": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "evadd": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "evex": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "evtrm": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "ev": 4, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "evexg": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "evexd": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "segadd": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "segex": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "segtrm": 0, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "seg": 2, 2024-09-10T23:36:09.592 INFO:teuthology.orchestra.run.smithi002.stdout: "segmjr": 2, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "segexg": 0, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "segexd": 0, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "expos": 4194304, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "wrpos": 4195424, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "rdpos": 4195283, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "jlat": { 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "replayed": 4 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_mem": { 2024-09-10T23:36:09.593 INFO:teuthology.orchestra.run.smithi002.stdout: "ino": 3, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "ino+": 3, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "ino-": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "dir": 1, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "dir+": 1, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "dir-": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "dn": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "dn+": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "dn-": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "cap": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "cap+": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "cap-": 0, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "rss": 48588, 2024-09-10T23:36:09.594 INFO:teuthology.orchestra.run.smithi002.stdout: "heap": 248246272 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_server": { 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_request": 0, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_session": 0, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_peer_request": 0, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "req_create_latency": { 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.595 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getattr_latency": { 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "req_link_latency": { 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookup_latency": { 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupino_latency": { 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.597 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupname_latency": { 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:09.598 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lssnap_latency": { 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mkdir_latency": { 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mknod_latency": { 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mksnap_latency": { 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "req_open_latency": { 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.600 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "req_readdir_latency": { 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rename_latency": { 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmdir_latency": { 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setattr_latency": { 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.603 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setlayout_latency": { 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setxattr_latency": { 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "req_symlink_latency": { 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.605 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "req_unlink_latency": { 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.606 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_sessions": { 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "session_count": 0, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "session_add": 1, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "session_remove": 1, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "sessions_open": 1, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "sessions_stale": 0, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "total_load": 0, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "average_load": 0, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "avg_session_uptime": 1070, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:09.608 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:09.609 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 189423, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 51, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:09.610 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 155, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 8672, 2024-09-10T23:36:09.611 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 13, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter": { 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_active": 0, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_laggy": 0, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_send": 2385, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_send_bytes": 21, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_resend": 3, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_reply": 2385, 2024-09-10T23:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: "op_latency": { 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 2385, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 1.468964912, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000615918 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "op_inflight": 0, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "oplen_avg": { 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 2385, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 2386 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "op": 2385, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "op_r": 2385, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "op_w": 0, 2024-09-10T23:36:09.613 INFO:teuthology.orchestra.run.smithi002.stdout: "op_rmw": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "op_pg": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_stat": 1557, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_create": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_read": 826, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_write": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_writefull": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_writesame": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_append": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_zero": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_truncate": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_delete": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_mapext": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:09.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_getxattr": 1, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_setxattr": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_call": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_watch": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_notify": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_pgls": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_other": 0, 2024-09-10T23:36:09.615 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_active": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_send": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_resend": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_ping": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_active": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_send": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_resend": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_active": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_send": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_resend": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_active": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_send": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_resend": 0, 2024-09-10T23:36:09.616 INFO:teuthology.orchestra.run.smithi002.stdout: "command_active": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "command_send": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "command_resend": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "map_epoch": 77, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "map_full": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "map_inc": 2, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_sessions": 5, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_session_open": 5, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_session_close": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_laggy": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_wr": 0, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_rd": 2, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_del": 0 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: "oft": { 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_objs": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_updates": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_removes": 0 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "purge_queue": { 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executed": 0, 2024-09-10T23:36:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 2624, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 977845, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 2624, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2624, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 977845, 2024-09-10T23:36:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 2385, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 1125, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2385, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1125, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 1024, 2024-09-10T23:36:09.621 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 2385, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 2385, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2385, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 2385, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 3758096384, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 0, 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:09.623 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-write_buf_throttle-0x558528511040": { 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 3758096384, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:09.624 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 0, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 0, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "trackedop": { 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: "slow_ops_count": 0 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:09.625 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:36:10.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:10 smithi154 ceph-mon[35136]: pgmap v706: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:10.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:10 smithi002 ceph-mon[31150]: pgmap v706: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:10.412 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-10T23:36:10.412 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-10T23:36:10.412 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T23:36:10.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T23:36:10.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:10 smithi177 ceph-mon[35760]: pgmap v706: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.001285094, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000213056, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 235, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 232, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 528816, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 142768, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.038779082, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.021264038, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.020972199, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 231, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.012915509, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000055911 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 528816, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 142768 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 5, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 179, 2024-09-10T23:36:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3104, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 111792, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.020679188, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.015182600, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003500993, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 178, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014509125, 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000081511 2024-09-10T23:36:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 111792 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-10T23:36:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:36:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 29, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 968, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 236, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 495577, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 236, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 236, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 495577, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:11.208 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:36:12.036 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T23:36:12.037 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T23:36:12.037 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T23:36:12.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T23:36:12.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:12 smithi154 ceph-mon[35136]: pgmap v707: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:12.421 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:12 smithi002 ceph-mon[31150]: pgmap v707: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:12.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:12 smithi177 ceph-mon[35760]: pgmap v707: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:12.839 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:36:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:12.839 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 1063, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 1059, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 827776, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 403440, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.148130470, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.079446581, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.040793589, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.022168533, 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:12.840 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 1058, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.058502885, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000055295 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 550912, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 141408 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:12.841 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 1540, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 1713, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 392898, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 881843, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 4, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.124855581, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.059212349, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.024248734, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.032591095, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 1711, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.062956558, 2024-09-10T23:36:12.842 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000036795 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 392384 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 8, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 8, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 4573, 2024-09-10T23:36:12.843 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 1732, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 4, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003622978, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000182885, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003280970, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000096786, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 7, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.007137740, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001019677 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:12.844 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 1, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "finisher-MDSRank": { 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "queue_len": 0, 2024-09-10T23:36:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: "complete_latency": { 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 4005, 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.094006933, 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000023472 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "queue_len": 0, 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "complete_latency": { 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "request": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "reply": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "reply_latency": { 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "slow_reply": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "forward": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:12.847 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_commit": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_split": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_merge": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_top": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_bottom": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_pinned": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_expired": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "subtrees": 1, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse": 0, 2024-09-10T23:36:12.848 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_hit": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_forward": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_discover": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_lock": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "load_cent": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "q": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "exported": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "exported_inodes": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "imported": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "imported_inodes": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:12.849 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rfiles": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rbytes": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rsnaps": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:12.850 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_caps": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "process_request_cap_release": 0 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache": { 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_update": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_try_discover": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_send_discover": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:12.851 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_created": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_enqueued": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_migrated": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_started": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_completed": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:12.852 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_flush": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_started": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "uninline_write_failed": 0 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log": { 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "evlrg": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "evadd": 0, 2024-09-10T23:36:12.853 INFO:teuthology.orchestra.run.smithi002.stdout: "evex": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "evtrm": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "ev": 3, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "evexg": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "evexd": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "segadd": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "segex": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "segtrm": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "seg": 2, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "segmjr": 2, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "segexg": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "segexd": 0, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "expos": 4194304, 2024-09-10T23:36:12.854 INFO:teuthology.orchestra.run.smithi002.stdout: "wrpos": 4195200, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rdpos": 4194892, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "jlat": { 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "replayed": 3 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_mem": { 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "ino": 3, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "ino+": 3, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "ino-": 0, 2024-09-10T23:36:12.855 INFO:teuthology.orchestra.run.smithi002.stdout: "dir": 1, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dir+": 1, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dir-": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dn": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dn+": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dn-": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "cap": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "cap+": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "cap-": 0, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rss": 48264, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "heap": 248242176 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_server": { 2024-09-10T23:36:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_request": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_session": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_peer_request": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "req_create_latency": { 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getattr_latency": { 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.857 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "req_link_latency": { 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookup_latency": { 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupino_latency": { 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupname_latency": { 2024-09-10T23:36:12.859 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lssnap_latency": { 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mkdir_latency": { 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mknod_latency": { 2024-09-10T23:36:12.861 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mksnap_latency": { 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "req_open_latency": { 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "req_readdir_latency": { 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rename_latency": { 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmdir_latency": { 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setattr_latency": { 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.865 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setlayout_latency": { 2024-09-10T23:36:12.866 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setxattr_latency": { 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "req_symlink_latency": { 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "req_unlink_latency": { 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_sessions": { 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "session_count": 1, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "session_add": 1, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "session_remove": 0, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "sessions_open": 1, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "sessions_stale": 0, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "total_load": 0, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "average_load": 0, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "avg_session_uptime": 1813, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.869 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:12.870 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:12.871 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 197463, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 54, 2024-09-10T23:36:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 155, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 8672, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 13, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter": { 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "op_active": 0, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "op_laggy": 0, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "op_send": 2367, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "op_send_bytes": 21, 2024-09-10T23:36:12.874 INFO:teuthology.orchestra.run.smithi002.stdout: "op_resend": 3, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "op_reply": 2367, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "op_latency": { 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 2367, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 1.242970310, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000525124 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "op_inflight": 0, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "oplen_avg": { 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 2367, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 2368 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "op": 2367, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "op_r": 2367, 2024-09-10T23:36:12.875 INFO:teuthology.orchestra.run.smithi002.stdout: "op_w": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "op_rmw": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "op_pg": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_stat": 1536, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_create": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_read": 829, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_write": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_writefull": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_writesame": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_append": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_zero": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_truncate": 0, 2024-09-10T23:36:12.876 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_delete": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_mapext": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_getxattr": 1, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_setxattr": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_call": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_watch": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_notify": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:12.877 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_pgls": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_other": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_active": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_send": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_resend": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_ping": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_active": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_send": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_resend": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_active": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_send": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_resend": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_active": 0, 2024-09-10T23:36:12.878 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_send": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_resend": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "command_active": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "command_send": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "command_resend": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "map_epoch": 77, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "map_full": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "map_inc": 2, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_sessions": 6, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_session_open": 6, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_session_close": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_laggy": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_wr": 0, 2024-09-10T23:36:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_rd": 2, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_del": 0 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "oft": { 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_objs": 0, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_updates": 0, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_removes": 0 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "purge_queue": { 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:12.880 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executed": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 2607, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 975367, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:12.881 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 2607, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2607, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 975367, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-10T23:36:12.882 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 2367, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 901, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2367, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 901, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.883 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 1024, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 2367, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 2367, 2024-09-10T23:36:12.884 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2367, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 2367, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 3758096384, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:12.885 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-write_buf_throttle-0x55f9e8a41040": { 2024-09-10T23:36:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 3758096384, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:12.887 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "trackedop": { 2024-09-10T23:36:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: "slow_ops_count": 0 2024-09-10T23:36:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:12.888 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:36:13.652 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-10T23:36:13.652 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-10T23:36:13.652 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T23:36:13.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T23:36:13.914 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:14.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:14 smithi154 ceph-mon[35136]: pgmap v708: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:36:14.299 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:14 smithi002 ceph-mon[31150]: pgmap v708: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:36:14.404 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T23:36:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 237, 2024-09-10T23:36:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 234, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 529360, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 144048, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.039404980, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.021473176, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.020092199, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 233, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.013409484, 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000057551 2024-09-10T23:36:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 529360, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 144048 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 5, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 180, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3104, 2024-09-10T23:36:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 111968, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.019936725, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.014202339, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003804639, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 179, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014043952, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000078457 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 111968 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-10T23:36:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000232726, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000156211, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149007, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 968, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 238, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 495837, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 238, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 238, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 495837, 2024-09-10T23:36:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-10T23:36:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-10T23:36:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-10T23:36:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-10T23:36:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T23:36:14.416 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T23:36:14.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:14 smithi177 ceph-mon[35760]: pgmap v708: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T23:36:15.136 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T23:36:15.137 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T23:36:15.137 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T23:36:15.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T23:36:15.398 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:16.077 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:16 smithi154 ceph-mon[35136]: pgmap v709: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:36:16.082 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 140, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 142, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 52107, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 81517, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 14, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.022292482, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.006756436, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.011186404, 2024-09-10T23:36:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000380753, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 140, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.031326417, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000223760 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 229, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000053612, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000234 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 736 2024-09-10T23:36:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 904, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 949, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 720485, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 840800, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 53, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.144014995, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.064276969, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.080493439, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.005080895, 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 949, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.067490687, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000071117 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1246, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000308013, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000247 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 580752, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 145696 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 68, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 240, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 25488, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 450702, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 10, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.021751105, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.013183771, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.006878419, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000201944, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 238, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.024719814, 2024-09-10T23:36:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000103864 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 107, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000054341, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000507 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 393856 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T23:36:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 50, 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001345557, 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000026911 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000010135, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000005067 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 10, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 10, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 10, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T23:36:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T23:36:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T23:36:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 5, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 298, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T23:36:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1, 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 4, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T23:36:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 4, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195424, 2024-09-10T23:36:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.005623707, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001874569 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 13, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 13, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-10T23:36:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 12, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 10, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 10, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 52416, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 257679360 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T23:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 4, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T23:36:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T23:36:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T23:36:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T23:36:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 76, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 237991, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 76, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 155, 2024-09-10T23:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 51192, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 198, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 38, 2024-09-10T23:36:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 11332, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 28, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 38, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 38, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.230993797, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006078784 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 38, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 60 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 38, 2024-09-10T23:36:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 38, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 3, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 6, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-10T23:36:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T23:36:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T23:36:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 77, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 9, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 9, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-10T23:36:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1108, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 681476, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1108, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1108, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 681476, 2024-09-10T23:36:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 38, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 11332, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 38, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 11332, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 38, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 38, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 38, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 38, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55ec39dfadc0": { 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 4, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1120, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 4, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1120, 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:16.130 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:16.131 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T23:36:16.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:16 smithi177 ceph-mon[35760]: pgmap v709: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:36:16.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:16 smithi002 ceph-mon[31150]: pgmap v709: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T23:36:17.010 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T23:36:17.010 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T23:36:17.010 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T23:36:17.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T23:36:17.257 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:17.735 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 2415, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 2414, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 685847, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 766835, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.219624809, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.100811629, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.045891684, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.057884391, 2024-09-10T23:36:17.736 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2413, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.092778540, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000038449 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.737 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 3, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 179, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 716, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 393610, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.013426636, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.010073579, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.001587068, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000072622, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 177, 2024-09-10T23:36:17.738 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.012107916, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000068406 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 392912 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 245, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 241, 2024-09-10T23:36:17.739 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 552540, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 144926, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.041356704, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.021736136, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.023876140, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000018426, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 240, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.015985490, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000066606 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 552272, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 144608 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T23:36:17.741 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4064, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.091667996, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000022556 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:17.743 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-10T23:36:17.744 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:17.745 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:17.746 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:17.747 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:17.748 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T23:36:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 4, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-10T23:36:17.750 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195424, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4195283, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 4 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T23:36:17.751 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48700, 2024-09-10T23:36:17.752 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 248246272 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T23:36:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.754 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.755 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.756 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T23:36:17.758 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.759 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.761 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T23:36:17.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.764 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.764 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T23:36:17.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1281, 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:17.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:17.767 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:17.768 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:17.769 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 181303, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 46, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 155, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:17.770 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8672, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2413, 2024-09-10T23:36:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2413, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2413, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.330963437, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000551580 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2413, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2414 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.772 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2413, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2413, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1576, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 835, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T23:36:17.773 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T23:36:17.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T23:36:17.775 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 77, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 4, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 4, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T23:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:17.777 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2659, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 984283, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2659, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2659, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 984283, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:17.779 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2413, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1125, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2413, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1125, 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:17.780 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2413, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2413, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2413, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2413, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.783 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x559f0b779040": { 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T23:36:17.784 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:17.785 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T23:36:18.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:18 smithi154 ceph-mon[35136]: pgmap v710: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:36:18.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:18 smithi177 ceph-mon[35760]: pgmap v710: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:36:18.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:18 smithi002 ceph-mon[31150]: pgmap v710: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T23:36:18.630 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T23:36:18.631 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T23:36:18.631 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T23:36:18.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T23:36:18.880 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:19.392 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T23:36:19.392 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:19.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 908, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 962, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 717411, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 406368, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.131823037, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.063746263, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.066241181, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.005034011, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 961, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.059674972, 2024-09-10T23:36:19.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000062096 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1303, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000292562, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000224 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 564176, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 148128 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 86, 2024-09-10T23:36:19.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 261, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 30611, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 478737, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 13, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.034235823, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.018481083, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.013505823, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000211956, 2024-09-10T23:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 258, 2024-09-10T23:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.029282911, 2024-09-10T23:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000113499 2024-09-10T23:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 120, 2024-09-10T23:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000027385, 2024-09-10T23:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000228 2024-09-10T23:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 394832 2024-09-10T23:36:19.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.398 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:19.398 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 121, 2024-09-10T23:36:19.398 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 121, 2024-09-10T23:36:19.398 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 34281, 2024-09-10T23:36:19.398 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 598103, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 54, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.026656168, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.005203910, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.019830244, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000407361, 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 121, 2024-09-10T23:36:19.400 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.026130108, 2024-09-10T23:36:19.400 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000215951 2024-09-10T23:36:19.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.400 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:19.400 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 152, 2024-09-10T23:36:19.400 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000076801, 2024-09-10T23:36:19.401 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000505 2024-09-10T23:36:19.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.401 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:19.401 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:19.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.401 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T23:36:19.402 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T23:36:19.402 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T23:36:19.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.402 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T23:36:19.402 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:19.403 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:19.403 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 46, 2024-09-10T23:36:19.403 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001282258, 2024-09-10T23:36:19.403 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000027875 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000011800, 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000005900 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 1, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T23:36:19.405 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 1, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 10, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T23:36:19.406 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 10, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 10, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T23:36:19.407 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 1, 2024-09-10T23:36:19.408 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 5, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 298, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:19.409 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1, 2024-09-10T23:36:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:19.411 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:19.412 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 3, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 3, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T23:36:19.413 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195200, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.003024313, 2024-09-10T23:36:19.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001512156 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 13, 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 13, 2024-09-10T23:36:19.415 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 12, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 10, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 10, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 50100, 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 257679360 2024-09-10T23:36:19.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 1, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 1, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 10, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T23:36:19.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T23:36:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T23:36:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 715, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T23:36:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 254259, 2024-09-10T23:36:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 84, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 155, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 51192, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 198, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T23:36:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 37, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 11108, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 37, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 37, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.209994363, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005675523 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T23:36:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 37, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 59 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 37, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 37, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 2, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 6, 2024-09-10T23:36:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T23:36:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T23:36:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 77, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 9, 2024-09-10T23:36:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 9, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T23:36:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1111, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 665435, 2024-09-10T23:36:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1111, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1111, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 665435, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 37, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 11108, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 37, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 11108, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 37, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 37, 2024-09-10T23:36:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 37, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 37, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x562392468dc0": { 2024-09-10T23:36:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 896, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2, 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 896, 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T23:36:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T23:36:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:19.451 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T23:36:20.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:20 smithi154 ceph-mon[35136]: pgmap v711: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:20.366 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T23:36:20.366 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T23:36:20.366 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T23:36:20.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T23:36:20.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:20 smithi177 ceph-mon[35760]: pgmap v711: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:20.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:20 smithi002 ceph-mon[31150]: pgmap v711: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T23:36:20.613 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 252, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 246, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 556866, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 147300, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.046051147, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.022831532, 2024-09-10T23:36:21.188 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.028451315, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000024959, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 246, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.020096342, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000081692 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 556032, 2024-09-10T23:36:21.189 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 146976 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 3, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 182, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 674, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 397361, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.014058803, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.010771623, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.001334762, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000041894, 2024-09-10T23:36:21.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 180, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.012663066, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000070350 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 396720 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.191 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1667, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1669, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 498961, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 530164, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.208094713, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.098655493, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.043145658, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.050030581, 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:21.192 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1667, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.076995451, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000046188 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.193 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3333, 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.100061331, 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000030021 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:21.194 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.195 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T23:36:21.196 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:21.197 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T23:36:21.198 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T23:36:21.200 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T23:36:21.202 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 2, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T23:36:21.203 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4194892, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4194352, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 2 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-10T23:36:21.204 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 47840, 2024-09-10T23:36:21.205 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 248242176 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.206 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T23:36:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.211 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.213 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.214 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.218 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-10T23:36:21.219 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:21.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:21.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:21.222 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 181303, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 46, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:21.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 155, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8672, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T23:36:21.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 1670, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 1670, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1670, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.802977912, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000480825 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.225 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1670, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1671 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 1670, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 1670, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 832, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 836, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-10T23:36:21.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:21.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T23:36:21.228 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 77, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T23:36:21.229 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 4, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 4, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.230 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:21.231 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1918, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 868215, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1918, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1918, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 868215, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.232 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 1670, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 593, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1670, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 593, 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:21.233 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:21.234 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 1670, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1670, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1670, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1670, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.236 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x56553c87b040": { 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T23:36:21.237 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T23:36:21.238 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T23:36:22.129 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T23:36:22.129 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T23:36:22.129 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T23:36:22.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T23:36:22.278 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:22 smithi154 ceph-mon[35136]: pgmap v712: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:36:22.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:22 smithi177 ceph-mon[35760]: pgmap v712: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:22 smithi002 ceph-mon[31150]: pgmap v712: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T23:36:22.874 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-10T23:36:22.874 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:22.874 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 920, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 968, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 732966, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 291779, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 8, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.142255054, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.073920599, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.069376792, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.003987688, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 971, 2024-09-10T23:36:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.061180973, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000063008 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1288, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000328500, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000255 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 576608, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 150048 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 133, 2024-09-10T23:36:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 305, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 52524, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 454390, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 9, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.027941569, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.016080038, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.010578033, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000335058, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 306, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.040231246, 2024-09-10T23:36:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000131474 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 195, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000040762, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000209 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 396656 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 60, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 68, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 10015, 2024-09-10T23:36:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 621814, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 58, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 7, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.020696957, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.001892735, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.016962888, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000268111, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 60, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.010669498, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000177824 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 50, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000003503, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000070 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 37, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.001360079, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000036758 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000011599, 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000005799 2024-09-10T23:36:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 0, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 0, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 0, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 11, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 10, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 10, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 10, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 1, 2024-09-10T23:36:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, 2024-09-10T23:36:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 5, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 298, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 0 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 1, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 0, 2024-09-10T23:36:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 2, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 2, 2024-09-10T23:36:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 2, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 2, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 2, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 4194892, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-10T23:36:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.001602018, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001602018 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 13, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 13, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 0, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 11, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 12, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 1, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 10, 2024-09-10T23:36:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 10, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 50424, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 257683456 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 0, 2024-09-10T23:36:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-10T23:36:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-10T23:36:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 0, 2024-09-10T23:36:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 221847, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 68, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 51192, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 198, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-10T23:36:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 35, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 10710, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 33, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 35, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 35, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.194994288, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.005571265 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 35, 2024-09-10T23:36:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 57 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 35, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 35, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 10, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 1, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 5, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-10T23:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 6, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 20, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-10T23:36:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-10T23:36:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 77, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 8, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 8, 2024-09-10T23:36:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 14, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 0, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 1 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 1109, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 678479, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 1109, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1109, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 678479, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 35, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 10710, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 35, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 10710, 2024-09-10T23:36:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 35, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 35, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 35, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 35, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x55e93af8cdc0": { 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 2, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 588, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 2, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1, 2024-09-10T23:36:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 588, 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:22.924 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-10T23:36:23.835 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T23:36:23.836 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T23:36:23.836 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T23:36:23.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T23:36:24.089 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:36:24.136 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:24 smithi177 ceph-mon[35760]: pgmap v713: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-10T23:36:24.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:24 smithi002 ceph-mon[31150]: pgmap v713: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-10T23:36:24.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:24 smithi154 ceph-mon[35136]: pgmap v713: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 406, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 398, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 607043, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 774040, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 58, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.072764656, 2024-09-10T23:36:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.027449866, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.045784473, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000392304, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 397, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.035340089, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000089017 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 161, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000030703, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000190 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 573264, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 152128 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 77, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 252, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 29784, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 450573, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 10, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.024875829, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.014296619, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.008546320, 2024-09-10T23:36:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000321844, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 251, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.032623271, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000129973 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 112, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000048572, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000433 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 396832 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 856, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 775, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 210014, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 180690, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 8, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.106958149, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.054894934, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.053353055, 2024-09-10T23:36:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.004090984, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 773, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.055019171, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000071176 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1580, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000314879, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000199 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 28, 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.002248936, 2024-09-10T23:36:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000080319 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000024492, 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000012246 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 2, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 1, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000172298, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000172298 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-10T23:36:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 1, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 11, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 11, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 11, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 10, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 0, 2024-09-10T23:36:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 2, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 4, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 2, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 0, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 1, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 5, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 298, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 1 2024-09-10T23:36:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 2, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 4, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 4, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-09-10T23:36:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 2, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 2, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 2, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 4195424, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-10T23:36:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.004334213, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001444737 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 14, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 14, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 0, 2024-09-10T23:36:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 12, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 13, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 1, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 11, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 11, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 0, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 1, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 1, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 49800, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 257679360 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 3, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 2, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 4, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 0, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-10T23:36:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000172298, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000172298 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-10T23:36:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-10T23:36:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-10T23:36:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-10T23:36:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-10T23:36:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-10T23:36:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-10T23:36:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-10T23:36:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-10T23:36:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-10T23:36:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-10T23:36:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-10T23:36:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-10T23:36:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-10T23:36:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-10T23:36:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-10T23:36:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 0, 2024-09-10T23:36:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 1, 2024-09-10T23:36:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-09-10T23:36:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 0, 2024-09-10T23:36:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-10T23:36:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 1, 2024-09-10T23:36:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 1, 2024-09-10T23:36:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 79, 2024-09-10T23:36:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-10T23:36:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 262823, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 89, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 55416, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 213, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 38, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 11332, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 33, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 38, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 38, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.213993743, 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.005631414 2024-09-10T23:36:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 38, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 60 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 38, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 0, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 38, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 0, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 10, 2024-09-10T23:36:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 3, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 6, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 6, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 20, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-09-10T23:36:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-10T23:36:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 77, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 8, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 8, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 14, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 0, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 1 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 0, 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 1335, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 709258, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 1335, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1335, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 709258, 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 38, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 11332, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 38, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 11332, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 38, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 38, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 38, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 38, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x55b256ca4dc0": { 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 4, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 1120, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 4, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 1120, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-09-10T23:36:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-10T23:36:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:24.682 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-10T23:36:25.446 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T23:36:25.447 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T23:36:25.447 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T23:36:25.447 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T23:36:25.692 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:36:26.089 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:26 smithi177 ceph-mon[35760]: pgmap v714: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 5416, 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 6983, 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 2213304, 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 6502242, 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 15, 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 6, 2024-09-10T23:36:26.261 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.701463960, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.337707688, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.255999673, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.102203023, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6979, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1.181320186, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000169267 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6223, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.001475653, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000237 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.262 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 647312, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 206288 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1147, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1261, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 276302, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 874710, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 11, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 7, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.132660743, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.067940243, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.056513591, 2024-09-10T23:36:26.263 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.014243036, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1259, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.374362414, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000297349 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1206, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000336272, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000278 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 404496 2024-09-10T23:36:26.264 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 3698, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 3715, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 864352, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 8692870, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 270, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 7, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.440806859, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.183547188, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.204661766, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.052357288, 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:26.265 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3717, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.457419354, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000123061 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2933, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000595912, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000203 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-10T23:36:26.266 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6580, 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1.731585159, 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000263158 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:26.267 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 18, 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000487959, 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000027108 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 646, 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 646, 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-10T23:36:26.268 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 646, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2.981047265, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.004614624 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 0, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 345, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 24, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 5, 2024-09-10T23:36:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 19, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 16, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 3, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 3, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 2, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 795, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 788, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-10T23:36:26.270 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 316, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 4, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 234, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-10T23:36:26.271 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 316, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 204, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 23, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 181, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 112, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 651, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 631, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 599, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:26.272 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 757, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 718, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 1, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 621 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 0, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 0, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 5, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:26.273 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 3, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 3, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:26.274 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 23, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 2692, 2024-09-10T23:36:26.275 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 2660, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 2660, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 32, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 58, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 53, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 52, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 52, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 1, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 1, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 1, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 12344789, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 12428075, 2024-09-10T23:36:26.276 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2677, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 5.768154896, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.002154708 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 23, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 49, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 26, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 18, 2024-09-10T23:36:26.277 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 20, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 2, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 24, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 29, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 5, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 3, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 17, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 14, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 55620, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 271306752 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 1861, 2024-09-10T23:36:26.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 646, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 16, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 0, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 5, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.004379070, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000875814 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 16, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.003355028, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000209689 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.279 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.280 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000322294, 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000161147 2024-09-10T23:36:26.281 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.282 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-10T23:36:26.283 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 8, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.012754506, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001594313 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.284 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000159147, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000159147 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.003950240, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001975120 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-10T23:36:26.285 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.003169037, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001584518 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.286 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.006978068, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.003489034 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 600, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2.924181169, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.004873635 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 7, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.019017433, 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.002716776 2024-09-10T23:36:26.289 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.002781273, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.002781273 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 2, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 89, 2024-09-10T23:36:26.291 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 89, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 732, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:26.292 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:26.293 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:26.294 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 307218, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 126, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-10T23:36:26.295 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:26.296 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:26.296 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:26.296 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:26.296 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:26.296 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 94594, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 596, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:26.297 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 4811, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 8591614, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 37, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 4811, 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-10T23:36:26.298 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 4811, 2024-09-10T23:36:26.299 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 25.554246105, 2024-09-10T23:36:26.299 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.005311628 2024-09-10T23:36:26.299 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.299 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-10T23:36:26.299 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-10T23:36:26.299 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 4811, 2024-09-10T23:36:26.300 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 5545 2024-09-10T23:36:26.300 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.300 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 4811, 2024-09-10T23:36:26.300 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 363, 2024-09-10T23:36:26.300 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 4448, 2024-09-10T23:36:26.300 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 325, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 25, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 24, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 2678, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 165, 2024-09-10T23:36:26.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 517, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:26.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 339, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 50, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-10T23:36:26.303 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-10T23:36:26.304 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:26.304 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-10T23:36:26.304 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:26.304 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 599, 2024-09-10T23:36:26.304 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-10T23:36:26.304 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-10T23:36:26.305 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-10T23:36:26.305 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-10T23:36:26.305 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-10T23:36:26.305 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-10T23:36:26.305 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-10T23:36:26.305 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-10T23:36:26.306 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 77, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 12, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 12, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 811, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 0, 2024-09-10T23:36:26.307 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 12 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 3, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-10T23:36:26.308 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 3, 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 3, 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 3, 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:26.310 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:26.310 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 10257, 2024-09-10T23:36:26.310 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 2405308, 2024-09-10T23:36:26.310 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:26.310 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 10257, 2024-09-10T23:36:26.311 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:26.311 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:26.311 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 10257, 2024-09-10T23:36:26.311 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 2405308, 2024-09-10T23:36:26.311 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:26.311 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 4811, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 8591917, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 4811, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 8591917, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-10T23:36:26.313 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 4811, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 4811, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 4811, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 4811, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 3, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 303, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 3, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 303, 2024-09-10T23:36:26.315 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x55725990cdc0": { 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 2692, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 8233771, 2024-09-10T23:36:26.316 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 2692, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 2677, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 8233771, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-09-10T23:36:26.317 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-10T23:36:26.318 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:26.318 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-10T23:36:26.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:26 smithi002 ceph-mon[31150]: pgmap v714: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T23:36:26.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:26 smithi154 ceph-mon[35136]: pgmap v714: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T23:36:27.064 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T23:36:27.064 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T23:36:27.064 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T23:36:27.064 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T23:36:27.309 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:36:27.832 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-10T23:36:27.833 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:27.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1645, 2024-09-10T23:36:27.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1647, 2024-09-10T23:36:27.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 4682679, 2024-09-10T23:36:27.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 523120, 2024-09-10T23:36:27.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 6, 2024-09-10T23:36:27.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:27.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.199885292, 2024-09-10T23:36:27.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.085870263, 2024-09-10T23:36:27.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.049688402, 2024-09-10T23:36:27.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.048821457, 2024-09-10T23:36:27.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:27.835 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1645, 2024-09-10T23:36:27.835 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.070123066, 2024-09-10T23:36:27.835 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000042628 2024-09-10T23:36:27.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.836 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:27.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.836 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.837 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:27.837 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:27.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.837 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:27.837 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 614, 2024-09-10T23:36:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 610, 2024-09-10T23:36:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 644034, 2024-09-10T23:36:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 264108, 2024-09-10T23:36:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 3, 2024-09-10T23:36:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.083690773, 2024-09-10T23:36:27.839 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.041601362, 2024-09-10T23:36:27.839 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.033619875, 2024-09-10T23:36:27.839 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.011597843, 2024-09-10T23:36:27.839 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:27.839 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 609, 2024-09-10T23:36:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.032819337, 2024-09-10T23:36:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000053890 2024-09-10T23:36:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 554064, 2024-09-10T23:36:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 148608 2024-09-10T23:36:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.842 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:27.842 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1141, 2024-09-10T23:36:27.842 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1319, 2024-09-10T23:36:27.842 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 4328102, 2024-09-10T23:36:27.842 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 760099, 2024-09-10T23:36:27.843 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:27.843 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 3, 2024-09-10T23:36:27.843 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.135999688, 2024-09-10T23:36:27.843 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.069940092, 2024-09-10T23:36:27.843 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.027897890, 2024-09-10T23:36:27.844 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.027869178, 2024-09-10T23:36:27.844 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:27.844 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1318, 2024-09-10T23:36:27.844 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.052204737, 2024-09-10T23:36:27.844 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000039609 2024-09-10T23:36:27.845 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.845 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:27.845 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.845 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.845 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.846 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T23:36:27.846 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 399168 2024-09-10T23:36:27.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.846 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-10T23:36:27.847 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-10T23:36:27.847 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-10T23:36:27.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.847 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-10T23:36:27.847 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:27.847 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:27.848 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 5344, 2024-09-10T23:36:27.848 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.141651986, 2024-09-10T23:36:27.848 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000026506 2024-09-10T23:36:27.848 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.848 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:27.849 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-10T23:36:27.849 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-10T23:36:27.849 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.849 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.849 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.850 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.850 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-10T23:36:27.850 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 0, 2024-09-10T23:36:27.850 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 0, 2024-09-10T23:36:27.851 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-10T23:36:27.851 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.851 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.851 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.851 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-10T23:36:27.852 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 0, 2024-09-10T23:36:27.852 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:27.852 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:27.852 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 0, 2024-09-10T23:36:27.852 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-09-10T23:36:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-10T23:36:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 17, 2024-09-10T23:36:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 4, 2024-09-10T23:36:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 13, 2024-09-10T23:36:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 10, 2024-09-10T23:36:27.854 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 0, 2024-09-10T23:36:27.854 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:27.854 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-09-10T23:36:27.854 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 2, 2024-09-10T23:36:27.854 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 0, 2024-09-10T23:36:27.854 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 0, 2024-09-10T23:36:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 0, 2024-09-10T23:36:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 0, 2024-09-10T23:36:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-10T23:36:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-10T23:36:27.856 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-10T23:36:27.856 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 0, 2024-09-10T23:36:27.856 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, 2024-09-10T23:36:27.856 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, 2024-09-10T23:36:27.856 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, 2024-09-10T23:36:27.857 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:27.857 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:27.857 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:27.857 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 4, 2024-09-10T23:36:27.857 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 234, 2024-09-10T23:36:27.857 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-10T23:36:27.858 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:27.858 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:27.858 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:27.858 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:27.858 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:27.858 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:27.859 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:27.859 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:27.859 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:27.859 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:36:27.859 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:27.859 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:27.860 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:27.860 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:27.860 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 0, 2024-09-10T23:36:27.860 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:27.860 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:27.861 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 0 2024-09-10T23:36:27.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.861 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-10T23:36:27.861 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-10T23:36:27.861 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:27.861 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 0, 2024-09-10T23:36:27.862 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 0, 2024-09-10T23:36:27.862 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:27.862 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-10T23:36:27.862 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:27.862 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:27.863 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 0, 2024-09-10T23:36:27.863 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 0, 2024-09-10T23:36:27.863 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:27.863 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-10T23:36:27.863 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:27.863 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:27.864 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:27.864 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-10T23:36:27.864 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-10T23:36:27.864 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:36:27.864 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:36:27.864 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:27.865 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:27.865 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-10T23:36:27.865 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:27.865 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:27.865 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-09-10T23:36:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-09-10T23:36:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-10T23:36:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-10T23:36:27.867 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 0, 2024-09-10T23:36:27.867 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-09-10T23:36:27.867 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-09-10T23:36:27.867 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 2692, 2024-09-10T23:36:27.867 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-10T23:36:27.867 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-09-10T23:36:27.868 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 0, 2024-09-10T23:36:27.868 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-09-10T23:36:27.868 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-09-10T23:36:27.868 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 2, 2024-09-10T23:36:27.868 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 52, 2024-09-10T23:36:27.868 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-10T23:36:27.869 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-09-10T23:36:27.869 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 12344789, 2024-09-10T23:36:27.869 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 12428075, 2024-09-10T23:36:27.869 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 12426087, 2024-09-10T23:36:27.869 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-10T23:36:27.870 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.870 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.870 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.870 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 2692 2024-09-10T23:36:27.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.871 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-10T23:36:27.871 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 14, 2024-09-10T23:36:27.871 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 17, 2024-09-10T23:36:27.871 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 3, 2024-09-10T23:36:27.871 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 9, 2024-09-10T23:36:27.872 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 11, 2024-09-10T23:36:27.872 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 2, 2024-09-10T23:36:27.872 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 17, 2024-09-10T23:36:27.872 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 19, 2024-09-10T23:36:27.872 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 2, 2024-09-10T23:36:27.872 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-09-10T23:36:27.873 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 0, 2024-09-10T23:36:27.873 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 0, 2024-09-10T23:36:27.873 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 49392, 2024-09-10T23:36:27.873 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 249286656 2024-09-10T23:36:27.873 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.873 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-10T23:36:27.874 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 0, 2024-09-10T23:36:27.874 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:27.874 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 0, 2024-09-10T23:36:27.874 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 0, 2024-09-10T23:36:27.874 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 0, 2024-09-10T23:36:27.874 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-10T23:36:27.875 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.875 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.875 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.875 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.875 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-10T23:36:27.875 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.876 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.876 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.876 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:27.876 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.877 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.877 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.877 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.877 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-10T23:36:27.877 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.878 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.878 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.878 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-10T23:36:27.878 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.878 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.879 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.879 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.879 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:27.879 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.879 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.880 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.880 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-10T23:36:27.880 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.880 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.880 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.881 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.881 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-10T23:36:27.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.881 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.882 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:27.882 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.882 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.882 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.883 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:27.883 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.883 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.883 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.884 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-10T23:36:27.884 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.884 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.884 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.884 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-10T23:36:27.885 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.885 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.885 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.885 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-10T23:36:27.885 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.886 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.886 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.886 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.886 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-10T23:36:27.886 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.886 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.887 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.887 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-10T23:36:27.887 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.887 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.888 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.888 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-10T23:36:27.888 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.888 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.888 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.889 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.889 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-10T23:36:27.889 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.889 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.889 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.890 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.890 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:27.890 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.890 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.890 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.890 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.891 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:27.891 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.891 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.891 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.891 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.891 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-10T23:36:27.892 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.892 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.892 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.892 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:27.892 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.893 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.893 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:27.893 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.894 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.894 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-10T23:36:27.894 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.894 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.895 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:27.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.895 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.895 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.896 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.896 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:27.896 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.896 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.896 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.897 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:27.898 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 2, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 0, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 0, 2024-09-10T23:36:27.899 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 2059, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:27.901 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:27.902 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 189339, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 50, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:27.903 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 55010, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 257, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.904 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 3143, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 26, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 4, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 3143, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3143, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1.472956163, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000468646 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-10T23:36:27.905 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3143, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 3144 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 3143, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 3143, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 0, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 1671, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 0, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 1469, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 0, 2024-09-10T23:36:27.906 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 2, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:27.907 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-10T23:36:27.908 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 77, 2024-09-10T23:36:27.909 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 5, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 5, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 0, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 2, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 0 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 0, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:27.910 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 0, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.911 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 3396, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 9333307, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 3396, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3396, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 9333307, 2024-09-10T23:36:27.912 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:27.913 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 3143, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 8233781, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3143, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 8233781, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-10T23:36:27.914 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 3143, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 3143, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3143, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 3143, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.915 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-09-10T23:36:27.916 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x561697915040": { 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:27.917 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-10T23:36:27.918 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-10T23:36:28.447 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:28 smithi177 ceph-mon[35760]: pgmap v715: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-10T23:36:28.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:28 smithi002 ceph-mon[31150]: pgmap v715: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-10T23:36:28.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:28 smithi154 ceph-mon[35136]: pgmap v715: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-10T23:36:28.714 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-10T23:36:28.714 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-10T23:36:28.714 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T23:36:28.725 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T23:36:28.726 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:36:28.726 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:36:28.748 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T23:36:28.748 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:36:28.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:36:29.119 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:29.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 -- 172.21.15.2:0/2198284854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc1076a0 msgr2=0x7f7cdc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:29.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/2198284854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc1076a0 0x7f7cdc107ae0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009900 tx=0x7f7cd002a410 comp rx=0 tx=0).stop 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 -- 172.21.15.2:0/2198284854 shutdown_connections 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/2198284854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc108020 0x7f7cdc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/2198284854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc1076a0 0x7f7cdc107ae0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/2198284854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cdc101c90 0x7f7cdc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 -- 172.21.15.2:0/2198284854 >> 172.21.15.2:0/2198284854 conn(0x7f7cdc0fd700 msgr2=0x7f7cdc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 -- 172.21.15.2:0/2198284854 shutdown_connections 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.608+0000 7f7ce40b7640 1 -- 172.21.15.2:0/2198284854 wait complete. 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 Processor -- start 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 -- start start 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 0x7f7cdc19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc1076a0 0x7f7cdc19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:29.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cdc108020 0x7f7cdc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc111ce0 con 0x7f7cdc101c90 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc111b60 con 0x7f7cdc1076a0 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce40b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc111e60 con 0x7f7cdc108020 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 0x7f7cdc19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 0x7f7cdc19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39556/0 (socket says 172.21.15.2:39556) 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 -- 172.21.15.2:0/1727987895 learned_addr learned my addr 172.21.15.2:0/1727987895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1652640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc1076a0 0x7f7cdc19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce2654640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cdc108020 0x7f7cdc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 -- 172.21.15.2:0/1727987895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cdc108020 msgr2=0x7f7cdc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cdc108020 0x7f7cdc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 -- 172.21.15.2:0/1727987895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc1076a0 msgr2=0x7f7cdc19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc1076a0 0x7f7cdc19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.609+0000 7f7ce1e53640 1 -- 172.21.15.2:0/1727987895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc1a54b0 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.610+0000 7f7ce1e53640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 0x7f7cdc19a0d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00ba50 tx=0x7f7ccc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.610+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc019070 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.610+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ccc00cbe0 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.610+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc1a57a0 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.610+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0075d0 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.610+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1a5d80 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.611+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc102070 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.612+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7ccc007830 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.613+0000 7f7cdaffd640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7cc40b5360 0x7f7cc40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.613+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f7ccc0e5870 con 0x7f7cdc101c90 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.613+0000 7f7ce1652640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7cc40b5360 0x7f7cc40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:29.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.614+0000 7f7ce1652640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7cc40b5360 0x7f7cc40b7820 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0031440 tx=0x7f7cd00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:29.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.616+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7ccc0ac740 con 0x7f7cdc101c90 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.815+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7cdc109e00 con 0x7f7cdc101c90 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.815+0000 7f7cdaffd640 1 -- 172.21.15.2:0/1727987895 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v77) ==== 81+0+578 (secure 0 0 0) 0x7f7ccc0ac040 con 0x7f7cdc101c90 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3734475991 2024-09-11T23:14:50.129191+0000 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3734475991 2024-09-11T23:14:50.129191+0000 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3292855559 2024-09-11T23:14:50.129191+0000 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3314421959 2024-09-11T23:14:25.416951+0000 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2291894232 2024-09-11T23:14:25.416951+0000 2024-09-10T23:36:29.816 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/823401111 2024-09-11T23:14:25.416951+0000 2024-09-10T23:36:29.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1827148024 2024-09-11T23:14:50.129191+0000 2024-09-10T23:36:29.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/958693037 2024-09-11T23:14:50.129191+0000 2024-09-10T23:36:29.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/823401111 2024-09-11T23:14:25.416951+0000 2024-09-10T23:36:29.817 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/672005157 2024-09-11T23:14:25.416951+0000 2024-09-10T23:36:29.817 INFO:teuthology.orchestra.run.smithi002.stderr:listed 10 entries 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7cc40b5360 msgr2=0x7f7cc40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7cc40b5360 0x7f7cc40b7820 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0031440 tx=0x7f7cd00095f0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 msgr2=0x7f7cdc19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 0x7f7cdc19a0d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00ba50 tx=0x7f7ccc00bf10 comp rx=0 tx=0).stop 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 shutdown_connections 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f7cc40b5360 0x7f7cc40b7820 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cdc108020 0x7f7cdc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc1076a0 0x7f7cdc19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 --2- 172.21.15.2:0/1727987895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cdc101c90 0x7f7cdc19a0d0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 >> 172.21.15.2:0/1727987895 conn(0x7f7cdc0fd700 msgr2=0x7f7cdc104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 shutdown_connections 2024-09-10T23:36:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:29.817+0000 7f7ce40b7640 1 -- 172.21.15.2:0/1727987895 wait complete. 2024-09-10T23:36:30.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:30 smithi002 ceph-mon[31150]: pgmap v716: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-10T23:36:30.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:30 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1727987895' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:36:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:30 smithi177 ceph-mon[35760]: pgmap v716: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-10T23:36:30.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:30 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1727987895' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:36:30.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:30 smithi154 ceph-mon[35136]: pgmap v716: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-10T23:36:30.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:30 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1727987895' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:36:30.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:36:30.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:36:30.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:36:30.673 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:36:30.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:36:30.673 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:36:30.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:36:30.707 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T23:36:30.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:36:30.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:36:30.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:36:30.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:36:30.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-10T23:36:30.940 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T23:36:30.950 INFO:tasks.cephadm:Teardown begin 2024-09-10T23:36:30.951 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:36:30.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:36:31.211 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2601490745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3941087d0 msgr2=0x7ff394108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2601490745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3941087d0 0x7ff394108c10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff384009900 tx=0x7ff38402a410 comp rx=0 tx=0).stop 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2601490745 shutdown_connections 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2601490745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 0x7ff39410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2601490745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3941087d0 0x7ff394108c10 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2601490745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff394102dc0 0x7ff3941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2601490745 >> 172.21.15.2:0/2601490745 conn(0x7ff3940fe830 msgr2=0x7ff394100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2601490745 shutdown_connections 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.668+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2601490745 wait complete. 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 Processor -- start 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 -- start start 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 0x7ff3941992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3941087d0 0x7ff394199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 0x7ff39419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff394112e20 con 0x7ff394102dc0 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff394112ca0 con 0x7ff3941087d0 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39c3a2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff394112fa0 con 0x7ff394109150 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39a13e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 0x7ff3941992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39a13e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 0x7ff3941992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43800/0 (socket says 172.21.15.2:43800) 2024-09-10T23:36:31.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.669+0000 7ff39a13e640 1 -- 172.21.15.2:0/2783796078 learned_addr learned my addr 172.21.15.2:0/2783796078 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39993d640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3941087d0 0x7ff394199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a93f640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 0x7ff39419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a13e640 1 -- 172.21.15.2:0/2783796078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 msgr2=0x7ff39419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a13e640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 0x7ff39419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a13e640 1 -- 172.21.15.2:0/2783796078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3941087d0 msgr2=0x7ff394199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a13e640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3941087d0 0x7ff394199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a13e640 1 -- 172.21.15.2:0/2783796078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39419f380 con 0x7ff394102dc0 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a93f640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 0x7ff39419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39993d640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3941087d0 0x7ff394199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39a13e640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 0x7ff3941992d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7ff39000d950 tx=0x7ff39000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:31.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390017030 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff390004020 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39419f670 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3900047a0 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.670+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3941a5d30 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.671+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3941031a0 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.673+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff390009a30 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.673+0000 7ff38b7fe640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3800b52e0 0x7ff3800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.673+0000 7ff39993d640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3800b52e0 0x7ff3800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.673+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7ff3900e5dd0 con 0x7ff394102dc0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.674+0000 7ff39993d640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3800b52e0 0x7ff3800b77a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff384005ab0 tx=0x7ff384000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:31.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.676+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3900acca0 con 0x7ff394102dc0 2024-09-10T23:36:31.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.900+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff39402e5c0 con 0x7ff394102dc0 2024-09-10T23:36:31.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.900+0000 7ff38b7fe640 1 -- 172.21.15.2:0/2783796078 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7ff3900ac5a0 con 0x7ff394102dc0 2024-09-10T23:36:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:36:31.902 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:36:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:36:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3800b52e0 msgr2=0x7ff3800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3800b52e0 0x7ff3800b77a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff384005ab0 tx=0x7ff384000bc0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 msgr2=0x7ff3941992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 0x7ff3941992d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7ff39000d950 tx=0x7ff39000de10 comp rx=0 tx=0).stop 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 shutdown_connections 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7ff3800b52e0 0x7ff3800b77a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff394109150 0x7ff39419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3941087d0 0x7ff394199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 --2- 172.21.15.2:0/2783796078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff394102dc0 0x7ff3941992d0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 >> 172.21.15.2:0/2783796078 conn(0x7ff3940fe830 msgr2=0x7ff394100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 shutdown_connections 2024-09-10T23:36:31.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:31.903+0000 7ff39c3a2640 1 -- 172.21.15.2:0/2783796078 wait complete. 2024-09-10T23:36:32.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:32 smithi002 ceph-mon[31150]: pgmap v717: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-10T23:36:32.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:32 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2783796078' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:36:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:32 smithi177 ceph-mon[35760]: pgmap v717: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-10T23:36:32.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:32 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2783796078' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:36:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:32 smithi154 ceph-mon[35136]: pgmap v717: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-10T23:36:32.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:32 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2783796078' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:36:32.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:36:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/2997127104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c3810f420 msgr2=0x7f1c38111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/2997127104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c3810f420 0x7f1c38111810 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009ca0 tx=0x7f1c3002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/2997127104 shutdown_connections 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/2997127104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c3810f420 0x7f1c38111810 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/2997127104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c38102190 0x7f1c3810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/2997127104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38101870 0x7f1c38101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/2997127104 >> 172.21.15.2:0/2997127104 conn(0x7f1c380fd700 msgr2=0x7f1c380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.327+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/2997127104 shutdown_connections 2024-09-10T23:36:33.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/2997127104 wait complete. 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 Processor -- start 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 -- start start 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 0x7f1c3819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38102190 0x7f1c3819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3810f420 0x7f1c381a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38114fc0 con 0x7f1c38101870 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38114e40 con 0x7f1c38102190 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3f7dc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38115140 con 0x7f1c3810f420 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3d578640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 0x7f1c3819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.328+0000 7f1c3d578640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 0x7f1c3819b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43826/0 (socket says 172.21.15.2:43826) 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 -- 172.21.15.2:0/1740687748 learned_addr learned my addr 172.21.15.2:0/1740687748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3dd79640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3810f420 0x7f1c381a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3cd77640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38102190 0x7f1c3819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 -- 172.21.15.2:0/1740687748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3810f420 msgr2=0x7f1c381a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3810f420 0x7f1c381a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 -- 172.21.15.2:0/1740687748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38102190 msgr2=0x7f1c3819b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38102190 0x7f1c3819b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 -- 172.21.15.2:0/1740687748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c381a14e0 con 0x7f1c38101870 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3d578640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 0x7f1c3819b430 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400d950 tx=0x7f1c3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34017070 con 0x7f1c38101870 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c34009c30 con 0x7f1c38101870 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c381a17d0 con 0x7f1c38101870 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400f620 con 0x7f1c38101870 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.329+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c381a7e90 con 0x7f1c38101870 2024-09-10T23:36:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.330+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c38101c50 con 0x7f1c38101870 2024-09-10T23:36:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.332+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1c34010460 con 0x7f1c38101870 2024-09-10T23:36:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.333+0000 7f1c2a7fc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1c240b52e0 0x7f1c240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.333+0000 7f1c3cd77640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1c240b52e0 0x7f1c240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.333+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f1c340e5910 con 0x7f1c38101870 2024-09-10T23:36:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.333+0000 7f1c3cd77640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1c240b52e0 0x7f1c240b77a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c005fd0 tx=0x7f1c2c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.337+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1c340ac7e0 con 0x7f1c38101870 2024-09-10T23:36:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.559+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c3819c560 con 0x7f1c38101870 2024-09-10T23:36:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.560+0000 7f1c2a7fc640 1 -- 172.21.15.2:0/1740687748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11964 (secure 0 0 0) 0x7f1c34009de0 con 0x7f1c38101870 2024-09-10T23:36:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:36:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-10T23:24:11:867846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14652,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/348830467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":348830467},{"type":"v1","addr":"172.21.15.2:6835","nonce":348830467}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/366884472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":366884472},{"type":"v1","addr":"172.21.15.2:6837","nonce":366884472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:22:17.001408+0000","modified":"2024-09-10T23:24:11.636175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24568,"mds_1":24563,"mds_2":24547,"mds_3":24541,"mds_4":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14712":{"gid":14712,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6839/1174009300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1174009300},{"type":"v1","addr":"172.21.15.2:6839","nonce":1174009300}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14718":{"gid":14718,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6841/2991165185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2991165185},{"type":"v1","addr":"172.21.15.2:6841","nonce":2991165185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/940548947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":940548947},{"type":"v1","addr":"172.21.15.154:6833","nonce":940548947}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/157862185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":157862185},{"type":"v1","addr":"172.21.15.154:6835","nonce":157862185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/4014999302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4014999302},{"type":"v1","addr":"172.21.15.177:6833","nonce":4014999302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/4148932474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4148932474},{"type":"v1","addr":"172.21.15.154:6837","nonce":4148932474}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.177:6835/2192031560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2192031560},{"type":"v1","addr":"172.21.15.177:6835","nonce":2192031560}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6837/4092191728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":4092191728},{"type":"v1","addr":"172.21.15.177:6837","nonce":4092191728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6839/3482947796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3482947796},{"type":"v1","addr":"172.21.15.154:6839","nonce":3482947796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.177:6839/2078594456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2078594456},{"type":"v1","addr":"172.21.15.177:6839","nonce":2078594456}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24568,"qdb_cluster":[24536,24541,24547,24563,24568]},"id":1}]} 2024-09-10T23:36:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-10T23:36:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1c240b52e0 msgr2=0x7f1c240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1c240b52e0 0x7f1c240b77a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c005fd0 tx=0x7f1c2c005850 comp rx=0 tx=0).stop 2024-09-10T23:36:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 msgr2=0x7f1c3819b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 0x7f1c3819b430 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400d950 tx=0x7f1c3400de10 comp rx=0 tx=0).stop 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 shutdown_connections 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f1c240b52e0 0x7f1c240b77a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3810f420 0x7f1c381a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38102190 0x7f1c3819b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 --2- 172.21.15.2:0/1740687748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38101870 0x7f1c3819b430 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.562+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 >> 172.21.15.2:0/1740687748 conn(0x7f1c380fd700 msgr2=0x7f1c381115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.563+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 shutdown_connections 2024-09-10T23:36:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:33.563+0000 7f1c3f7dc640 1 -- 172.21.15.2:0/1740687748 wait complete. 2024-09-10T23:36:34.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:34 smithi002 ceph-mon[31150]: pgmap v718: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:36:34.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:34 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1740687748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:36:34.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:36:34.462 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:34 smithi177 ceph-mon[35760]: pgmap v718: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:36:34.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:34 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1740687748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:36:34.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:34 smithi154 ceph-mon[35136]: pgmap v718: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T23:36:34.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:34 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1740687748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.958+0000 7f8781051640 1 -- 172.21.15.2:0/4154013783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 msgr2=0x7f877c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.958+0000 7f8781051640 1 --2- 172.21.15.2:0/4154013783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c107ae0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f8764009900 tx=0x7f876402a410 comp rx=0 tx=0).stop 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 -- 172.21.15.2:0/4154013783 shutdown_connections 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 --2- 172.21.15.2:0/4154013783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c108020 0x7f877c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 --2- 172.21.15.2:0/4154013783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c107ae0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 --2- 172.21.15.2:0/4154013783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c101c90 0x7f877c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 -- 172.21.15.2:0/4154013783 >> 172.21.15.2:0/4154013783 conn(0x7f877c0fd700 msgr2=0x7f877c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 -- 172.21.15.2:0/4154013783 shutdown_connections 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 -- 172.21.15.2:0/4154013783 wait complete. 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.959+0000 7f8781051640 1 Processor -- start 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 -- start start 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c101c90 0x7f877c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c108020 0x7f877c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111ce0 con 0x7f877c1076a0 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111b60 con 0x7f877c101c90 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f8781051640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111e60 con 0x7f877c108020 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c1997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43842/0 (socket says 172.21.15.2:43842) 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 -- 172.21.15.2:0/4045649924 learned_addr learned my addr 172.21.15.2:0/4045649924 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877ad9d640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c101c90 0x7f877c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877b59e640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c108020 0x7f877c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 -- 172.21.15.2:0/4045649924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c108020 msgr2=0x7f877c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c108020 0x7f877c19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 -- 172.21.15.2:0/4045649924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c101c90 msgr2=0x7f877c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c101c90 0x7f877c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877a59c640 1 -- 172.21.15.2:0/4045649924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c19f350 con 0x7f877c1076a0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877ad9d640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c101c90 0x7f877c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.960+0000 7f877b59e640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c108020 0x7f877c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.961+0000 7f877a59c640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c1997e0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f8764006010 tx=0x7f87640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.961+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876403f030 con 0x7f877c1076a0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.961+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c19f5e0 con 0x7f877c1076a0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.961+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8764003800 con 0x7f877c1076a0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.961+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764035070 con 0x7f877c1076a0 2024-09-10T23:36:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.961+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1a5d00 con 0x7f877c1076a0 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.962+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f877c102070 con 0x7f877c1076a0 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.963+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8764031b10 con 0x7f877c1076a0 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.964+0000 7f8773fff640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87680b5360 0x7f87680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.964+0000 7f877ad9d640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87680b5360 0x7f87680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.964+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7f8764106840 con 0x7f877c1076a0 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.965+0000 7f877ad9d640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87680b5360 0x7f87680b7820 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8774005fd0 tx=0x7f8774005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:34.967+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f87640cd6b0 con 0x7f877c1076a0 2024-09-10T23:36:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.153+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f877c19a3d0 con 0x7f877c1076a0 2024-09-10T23:36:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.154+0000 7f8773fff640 1 -- 172.21.15.2:0/4045649924 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22706 (secure 0 0 0) 0x7f877c19a3d0 con 0x7f877c1076a0 2024-09-10T23:36:35.156 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T23:36:35.157 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"2f953db4-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:03.975095+0000","modified":"2024-09-10T23:22:51.479951+0000","last_up_change":"2024-09-10T23:21:24.451876+0000","last_in_change":"2024-09-10T23:21:01.916701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:17:34.596978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:13.247903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:15.004607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"519e53ed-0182-44f2-bf22-cf88e408fcd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6803","nonce":3071495420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6805","nonce":3071495420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6809","nonce":3071495420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3071495420},{"type":"v1","addr":"172.21.15.2:6807","nonce":3071495420}]},"public_addr":"172.21.15.2:6803/3071495420","cluster_addr":"172.21.15.2:6805/3071495420","heartbeat_back_addr":"172.21.15.2:6809/3071495420","heartbeat_front_addr":"172.21.15.2:6807/3071495420","state":["exists","up"]},{"osd":1,"uuid":"d3a75885-bb7f-436b-999f-33d290e0c742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6801","nonce":773951399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6803","nonce":773951399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6807","nonce":773951399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":773951399},{"type":"v1","addr":"172.21.15.154:6805","nonce":773951399}]},"public_addr":"172.21.15.154:6801/773951399","cluster_addr":"172.21.15.154:6803/773951399","heartbeat_back_addr":"172.21.15.154:6807/773951399","heartbeat_front_addr":"172.21.15.154:6805/773951399","state":["exists","up"]},{"osd":2,"uuid":"0cb0306d-145f-4ca5-a4aa-cb66fa3648f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6801","nonce":3512583930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6803","nonce":3512583930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6807","nonce":3512583930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3512583930},{"type":"v1","addr":"172.21.15.177:6805","nonce":3512583930}]},"public_addr":"172.21.15.177:6801/3512583930","cluster_addr":"172.21.15.177:6803/3512583930","heartbeat_back_addr":"172.21.15.177:6807/3512583930","heartbeat_front_addr":"172.21.15.177:6805/3512583930","state":["exists","up"]},{"osd":3,"uuid":"3d4bc460-5421-4710-9aca-415a54129b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6811","nonce":2995211952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6813","nonce":2995211952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6817","nonce":2995211952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":2995211952},{"type":"v1","addr":"172.21.15.2:6815","nonce":2995211952}]},"public_addr":"172.21.15.2:6811/2995211952","cluster_addr":"172.21.15.2:6813/2995211952","heartbeat_back_addr":"172.21.15.2:6817/2995211952","heartbeat_front_addr":"172.21.15.2:6815/2995211952","state":["exists","up"]},{"osd":4,"uuid":"97973d11-680e-43c6-81ee-5a2cbfc57bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6809","nonce":3616268167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6811","nonce":3616268167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6815","nonce":3616268167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3616268167},{"type":"v1","addr":"172.21.15.154:6813","nonce":3616268167}]},"public_addr":"172.21.15.154:6809/3616268167","cluster_addr":"172.21.15.154:6811/3616268167","heartbeat_back_addr":"172.21.15.154:6815/3616268167","heartbeat_front_addr":"172.21.15.154:6813/3616268167","state":["exists","up"]},{"osd":5,"uuid":"7cf7fb9f-277c-41b2-8522-d629c87d02ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6809","nonce":1630560150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6811","nonce":1630560150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6815","nonce":1630560150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1630560150},{"type":"v1","addr":"172.21.15.177:6813","nonce":1630560150}]},"public_addr":"172.21.15.177:6809/1630560150","cluster_addr":"172.21.15.177:6811/1630560150","heartbeat_back_addr":"172.21.15.177:6815/1630560150","heartbeat_front_addr":"172.21.15.177:6813/1630560150","state":["exists","up"]},{"osd":6,"uuid":"843cbdb2-0356-4d03-bd97-472b65618974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6819","nonce":2336103544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6821","nonce":2336103544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6825","nonce":2336103544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2336103544},{"type":"v1","addr":"172.21.15.2:6823","nonce":2336103544}]},"public_addr":"172.21.15.2:6819/2336103544","cluster_addr":"172.21.15.2:6821/2336103544","heartbeat_back_addr":"172.21.15.2:6825/2336103544","heartbeat_front_addr":"172.21.15.2:6823/2336103544","state":["exists","up"]},{"osd":7,"uuid":"4429311c-fcfa-4d52-b1bf-627c2d65bc97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6817","nonce":2645883120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6819","nonce":2645883120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6823","nonce":2645883120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2645883120},{"type":"v1","addr":"172.21.15.154:6821","nonce":2645883120}]},"public_addr":"172.21.15.154:6817/2645883120","cluster_addr":"172.21.15.154:6819/2645883120","heartbeat_back_addr":"172.21.15.154:6823/2645883120","heartbeat_front_addr":"172.21.15.154:6821/2645883120","state":["exists","up"]},{"osd":8,"uuid":"23e4001a-571b-4bf0-a4d9-04e1a2589298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6817","nonce":2637144478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6819","nonce":2637144478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6823","nonce":2637144478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2637144478},{"type":"v1","addr":"172.21.15.177:6821","nonce":2637144478}]},"public_addr":"172.21.15.177:6817/2637144478","cluster_addr":"172.21.15.177:6819/2637144478","heartbeat_back_addr":"172.21.15.177:6823/2637144478","heartbeat_front_addr":"172.21.15.177:6821/2637144478","state":["exists","up"]},{"osd":9,"uuid":"9ac4ba62-a52e-4008-b126-e8a29957fcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6827","nonce":3955910854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6829","nonce":3955910854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6833","nonce":3955910854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3955910854},{"type":"v1","addr":"172.21.15.2:6831","nonce":3955910854}]},"public_addr":"172.21.15.2:6827/3955910854","cluster_addr":"172.21.15.2:6829/3955910854","heartbeat_back_addr":"172.21.15.2:6833/3955910854","heartbeat_front_addr":"172.21.15.2:6831/3955910854","state":["exists","up"]},{"osd":10,"uuid":"2258f977-145d-4b91-b6f7-ace80b9a09e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6825","nonce":2294019881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6827","nonce":2294019881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6831","nonce":2294019881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2294019881},{"type":"v1","addr":"172.21.15.154:6829","nonce":2294019881}]},"public_addr":"172.21.15.154:6825/2294019881","cluster_addr":"172.21.15.154:6827/2294019881","heartbeat_back_addr":"172.21.15.154:6831/2294019881","heartbeat_front_addr":"172.21.15.154:6829/2294019881","state":["exists","up"]},{"osd":11,"uuid":"8f03df9f-bd81-43d7-aae6-63e3630ab331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6825","nonce":3355252458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6827","nonce":3355252458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6831","nonce":3355252458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3355252458},{"type":"v1","addr":"172.21.15.177:6829","nonce":3355252458}]},"public_addr":"172.21.15.177:6825/3355252458","cluster_addr":"172.21.15.177:6827/3355252458","heartbeat_back_addr":"172.21.15.177:6831/3355252458","heartbeat_front_addr":"172.21.15.177:6829/3355252458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:16:41.178070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:07.133196+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:31.284086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:57.610411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:23.775650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:49.352179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:15.250532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:41.889444+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:06.525874+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:31.540380+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:58.276173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:23.205402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/3734475991":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3292855559":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/3314421959":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/2291894232":"2024-09-11T23:14:25.416951+0000","172.21.15.2:6801/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/1827148024":"2024-09-11T23:14:50.129191+0000","172.21.15.2:0/958693037":"2024-09-11T23:14:50.129191+0000","172.21.15.2:6800/823401111":"2024-09-11T23:14:25.416951+0000","172.21.15.2:0/672005157":"2024-09-11T23:14:25.416951+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87680b5360 msgr2=0x7f87680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87680b5360 0x7f87680b7820 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8774005fd0 tx=0x7f8774005ea0 comp rx=0 tx=0).stop 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 msgr2=0x7f877c1997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c1997e0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f8764006010 tx=0x7f87640042f0 comp rx=0 tx=0).stop 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 shutdown_connections 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87680b5360 0x7f87680b7820 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f877c108020 0x7f877c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c1076a0 0x7f877c1997e0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 --2- 172.21.15.2:0/4045649924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c101c90 0x7f877c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 >> 172.21.15.2:0/4045649924 conn(0x7f877c0fd700 msgr2=0x7f877c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.156+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 shutdown_connections 2024-09-10T23:36:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:35.157+0000 7f8781051640 1 -- 172.21.15.2:0/4045649924 wait complete. 2024-09-10T23:36:35.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T23:36:36.096 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:36.358 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-mon[31150]: pgmap v719: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T23:36:36.358 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/4045649924' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:36.358 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-mon[35760]: pgmap v719: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T23:36:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/4045649924' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:36.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:36.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mon[35136]: pgmap v719: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T23:36:36.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/4045649924' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:36.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/87181730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44108060 msgr2=0x7fcd4410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/87181730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44108060 0x7fcd4410e860 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009ca0 tx=0x7fcd3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/87181730 shutdown_connections 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/87181730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44108060 0x7fcd4410e860 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/87181730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd441076e0 0x7fcd44107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/87181730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd44101cd0 0x7fcd441020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.599+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/87181730 >> 172.21.15.2:0/87181730 conn(0x7fcd440fd700 msgr2=0x7fcd440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.600+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/87181730 shutdown_connections 2024-09-10T23:36:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.600+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/87181730 wait complete. 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.600+0000 7fcd4b8c4640 1 Processor -- start 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 -- start start 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 0x7fcd44199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd441076e0 0x7fcd4419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44108060 0x7fcd441a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44111ce0 con 0x7fcd44101cd0 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44111b60 con 0x7fcd44108060 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd4b8c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44111e60 con 0x7fcd441076e0 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 0x7fcd44199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 0x7fcd44199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43856/0 (socket says 172.21.15.2:43856) 2024-09-10T23:36:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 -- 172.21.15.2:0/3548799331 learned_addr learned my addr 172.21.15.2:0/3548799331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49e61640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44108060 0x7fcd441a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd48e5f640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd441076e0 0x7fcd4419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 -- 172.21.15.2:0/3548799331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd441076e0 msgr2=0x7fcd4419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd441076e0 0x7fcd4419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 -- 172.21.15.2:0/3548799331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44108060 msgr2=0x7fcd441a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44108060 0x7fcd441a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.601+0000 7fcd49660640 1 -- 172.21.15.2:0/3548799331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd441a5570 con 0x7fcd44101cd0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.602+0000 7fcd49660640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 0x7fcd44199fb0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000d950 tx=0x7fcd4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.602+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40017030 con 0x7fcd44101cd0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.602+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd441a5740 con 0x7fcd44101cd0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.602+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd40004020 con 0x7fcd44101cd0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.602+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd400047a0 con 0x7fcd44101cd0 2024-09-10T23:36:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.602+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd441a5c20 con 0x7fcd44101cd0 2024-09-10T23:36:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.603+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd441020b0 con 0x7fcd44101cd0 2024-09-10T23:36:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.604+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcd40009a30 con 0x7fcd44101cd0 2024-09-10T23:36:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.605+0000 7fcd3a7fc640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcd300b52e0 0x7fcd300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.605+0000 7fcd48e5f640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcd300b52e0 0x7fcd300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.605+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8219+0+0 (secure 0 0 0) 0x7fcd400e5bd0 con 0x7fcd44101cd0 2024-09-10T23:36:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.605+0000 7fcd48e5f640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcd300b52e0 0x7fcd300b77a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406c0f0 tx=0x7fcd3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.608+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd400acaa0 con 0x7fcd44101cd0 2024-09-10T23:36:36.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.831+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcd4406b900 con 0x7fcd44101cd0 2024-09-10T23:36:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.834+0000 7fcd3a7fc640 1 -- 172.21.15.2:0/3548799331 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7fcd400ac3a0 con 0x7fcd44101cd0 2024-09-10T23:36:36.835 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:36:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcd300b52e0 msgr2=0x7fcd300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcd300b52e0 0x7fcd300b77a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406c0f0 tx=0x7fcd3400b390 comp rx=0 tx=0).stop 2024-09-10T23:36:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 msgr2=0x7fcd44199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 0x7fcd44199fb0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000d950 tx=0x7fcd4000de10 comp rx=0 tx=0).stop 2024-09-10T23:36:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 shutdown_connections 2024-09-10T23:36:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fcd300b52e0 0x7fcd300b77a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44108060 0x7fcd441a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd441076e0 0x7fcd4419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 --2- 172.21.15.2:0/3548799331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd44101cd0 0x7fcd44199fb0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 >> 172.21.15.2:0/3548799331 conn(0x7fcd440fd700 msgr2=0x7fcd440fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 shutdown_connections 2024-09-10T23:36:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:36.837+0000 7fcd4b8c4640 1 -- 172.21.15.2:0/3548799331 wait complete. 2024-09-10T23:36:36.885 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a[31146]: 2024-09-10T23:36:36.832+0000 7fab69f2c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:36:37.214 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.214 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.214 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-mds[66400]: -- 172.21.15.177:0/4214605202 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d3480b860 con 0x563d347e9400 2024-09-10T23:36:37.215 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: starting mds.i at 2024-09-10T23:36:37.215 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l[65490]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.215 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l[65490]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.215 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l[65490]: starting mds.l at 2024-09-10T23:36:37.215 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c[66097]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.215 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c[66097]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-mds[66101]: -- 172.21.15.177:0/2097836233 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c6f522b860 con 0x55c6f5209400 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c[66097]: starting mds.c at 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f[65794]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f[65794]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-mds[65798]: -- 172.21.15.177:0/2143580188 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5647d4873860 con 0x5647d4851400 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:36:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f[65794]: starting mds.f at 2024-09-10T23:36:37.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3548799331' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/3548799331' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:36:37.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:37 smithi177 ceph-mon[35760]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T23:36:37.236 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a[74883]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a[74883]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-mds[74900]: -- 172.21.15.2:0/1072067223 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56314104d860 con 0x56314102b000 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a[74883]: starting mds.a at 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3548799331' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:36:37.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/3548799331' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:37 smithi002 ceph-mon[31150]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g[74549]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g[74549]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-mds[74557]: -- 172.21.15.2:0/475194192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56323cb35860 con 0x56323cb13000 2024-09-10T23:36:37.238 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:36:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g[74549]: starting mds.g at 2024-09-10T23:36:37.280 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h[65305]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.280 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h[65305]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.280 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mds[65309]: -- 172.21.15.154:0/1332742960 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ef0753c20 con 0x561ef0731400 2024-09-10T23:36:37.280 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h[65305]: starting mds.h at 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3548799331' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/3548799331' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:36:37.281 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:37 smithi154 ceph-mon[35136]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b[65605]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b[65605]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mds[65609]: -- 172.21.15.154:0/1223671018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c17dcdb860 con 0x55c17dcb9000 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b[65605]: starting mds.b at 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e[65004]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e[65004]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mds[65008]: -- 172.21.15.154:0/4123755011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558ad165860 con 0x5558ad142800 2024-09-10T23:36:37.282 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e[65004]: starting mds.e at 2024-09-10T23:36:37.283 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k[64702]: ignoring --setuser ceph since I am not root 2024-09-10T23:36:37.283 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k[64702]: ignoring --setgroup ceph since I am not root 2024-09-10T23:36:37.283 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-mds[64706]: -- 172.21.15.154:0/869654250 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be7e5db860 con 0x55be7e5b9400 2024-09-10T23:36:37.283 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:36:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k[64702]: starting mds.k at 2024-09-10T23:36:37.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:36:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:38.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: pgmap v720: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T23:36:38.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6833/2803333022,v1:172.21.15.154:6835/2803333022] up:boot 2024-09-10T23:36:38.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6832/1918807532,v1:172.21.15.154:6834/1918807532] up:boot 2024-09-10T23:36:38.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6832/413018184,v1:172.21.15.177:6835/413018184] up:boot 2024-09-10T23:36:38.210 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6833/580710838,v1:172.21.15.177:6837/580710838] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6834/3998006554,v1:172.21.15.177:6838/3998006554] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.177:6836/56168267,v1:172.21.15.177:6839/56168267] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.2:6839/2395667701,v1:172.21.15.2:6840/2395667701] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.2:6838/2075738989,v1:172.21.15.2:6841/2075738989] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6836/1455887090,v1:172.21.15.154:6837/1455887090] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: mds.? [v2:172.21.15.154:6838/1541069708,v1:172.21.15.154:6839/1541069708] up:boot 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:36:38.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:36:38.212 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:36:38.212 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:36:38.212 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:36:38.212 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:36:38.212 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:36:38.212 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:38 smithi002 ceph-mon[31150]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 -- 172.21.15.2:0/3044331970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d081045c0 msgr2=0x7f6d0810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/3044331970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d081045c0 0x7f6d0810cab0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009900 tx=0x7f6cf002a410 comp rx=0 tx=0).stop 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 -- 172.21.15.2:0/3044331970 shutdown_connections 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/3044331970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d0810d100 0x7f6d0810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/3044331970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d081045c0 0x7f6d0810cab0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/3044331970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d08103ca0 0x7f6d08104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 -- 172.21.15.2:0/3044331970 >> 172.21.15.2:0/3044331970 conn(0x7f6d080fd700 msgr2=0x7f6d080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 -- 172.21.15.2:0/3044331970 shutdown_connections 2024-09-10T23:36:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 -- 172.21.15.2:0/3044331970 wait complete. 2024-09-10T23:36:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.293+0000 7f6d0eb55640 1 Processor -- start 2024-09-10T23:36:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 -- start start 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d08103ca0 0x7f6d0819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d081045c0 0x7f6d0819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 0x7f6d081a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d08112db0 con 0x7f6d0810d100 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d08112c30 con 0x7f6d08103ca0 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0eb55640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d08112f30 con 0x7f6d081045c0 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 0x7f6d081a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 0x7f6d081a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43904/0 (socket says 172.21.15.2:43904) 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 -- 172.21.15.2:0/2632478671 learned_addr learned my addr 172.21.15.2:0/2632478671 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0c8f1640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d08103ca0 0x7f6d0819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d07fff640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d081045c0 0x7f6d0819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 -- 172.21.15.2:0/2632478671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d081045c0 msgr2=0x7f6d0819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d081045c0 0x7f6d0819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 -- 172.21.15.2:0/2632478671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d08103ca0 msgr2=0x7f6d0819b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d08103ca0 0x7f6d0819b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.294+0000 7f6d0d0f2640 1 -- 172.21.15.2:0/2632478671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d081a15d0 con 0x7f6d0810d100 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.295+0000 7f6d0d0f2640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 0x7f6d081a0e00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000cad0 tx=0x7f6d0000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.295+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000ad60 con 0x7f6d0810d100 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.295+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d00005020 con 0x7f6d0810d100 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.295+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d081a18c0 con 0x7f6d0810d100 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.295+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000f6b0 con 0x7f6d0810d100 2024-09-10T23:36:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.295+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d081a7f80 con 0x7f6d0810d100 2024-09-10T23:36:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.296+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d08104080 con 0x7f6d0810d100 2024-09-10T23:36:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.297+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6d000054f0 con 0x7f6d0810d100 2024-09-10T23:36:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.298+0000 7f6d05ffb640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6cf40b52e0 0x7f6cf40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.298+0000 7f6d0c8f1640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6cf40b52e0 0x7f6cf40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.298+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8649+0+0 (secure 0 0 0) 0x7f6d000e5d30 con 0x7f6d0810d100 2024-09-10T23:36:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.299+0000 7f6d0c8f1640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6cf40b52e0 0x7f6cf40b77a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009990 tx=0x7f6cf8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:38.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.302+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6d00014030 con 0x7f6d0810d100 2024-09-10T23:36:38.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: pgmap v720: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T23:36:38.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6833/2803333022,v1:172.21.15.154:6835/2803333022] up:boot 2024-09-10T23:36:38.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6832/1918807532,v1:172.21.15.154:6834/1918807532] up:boot 2024-09-10T23:36:38.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6832/413018184,v1:172.21.15.177:6835/413018184] up:boot 2024-09-10T23:36:38.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6833/580710838,v1:172.21.15.177:6837/580710838] up:boot 2024-09-10T23:36:38.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6834/3998006554,v1:172.21.15.177:6838/3998006554] up:boot 2024-09-10T23:36:38.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.177:6836/56168267,v1:172.21.15.177:6839/56168267] up:boot 2024-09-10T23:36:38.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.2:6839/2395667701,v1:172.21.15.2:6840/2395667701] up:boot 2024-09-10T23:36:38.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.2:6838/2075738989,v1:172.21.15.2:6841/2075738989] up:boot 2024-09-10T23:36:38.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6836/1455887090,v1:172.21.15.154:6837/1455887090] up:boot 2024-09-10T23:36:38.466 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: mds.? [v2:172.21.15.154:6838/1541069708,v1:172.21.15.154:6839/1541069708] up:boot 2024-09-10T23:36:38.467 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T23:36:38.467 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:36:38.467 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:36:38.467 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:36:38.467 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:36:38.467 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:36:38.468 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:36:38.468 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:36:38.468 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:36:38.468 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:36:38.468 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:38 smithi177 ceph-mon[35760]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:36:38.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: pgmap v720: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T23:36:38.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6833/2803333022,v1:172.21.15.154:6835/2803333022] up:boot 2024-09-10T23:36:38.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6832/1918807532,v1:172.21.15.154:6834/1918807532] up:boot 2024-09-10T23:36:38.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6832/413018184,v1:172.21.15.177:6835/413018184] up:boot 2024-09-10T23:36:38.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6833/580710838,v1:172.21.15.177:6837/580710838] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6834/3998006554,v1:172.21.15.177:6838/3998006554] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.177:6836/56168267,v1:172.21.15.177:6839/56168267] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.2:6839/2395667701,v1:172.21.15.2:6840/2395667701] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.2:6838/2075738989,v1:172.21.15.2:6841/2075738989] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6836/1455887090,v1:172.21.15.154:6837/1455887090] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: mds.? [v2:172.21.15.154:6838/1541069708,v1:172.21.15.154:6839/1541069708] up:boot 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:36:38.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:36:38.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:36:38.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:36:38.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:36:38.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:36:38.531 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:38 smithi154 ceph-mon[35136]: from='mgr.14150 172.21.15.2:0/1960928238' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:36:38.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:38.527+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6d081a8310 con 0x7f6d0810d100 2024-09-10T23:36:39.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.055+0000 7f6d05ffb640 1 -- 172.21.15.2:0/2632478671 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f6d000ac9f0 con 0x7f6d0810d100 2024-09-10T23:36:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6cf40b52e0 msgr2=0x7f6cf40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6cf40b52e0 0x7f6cf40b77a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009990 tx=0x7f6cf8009110 comp rx=0 tx=0).stop 2024-09-10T23:36:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 msgr2=0x7f6d081a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 0x7f6d081a0e00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000cad0 tx=0x7f6d0000ced0 comp rx=0 tx=0).stop 2024-09-10T23:36:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 shutdown_connections 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f6cf40b52e0 0x7f6cf40b77a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d0810d100 0x7f6d081a0e00 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d081045c0 0x7f6d0819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 --2- 172.21.15.2:0/2632478671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d08103ca0 0x7f6d0819b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 >> 172.21.15.2:0/2632478671 conn(0x7f6d080fd700 msgr2=0x7f6d0810f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 shutdown_connections 2024-09-10T23:36:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:39.058+0000 7f6d0eb55640 1 -- 172.21.15.2:0/2632478671 wait complete. 2024-09-10T23:36:39.372 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:39 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2632478671' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:36:39.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:39 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2632478671' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:36:39.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:39 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2632478671' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:36:39.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:36:39.997 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:40.369 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:40 smithi002 ceph-mon[31150]: pgmap v722: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T23:36:40.369 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:40 smithi002 ceph-mon[31150]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:36:40.369 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:40 smithi002 ceph-mon[31150]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:36:40.369 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:40 smithi002 ceph-mon[31150]: Cluster is now healthy 2024-09-10T23:36:40.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:40 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/2632478671' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:36:40.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:40 smithi002 ceph-mon[31150]: fsmap 12 up:standby 2024-09-10T23:36:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:40 smithi177 ceph-mon[35760]: pgmap v722: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T23:36:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:40 smithi177 ceph-mon[35760]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:36:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:40 smithi177 ceph-mon[35760]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:36:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:40 smithi177 ceph-mon[35760]: Cluster is now healthy 2024-09-10T23:36:40.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:40 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/2632478671' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:36:40.465 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:40 smithi177 ceph-mon[35760]: fsmap 12 up:standby 2024-09-10T23:36:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 -- 172.21.15.2:0/1657713461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718104600 msgr2=0x7f871810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1657713461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718104600 0x7f871810caf0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f870c009900 tx=0x7f870c02a410 comp rx=0 tx=0).stop 2024-09-10T23:36:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 -- 172.21.15.2:0/1657713461 shutdown_connections 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1657713461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871810d140 0x7f871810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1657713461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718104600 0x7f871810caf0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1657713461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8718103ce0 0x7f87181040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 -- 172.21.15.2:0/1657713461 >> 172.21.15.2:0/1657713461 conn(0x7f87180fd720 msgr2=0x7f87180ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 -- 172.21.15.2:0/1657713461 shutdown_connections 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.454+0000 7f871e0bb640 1 -- 172.21.15.2:0/1657713461 wait complete. 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 Processor -- start 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 -- start start 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 0x7f87181992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8718104600 0x7f8718199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871810d140 0x7f871819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112e00 con 0x7f8718103ce0 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112c80 con 0x7f8718104600 2024-09-10T23:36:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f871e0bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112f80 con 0x7f871810d140 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.455+0000 7f87177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 0x7f87181992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 0x7f87181992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43910/0 (socket says 172.21.15.2:43910) 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 -- 172.21.15.2:0/1061479926 learned_addr learned my addr 172.21.15.2:0/1061479926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f8716ffd640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8718104600 0x7f8718199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f8717fff640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871810d140 0x7f871819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 -- 172.21.15.2:0/1061479926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871810d140 msgr2=0x7f871819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871810d140 0x7f871819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 -- 172.21.15.2:0/1061479926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8718104600 msgr2=0x7f8718199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8718104600 0x7f8718199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 -- 172.21.15.2:0/1061479926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871819f3a0 con 0x7f8718103ce0 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f8716ffd640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8718104600 0x7f8718199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f87177fe640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 0x7f87181992f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f870800d770 tx=0x7f870800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708017070 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080054d0 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871819f690 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708004c30 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.456+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87181a5d50 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.457+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87181040c0 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.459+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8708004e70 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.459+0000 7f8714ff9640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87000b5360 0x7f87000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.460+0000 7f8716ffd640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87000b5360 0x7f87000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.460+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8649+0+0 (secure 0 0 0) 0x7f87080e58a0 con 0x7f8718103ce0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.460+0000 7f8716ffd640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87000b5360 0x7f87000b7820 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f870c006010 tx=0x7f870c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.464+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f87080ac5c0 con 0x7f8718103ce0 2024-09-10T23:36:40.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:40 smithi154 ceph-mon[35136]: pgmap v722: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T23:36:40.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:40 smithi154 ceph-mon[35136]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:36:40.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:40 smithi154 ceph-mon[35136]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:36:40.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:40 smithi154 ceph-mon[35136]: Cluster is now healthy 2024-09-10T23:36:40.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:40 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/2632478671' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:36:40.530 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:40 smithi154 ceph-mon[35136]: fsmap 12 up:standby 2024-09-10T23:36:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:40.649+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f87181a60a0 con 0x7f8718103ce0 2024-09-10T23:36:41.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.058+0000 7f8714ff9640 1 -- 172.21.15.2:0/1061479926 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) ==== 181+0+0 (secure 0 0 0) 0x7f87080abec0 con 0x7f8718103ce0 2024-09-10T23:36:41.060 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:36:41.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.061+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87000b5360 msgr2=0x7f87000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.061+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87000b5360 0x7f87000b7820 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f870c006010 tx=0x7f870c000bc0 comp rx=0 tx=0).stop 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.061+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 msgr2=0x7f87181992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.061+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 0x7f87181992f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f870800d770 tx=0x7f870800dc30 comp rx=0 tx=0).stop 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 shutdown_connections 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7f87000b5360 0x7f87000b7820 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871810d140 0x7f871819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8718104600 0x7f8718199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 --2- 172.21.15.2:0/1061479926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8718103ce0 0x7f87181992f0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 >> 172.21.15.2:0/1061479926 conn(0x7f87180fd720 msgr2=0x7f871810f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 shutdown_connections 2024-09-10T23:36:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:41.062+0000 7f871e0bb640 1 -- 172.21.15.2:0/1061479926 wait complete. 2024-09-10T23:36:41.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:41 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1061479926' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:36:41.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:41 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1061479926' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:36:41.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:41 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1061479926' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:36:41.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:36:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:42.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:42 smithi002 ceph-mon[31150]: pgmap v723: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T23:36:42.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:42 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1061479926' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:36:42.342 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:42 smithi002 ceph-mon[31150]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:36:42.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:42 smithi177 ceph-mon[35760]: pgmap v723: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T23:36:42.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:42 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1061479926' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:36:42.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:42 smithi177 ceph-mon[35760]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:36:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:42 smithi154 ceph-mon[35136]: pgmap v723: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T23:36:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:42 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1061479926' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:36:42.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:42 smithi154 ceph-mon[35136]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 -- 172.21.15.2:0/3161904958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88810d140 msgr2=0x7fa88810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 --2- 172.21.15.2:0/3161904958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88810d140 0x7fa88810f5a0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fa880009ca0 tx=0x7fa88002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 -- 172.21.15.2:0/3161904958 shutdown_connections 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 --2- 172.21.15.2:0/3161904958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88810d140 0x7fa88810f5a0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 --2- 172.21.15.2:0/3161904958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888104600 0x7fa88810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 --2- 172.21.15.2:0/3161904958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa888103ce0 0x7fa8881040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 -- 172.21.15.2:0/3161904958 >> 172.21.15.2:0/3161904958 conn(0x7fa8880fd720 msgr2=0x7fa8880ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 -- 172.21.15.2:0/3161904958 shutdown_connections 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 -- 172.21.15.2:0/3161904958 wait complete. 2024-09-10T23:36:42.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 Processor -- start 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.564+0000 7fa88d95c640 1 -- start start 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 0x7fa88819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888104600 0x7fa88819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88810d140 0x7fa8881a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa888112db0 con 0x7fa888103ce0 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa888112c30 con 0x7fa888104600 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa888112f30 con 0x7fa88810d140 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 0x7fa88819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 0x7fa88819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48096/0 (socket says 172.21.15.2:48096) 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 -- 172.21.15.2:0/1110768134 learned_addr learned my addr 172.21.15.2:0/1110768134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa8867fc640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888104600 0x7fa88819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa8877fe640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88810d140 0x7fa8881a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 -- 172.21.15.2:0/1110768134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88810d140 msgr2=0x7fa8881a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88810d140 0x7fa8881a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 -- 172.21.15.2:0/1110768134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888104600 msgr2=0x7fa88819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888104600 0x7fa88819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 -- 172.21.15.2:0/1110768134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8881a1550 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa8877fe640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88810d140 0x7fa8881a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa886ffd640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 0x7fa88819b4a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d770 tx=0x7fa87800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878017070 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8780054d0 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8881a1840 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878004c30 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8881a7f00 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.566+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8881040c0 con 0x7fa888103ce0 2024-09-10T23:36:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.568+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa878004e10 con 0x7fa888103ce0 2024-09-10T23:36:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.568+0000 7fa88c95a640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa8700b52e0 0x7fa8700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.569+0000 7fa8867fc640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa8700b52e0 0x7fa8700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.569+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8095+0+0 (secure 0 0 0) 0x7fa8780e5610 con 0x7fa888103ce0 2024-09-10T23:36:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.569+0000 7fa8867fc640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa8700b52e0 0x7fa8700b77a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa88810e8f0 tx=0x7fa87c00b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.573+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa8780ac5b0 con 0x7fa888103ce0 2024-09-10T23:36:42.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:42.760+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa8881a82f0 con 0x7fa888103ce0 2024-09-10T23:36:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.066+0000 7fa88c95a640 1 -- 172.21.15.2:0/1110768134 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) ==== 169+0+0 (secure 0 0 0) 0x7fa8780abeb0 con 0x7fa888103ce0 2024-09-10T23:36:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-10T23:36:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa8700b52e0 msgr2=0x7fa8700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa8700b52e0 0x7fa8700b77a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa88810e8f0 tx=0x7fa87c00b360 comp rx=0 tx=0).stop 2024-09-10T23:36:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 msgr2=0x7fa88819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 0x7fa88819b4a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d770 tx=0x7fa87800dc30 comp rx=0 tx=0).stop 2024-09-10T23:36:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 shutdown_connections 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:6800/3310548901,v1:172.21.15.2:6801/3310548901] conn(0x7fa8700b52e0 0x7fa8700b77a0 secure :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa88810e8f0 tx=0x7fa87c00b360 comp rx=0 tx=0).stop 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa88810d140 0x7fa8881a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa888104600 0x7fa88819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 --2- 172.21.15.2:0/1110768134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa888103ce0 0x7fa88819b4a0 secure :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fa87800d770 tx=0x7fa87800dc30 comp rx=0 tx=0).stop 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.069+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 >> 172.21.15.2:0/1110768134 conn(0x7fa8880fd720 msgr2=0x7fa88810f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.070+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 shutdown_connections 2024-09-10T23:36:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T23:36:43.070+0000 7fa88d95c640 1 -- 172.21.15.2:0/1110768134 wait complete. 2024-09-10T23:36:43.391 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:43 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1110768134' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:36:43.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:43 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1110768134' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:36:43.529 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:43 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1110768134' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:36:43.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:36:43.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:36:43.799 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:36:43.831 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T23:36:43.831 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:36:43.847 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:36:43.865 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:36:43.888 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T23:36:43.888 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T23:36:43.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:36:43.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:43 smithi002 systemd[1]: Stopping Ceph mon.a for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:44 smithi177 ceph-mon[35760]: pgmap v725: 65 pgs: 65 active+clean; 577 KiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:36:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:44 smithi177 ceph-mon[35760]: from='client.? 172.21.15.2:0/1110768134' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:36:44.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:44 smithi177 ceph-mon[35760]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:36:44.342 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:44 smithi154 ceph-mon[35136]: pgmap v725: 65 pgs: 65 active+clean; 577 KiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:36:44.342 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:44 smithi154 ceph-mon[35136]: from='client.? 172.21.15.2:0/1110768134' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:36:44.342 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:44 smithi154 ceph-mon[35136]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:36:44.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 ceph-mon[31150]: pgmap v725: 65 pgs: 65 active+clean; 577 KiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:36:44.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 ceph-mon[31150]: from='client.? 172.21.15.2:0/1110768134' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:36:44.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 ceph-mon[31150]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:36:44.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a[31146]: 2024-09-10T23:36:44.187+0000 7fab6f737640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:36:44.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a[31146]: 2024-09-10T23:36:44.187+0000 7fab6f737640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T23:36:44.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 podman[120069]: 2024-09-10 23:36:44.218631422 +0000 UTC m=+0.136084190 container died 45da16428b40e06b27d2c291add3a9a32a8545fe0bbecae83efd05ae6c599f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:36:44.865 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 podman[120069]: 2024-09-10 23:36:44.612651041 +0000 UTC m=+0.530103791 container cleanup 45da16428b40e06b27d2c291add3a9a32a8545fe0bbecae83efd05ae6c599f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:36:44.865 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 10 23:36:44 smithi002 bash[120069]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:36:45.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T23:36:45.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:45.105 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T23:36:45.105 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T23:36:45.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.b 2024-09-10T23:36:45.454 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:45 smithi154 systemd[1]: Stopping Ceph mon.b for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:45.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-b[35132]: 2024-09-10T23:36:45.452+0000 7f9ebdc92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:36:45.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-b[35132]: 2024-09-10T23:36:45.452+0000 7f9ebdc92640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T23:36:45.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:45 smithi154 podman[70054]: 2024-09-10 23:36:45.626379622 +0000 UTC m=+0.296838461 container died 00dca4eb2b756df9d5e42006ee7e01b12c8c29feed3a476315a1bdac3618eceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:36:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:46 smithi154 podman[70054]: 2024-09-10 23:36:46.011989884 +0000 UTC m=+0.682448724 container cleanup 00dca4eb2b756df9d5e42006ee7e01b12c8c29feed3a476315a1bdac3618eceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T23:36:46.279 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 23:36:46 smithi154 bash[70054]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-b 2024-09-10T23:36:46.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T23:36:46.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:46.485 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T23:36:46.485 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T23:36:46.486 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.c 2024-09-10T23:36:46.816 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:46 smithi177 systemd[1]: Stopping Ceph mon.c for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:47.093 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-c[35743]: 2024-09-10T23:36:46.815+0000 7f083b489640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:36:47.093 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-c[35743]: 2024-09-10T23:36:46.815+0000 7f083b489640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T23:36:47.093 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:46 smithi177 podman[71447]: 2024-09-10 23:36:46.907236691 +0000 UTC m=+0.222811266 container died 0801e2e661863e6160206cbd96a0f62fceb909fd15ca79726bfd00546b333af2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T23:36:47.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:47 smithi177 podman[71447]: 2024-09-10 23:36:47.291049164 +0000 UTC m=+0.606623739 container cleanup 0801e2e661863e6160206cbd96a0f62fceb909fd15ca79726bfd00546b333af2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T23:36:47.464 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 10 23:36:47 smithi177 bash[71447]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mon-c 2024-09-10T23:36:47.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T23:36:47.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:47.759 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T23:36:47.759 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T23:36:47.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:36:48.086 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:47 smithi002 systemd[1]: Stopping Ceph mgr.x for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:48.411 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:36:48.084+0000 7fc2ebcbf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:36:48.411 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x[31380]: 2024-09-10T23:36:48.084+0000 7fc2ebcbf640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T23:36:48.411 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 podman[120192]: 2024-09-10 23:36:48.116064781 +0000 UTC m=+0.153024482 container died 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T23:36:48.737 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 podman[120192]: 2024-09-10 23:36:48.519000693 +0000 UTC m=+0.555960403 container cleanup 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T23:36:48.737 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 bash[120192]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x 2024-09-10T23:36:48.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T23:36:48.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 podman[120207]: 2024-09-10 23:36:48.737191121 +0000 UTC m=+0.617710663 container remove 407ca5abcf6e70b72623103ecc44ca6c174c2659512fa3f9c5985a6a45790ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-x, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T23:36:48.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-10T23:36:48.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 systemd[1]: Stopped Ceph mgr.x for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:36:48.988 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 10 23:36:48 smithi002 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.x.service: Consumed 50.631s CPU time. 2024-09-10T23:36:49.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:49.001 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T23:36:49.001 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T23:36:49.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.y 2024-09-10T23:36:49.346 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:36:49 smithi154 systemd[1]: Stopping Ceph mgr.y for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:49.661 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:36:49 smithi154 podman[70177]: 2024-09-10 23:36:49.346266403 +0000 UTC m=+0.152996501 container died 348398aa5980de2ba80121cc6e477c2398a9b5e50f51d011902e76881536f59e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T23:36:50.029 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:36:49 smithi154 podman[70177]: 2024-09-10 23:36:49.768052543 +0000 UTC m=+0.574782689 container cleanup 348398aa5980de2ba80121cc6e477c2398a9b5e50f51d011902e76881536f59e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T23:36:50.029 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 23:36:49 smithi154 bash[70177]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-y 2024-09-10T23:36:50.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T23:36:50.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:50.195 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T23:36:50.195 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T23:36:50.195 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.z 2024-09-10T23:36:50.534 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:36:50 smithi177 systemd[1]: Stopping Ceph mgr.z for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:50.822 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:36:50 smithi177 podman[71582]: 2024-09-10 23:36:50.533286538 +0000 UTC m=+0.143721905 container died a962b256e70aac20eca5411815171fe1b4111d8870f215fdb968aecc3a04fc75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T23:36:51.157 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:36:50 smithi177 podman[71582]: 2024-09-10 23:36:50.913122042 +0000 UTC m=+0.523557407 container cleanup a962b256e70aac20eca5411815171fe1b4111d8870f215fdb968aecc3a04fc75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:36:51.157 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 10 23:36:50 smithi177 bash[71582]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mgr-z 2024-09-10T23:36:51.299 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T23:36:51.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:51.334 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T23:36:51.334 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T23:36:51.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.0 2024-09-10T23:36:51.632 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:51 smithi002 systemd[1]: Stopping Ceph osd.0 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:36:51.986 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0[47333]: 2024-09-10T23:36:51.631+0000 7fde1488d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:36:51.987 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0[47333]: 2024-09-10T23:36:51.631+0000 7fde1488d640 -1 osd.0 80 *** Got signal Terminated *** 2024-09-10T23:36:51.987 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0[47333]: 2024-09-10T23:36:51.631+0000 7fde1488d640 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:36:57.237 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:56 smithi002 podman[120313]: 2024-09-10 23:36:56.958723949 +0000 UTC m=+5.427819175 container died bd3fb658aace3c23cd1b08ad5cc45e7027ca5af2c97362a2a88d7df721469e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T23:36:57.709 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:57 smithi002 podman[120313]: 2024-09-10 23:36:57.448792328 +0000 UTC m=+5.917887552 container cleanup bd3fb658aace3c23cd1b08ad5cc45e7027ca5af2c97362a2a88d7df721469e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T23:36:57.709 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:57 smithi002 bash[120313]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0 2024-09-10T23:36:57.987 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:57 smithi002 podman[120329]: 2024-09-10 23:36:57.708829365 +0000 UTC m=+0.751688900 container remove bd3fb658aace3c23cd1b08ad5cc45e7027ca5af2c97362a2a88d7df721469e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:36:58.347 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:58 smithi002 podman[120416]: 2024-09-10 23:36:57.975114262 +0000 UTC m=+0.016548465 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:36:58.347 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:58 smithi002 podman[120416]: 2024-09-10 23:36:58.093213536 +0000 UTC m=+0.134647798 container create 44fc3b5d73a89e08befb256762840e654de727413b3f713bdb9ec898916571ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:36:58.347 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:58 smithi002 podman[120416]: 2024-09-10 23:36:58.346514332 +0000 UTC m=+0.387948538 container init 44fc3b5d73a89e08befb256762840e654de727413b3f713bdb9ec898916571ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:36:58.737 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:58 smithi002 podman[120416]: 2024-09-10 23:36:58.350248676 +0000 UTC m=+0.391682880 container start 44fc3b5d73a89e08befb256762840e654de727413b3f713bdb9ec898916571ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:36:58.737 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:58 smithi002 podman[120416]: 2024-09-10 23:36:58.454585431 +0000 UTC m=+0.496019651 container attach 44fc3b5d73a89e08befb256762840e654de727413b3f713bdb9ec898916571ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T23:36:58.737 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 10 23:36:58 smithi002 podman[120416]: 2024-09-10 23:36:58.546791037 +0000 UTC m=+0.588225246 container died 44fc3b5d73a89e08befb256762840e654de727413b3f713bdb9ec898916571ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T23:36:59.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T23:36:59.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:36:59.201 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T23:36:59.201 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T23:36:59.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.1 2024-09-10T23:36:59.529 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:36:59 smithi154 systemd[1]: Stopping Ceph osd.1 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:00.029 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:36:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1[39587]: 2024-09-10T23:36:59.568+0000 7fdb7ac19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:00.029 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:36:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1[39587]: 2024-09-10T23:36:59.568+0000 7fdb7ac19640 -1 osd.1 80 *** Got signal Terminated *** 2024-09-10T23:37:00.029 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:36:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1[39587]: 2024-09-10T23:36:59.568+0000 7fdb7ac19640 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:05.279 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:05 smithi154 podman[70304]: 2024-09-10 23:37:05.007314675 +0000 UTC m=+5.606557226 container died b2aa78075ab9c89b9195a9061761b28c04f66a0297fd7fbe44fe4f1ab15f96ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:05.666 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:05 smithi154 podman[70304]: 2024-09-10 23:37:05.439549552 +0000 UTC m=+6.038792104 container cleanup b2aa78075ab9c89b9195a9061761b28c04f66a0297fd7fbe44fe4f1ab15f96ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T23:37:05.666 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:05 smithi154 bash[70304]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1 2024-09-10T23:37:06.029 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:05 smithi154 podman[70320]: 2024-09-10 23:37:05.666178925 +0000 UTC m=+0.657129786 container remove b2aa78075ab9c89b9195a9061761b28c04f66a0297fd7fbe44fe4f1ab15f96ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:37:06.370 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:06 smithi154 podman[70406]: 2024-09-10 23:37:06.015456328 +0000 UTC m=+0.015820139 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:06.370 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:06 smithi154 podman[70406]: 2024-09-10 23:37:06.133654568 +0000 UTC m=+0.134018371 container create 4cace4c20f10ffd5df5bd4f97a34e89b444ca44bc361710878a495fb58b154d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T23:37:06.779 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:06 smithi154 podman[70406]: 2024-09-10 23:37:06.369867789 +0000 UTC m=+0.370231594 container init 4cace4c20f10ffd5df5bd4f97a34e89b444ca44bc361710878a495fb58b154d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:37:06.779 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:06 smithi154 podman[70406]: 2024-09-10 23:37:06.373491991 +0000 UTC m=+0.373855805 container start 4cace4c20f10ffd5df5bd4f97a34e89b444ca44bc361710878a495fb58b154d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:37:06.779 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:06 smithi154 podman[70406]: 2024-09-10 23:37:06.470111881 +0000 UTC m=+0.470475704 container attach 4cace4c20f10ffd5df5bd4f97a34e89b444ca44bc361710878a495fb58b154d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T23:37:06.779 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 23:37:06 smithi154 podman[70406]: 2024-09-10 23:37:06.571467169 +0000 UTC m=+0.571830976 container died 4cace4c20f10ffd5df5bd4f97a34e89b444ca44bc361710878a495fb58b154d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T23:37:07.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T23:37:07.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:07.242 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T23:37:07.242 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T23:37:07.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.2 2024-09-10T23:37:07.643 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:07 smithi177 systemd[1]: Stopping Ceph osd.2 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:07.964 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2[40745]: 2024-09-10T23:37:07.641+0000 7f5a229bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:07.964 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2[40745]: 2024-09-10T23:37:07.641+0000 7f5a229bd640 -1 osd.2 80 *** Got signal Terminated *** 2024-09-10T23:37:07.964 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2[40745]: 2024-09-10T23:37:07.641+0000 7f5a229bd640 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:13.401 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:13 smithi177 podman[71707]: 2024-09-10 23:37:13.133590477 +0000 UTC m=+5.699772620 container died ebf136e06b0f435bea9070d4fa24b0f49f957b7916712ed475f1eb5a5828591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:13.677 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:13 smithi177 podman[71707]: 2024-09-10 23:37:13.474734069 +0000 UTC m=+6.040916211 container cleanup ebf136e06b0f435bea9070d4fa24b0f49f957b7916712ed475f1eb5a5828591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T23:37:13.677 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:13 smithi177 bash[71707]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2 2024-09-10T23:37:13.964 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:13 smithi177 podman[71724]: 2024-09-10 23:37:13.676504256 +0000 UTC m=+0.541229171 container remove ebf136e06b0f435bea9070d4fa24b0f49f957b7916712ed475f1eb5a5828591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:14.338 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:14 smithi177 podman[71814]: 2024-09-10 23:37:13.987241379 +0000 UTC m=+0.015800185 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:14.338 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:14 smithi177 podman[71814]: 2024-09-10 23:37:14.094003043 +0000 UTC m=+0.122561839 container create 058dbff0371c185b08f45b98951b3d6f361e5776943f40c4b1b231f32992a021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T23:37:14.714 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:14 smithi177 podman[71814]: 2024-09-10 23:37:14.338489484 +0000 UTC m=+0.367048288 container init 058dbff0371c185b08f45b98951b3d6f361e5776943f40c4b1b231f32992a021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T23:37:14.715 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:14 smithi177 podman[71814]: 2024-09-10 23:37:14.342186813 +0000 UTC m=+0.370745608 container start 058dbff0371c185b08f45b98951b3d6f361e5776943f40c4b1b231f32992a021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T23:37:14.715 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:14 smithi177 podman[71814]: 2024-09-10 23:37:14.438555818 +0000 UTC m=+0.467114627 container attach 058dbff0371c185b08f45b98951b3d6f361e5776943f40c4b1b231f32992a021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T23:37:14.715 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 10 23:37:14 smithi177 podman[71814]: 2024-09-10 23:37:14.530608176 +0000 UTC m=+0.559166988 container died 058dbff0371c185b08f45b98951b3d6f361e5776943f40c4b1b231f32992a021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:37:15.150 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T23:37:15.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:15.191 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T23:37:15.191 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T23:37:15.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.3 2024-09-10T23:37:15.487 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:15 smithi002 systemd[1]: Stopping Ceph osd.3 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:15.755 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:15 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:37:15.502+0000 7f0907a55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:15.755 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:15 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:37:15.502+0000 7f0907a55640 -1 osd.3 80 *** Got signal Terminated *** 2024-09-10T23:37:15.755 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:15 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:37:15.502+0000 7f0907a55640 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:18.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:18 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:18.425+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:18.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:18.592+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:19.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:19 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:19.375+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:19.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:19 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:19.330+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:19.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:19.634+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:20.237 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:19 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3[54176]: 2024-09-10T23:37:19.889+0000 7f0900062640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.644934+0000 front 2024-09-10T23:36:55.644973+0000 (oldest deadline 2024-09-10T23:37:19.144958+0000) 2024-09-10T23:37:20.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:20 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:20.367+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:20.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:20 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:20.377+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:20.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:20.662+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:21.320 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:21 smithi002 podman[120520]: 2024-09-10 23:37:21.015271944 +0000 UTC m=+5.620913615 container died 6128452c1f1d307782f4c025f3881f660669bd739499d962fcb264f5acd0f978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:21.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:21 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:21.400+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:21.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:21 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:21.348+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:21.737 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:21 smithi002 podman[120520]: 2024-09-10 23:37:21.527940822 +0000 UTC m=+6.133582472 container cleanup 6128452c1f1d307782f4c025f3881f660669bd739499d962fcb264f5acd0f978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:37:21.738 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:21 smithi002 bash[120520]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3 2024-09-10T23:37:21.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:21.651+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:22.112 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:21 smithi002 podman[120548]: 2024-09-10 23:37:21.788050505 +0000 UTC m=+0.765443951 container remove 6128452c1f1d307782f4c025f3881f660669bd739499d962fcb264f5acd0f978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T23:37:22.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:21 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:21.801+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:22.393 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:22 smithi002 podman[120639]: 2024-09-10 23:37:22.01464769 +0000 UTC m=+0.017001198 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:22.393 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:22 smithi002 podman[120639]: 2024-09-10 23:37:22.139075267 +0000 UTC m=+0.141428769 container create dc8bc089f3c2638f67474981c57a95c9d1694f2b22372fe579f44a1d55cd5827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:37:22.678 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:22.354+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:22.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:22 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:22.425+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:22.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:22 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:22.391+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:22.737 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:22 smithi002 podman[120639]: 2024-09-10 23:37:22.399707615 +0000 UTC m=+0.402061114 container init dc8bc089f3c2638f67474981c57a95c9d1694f2b22372fe579f44a1d55cd5827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:37:22.737 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:22 smithi002 podman[120639]: 2024-09-10 23:37:22.403136027 +0000 UTC m=+0.405489519 container start dc8bc089f3c2638f67474981c57a95c9d1694f2b22372fe579f44a1d55cd5827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T23:37:22.738 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:22 smithi002 podman[120639]: 2024-09-10 23:37:22.508616262 +0000 UTC m=+0.510969760 container attach dc8bc089f3c2638f67474981c57a95c9d1694f2b22372fe579f44a1d55cd5827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T23:37:22.738 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 10 23:37:22 smithi002 podman[120639]: 2024-09-10 23:37:22.6021811 +0000 UTC m=+0.604534612 container died dc8bc089f3c2638f67474981c57a95c9d1694f2b22372fe579f44a1d55cd5827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:22.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:22.677+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:23.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:22 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:22.829+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:23.503 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T23:37:23.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:23.555 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T23:37:23.555 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T23:37:23.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.4 2024-09-10T23:37:23.676 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:23.340+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:23.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:23 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:23.374+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:23.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:23 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:23.436+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:23.877 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:23 smithi154 systemd[1]: Stopping Ceph osd.4 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:23.877 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:23 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:23.797+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:23.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:23.675+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:24.279 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:23 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4[46475]: 2024-09-10T23:37:23.876+0000 7f6c4ac2a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:24.279 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:23 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4[46475]: 2024-09-10T23:37:23.876+0000 7f6c4ac2a640 -1 osd.4 80 *** Got signal Terminated *** 2024-09-10T23:37:24.279 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:23 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4[46475]: 2024-09-10T23:37:23.876+0000 7f6c4ac2a640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:24.685 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:24.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:24.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:24 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:24.454+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:24.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:24 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:24.356+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:24.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:24.684+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:25.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:24 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:24.839+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:25.642 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:25 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:25.368+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:25.736 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:25 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:25.411+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:25.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:25 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:25.345+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:25.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:25 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:25.641+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:25.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:25 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:25.641+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:26.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:25 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:25.877+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:26.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:26 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:26.353+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:26.714 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:26 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:26.600+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:26.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:26 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:26.600+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:26.736 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:26 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:26.445+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:26.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:26 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:26.371+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:27.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:26 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:26.890+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:27.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:26 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:26.890+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:27.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:27 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:27.361+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:27.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:27 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:27.602+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:27.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:27 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:27.602+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:27.736 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:27.420+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:27.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:27.335+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:28.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:27 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:27.901+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:28.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:27 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:27.901+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:28.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:28 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:28.392+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:28.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:28 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:28.568+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:28.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:28 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:28.568+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:28.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:28 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:28.430+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:28.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:28 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:28.430+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:28.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:28 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:28.321+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:28.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:28 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:28.321+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:29.197 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:28 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:28.866+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:29.197 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:28 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:28.866+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:29.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:29 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:29.199+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:29.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:29 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:29.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:29.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:29 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:29.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:29.477 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:29 smithi154 podman[70525]: 2024-09-10 23:37:29.197415804 +0000 UTC m=+5.441775517 container died f2a085c72aff9f8b55b3f1cd01a3d034a22103e6c87dc22771a2ba926fc83482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:29.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:29 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:29.410+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:29.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:29 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:29.410+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:29.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:29 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:29.302+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:29.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:29 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:29.302+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:29.779 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:29 smithi154 podman[70525]: 2024-09-10 23:37:29.576857811 +0000 UTC m=+5.821217529 container cleanup f2a085c72aff9f8b55b3f1cd01a3d034a22103e6c87dc22771a2ba926fc83482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:37:29.779 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:29 smithi154 bash[70525]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4 2024-09-10T23:37:29.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:29 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:29.572+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:29.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:29 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:29.572+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:30.146 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:29 smithi154 podman[70540]: 2024-09-10 23:37:29.836510499 +0000 UTC m=+0.633344178 container remove f2a085c72aff9f8b55b3f1cd01a3d034a22103e6c87dc22771a2ba926fc83482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T23:37:30.146 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:29 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:29.839+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:30.146 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:29 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:29.839+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:30.416 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:30 smithi154 podman[70631]: 2024-09-10 23:37:30.048929106 +0000 UTC m=+0.016125903 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:30.416 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:30 smithi154 podman[70631]: 2024-09-10 23:37:30.162257195 +0000 UTC m=+0.129453983 container create 27bcb092f8a67ab24c6e5aab962cc6cc5f8d13aab5195961637fb7c34f11bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T23:37:30.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:30 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:30.162+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:30.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:30 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:30.341+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:30.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:30 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:30.341+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:30.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:30.374+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:30.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:30.374+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:30.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:30.319+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:30.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:30.319+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:30.779 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:30 smithi154 podman[70631]: 2024-09-10 23:37:30.415544088 +0000 UTC m=+0.382740888 container init 27bcb092f8a67ab24c6e5aab962cc6cc5f8d13aab5195961637fb7c34f11bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:30.779 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:30 smithi154 podman[70631]: 2024-09-10 23:37:30.419577147 +0000 UTC m=+0.386773941 container start 27bcb092f8a67ab24c6e5aab962cc6cc5f8d13aab5195961637fb7c34f11bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T23:37:30.779 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:30 smithi154 podman[70631]: 2024-09-10 23:37:30.532057424 +0000 UTC m=+0.499254225 container attach 27bcb092f8a67ab24c6e5aab962cc6cc5f8d13aab5195961637fb7c34f11bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:37:30.779 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 23:37:30 smithi154 podman[70631]: 2024-09-10 23:37:30.602993371 +0000 UTC m=+0.570190157 container died 27bcb092f8a67ab24c6e5aab962cc6cc5f8d13aab5195961637fb7c34f11bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:30.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:30 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:30.426+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:30.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:30 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:30.557+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:30.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:30 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:30.557+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:31.211 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:30 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:30.872+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:31.211 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:30 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:30.872+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:31.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T23:37:31.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:31.270 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T23:37:31.270 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T23:37:31.270 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.5 2024-09-10T23:37:31.464 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:31 smithi177 systemd[1]: Stopping Ceph osd.5 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:31.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:31.331+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:31.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:31.331+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:31.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:31.118+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:31.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:31 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:31.339+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:31.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:31 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:31.339+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:31.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:31 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:31.336+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:31.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:31 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:31.336+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:31.778 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:31 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:31.465+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:31.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:31.572+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:31.965 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:31.572+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:31.965 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:31.619+0000 7f784c390640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:31.965 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:31.619+0000 7f784c390640 -1 osd.5 80 *** Got signal Terminated *** 2024-09-10T23:37:31.965 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:31 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:31.619+0000 7f784c390640 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:32.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:31 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:31.872+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:32.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:31 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:31.872+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:32.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:32 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:32.130+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:32.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:32 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:32.353+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:32.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:32 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:32.353+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:32.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:32 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:32.379+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:32.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:32 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:32.379+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:32.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:32 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:32.298+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:32.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:32 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:32.298+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:32.780 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:32 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:32.444+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:32.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:32 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:32.539+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:32.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:32 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:32.539+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:33.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:32 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:32.878+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:33.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:32 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:32.878+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:33.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:33 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:33.102+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:33.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:33 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:33.331+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:33.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:33 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:33.331+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:33.555 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:33 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:33.263+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:33.555 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:33 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:33.263+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:33.556 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:33 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:33.386+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:33.556 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:33 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:33.386+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:33.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:33 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:33.419+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:33.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:33 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:33.586+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:33.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:33 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:33.586+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:34.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:33 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:33.842+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:34.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:33 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:33.842+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:34.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:33 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:33.842+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:34.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:34 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:34.327+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:34.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:34 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:34.327+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:34.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:34 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:34.327+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:34.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:34 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:34.089+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:34.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:34 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:34.307+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:34.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:34 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:34.307+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:34.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:34 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:34.358+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:34.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:34 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:34.358+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:34.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:34 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:34.358+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:34.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:34 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:34.469+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:34.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:34 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:34.575+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:34.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:34 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:34.575+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:35.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:34 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:34.829+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:35.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:34 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:34.829+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:35.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:34 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:34.829+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:35.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:35.303+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:35.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:35.303+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:35.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:35.303+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:35.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:35.096+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:35.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:35.350+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:35.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:35.350+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:35.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:35.350+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:35.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:35.274+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:35.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:35.274+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:35.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:35 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:35.274+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:35.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:35 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:35.496+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:35.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:35.528+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:35.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:35 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:35.528+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:36.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:35 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:35.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:36.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:35 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:35.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:36.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:35 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:35.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:36.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:36.265+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:36.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:36.265+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:36.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:36.265+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:36.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:36.067+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:36.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:36.067+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:36.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:36.382+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:36.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:36.382+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:36.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:36.382+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:36.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:36.316+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:36.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:36.316+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:36.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:36 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:36.316+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:36.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:36.480+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:36.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:36.513+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:52.935861+0000 front 2024-09-10T23:36:52.935888+0000 (oldest deadline 2024-09-10T23:37:18.236046+0000) 2024-09-10T23:37:36.965 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:36.513+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.137279+0000 front 2024-09-10T23:37:04.137145+0000 (oldest deadline 2024-09-10T23:37:25.237148+0000) 2024-09-10T23:37:36.965 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:36 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5[47241]: 2024-09-10T23:37:36.513+0000 7f784499d640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.538231+0000 front 2024-09-10T23:37:10.538261+0000 (oldest deadline 2024-09-10T23:37:35.838359+0000) 2024-09-10T23:37:37.279 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:37 smithi177 podman[71927]: 2024-09-10 23:37:37.007146465 +0000 UTC m=+5.539112330 container died 4a05e5cded2ebadc7a58eafa8454aa20641595c7beba257fb7932cd8857e7d96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T23:37:37.279 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:37 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:37.105+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:37.279 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:37 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:37.105+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:37.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:36.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:37.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:36.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:37.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:36 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:36.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:37.654 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:37 smithi177 podman[71927]: 2024-09-10 23:37:37.377533045 +0000 UTC m=+5.909498910 container cleanup 4a05e5cded2ebadc7a58eafa8454aa20641595c7beba257fb7932cd8857e7d96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:37:37.654 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:37 smithi177 bash[71927]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5 2024-09-10T23:37:37.655 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:37 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:37.315+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:37.655 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:37 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:37.315+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:37.655 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:37 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:37.315+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:37.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:37 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:37.412+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:37.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:37 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:37.412+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:37.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:37 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:37.412+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:37.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:37 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:37.329+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:37.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:37 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:37.329+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:37.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:37 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:37.329+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:37.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:37 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:37.477+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:37.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:37 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:37.477+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:37.964 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:37 smithi177 podman[71942]: 2024-09-10 23:37:37.653804465 +0000 UTC m=+0.642953200 container remove 4a05e5cded2ebadc7a58eafa8454aa20641595c7beba257fb7932cd8857e7d96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T23:37:38.241 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:37 smithi177 podman[72032]: 2024-09-10 23:37:37.888367037 +0000 UTC m=+0.015786089 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:38.241 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:38 smithi177 podman[72032]: 2024-09-10 23:37:38.013349421 +0000 UTC m=+0.140768461 container create 976ac8ecf4cd5f0c62fb723baf1e761452d368890b5288366939544cc16dce6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T23:37:38.241 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:38 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:38.152+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:38.241 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:38 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:38.152+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:38.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:37 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:37.845+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:38.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:37 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:37.845+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:38.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:37 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:37.845+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:38.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:38 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:38.323+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:38.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:38 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:38.323+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:38.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:38 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:38.323+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:38.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:38 smithi177 podman[72032]: 2024-09-10 23:37:38.240742013 +0000 UTC m=+0.368161058 container init 976ac8ecf4cd5f0c62fb723baf1e761452d368890b5288366939544cc16dce6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:37:38.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:38 smithi177 podman[72032]: 2024-09-10 23:37:38.244127296 +0000 UTC m=+0.371546339 container start 976ac8ecf4cd5f0c62fb723baf1e761452d368890b5288366939544cc16dce6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T23:37:38.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:38 smithi177 podman[72032]: 2024-09-10 23:37:38.3409775 +0000 UTC m=+0.468396553 container attach 976ac8ecf4cd5f0c62fb723baf1e761452d368890b5288366939544cc16dce6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:38.715 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 10 23:37:38 smithi177 podman[72032]: 2024-09-10 23:37:38.440432716 +0000 UTC m=+0.567851756 container died 976ac8ecf4cd5f0c62fb723baf1e761452d368890b5288366939544cc16dce6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:38.736 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:38.459+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:38.736 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:38.459+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:38.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:38.459+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:38.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:38.319+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:38.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:38.319+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:38.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:38.319+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:38.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:38 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:38.494+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:38.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:38 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:38.494+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:39.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T23:37:39.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:39.160 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T23:37:39.160 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T23:37:39.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.6 2024-09-10T23:37:39.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:38 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:38.871+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:39.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:38 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:38.871+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:39.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:38 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:38.871+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:39.364 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:39 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:39.133+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:39.364 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:39 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:39.133+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:39.463 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 systemd[1]: Stopping Ceph osd.6 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:39.463 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:39.275+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:39.463 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:39.275+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:39.463 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:39.275+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:39.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:39 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:39.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:39.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:39 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:39.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:39.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:39 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:39.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:39.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:39.462+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:39.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:39.462+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:39.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:39.462+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:39.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:39.473+0000 7f9728e30640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:39.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:39.473+0000 7f9728e30640 -1 osd.6 80 *** Got signal Terminated *** 2024-09-10T23:37:39.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:39 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:39.473+0000 7f9728e30640 -1 osd.6 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:39.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:39 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:39.454+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:39.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:39 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:39.454+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:40.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:39 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:39.917+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:40.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:39 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:39.917+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:40.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:39 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:39.917+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:40.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:40 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:40.143+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:40.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:40 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:40.143+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:40.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:40 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:40.378+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:40.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:40 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:40.378+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:40.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:40 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:40.378+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:40.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:40.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:40.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:40.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:40.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:40.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:40.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:40.296+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:40.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:40.296+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:40.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:40 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:40.296+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:40.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:40 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:40.487+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:40.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:40 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:40.487+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:41.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:40 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:40.904+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:41.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:40 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:40.905+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:41.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:40 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:40.905+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:41.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:41 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:41.190+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:41.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:41 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:41.190+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:41.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:41 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:41.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:41.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:41 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:41.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:41.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:41 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:41.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:41.509 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:41.248+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:41.509 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:41.248+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:41.509 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:41.248+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:41.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:41 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:41.461+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:41.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:41 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:41.461+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:41.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:41 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:41.461+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:41.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:41.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:41.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:41.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:41.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:41.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:41.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:41 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:41.508+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.926471+0000 front 2024-09-10T23:37:18.926232+0000 (oldest deadline 2024-09-10T23:37:41.226379+0000) 2024-09-10T23:37:42.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:41 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:41.862+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:42.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:41 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:41.862+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:42.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:41 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:41.862+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:42.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:42 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:42.158+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:42.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:42 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:42.158+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:42.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:42 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:42.328+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:42.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:42 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:42.328+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:42.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:42 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:42.328+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:42.500 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:42.244+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:42.501 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:42.244+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:42.501 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:42.244+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:42.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:42.466+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:42.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:42.466+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:42.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:42.466+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:42.986 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:42.500+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:42.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:42.500+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:42.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:42.500+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:42.987 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:42 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:42.500+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.926471+0000 front 2024-09-10T23:37:18.926232+0000 (oldest deadline 2024-09-10T23:37:41.226379+0000) 2024-09-10T23:37:43.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:42.845+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:43.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:42.845+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:43.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:42.845+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:43.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:43 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:43.203+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:43.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:43 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:43.203+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:43.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:43 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:43.203+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:43.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:43 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:43.310+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:43.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:43 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:43.310+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:43.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:43 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:43.310+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:43.468 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:43.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:43.468 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:43.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:43.468 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:43.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:43.468 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:43.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:43.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:43.467+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:43.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:43.467+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:43.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:43.467+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:43.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:43 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:43.467+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.926471+0000 front 2024-09-10T23:37:18.926232+0000 (oldest deadline 2024-09-10T23:37:41.226379+0000) 2024-09-10T23:37:43.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:43 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:43.483+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:43.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:43 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:43.483+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:43.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:43 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:43.483+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:44.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:43 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:43.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:44.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:43 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:43.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:44.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:43 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:43.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:44.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:44 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:44.176+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:44.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:44 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:44.176+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:44.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:44 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:44.176+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:44.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:44 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:44.303+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:44.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:44 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:44.303+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:44.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:44 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:44.303+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:44.472 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:44.184+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:44.472 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:44.184+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:44.472 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:44.184+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:44.472 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:44.184+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:44.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:44.471+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:53.822436+0000 front 2024-09-10T23:36:53.822402+0000 (oldest deadline 2024-09-10T23:37:18.522583+0000) 2024-09-10T23:37:44.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:44.471+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:03.124558+0000 front 2024-09-10T23:37:03.124505+0000 (oldest deadline 2024-09-10T23:37:27.824293+0000) 2024-09-10T23:37:44.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:44.471+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:10.125575+0000 front 2024-09-10T23:37:10.125564+0000 (oldest deadline 2024-09-10T23:37:34.225349+0000) 2024-09-10T23:37:44.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:44 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6[60832]: 2024-09-10T23:37:44.471+0000 7f9725445640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.926471+0000 front 2024-09-10T23:37:18.926232+0000 (oldest deadline 2024-09-10T23:37:41.226379+0000) 2024-09-10T23:37:44.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:44 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:44.449+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:44.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:44 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:44.449+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:44.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:44 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:44.449+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:45.116 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:44 smithi002 podman[120740]: 2024-09-10 23:37:44.827174591 +0000 UTC m=+5.466099370 container died ddcb3b6006d3b5048235d260744e18031eeadbff7fb25356cab8da566cc89993 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T23:37:45.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:44 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:44.812+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:45.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:44 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:44.812+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:45.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:44 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:44.812+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:45.376 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:45 smithi002 podman[120740]: 2024-09-10 23:37:45.357157441 +0000 UTC m=+5.996082217 container cleanup ddcb3b6006d3b5048235d260744e18031eeadbff7fb25356cab8da566cc89993 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:45.376 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:45 smithi002 bash[120740]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6 2024-09-10T23:37:45.376 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:45 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:45.175+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:45.376 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:45 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:45.175+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:45.376 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:45 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:45.175+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:45.376 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:45 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:45.175+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:45.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:45 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:45.198+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:45.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:45 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:45.198+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:45.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:45 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:45.198+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:45.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:45 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:45.326+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:45.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:45 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:45.326+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:45.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:45 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:45.326+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:45.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:45.478+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:45.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:45.478+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:45.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:45.478+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:45.986 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:45 smithi002 podman[120757]: 2024-09-10 23:37:45.583311186 +0000 UTC m=+0.743711986 container remove ddcb3b6006d3b5048235d260744e18031eeadbff7fb25356cab8da566cc89993 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:37:46.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:45.802+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:46.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:45.802+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:46.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:45.802+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:46.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:45 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:45.802+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:46.303 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:46 smithi002 podman[120849]: 2024-09-10 23:37:45.936577482 +0000 UTC m=+0.016178334 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:46.304 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:46 smithi002 podman[120849]: 2024-09-10 23:37:46.084238889 +0000 UTC m=+0.163839735 container create 8dd052a402dbe48c9b99f7ec819dfffe710ae05e6706a1cf4b961d436d08fc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:46.304 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:46 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:46.178+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:46.304 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:46 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:46.178+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:46.304 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:46 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:46.178+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:46.304 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:46 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:46.178+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:46.636 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:46.246+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:46.636 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:46.246+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:46.636 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:46.246+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:46.637 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:46.294+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:46.637 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:46.294+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:46.637 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:46 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:46.294+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:46.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:46 smithi002 podman[120849]: 2024-09-10 23:37:46.303598217 +0000 UTC m=+0.383199061 container init 8dd052a402dbe48c9b99f7ec819dfffe710ae05e6706a1cf4b961d436d08fc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:46.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:46 smithi002 podman[120849]: 2024-09-10 23:37:46.307046842 +0000 UTC m=+0.386647690 container start 8dd052a402dbe48c9b99f7ec819dfffe710ae05e6706a1cf4b961d436d08fc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:37:46.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:46 smithi002 podman[120849]: 2024-09-10 23:37:46.403381851 +0000 UTC m=+0.482982695 container attach 8dd052a402dbe48c9b99f7ec819dfffe710ae05e6706a1cf4b961d436d08fc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T23:37:46.737 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:46 smithi002 podman[120849]: 2024-09-10 23:37:46.50242007 +0000 UTC m=+0.582020914 container died 8dd052a402dbe48c9b99f7ec819dfffe710ae05e6706a1cf4b961d436d08fc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:46.769 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:46.434+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:46.770 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:46.434+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:46.770 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:46.434+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:47.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:46.769+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:47.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:46.769+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:47.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:46.769+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:47.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:46.769+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:47.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T23:37:47.338 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:47 smithi002 podman[120871]: 2024-09-10 23:37:47.282523602 +0000 UTC m=+0.774197287 container remove 8dd052a402dbe48c9b99f7ec819dfffe710ae05e6706a1cf4b961d436d08fc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:47 smithi002 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.6.service: Deactivated successfully. 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:47 smithi002 systemd[1]: Stopped Ceph osd.6 for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 10 23:37:47 smithi002 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.6.service: Consumed 8.522s CPU time. 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:47 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:47.218+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:47 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:47.218+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:47 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:47.218+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:47.339 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:47 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:47.218+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:47.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:47.355 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T23:37:47.355 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T23:37:47.355 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.7 2024-09-10T23:37:47.586 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:47 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:47.227+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:47.587 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:47 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:47.227+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:47.587 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:47 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:47.227+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:47.587 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:47 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:47.311+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:47.587 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:47 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:47.311+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:47.587 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:47 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:47.311+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:47.661 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 systemd[1]: Stopping Ceph osd.7 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:47.661 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:47.473+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:47.661 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:47.473+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:47.661 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:47.473+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:47.661 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:47.660+0000 7fe9b236f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:47.662 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:47.660+0000 7fe9b236f640 -1 osd.7 80 *** Got signal Terminated *** 2024-09-10T23:37:47.662 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:47.660+0000 7fe9b236f640 -1 osd.7 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:48.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:47.747+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:48.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:47.747+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:48.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:47.747+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:48.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:47 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:47.747+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:48.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:48 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:48.228+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:48.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:48 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:48.228+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:48.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:48 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:48.228+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:48.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:48 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:48.228+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:48.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:48.238+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:48.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:48.238+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:48.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:48.238+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:48.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:48.314+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:48.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:48.314+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:48.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:48 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:48.314+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:48.717 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:48.456+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:48.717 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:48.456+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:48.717 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:48.456+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:49.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:48.716+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:49.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:48.716+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:49.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:48.716+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:49.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:48 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:48.716+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:49.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:49 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:49.219+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:49.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:49 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:49.219+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:49.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:49 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:49.219+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:49.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:49 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:49.219+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:49.529 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:49.469+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:49.529 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:49.469+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:49.529 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:49.469+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:49.529 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:49.469+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:23.357082+0000 front 2024-09-10T23:37:23.357058+0000 (oldest deadline 2024-09-10T23:37:49.257256+0000) 2024-09-10T23:37:49.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:49 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:49.253+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:49.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:49 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:49.253+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:49.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:49 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:49.253+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:49.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:49 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:49.298+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:49.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:49 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:49.298+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:49.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:49 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:49.298+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:50.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:49.713+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:50.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:49.713+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:50.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:49.713+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:50.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:49 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:49.713+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:50.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:50.226+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:50.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:50.226+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:50.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:50.226+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:50.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:50.304+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:50.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:50.304+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:50.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:50 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:50.304+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:50.735 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:50.459+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:50.735 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:50.459+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:50.735 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:50.459+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:50.736 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:50.459+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:23.357082+0000 front 2024-09-10T23:37:23.357058+0000 (oldest deadline 2024-09-10T23:37:49.257256+0000) 2024-09-10T23:37:50.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:50 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:50.266+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:50.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:50 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:50.266+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:50.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:50 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:50.266+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:50.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:50 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:50.266+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:51.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:50.735+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:51.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:50.735+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:51.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:50.735+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:51.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:50.735+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:51.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:51.229+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:51.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:51.229+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:51.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:51.229+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:51.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:51 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:51.229+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:51.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:51 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:51.232+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:51.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:51 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:51.232+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:51.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:51 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:51.232+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:51.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:51 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:51.278+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:51.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:51 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:51.278+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:51.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:51 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:51.278+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:51.752 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:51.481+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:51.752 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:51.481+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:51.752 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:51.481+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:51.752 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:51.481+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:23.357082+0000 front 2024-09-10T23:37:23.357058+0000 (oldest deadline 2024-09-10T23:37:49.257256+0000) 2024-09-10T23:37:52.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:51.751+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:52.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:51.751+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:52.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:51.751+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:52.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:51 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:51.751+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:52.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:52.278+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:52.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:52.278+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:52.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:52.278+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:52.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:52.271+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:52.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:52.271+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:52.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:52 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:52.271+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:52.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:52.241+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:52.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:52.241+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:52.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:52.241+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:52.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:52.241+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:52.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:52 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:52.241+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:52.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:52.518+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.253533+0000 front 2024-09-10T23:37:01.253630+0000 (oldest deadline 2024-09-10T23:37:30.054365+0000) 2024-09-10T23:37:52.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:52.518+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.355512+0000 front 2024-09-10T23:37:12.355498+0000 (oldest deadline 2024-09-10T23:37:37.055354+0000) 2024-09-10T23:37:52.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:52.518+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:17.056030+0000 front 2024-09-10T23:37:17.056072+0000 (oldest deadline 2024-09-10T23:37:41.155891+0000) 2024-09-10T23:37:52.779 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7[53411]: 2024-09-10T23:37:52.518+0000 7fe9aa97c640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:23.357082+0000 front 2024-09-10T23:37:23.357058+0000 (oldest deadline 2024-09-10T23:37:49.257256+0000) 2024-09-10T23:37:53.076 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:52.790+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:53.076 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:52.790+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:53.076 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:52.790+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:53.076 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:52 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:52.790+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:53.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:53 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:53.209+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:53.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:53 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:53.209+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:53.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:53 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:53.209+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:53.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:53 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:53.209+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:53.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:53 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:53.209+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:53.529 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:53 smithi154 podman[70735]: 2024-09-10 23:37:53.075352054 +0000 UTC m=+5.528197098 container died 0fd1461d78d70f32de543de6e9d56ead1cef808eea964ec246625b768f2d5b65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T23:37:53.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:53 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:53.269+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:53.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:53 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:53.269+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:53.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:53 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:53.269+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:53.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:53 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:53.308+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:53.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:53 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:53.308+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:53.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:53 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:53.308+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:53.815 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:53 smithi154 podman[70735]: 2024-09-10 23:37:53.663210688 +0000 UTC m=+6.116055733 container cleanup 0fd1461d78d70f32de543de6e9d56ead1cef808eea964ec246625b768f2d5b65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T23:37:53.816 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:53 smithi154 bash[70735]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7 2024-09-10T23:37:54.279 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:53 smithi154 podman[70761]: 2024-09-10 23:37:53.972776898 +0000 UTC m=+0.894359327 container remove 0fd1461d78d70f32de543de6e9d56ead1cef808eea964ec246625b768f2d5b65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T23:37:54.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:53 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:53.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:54.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:53 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:53.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:54.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:53 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:53.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:54.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:53 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:53.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:54.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:53 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:53.814+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:37:54.610 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:54 smithi154 podman[70853]: 2024-09-10 23:37:54.23398363 +0000 UTC m=+0.016149179 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:54.610 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:54 smithi154 podman[70853]: 2024-09-10 23:37:54.37381689 +0000 UTC m=+0.155982424 container create c73d84153e567265c2cca919a75a6427c87d5b8baae6cf284fefe50cc87d5208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:54.610 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:54 smithi154 podman[70853]: 2024-09-10 23:37:54.609966957 +0000 UTC m=+0.392132493 container init c73d84153e567265c2cca919a75a6427c87d5b8baae6cf284fefe50cc87d5208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T23:37:54.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:54.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:54.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:54.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:54.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:54.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:54.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:54.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:37:54.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:54.317+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:54.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:54.317+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:54.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:54.317+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:54.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:54 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:54.317+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:37:54.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:54 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:54.242+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:54.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:54 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:54.242+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:54.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:54 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:54.242+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:54.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:54 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:54.242+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:54.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:54 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:54.242+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:55.029 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:54 smithi154 podman[70853]: 2024-09-10 23:37:54.613663507 +0000 UTC m=+0.395829042 container start c73d84153e567265c2cca919a75a6427c87d5b8baae6cf284fefe50cc87d5208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T23:37:55.029 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:54 smithi154 podman[70853]: 2024-09-10 23:37:54.718059694 +0000 UTC m=+0.500225239 container attach c73d84153e567265c2cca919a75a6427c87d5b8baae6cf284fefe50cc87d5208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T23:37:55.029 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 23:37:54 smithi154 podman[70853]: 2024-09-10 23:37:54.804006239 +0000 UTC m=+0.586171783 container died c73d84153e567265c2cca919a75a6427c87d5b8baae6cf284fefe50cc87d5208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:55.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:54.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:55.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:54.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:55.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:54.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:55.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:54.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:55.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:54.811+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:37:55.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T23:37:55.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:55.542 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T23:37:55.542 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T23:37:55.543 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.8 2024-09-10T23:37:55.571 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.237+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.237+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.237+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.237+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:55.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:55.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:55.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:55.572 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:55.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:37:55.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:55 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:55.285+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:55.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:55 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:55.285+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:55.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:55 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:55.285+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:55.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:55 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:55.285+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:55.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:55 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:55.285+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:55.864 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 systemd[1]: Stopping Ceph osd.8 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:56.214 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.863+0000 7f7aab21b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:56.214 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.863+0000 7f7aab21b640 -1 osd.8 80 *** Got signal Terminated *** 2024-09-10T23:37:56.214 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:55 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:55.863+0000 7f7aab21b640 -1 osd.8 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:56.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:55 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:55.795+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:56.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:55 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:55.795+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:56.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:55 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:55.795+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:56.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:55 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:55.795+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:56.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:55 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:55.795+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:37:56.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:56.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:56.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:56.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:56.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:56.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:56.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:56.283+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:37:56.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:56.365+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:56.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:56.365+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:56.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:56.365+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:56.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:56 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:56.365+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:37:56.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:56 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:56.315+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:56.736 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:56 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:56.315+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:56.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:56 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:56.315+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:56.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:56 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:56.315+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:56.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:56 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:56.315+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:57.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:56 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:56.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:57.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:56 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:56.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:57.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:56 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:56.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:57.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:56 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:56.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:57.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:56 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:56.782+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:37:57.404 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:57.235+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:57.404 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:57.235+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:57.404 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:57.235+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:57.404 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:57.235+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:37:57.661 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:57.402+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:57.661 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:57.402+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:57.661 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:57.402+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:57.661 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:57.402+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:37:57.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:57 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:57.361+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:57.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:57 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:57.361+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:57.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:57 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:57.361+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:57.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:57 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:57.361+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:57.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:57 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:57.361+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:58.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:57 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:57.807+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:58.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:57 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:57.807+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:58.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:57 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:57.807+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:58.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:57 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:57.807+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:58.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:57 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:57.807+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:37:58.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:58.318+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:58.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:58.318+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:58.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:58.318+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:58.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:58.318+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:58.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:58 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:58.318+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:58.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:58.215+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:58.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:58.215+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:58.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:58.215+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:58.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:58.215+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:37:58.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:58.419+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:58.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:58.419+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:58.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:58.419+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:58.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:58 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:58.419+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:37:59.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:58 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:58.856+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:37:59.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:58 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:58.856+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:37:59.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:58 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:58.856+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:37:59.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:58 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:58.856+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:37:59.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:58 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:58.856+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:37:59.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:59.209+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:37:59.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:59.209+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:37:59.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:59.209+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:37:59.464 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:59.209+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:37:59.465 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:37:59.209+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.473349+0000 front 2024-09-10T23:37:34.473332+0000 (oldest deadline 2024-09-10T23:37:58.573392+0000) 2024-09-10T23:37:59.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:59 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:59.281+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:37:59.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:59 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:59.281+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:37:59.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:59 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:59.281+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:37:59.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:59 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:59.281+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:37:59.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:59 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:59.281+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:37:59.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:37:59 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:37:59.281+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:37:59.964 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:59.464+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:37:59.965 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:59.464+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:37:59.965 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:59.464+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:37:59.965 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:59.464+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:37:59.965 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:37:59 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:37:59.464+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:00.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:59.859+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:00.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:59.859+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:00.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:59.859+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:00.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:59.859+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:00.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:37:59 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:37:59.859+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:00.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:00.421+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:00.421+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:00.421+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:00.421+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:00.421+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:38:00.242+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.169465+0000 front 2024-09-10T23:37:04.169691+0000 (oldest deadline 2024-09-10T23:37:28.269494+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:38:00.242+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:08.269913+0000 front 2024-09-10T23:37:08.269796+0000 (oldest deadline 2024-09-10T23:37:35.270471+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:38:00.242+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:19.271820+0000 front 2024-09-10T23:37:19.271753+0000 (oldest deadline 2024-09-10T23:37:42.771736+0000) 2024-09-10T23:38:00.715 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:38:00.242+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.672916+0000 front 2024-09-10T23:37:28.672793+0000 (oldest deadline 2024-09-10T23:37:53.972663+0000) 2024-09-10T23:38:00.716 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:00 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8[54166]: 2024-09-10T23:38:00.242+0000 7f7aa7830640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.473349+0000 front 2024-09-10T23:37:34.473332+0000 (oldest deadline 2024-09-10T23:37:58.573392+0000) 2024-09-10T23:38:00.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:00 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:00.246+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:00.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:00 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:00.246+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:00.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:00 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:00.246+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:00.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:00 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:00.246+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:00.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:00 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:00.246+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:00.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:00 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:00.246+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:01.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:00 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:00.820+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:01.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:00 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:00.820+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:01.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:00 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:00.820+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:01.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:00 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:00.820+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:01.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:00 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:00.820+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:01.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:00 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:00.820+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:01.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:01 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:01.215+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:01.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:01 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:01.215+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:01.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:01 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:01.215+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:01.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:01 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:01.215+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:01.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:01 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:01.215+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:01.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:01 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:01.215+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:01.714 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:01 smithi177 podman[72148]: 2024-09-10 23:38:01.403238022 +0000 UTC m=+5.668241164 container died e9b4bba151f4c08a47213f45da237584bc0abbf0db8df71a1e7ae3501862f60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:38:01.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:01 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:01.373+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:01.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:01 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:01.373+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:01.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:01 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:01.373+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:01.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:01 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:01.373+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:01.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:01 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:01.373+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:02.039 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:01 smithi177 podman[72148]: 2024-09-10 23:38:01.812940162 +0000 UTC m=+6.077943294 container cleanup e9b4bba151f4c08a47213f45da237584bc0abbf0db8df71a1e7ae3501862f60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T23:38:02.039 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:01 smithi177 bash[72148]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8 2024-09-10T23:38:02.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:01 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:01.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:02.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:01 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:01.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:02.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:01 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:01.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:02.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:01 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:01.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:02.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:01 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:01.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:02.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:01 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:01.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:02.357 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72163]: 2024-09-10 23:38:02.039225302 +0000 UTC m=+0.626471905 container remove e9b4bba151f4c08a47213f45da237584bc0abbf0db8df71a1e7ae3501862f60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:02.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:02 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:02.225+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:02.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:02 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:02.225+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:02.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:02 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:02.225+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:02.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:02 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:02.225+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:02.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:02 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:02.225+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:02.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:02 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:02.225+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:02.625 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:02.366+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:02.366+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:02.366+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:02.366+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:02.366+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72253]: 2024-09-10 23:38:02.356687511 +0000 UTC m=+0.099855653 container create 4221b6c4c48a9339f3efe841fcc6727c774035a44c8f558599edf00391bef7a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72253]: 2024-09-10 23:38:02.27264119 +0000 UTC m=+0.015809334 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:02.626 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72253]: 2024-09-10 23:38:02.625541657 +0000 UTC m=+0.368709795 container init 4221b6c4c48a9339f3efe841fcc6727c774035a44c8f558599edf00391bef7a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:38:02.965 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72253]: 2024-09-10 23:38:02.628902192 +0000 UTC m=+0.372070343 container start 4221b6c4c48a9339f3efe841fcc6727c774035a44c8f558599edf00391bef7a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:38:02.965 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72253]: 2024-09-10 23:38:02.71763369 +0000 UTC m=+0.460801853 container attach 4221b6c4c48a9339f3efe841fcc6727c774035a44c8f558599edf00391bef7a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:38:02.965 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 10 23:38:02 smithi177 podman[72253]: 2024-09-10 23:38:02.820211133 +0000 UTC m=+0.563379286 container died 4221b6c4c48a9339f3efe841fcc6727c774035a44c8f558599edf00391bef7a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T23:38:03.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:02 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:02.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:03.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:02 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:02.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:03.281 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:02 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:02.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:03.281 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:02 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:02.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:03.281 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:02 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:02.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:03.281 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:02 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:02.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:03.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:03 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:03.362+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:03.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:03 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:03.362+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:03.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:03 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:03.362+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:03.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:03 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:03.362+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:03.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:03 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:03.362+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:03.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:03.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:03.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:03.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:03.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:03.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:03.512 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T23:38:03.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:03.592 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T23:38:03.592 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T23:38:03.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.9 2024-09-10T23:38:03.919 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 systemd[1]: Stopping Ceph osd.9 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.916+0000 7f2c11bba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.916+0000 7f2c11bba640 -1 osd.9 80 *** Got signal Terminated *** 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:03 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:03.916+0000 7f2c11bba640 -1 osd.9 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:04.155+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:04.155+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:04.155+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:04.155+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:04.155+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:04.237 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:04 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:04.155+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:04.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:03 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:03.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:04.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:03 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:03.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:04.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:03 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:03.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:04.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:03 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:03.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:04.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:03 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:03.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:04.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:03 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:03.900+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:04.705 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:04 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:04.377+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:04.705 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:04 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:04.377+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:04.705 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:04 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:04.377+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:04.705 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:04 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:04.377+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:04.705 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:04 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:04.377+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:05.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:04 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:04.850+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:05.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:04 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:04.850+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:05.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:04 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:04.850+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:05.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:04 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:04.850+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:05.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:04 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:04.850+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:05.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:04 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:04.850+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:05.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:05 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:05.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:05.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:05 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:05.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:05.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:05 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:05.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:05.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:05 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:05.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:05.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:05 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:05.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:05.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:05 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:05.205+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:05.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:05 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:05.406+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:05.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:05 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:05.406+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:05.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:05 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:05.406+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:05.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:05 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:05.406+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:05.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:05 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:05.406+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:06.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:06.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:06.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:06.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:06.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:06.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:06.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:05 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:05.879+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:06.486 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:06 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:06.187+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:06.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:06 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:06.187+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:06.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:06 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:06.187+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:06.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:06 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:06.187+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:06.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:06 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:06.187+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:06.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:06 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:06.187+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:06.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:06.429+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:06.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:06.429+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:06.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:06.429+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:06.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:06.429+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:06.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:06.429+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:07.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:07.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:07.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:07.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:07.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:07.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:07.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:06 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:06.918+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:07.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:07.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:07.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:07.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:07.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:07.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:07.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:07.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:07.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:07.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:07.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:07 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:07.202+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:07.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:07.414+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:07.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:07.414+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:07.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:07.414+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:07.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:07.414+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:07.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:07 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:07.414+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:08.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:07 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:07.933+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:08.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:08 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:08.393+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:08.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:08 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:08.393+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:08.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:08 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:08.393+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:08.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:08 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:08.393+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:08.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:08 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:08.393+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:08.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:08 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:08.249+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:54.558126+0000 front 2024-09-10T23:36:54.558003+0000 (oldest deadline 2024-09-10T23:37:17.457994+0000) 2024-09-10T23:38:08.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:08 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:08.249+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:04.360247+0000 front 2024-09-10T23:37:04.360337+0000 (oldest deadline 2024-09-10T23:37:27.860146+0000) 2024-09-10T23:38:08.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:08 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:08.249+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.461789+0000 front 2024-09-10T23:37:12.461902+0000 (oldest deadline 2024-09-10T23:37:34.761731+0000) 2024-09-10T23:38:08.737 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:08 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:08.249+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:18.862782+0000 front 2024-09-10T23:37:18.862604+0000 (oldest deadline 2024-09-10T23:37:42.962709+0000) 2024-09-10T23:38:08.738 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:08 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:08.249+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:25.863781+0000 front 2024-09-10T23:37:25.863657+0000 (oldest deadline 2024-09-10T23:37:51.763661+0000) 2024-09-10T23:38:08.738 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:08 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9[67655]: 2024-09-10T23:38:08.249+0000 7f2c0a1c7640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:34.064747+0000 front 2024-09-10T23:37:34.064770+0000 (oldest deadline 2024-09-10T23:37:58.764665+0000) 2024-09-10T23:38:09.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:09.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:09.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:09.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:09.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:09.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:09.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:08 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:08.925+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:09.667 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:09 smithi002 podman[120961]: 2024-09-10 23:38:09.297120029 +0000 UTC m=+5.497206849 container died 275f1440ecddd97fa0a476125756994c92180b36c5f254de5b801f47c6e0adc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T23:38:09.668 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:09 smithi002 podman[120961]: 2024-09-10 23:38:09.667252174 +0000 UTC m=+5.867339032 container cleanup 275f1440ecddd97fa0a476125756994c92180b36c5f254de5b801f47c6e0adc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T23:38:09.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:09 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:09.440+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:09.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:09 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:09.440+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:09.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:09 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:09.440+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:09.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:09 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:09.440+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:09.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:09 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:09.440+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:09.986 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:09 smithi002 bash[120961]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9 2024-09-10T23:38:09.987 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:09 smithi002 podman[120979]: 2024-09-10 23:38:09.910365108 +0000 UTC m=+0.614241557 container remove 275f1440ecddd97fa0a476125756994c92180b36c5f254de5b801f47c6e0adc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:38:10.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:10.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:10.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:10.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:10.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:10.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:10.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:09 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:09.935+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:10.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:10 smithi002 podman[121067]: 2024-09-10 23:38:10.132726555 +0000 UTC m=+0.016142922 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:10.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:10 smithi002 podman[121067]: 2024-09-10 23:38:10.244624452 +0000 UTC m=+0.128040849 container create ca9bc5be516671993abbaea00371288084c7d82e759a2f4ef5b16bffd64a94d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T23:38:10.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:10 smithi002 podman[121067]: 2024-09-10 23:38:10.463494716 +0000 UTC m=+0.346911072 container init ca9bc5be516671993abbaea00371288084c7d82e759a2f4ef5b16bffd64a94d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T23:38:10.487 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:10 smithi002 podman[121067]: 2024-09-10 23:38:10.46722053 +0000 UTC m=+0.350636888 container start ca9bc5be516671993abbaea00371288084c7d82e759a2f4ef5b16bffd64a94d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T23:38:10.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:10.425+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:10.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:10.425+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:10.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:10.425+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:10.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:10.425+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:10.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:10.425+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:10.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:10.425+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:10.958 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:10 smithi002 podman[121067]: 2024-09-10 23:38:10.572167747 +0000 UTC m=+0.455584118 container attach ca9bc5be516671993abbaea00371288084c7d82e759a2f4ef5b16bffd64a94d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T23:38:10.959 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 10 23:38:10 smithi002 podman[121067]: 2024-09-10 23:38:10.664284793 +0000 UTC m=+0.547701148 container died ca9bc5be516671993abbaea00371288084c7d82e759a2f4ef5b16bffd64a94d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:11.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:10 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:10.907+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:11.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T23:38:11.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:11.354 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T23:38:11.354 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T23:38:11.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.10 2024-09-10T23:38:11.657 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 systemd[1]: Stopping Ceph osd.10 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:11.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:11 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:11.408+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:11.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:11 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:11.408+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:11.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:11 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:11.408+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:11.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:11 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:11.408+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:11.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:11 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:11.408+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:11.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:11 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:11.408+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:12.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.656+0000 7f4d8c208640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:12.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.656+0000 7f4d8c208640 -1 osd.10 80 *** Got signal Terminated *** 2024-09-10T23:38:12.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.656+0000 7f4d8c208640 -1 osd.10 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:12.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:12.029 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:12.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:12.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:12.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:12.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:12.030 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:11 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:11.875+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:12 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:12.382+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:12 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:12.382+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:12 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:12.382+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:12 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:12.382+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:12 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:12.382+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:12 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:12.382+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:13.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:13.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:13.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:13.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:13.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:13.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:13.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:12 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:12.858+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:13.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:13 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:13.369+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:13.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:13 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:13.369+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:13.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:13 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:13.369+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:13.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:13 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:13.369+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:13.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:13 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:13.369+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:13.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:13 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:13.369+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:14.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:13 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:13.822+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:14.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:14 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:14.324+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:14.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:14 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:14.324+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:14.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:14 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:14.324+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:14.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:14 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:14.324+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:14.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:14 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:14.324+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:14.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:14 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:14.324+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:15.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:15.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:15.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:15.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:15.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:15.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:15.280 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:14 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:14.786+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:15.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:15 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:15.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:55.165086+0000 front 2024-09-10T23:36:55.165036+0000 (oldest deadline 2024-09-10T23:37:21.565285+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:01.565530+0000 front 2024-09-10T23:37:01.565606+0000 (oldest deadline 2024-09-10T23:37:26.865711+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:12.067270+0000 front 2024-09-10T23:37:12.067132+0000 (oldest deadline 2024-09-10T23:37:33.767040+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-10T23:37:20.168482+0000 front 2024-09-10T23:37:20.168551+0000 (oldest deadline 2024-09-10T23:37:45.468298+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:27.669608+0000 front 2024-09-10T23:37:27.669589+0000 (oldest deadline 2024-09-10T23:37:52.969664+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.871005+0000 front 2024-09-10T23:37:35.870798+0000 (oldest deadline 2024-09-10T23:37:59.970655+0000) 2024-09-10T23:38:16.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:15 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10[59963]: 2024-09-10T23:38:15.831+0000 7f4d84815640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:39.971362+0000 front 2024-09-10T23:37:39.971326+0000 (oldest deadline 2024-09-10T23:38:05.871129+0000) 2024-09-10T23:38:16.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:16.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:16.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:16.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:16.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:16.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:16.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:16 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:16.371+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:17.325 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:17 smithi154 podman[70960]: 2024-09-10 23:38:17.041615265 +0000 UTC m=+5.488252805 container died 0c1e1cc0dce9fb28b306c106b2ea4cae007e84daec8f3df2a3fdbe5b122fb305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:38:17.631 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:17.631 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:17.631 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:17.632 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:17.632 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:17.632 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:17.632 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:17 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:17.339+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:17.699 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:17 smithi154 podman[70960]: 2024-09-10 23:38:17.406458157 +0000 UTC m=+5.853095702 container cleanup 0c1e1cc0dce9fb28b306c106b2ea4cae007e84daec8f3df2a3fdbe5b122fb305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:17.699 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:17 smithi154 bash[70960]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10 2024-09-10T23:38:18.016 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:17 smithi154 podman[70975]: 2024-09-10 23:38:17.699375413 +0000 UTC m=+0.655382361 container remove 0c1e1cc0dce9fb28b306c106b2ea4cae007e84daec8f3df2a3fdbe5b122fb305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:18.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:18 smithi154 podman[71066]: 2024-09-10 23:38:17.91892729 +0000 UTC m=+0.016060189 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:18.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:18 smithi154 podman[71066]: 2024-09-10 23:38:18.041989582 +0000 UTC m=+0.139122472 container create 9504f6a4a06cb7c28b621642a3d17ba2eb20d63f52c7a811d2a6935ae0be2612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:38:18.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:18 smithi154 podman[71066]: 2024-09-10 23:38:18.260986925 +0000 UTC m=+0.358119816 container init 9504f6a4a06cb7c28b621642a3d17ba2eb20d63f52c7a811d2a6935ae0be2612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:18.279 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:18 smithi154 podman[71066]: 2024-09-10 23:38:18.264264489 +0000 UTC m=+0.361397380 container start 9504f6a4a06cb7c28b621642a3d17ba2eb20d63f52c7a811d2a6935ae0be2612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T23:38:18.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:18.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:18.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:18.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:18.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:18.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:18.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:18 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:18.318+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:18.747 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:18 smithi154 podman[71066]: 2024-09-10 23:38:18.369680069 +0000 UTC m=+0.466812962 container attach 9504f6a4a06cb7c28b621642a3d17ba2eb20d63f52c7a811d2a6935ae0be2612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:38:18.747 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 23:38:18 smithi154 podman[71066]: 2024-09-10 23:38:18.455171005 +0000 UTC m=+0.552303899 container died 9504f6a4a06cb7c28b621642a3d17ba2eb20d63f52c7a811d2a6935ae0be2612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T23:38:19.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T23:38:19.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:19.108 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T23:38:19.109 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T23:38:19.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.11 2024-09-10T23:38:19.424 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 systemd[1]: Stopping Ceph osd.11 for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:19.424 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:19.424 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:19.424 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.348+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.422+0000 7f801c844640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.422+0000 7f801c844640 -1 osd.11 80 *** Got signal Terminated *** 2024-09-10T23:38:19.425 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:19 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:19.422+0000 7f801c844640 -1 osd.11 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:20.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:20 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:20.329+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:21.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:21.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:21.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:21.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:21.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:21.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:21.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:21 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:21.363+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:22.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:22.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:22.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:22.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:22.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:22.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:22.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:22 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:22.394+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:23.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:23.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:23.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:23.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:23.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:23.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:23.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:23 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:23.390+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:24.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-10T23:36:56.403080+0000 front 2024-09-10T23:36:56.402995+0000 (oldest deadline 2024-09-10T23:37:21.703047+0000) 2024-09-10T23:38:24.714 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T23:37:02.804227+0000 front 2024-09-10T23:37:02.804277+0000 (oldest deadline 2024-09-10T23:37:28.704271+0000) 2024-09-10T23:38:24.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-10T23:37:09.205430+0000 front 2024-09-10T23:37:09.205408+0000 (oldest deadline 2024-09-10T23:37:33.805838+0000) 2024-09-10T23:38:24.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T23:37:28.610171+0000 front 2024-09-10T23:37:28.610266+0000 (oldest deadline 2024-09-10T23:37:53.309921+0000) 2024-09-10T23:38:24.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-09-10T23:37:35.010868+0000 front 2024-09-10T23:37:35.010893+0000 (oldest deadline 2024-09-10T23:37:58.511005+0000) 2024-09-10T23:38:24.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-10T23:37:44.113025+0000 front 2024-09-10T23:37:44.113046+0000 (oldest deadline 2024-09-10T23:38:10.013013+0000) 2024-09-10T23:38:24.715 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11[60721]: 2024-09-10T23:38:24.376+0000 7f8018e59640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T23:37:50.013566+0000 front 2024-09-10T23:37:50.013532+0000 (oldest deadline 2024-09-10T23:38:15.313367+0000) 2024-09-10T23:38:25.207 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:24 smithi177 podman[72382]: 2024-09-10 23:38:24.932450747 +0000 UTC m=+5.645413557 container died 0251a18c09b3aa383365ae793d416ea720ed1841d456a4669ea86ee5244d720a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T23:38:25.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:25 smithi177 podman[72382]: 2024-09-10 23:38:25.306032203 +0000 UTC m=+6.018995002 container cleanup 0251a18c09b3aa383365ae793d416ea720ed1841d456a4669ea86ee5244d720a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T23:38:25.465 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:25 smithi177 bash[72382]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11 2024-09-10T23:38:25.864 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:25 smithi177 podman[72396]: 2024-09-10 23:38:25.557131544 +0000 UTC m=+0.627334859 container remove 0251a18c09b3aa383365ae793d416ea720ed1841d456a4669ea86ee5244d720a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:26.152 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:25 smithi177 podman[72486]: 2024-09-10 23:38:25.766807438 +0000 UTC m=+0.015597211 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:26.152 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:25 smithi177 podman[72486]: 2024-09-10 23:38:25.866197809 +0000 UTC m=+0.114987624 container create f52c16e09270d0e282b621ed3d5f8550bb525107ddb58a61a029ef85b363fa5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T23:38:26.152 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:26 smithi177 podman[72486]: 2024-09-10 23:38:26.076757688 +0000 UTC m=+0.325547460 container init f52c16e09270d0e282b621ed3d5f8550bb525107ddb58a61a029ef85b363fa5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-10T23:38:26.152 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:26 smithi177 podman[72486]: 2024-09-10 23:38:26.080050295 +0000 UTC m=+0.328840075 container start f52c16e09270d0e282b621ed3d5f8550bb525107ddb58a61a029ef85b363fa5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:38:26.152 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:26 smithi177 podman[72486]: 2024-09-10 23:38:26.151705529 +0000 UTC m=+0.400495323 container attach f52c16e09270d0e282b621ed3d5f8550bb525107ddb58a61a029ef85b363fa5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-10T23:38:26.464 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 10 23:38:26 smithi177 podman[72510]: 2024-09-10 23:38:26.291093369 +0000 UTC m=+0.016745573 container died f52c16e09270d0e282b621ed3d5f8550bb525107ddb58a61a029ef85b363fa5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T23:38:26.852 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T23:38:26.892 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:26.892 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T23:38:26.892 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T23:38:26.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.a 2024-09-10T23:38:27.212 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:26 smithi002 systemd[1]: Stopping Ceph mds.a for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:27.486 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a[74883]: 2024-09-10T23:38:27.210+0000 7f3ebb527640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:27.487 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:27 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a[74883]: 2024-09-10T23:38:27.210+0000 7f3ebb527640 -1 mds.a *** got signal Terminated *** 2024-09-10T23:38:29.236 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:28 smithi002 podman[121170]: 2024-09-10 23:38:28.906057864 +0000 UTC m=+1.811809296 container died a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T23:38:29.656 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:29 smithi002 podman[121170]: 2024-09-10 23:38:29.318741128 +0000 UTC m=+2.224492564 container cleanup a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T23:38:29.657 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:29 smithi002 bash[121170]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a 2024-09-10T23:38:29.657 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 10 23:38:29 smithi002 podman[121194]: 2024-09-10 23:38:29.528606248 +0000 UTC m=+0.617767635 container remove a4728e9d49b3ee4babc08b75f622a1d937ad803f80f031a66031a40040f575d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T23:38:29.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T23:38:29.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:29.712 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T23:38:29.712 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T23:38:29.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.d 2024-09-10T23:38:29.986 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:38:29 smithi002 systemd[1]: Stopping Ceph mds.d for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:30.486 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:38:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d[73663]: 2024-09-10T23:38:30.114+0000 7f5ea8f46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:30.487 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:38:30 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d[73663]: 2024-09-10T23:38:30.114+0000 7f5ea8f46640 -1 mds.d *** got signal Terminated *** 2024-09-10T23:38:33.007 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:38:32 smithi002 podman[121306]: 2024-09-10 23:38:32.751824992 +0000 UTC m=+2.812992255 container died fd702a6b184a116a576669e013d4eea95b707cad3905149ab7273f8f0b777127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T23:38:33.382 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:38:33 smithi002 podman[121306]: 2024-09-10 23:38:33.106103055 +0000 UTC m=+3.167270317 container cleanup fd702a6b184a116a576669e013d4eea95b707cad3905149ab7273f8f0b777127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T23:38:33.382 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 10 23:38:33 smithi002 bash[121306]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-d 2024-09-10T23:38:33.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T23:38:33.584 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:33.584 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T23:38:33.584 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T23:38:33.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.g 2024-09-10T23:38:33.902 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:33 smithi002 systemd[1]: Stopping Ceph mds.g for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:34.236 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:33 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g[74549]: 2024-09-10T23:38:33.902+0000 7f6f41194640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:34.236 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:33 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g[74549]: 2024-09-10T23:38:33.902+0000 7f6f41194640 -1 mds.g *** got signal Terminated *** 2024-09-10T23:38:37.178 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:36 smithi002 podman[121424]: 2024-09-10 23:38:36.909530401 +0000 UTC m=+3.095552043 container died cfe1aaa3419b90633051cf9e8d4dd4671f67cbb7dea9070f50e78d7f88cc011d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:37.487 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:37 smithi002 podman[121424]: 2024-09-10 23:38:37.251614727 +0000 UTC m=+3.437636410 container cleanup cfe1aaa3419b90633051cf9e8d4dd4671f67cbb7dea9070f50e78d7f88cc011d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T23:38:37.487 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:37 smithi002 bash[121424]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g 2024-09-10T23:38:37.487 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 10 23:38:37 smithi002 podman[121436]: 2024-09-10 23:38:37.427834463 +0000 UTC m=+0.514163448 container remove cfe1aaa3419b90633051cf9e8d4dd4671f67cbb7dea9070f50e78d7f88cc011d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-g, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:37.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T23:38:37.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:37.702 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T23:38:37.703 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T23:38:37.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.j 2024-09-10T23:38:37.987 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:38:37 smithi002 systemd[1]: Stopping Ceph mds.j for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:38.487 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:38:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j[73266]: 2024-09-10T23:38:38.030+0000 7f367530d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:38.487 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:38:38 smithi002 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j[73266]: 2024-09-10T23:38:38.030+0000 7f367530d640 -1 mds.j *** got signal Terminated *** 2024-09-10T23:38:41.348 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:38:41 smithi002 podman[121544]: 2024-09-10 23:38:41.078189082 +0000 UTC m=+3.147472857 container died ad87c0dc222dc29cb1a81573f355309969a8597a2456d7e23a4b2135a4bcde93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T23:38:41.681 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:38:41 smithi002 podman[121544]: 2024-09-10 23:38:41.446937235 +0000 UTC m=+3.516221010 container cleanup ad87c0dc222dc29cb1a81573f355309969a8597a2456d7e23a4b2135a4bcde93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:38:41.682 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 10 23:38:41 smithi002 bash[121544]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-j 2024-09-10T23:38:41.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T23:38:41.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:41.844 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T23:38:41.844 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T23:38:41.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.b 2024-09-10T23:38:42.150 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:38:41 smithi154 systemd[1]: Stopping Ceph mds.b for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:42.529 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:38:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b[65605]: 2024-09-10T23:38:42.147+0000 7efc99301640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:42.529 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:38:42 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b[65605]: 2024-09-10T23:38:42.147+0000 7efc99301640 -1 mds.b *** got signal Terminated *** 2024-09-10T23:38:45.249 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:38:44 smithi154 podman[71183]: 2024-09-10 23:38:44.90426938 +0000 UTC m=+2.858754242 container died d5bcc9c007995f6de818e33798a27db4d34ecdf7f3a25db69337c17a542601f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:45.529 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:38:45 smithi154 podman[71183]: 2024-09-10 23:38:45.331896801 +0000 UTC m=+3.286381732 container cleanup d5bcc9c007995f6de818e33798a27db4d34ecdf7f3a25db69337c17a542601f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T23:38:45.529 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 23:38:45 smithi154 bash[71183]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-b 2024-09-10T23:38:45.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T23:38:45.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:45.806 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T23:38:45.806 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T23:38:45.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.e 2024-09-10T23:38:46.127 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:38:45 smithi154 systemd[1]: Stopping Ceph mds.e for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:46.529 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:38:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e[65004]: 2024-09-10T23:38:46.126+0000 7fd231a91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:46.529 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:38:46 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e[65004]: 2024-09-10T23:38:46.126+0000 7fd231a91640 -1 mds.e *** got signal Terminated *** 2024-09-10T23:38:49.186 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:38:48 smithi154 podman[71306]: 2024-09-10 23:38:48.911062101 +0000 UTC m=+2.889026280 container died 0d901baa415dfafd26dd036b4fc112988bc69522483f3874da4db401886ca8ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:49.529 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:38:49 smithi154 podman[71306]: 2024-09-10 23:38:49.285577003 +0000 UTC m=+3.263541223 container cleanup 0d901baa415dfafd26dd036b4fc112988bc69522483f3874da4db401886ca8ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T23:38:49.529 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 23:38:49 smithi154 bash[71306]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-e 2024-09-10T23:38:49.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T23:38:49.754 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:49.754 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T23:38:49.754 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T23:38:49.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.h 2024-09-10T23:38:50.279 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:38:49 smithi154 systemd[1]: Stopping Ceph mds.h for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:50.279 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:38:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h[65305]: 2024-09-10T23:38:50.063+0000 7fceb1dcb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:50.279 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:38:50 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h[65305]: 2024-09-10T23:38:50.063+0000 7fceb1dcb640 -1 mds.h *** got signal Terminated *** 2024-09-10T23:38:53.207 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:38:52 smithi154 podman[71431]: 2024-09-10 23:38:52.908258078 +0000 UTC m=+2.935315268 container died 40f74786f163c4ba10f077b262ebe79d89929d9b0de0581ea8ee31ea146171bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:53.515 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:38:53 smithi154 podman[71431]: 2024-09-10 23:38:53.314065051 +0000 UTC m=+3.341122232 container cleanup 40f74786f163c4ba10f077b262ebe79d89929d9b0de0581ea8ee31ea146171bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:53.516 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 23:38:53 smithi154 bash[71431]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-h 2024-09-10T23:38:53.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T23:38:53.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:53.775 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T23:38:53.775 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T23:38:53.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.k 2024-09-10T23:38:54.029 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:38:53 smithi154 systemd[1]: Stopping Ceph mds.k for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:54.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:38:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k[64702]: 2024-09-10T23:38:54.117+0000 7f21ff1c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:54.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:38:54 smithi154 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k[64702]: 2024-09-10T23:38:54.117+0000 7f21ff1c7640 -1 mds.k *** got signal Terminated *** 2024-09-10T23:38:57.210 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:38:56 smithi154 podman[71566]: 2024-09-10 23:38:56.913972779 +0000 UTC m=+2.913957370 container died 694ae7bc01491b10995fb73c004ae6cd43460c485e32642bc24e66afa80fb0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:38:57.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:38:57 smithi154 podman[71566]: 2024-09-10 23:38:57.309593397 +0000 UTC m=+3.309577947 container cleanup 694ae7bc01491b10995fb73c004ae6cd43460c485e32642bc24e66afa80fb0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T23:38:57.529 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 23:38:57 smithi154 bash[71566]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-k 2024-09-10T23:38:57.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T23:38:57.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:57.680 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T23:38:57.681 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T23:38:57.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.c 2024-09-10T23:38:57.964 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:38:57 smithi177 systemd[1]: Stopping Ceph mds.c for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:58.228 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:38:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c[66097]: 2024-09-10T23:38:57.986+0000 7f7647295640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:58.228 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:38:57 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c[66097]: 2024-09-10T23:38:57.986+0000 7f7647295640 -1 mds.c *** got signal Terminated *** 2024-09-10T23:39:01.188 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:39:00 smithi177 podman[72588]: 2024-09-10 23:39:00.910942059 +0000 UTC m=+3.033826370 container died deafac7a9bac084e7e22feb0ec92629bbfda843b7b3a0db2dcfb4a3faf312c78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:39:01.464 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:39:01 smithi177 podman[72588]: 2024-09-10 23:39:01.278287842 +0000 UTC m=+3.401172198 container cleanup deafac7a9bac084e7e22feb0ec92629bbfda843b7b3a0db2dcfb4a3faf312c78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T23:39:01.465 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 10 23:39:01 smithi177 bash[72588]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-c 2024-09-10T23:39:01.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T23:39:01.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:01.740 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T23:39:01.740 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T23:39:01.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.f 2024-09-10T23:39:02.057 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:39:01 smithi177 systemd[1]: Stopping Ceph mds.f for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:02.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:39:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f[65794]: 2024-09-10T23:39:02.055+0000 7faa04e88640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:02.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:39:02 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f[65794]: 2024-09-10T23:39:02.055+0000 7faa04e88640 -1 mds.f *** got signal Terminated *** 2024-09-10T23:39:05.191 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:39:04 smithi177 podman[72722]: 2024-09-10 23:39:04.910608809 +0000 UTC m=+2.952332757 container died 4ae7aae5102a63c19c257c7b73db63b3c83529b54a7a9b33cb99d2b2cdc1e313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T23:39:05.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:39:05 smithi177 podman[72722]: 2024-09-10 23:39:05.264822069 +0000 UTC m=+3.306546014 container cleanup 4ae7aae5102a63c19c257c7b73db63b3c83529b54a7a9b33cb99d2b2cdc1e313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T23:39:05.464 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 10 23:39:05 smithi177 bash[72722]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-f 2024-09-10T23:39:05.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T23:39:05.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:05.775 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T23:39:05.775 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T23:39:05.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.i 2024-09-10T23:39:06.214 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:05 smithi177 systemd[1]: Stopping Ceph mds.i for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:06.214 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: 2024-09-10T23:39:06.076+0000 7fd9104fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:06.215 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:06 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i[66396]: 2024-09-10T23:39:06.076+0000 7fd9104fe640 -1 mds.i *** got signal Terminated *** 2024-09-10T23:39:08.964 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:08 smithi177 podman[72842]: 2024-09-10 23:39:08.916311176 +0000 UTC m=+2.923261785 container died 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:39:09.520 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:09 smithi177 podman[72842]: 2024-09-10 23:39:09.326829875 +0000 UTC m=+3.333780479 container cleanup 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T23:39:09.520 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:09 smithi177 bash[72842]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i 2024-09-10T23:39:09.755 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T23:39:09.777 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:09 smithi177 podman[72855]: 2024-09-10 23:39:09.519565826 +0000 UTC m=+0.600650419 container remove 02c5d834e51d0138d57b6455af2304194c6f9a07ea0fa6a44029ab39a7af0290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:39:09.777 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:09 smithi177 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-10T23:39:09.777 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:09 smithi177 systemd[1]: Stopped Ceph mds.i for 2f953db4-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:39:09.777 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 10 23:39:09 smithi177 systemd[1]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.i.service: Consumed 8.967s CPU time. 2024-09-10T23:39:09.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:09.788 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T23:39:09.788 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T23:39:09.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.l 2024-09-10T23:39:10.097 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:39:09 smithi177 systemd[1]: Stopping Ceph mds.l for 2f953db4-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:10.464 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:39:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l[65490]: 2024-09-10T23:39:10.096+0000 7fe8c36b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:10.464 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:39:10 smithi177 ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l[65490]: 2024-09-10T23:39:10.096+0000 7fe8c36b1640 -1 mds.l *** got signal Terminated *** 2024-09-10T23:39:13.206 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:39:12 smithi177 podman[72962]: 2024-09-10 23:39:12.914329244 +0000 UTC m=+2.907018094 container died dd1a9f1e01f8fbd2e736d9a5a7ff0a1c04c7d85cb94367765c4de1698e6f5583 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:39:13.464 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:39:13 smithi177 podman[72962]: 2024-09-10 23:39:13.288476417 +0000 UTC m=+3.281165258 container cleanup dd1a9f1e01f8fbd2e736d9a5a7ff0a1c04c7d85cb94367765c4de1698e6f5583 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T23:39:13.464 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 10 23:39:13 smithi177 bash[72962]: ceph-2f953db4-6fca-11ef-bcea-c7b262605968-mds-l 2024-09-10T23:39:13.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2f953db4-6fca-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T23:39:13.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:13.690 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T23:39:13.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:39:13.904 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:39:16.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:39:16.673 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:39:19.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:39:19.293 INFO:teuthology.orchestra.run.smithi177.stdout:Deleting cluster with fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:39:21.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:39:21.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:39:21.696 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:39:21.722 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T23:39:21.725 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi002/crash 2024-09-10T23:39:21.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:39:21.767 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:39:21.767 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:39:21.769 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi154/crash 2024-09-10T23:39:21.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:39:21.810 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:39:21.810 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:39:21.812 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi177/crash 2024-09-10T23:39:21.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:39:21.857 INFO:teuthology.orchestra.run.smithi177.stderr:tar: /var/lib/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:39:21.857 INFO:teuthology.orchestra.run.smithi177.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:39:21.858 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T23:39:21.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T23:39:21.897 INFO:tasks.cephadm:Compressing logs... 2024-09-10T23:39:21.898 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:39:21.940 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:39:21.943 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:39:21.965 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T23:39:21.966 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-09-10T23:39:21.966 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T23:39:21.966 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T23:39:21.966 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:39:21.967 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T23:39:21.967 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T23:39:21.968 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T23:39:21.968 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T23:39:21.968 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-10T23:39:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T23:39:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:39:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:39:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:39:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:39:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:: No such file or directory 2024-09-10T23:39:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:39:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T23:39:21.976 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr: 82.2% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr: 90.4% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.l.log: 87.7% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:39:21.977 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T23:39:21.978 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:39:21.978 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:39:21.979 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:39:21.979 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T23:39:21.979 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.3% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:39:21.979 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:39:21.979 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.y.log: /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.b.log: 92.5% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T23:39:21.981 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T23:39:21.981 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:39:21.981 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:39:21.983 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:39:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T23:39:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T23:39:21.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log: 87.7% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:39:21.984 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T23:39:21.985 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T23:39:21.985 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.d.log: 87.7% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:39:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T23:39:21.990 INFO:teuthology.orchestra.run.smithi002.stderr: 95.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T23:39:21.994 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.6% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T23:39:21.996 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T23:39:21.996 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T23:39:21.997 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.b.log: /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:39:22.000 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T23:39:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.j.log: 95.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T23:39:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:39:22.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:39:22.013 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:39:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:39:22.034 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:39:22.056 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T23:39:22.059 INFO:teuthology.orchestra.run.smithi002.stderr: 94.4% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T23:39:22.061 INFO:teuthology.orchestra.run.smithi002.stderr: 94.4% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T23:39:22.077 INFO:teuthology.orchestra.run.smithi177.stderr: 93.1% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T23:39:22.105 INFO:teuthology.orchestra.run.smithi154.stderr: 94.5% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T23:39:22.118 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T23:39:22.130 INFO:teuthology.orchestra.run.smithi177.stderr: 93.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T23:39:22.139 INFO:teuthology.orchestra.run.smithi154.stderr: 94.5% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T23:39:22.295 INFO:teuthology.orchestra.run.smithi177.stderr: 94.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T23:39:22.296 INFO:teuthology.orchestra.run.smithi002.stderr: 90.2% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T23:39:22.313 INFO:teuthology.orchestra.run.smithi177.stderr: 91.8% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T23:39:22.418 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T23:39:22.586 INFO:teuthology.orchestra.run.smithi177.stderr: 92.7% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T23:39:22.763 INFO:teuthology.orchestra.run.smithi177.stderr: 92.2% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T23:39:22.921 INFO:teuthology.orchestra.run.smithi002.stderr: 92.2% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T23:39:22.930 INFO:teuthology.orchestra.run.smithi002.stderr: 90.4% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T23:39:23.119 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T23:39:23.138 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T23:39:23.235 INFO:teuthology.orchestra.run.smithi154.stderr: 91.6% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T23:39:23.249 INFO:teuthology.orchestra.run.smithi177.stderr: 91.8% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T23:39:23.464 INFO:teuthology.orchestra.run.smithi002.stderr: 93.0% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T23:39:23.466 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-10T23:39:23.467 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m1.512s 2024-09-10T23:39:23.467 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m6.025s 2024-09-10T23:39:23.467 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.215s 2024-09-10T23:39:23.556 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T23:39:23.676 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T23:39:23.945 INFO:teuthology.orchestra.run.smithi177.stderr: 92.7% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T23:39:24.085 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T23:39:24.087 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-10T23:39:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m2.132s 2024-09-10T23:39:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m7.223s 2024-09-10T23:39:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.259s 2024-09-10T23:39:24.396 INFO:teuthology.orchestra.run.smithi177.stderr: 91.9% -- replaced with /var/log/ceph/2f953db4-6fca-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T23:39:24.398 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-10T23:39:24.398 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m2.441s 2024-09-10T23:39:24.398 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m7.664s 2024-09-10T23:39:24.398 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.263s 2024-09-10T23:39:24.398 INFO:tasks.cephadm:Archiving logs... 2024-09-10T23:39:24.399 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi002/log 2024-09-10T23:39:24.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:39:25.248 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi154/log 2024-09-10T23:39:25.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:39:26.419 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi177/log 2024-09-10T23:39:26.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:39:27.583 INFO:tasks.cephadm:Removing cluster... 2024-09-10T23:39:27.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --force 2024-09-10T23:39:27.798 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:39:28.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --force 2024-09-10T23:39:28.435 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:39:28.819 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2f953db4-6fca-11ef-bcea-c7b262605968 --force 2024-09-10T23:39:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:Deleting cluster with fsid: 2f953db4-6fca-11ef-bcea-c7b262605968 2024-09-10T23:39:29.271 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T23:39:29.272 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:39:29.292 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:39:29.308 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:39:29.324 INFO:tasks.cephadm:Teardown complete 2024-09-10T23:39:29.324 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T23:39:29.333 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T23:39:29.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:39:29.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:39:29.351 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:39:29.480 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T23:39:29.490 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T23:39:29.490 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:39:29.493 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:39:29.495 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:39:29.507 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:39:29.508 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:39:29.510 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:39:29.512 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:39:29.512 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T23:39:29.512 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 -276us[ -274us] +/- 46ms 2024-09-10T23:39:29.513 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 +443us[ +443us] +/- 77ms 2024-09-10T23:39:29.513 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +52us[ +54us] +/- 85ms 2024-09-10T23:39:29.513 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:39:29.514 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:39:29.514 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-10T23:39:29.514 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -253us[ -250us] +/- 46ms 2024-09-10T23:39:29.514 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 +434us[ +437us] +/- 77ms 2024-09-10T23:39:29.514 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +72us[ +74us] +/- 85ms 2024-09-10T23:39:29.514 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:39:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:39:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-10T23:39:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -259us[ -252us] +/- 46ms 2024-09-10T23:39:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +433us[ +441us] +/- 77ms 2024-09-10T23:39:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +81us[ +89us] +/- 85ms 2024-09-10T23:39:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:39:29.516 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T23:39:29.526 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T23:39:29.526 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T23:39:29.536 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:39:29.649 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:39:29.716 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:39:29.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:39:29.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:29.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:39:29.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:29.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:39:29.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:29.875 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T23:39:29.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T23:39:29.894 INFO:teuthology.task.internal:Duration was 1953.568215 seconds 2024-09-10T23:39:29.894 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T23:39:29.993 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T23:39:29.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:39:29.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:39:29.999 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:39:30.035 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:39:30.037 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:39:30.040 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:39:30.510 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T23:39:30.510 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T23:39:30.510 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:39:30.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T23:39:30.537 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:39:30.572 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-09-10T23:39:30.573 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:39:30.603 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T23:39:30.603 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:39:30.606 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:39:30.615 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:39:30.670 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T23:39:30.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:39:30.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:39:30.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:39:32.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T23:39:32.204 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T23:39:32.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:39:32.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:39:32.259 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:39:32.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T23:39:32.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:39:32.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:39:32.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:39:32.326 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-10T23:39:32.331 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-10T23:39:32.357 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-09-10T23:39:32.422 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:39:32.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:32.437 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:39:32.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:32.478 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:39:32.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:32.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T23:39:32.505 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T23:39:32.506 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi002 2024-09-10T23:39:32.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:39:32.572 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi154 2024-09-10T23:39:32.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:39:32.610 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899778/remote/smithi177 2024-09-10T23:39:32.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:39:32.647 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T23:39:32.648 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:39:32.650 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:39:32.653 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:39:32.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T23:39:32.718 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T23:39:32.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T23:39:32.731 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T23:39:32.732 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:39:32.734 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:39:32.737 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:39:32.747 INFO:teuthology.orchestra.run.smithi002.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:39 /home/ubuntu/cephtest 2024-09-10T23:39:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:39 /home/ubuntu/cephtest 2024-09-10T23:39:32.755 INFO:teuthology.orchestra.run.smithi177.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:39 /home/ubuntu/cephtest 2024-09-10T23:39:32.757 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T23:39:32.770 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T23:39:32.804 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1953.5682146549225 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-10T23:39:32.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:39:32.954 INFO:teuthology.run:pass